All Versions
33
Latest Version
Avg Release Cycle
42 days
Latest Release
1940 days ago

Changelog History
Page 2

  • v0.6.8 Changes

    December 14, 2016

    Full Changelog

    🛠 Fixed bugs:

    • In distributed mode, temporary files are not deleted at end of program #110

    🔀 Merged pull requests:

    • Advertise benchmark in README #113 (mvertes)
    • 👷 server, worker-controller: add current statistics #112 (mvertes)
    • 🛠 Fix bug #110 where temporary files were not deleted at end of task in… #111 (mvertes)
    • 👷 use SKALE_WORKERS to set number of workers in distributed mode, as in… #109 (mvertes)
    • ⚡️ update dependencies #108 (mvertes)
    • Doc: add a section on core concepts, label shuffle transforms #107 (mvertes)
    • 🔨 Refactor internal Task API, to propagate env and dependencies. In pro… #106 (mvertes)

  • v0.6.7 Changes

    November 22, 2016

    Full Changelog

    🔀 Merged pull requests:

    • Document standalone and distributed modes #105 (mvertes)
    • Distributed mode: Implement peer-to-peer through HTTP for shuffle data transfer #104 (mvertes)
    • 👌 Improve traces and file transfer. #103 (mvertes)
    • 👌 Improve task scheduling #102 (mvertes)
    • 🛠 Fix mocha dependency. Skip yarn files. #101 (mvertes)

  • v0.6.6 Changes

    November 04, 2016

    Full Changelog

    🔀 Merged pull requests:

    • Task serialization is now correct in all cases. #100 (mvertes)
    • ⚡️ Optimize task data transfer by sending sparse datasets. #99 (mvertes)
    • Preliminary work for optimization of task data transfer #98 (mvertes)
    • 👌 improve getReadStream #97 (mvertes)
    • 🛠 distributed mode: fixes in compressed transfers #96 (mvertes)
    • 👌 Improve distributed mode #95 (mvertes)
    • distributed mode: protocol debug traces enabled with SKALE_DEBUG=3 #94 (mvertes)
    • sc.textFile: fix handling of S3 directories #93 (mvertes)
    • 🛠 Fix log in distributed worker #92 (mvertes)

  • v0.6.5 Changes

    October 23, 2016

    Full Changelog

    🔀 Merged pull requests:

    • 👷 bin/worker.js: fix typo in dependencies #91 (mvertes)
    • Debug traces sent to stderr instead of stdout #90 (mvertes)
    • 💾 save to S3: extend http timeout to 1h #89 (mvertes)

  • v0.6.4 Changes

    October 11, 2016

    Full Changelog

    🔀 Merged pull requests:

    • dataset stream and save: preserve structure #88 (mvertes)
    • textFile: add capability to handle single AWS S3 files, gzipped or not. #87 (mvertes)

  • v0.6.3 Changes

    October 08, 2016

    Full Changelog

    🔀 Merged pull requests:

    • ➕ Add new stream action, which allows to stream out a dataset #86 (mvertes)

  • v0.6.2 Changes

    September 14, 2016

    Full Changelog

    Closed issues:

    • 👷 bin/server doesn't use nworker parameter #82

    🔀 Merged pull requests:

    • 🛠 Fix save() action to export a dataset to filesystem or S3 #84 (mvertes)
    • ✂ Remove unused nworker command line parameter #83 (mark-bradshaw)
    • ⚡️ Minor grammar update. #80 (mark-bradshaw)
    • ➕ Add streaming source from AWS S3 #78 (mvertes)
    • 👷 local worker: handle master disconnect #77 (mvertes)
    • 🐎 Increase buffer size of zlib from 16kB to 64kB. Better performances #76 (mvertes)
    • 👍 textFile now supports directory as dataset source #75 (mvertes)
    • 💅 Coding style change. We now use the same as NodeJS core. #74 (mvertes)

  • v0.6.1 Changes

    July 05, 2016

    Full Changelog

    🔀 Merged pull requests:

    • ⏱ Important improvements in task serialization, scheduling and debugging #73 (mvertes)
    • 💾 save: reset file at init #72 (mvertes)
    • ➕ Add SKALE_MEMORY env variable to set worker max memory #71 (mvertes)
    • spillToDisk: do not duplicate memory when writing to disk #70 (mvertes)

  • v0.6.0 Changes

    June 24, 2016

    Full Changelog

    🔀 Merged pull requests:

    • ✅ stop testing node-0.10 #69 (mvertes)
    • ➕ add new source gzipFile() to process gzipped text files #68 (mvertes)
    • 🆕 New action Dataset#save() to save dataset content in text file. #67 (mvertes)
    • 👷 Pass user options and worker context to reduce(), aggregate() and forEach() callbacks. #66 (mvertes)
    • 👷 Serverless version, direct IPCs between workers and master #65 (mvertes)
    • code cleaning #64 (mvertes)
    • 👌 improve tmp dir handling. Add env SKALE_TMP #63 (mvertes)
    • ✂ remove spurious test file #62 (mvertes)

  • v0.5.3 Changes

    May 17, 2016

    Full Changelog

    Closed issues:

    • skale-engine can not be used as a dependency in a Meteor project #56
    • Get rid of direct eval #53
    • 🔀 Use mkdirp.sync instead of lib/mkdir.js #51

    🔀 Merged pull requests:

    • 📇 rename lib/sizeof.js in lib/rough-sizeof.js as discussed in #52 #60 (mvertes)
    • 👉 Use indirect eval, strenghten regexp which match arrow function definition; fix #53 #59 (mvertes)
    • ✂ remove lib/mkdir.js and use external mkdirp module. Fix #51 #58 (mvertes)
    • Ensure compatibility with node back to 0.10, fix #56 #57 (mvertes)
    • 👍 better use of console.log() #50 (mvertes)
    • ds.filter(): rename internal filter member into _filter to avoid coll… #49 (mvertes)