All Versions
33
Latest Version
Avg Release Cycle
42 days
Latest Release
1625 days ago

Changelog History
Page 1

  • v1.2.2 Changes

    December 26, 2018

    Full Changelog

    🔀 Merged pull requests:

  • v1.2.1 Changes

    April 28, 2018

    Full Changelog

    Implemented enhancements:

    • 👷 workers: use global scope instead of worker context #236
    • ➕ Add tests for machine learning library #233
    • ➕ Add tests for ds.save() #232
    • ➕ Add tests for sc.textfile() #231

    Closed issues:

    • ✅ document and test save() to CSV format #241
    • modernize javascript syntax #210

    🔀 Merged pull requests:

  • v1.2.0 Changes

    November 14, 2017

    📦 This is a major feature relase. Install it with npm

    🆕 New

    • Skale-engine is renamed to skale. Version is now 1.2.0, identical to 0.8.0.
    • ➕ Add a machine learning library with classification, regression, clustering
    • 👍 Allows dependencies to be deployed in workers with new routine sc.require(). This will ease considerably the integration of various connectors to data sources, databases, etc.
    • 📚 Major improvements to documentation website

    👌 Improvements

    • ✅ The test suite has been fully reworked, and now uses individual files that can be executed separately
    • ✅ Tests are considerably faster and easier to develop and debug
    • ✅ Both standalone and distributed engine are now systematically tested
    • 👍 save(): now support output to CSV format
    • 👷 save(), textFile(): automatic forward of AWS env and credentials to workers
    • 👷 Workers: control garbage collect by command line option
    • Modernize javascript syntax
    • 🍎 Continuous integration: add MacOSX target in addition to Linux and Windows

    🛠 Fixes

    • 🛠 Fix a problem insample()
    • 🛠 Fix support of undefined keys in aggregateByKey()
    • 🛠 Fix debug traces

  • v0.8.0 Changes

    November 14, 2017

    Full Changelog

    Closed issues:

    • ➕ Add missing tests, refactor testing framework #205
    • 👷 External modules in worker #203
    • hey dude,I wonder has this program been applied to any application. #199
    • for loop over items used later as index #178

    🔀 Merged pull requests:

    • 📇 rename skale-engine to skale (#181) #230 (mvertes)
    • ✂ remove deprecated examples/ml/benchmark #229 (mvertes)
    • ✂ remove deprecated ml/examples/logreg #228 (mvertes)
    • ml: document StandardScaler() #227 (mvertes)
    • ml: document classificationMetrics #226 (mvertes)
    • Document sgd.predict() #225 (mvertes)
    • document sc.require(). Fix examples #224 (mvertes)
    • 👌 improve docs #223 (mvertes)
    • 👌 improve docs #222 (mvertes)
    • 🛠 fix link #221 (mvertes)
    • 🛠 fix eslint warnings #220 (mvertes)
    • ⚡️ update doc site #219 (mvertes)
    • Convert DataSet Object and related functions to modern JS #218 (frytyler)
    • avoid using require.resolve() which may fail for old node versions #217 (mvertes)
    • ✅ Rename tape-test in test, get rid of mocha, resolves #205 #216 (mvertes)
    • ➕ add new tests as per #205 #215 (mvertes)
    • ➕ additional tests, as per #205 #214 (mvertes)
    • ➕ additional tests, as per #205 #213 (mvertes)
    • ✅ tests: migrate to tape, as per #205 #212 (mvertes)
    • 👷 Implement dependency injection into workers, resolves #203 #211 (mvertes)
    • 📄 docs: modularize, add logo #208 (mvertes)
    • 👷 Pass context to worker callbacks, add modules setting as per #203 (in progress) #207 (mvertes)
    • ✅ test: start to add tape test cases, as per #205 #206 (mvertes)
    • ✅ tests: simplify engine. Use standalone mode #204 (mvertes)
    • ⚡️ update dependencies #202 (mvertes)
    • 👕 lint: do not scan site/ #201 (mvertes)
    • 🚀 doc: fix deploy rule #200 (mvertes)
    • 📚 doc: use mkdocs-material for documentation website. Add build recipes. #198 (mvertes)
    • doc: rebuild toc #197 (mvertes)
    • 🛠 fix ml.KMeans, add example based on classical iris dataset #196 (mvertes)
    • 🛠 fix sample(). Add takeSample(). #195 (mvertes)
    • now compute area under Precision Recall Curve, improve examples #194 (mvertes)
    • 📇 rename binary-classification-metrics to classification-metrics #193 (mvertes)
    • README: add link to code of conduct and API reference #192 (mvertes)
    • Create CODE_OF_CONDUCT.md #191 (mvertes)
    • ml: partition adult dataset, add headers in CSV files #190 (mvertes)
    • ml: rename SGDClassifier in SGDLinearModel, add regression example #189 (mvertes)
    • 🚚 ml: remove deprecated logistic-regression dependency #188 (mvertes)
    • ml SGDClassifier: include optional intercept fitting #187 (mvertes)
    • ml: add SGDClassifier class #186 (mvertes)
    • 📚 contributing: add notes about documentation and coding rules #185 (mvertes)
    • ml: simplify a lot model evaluation metrics. Compute ROC AUC. #184 (mvertes)
    • 🛠 Fix import of ml #183 (mvertes)
    • import skale-ml, as per #181 #182 (mvertes)
    • ⚡️ update dependencies #180 (mvertes)
    • 🛠 fixed the use of '===' operator in all sources #177 (vsimko)
    • travis: add osx target #176 (mvertes)
    • 🛠 Fix debug trace, update dependencies #175 (mvertes)
    • aggregateByKey: fix a bug where undefined key crashes post-shuffle #173 (mvertes)
    • 💾 save: add support to CSV format output #172 (mvertes)
    • 👷 Automatically forward AWS env variables in context and workers #171 (mvertes)
    • 👷 workers: control garbage collect by command line option. Improve debug traces #170 (mvertes)

  • v0.7.2 Changes

    June 27, 2017

    Full Changelog

    🔀 Merged pull requests:

    • ⚡️ update dependencies build files #169 (mvertes)
    • ⚡️ update dependencies #168 (mvertes)
    • 👷 workers: reduce amount of traces during shuffle #167 (mvertes)
    • 👷 worker: manually call garbage collector at end of task. Experimental #166 (mvertes)
    • ➕ add interactive REPL shell, supporting async/await #165 (mvertes)
    • 🛠 Fix and improved tracing of time measurements #164 (mvertes)
    • 👷 worker: allow to retry connections using -r <nbretry> option #163 (mvertes)
    • 📜 dataset: fix parsing of shuffle in aggregateByKey, clean code #162 (mvertes)
    • 🐎 performance: block processing for pipelines at source level, part 2 #161 (mvertes)
    • 👕 eslint: allow arrow functions and async/await #160 (mvertes)
    • 🛠 Fix previous task serialization change which impacted sc.range() #159 (mvertes)
    • 🐎 Clean code, improve traces for performances, set maximum partitions. #158 (mvertes)
    • ⚡️ update dependencies #157 (mvertes)
    • textFile: Fix handling of gzipped files in local filesystem #156 (mvertes)

  • v0.7.1 Changes

    May 17, 2017

    Full Changelog

    🔀 Merged pull requests:

  • v0.7.0 Changes

    April 04, 2017

    Full Changelog

    🛠 Fixed bugs:

    • textFile: fix a bug where the 1st file in S3 dir was skipped #126 (mvertes)

    Closed issues:

    • skale-engine version 0.5.3 regression? #61
    • sizeOf is incomplete and inaccurate #52

    🔀 Merged pull requests:

    • ⚡️ update dependencies #143 (mvertes)
    • textFile, save: document new protocols and formats #142 (mvertes)
    • 💾 save: support direct streaming to S3 #141 (mvertes)
    • textFile: support file globbing (i.e. src/**/*.js) in path argument #140 (mvertes)
    • 💾 save: support direct streaming to azure. #139 (mvertes)
    • azure: handle server errors with internal retry policy filter #138 (mvertes)
    • AggregateByKey: faster processing of shuffle files #137 (mvertes)
    • 🐎 aggregateByKey, coGroup: performance improvements #136 (mvertes)
    • 🐎 Performance increase of aggregateByKey and coGroup #135 (mvertes)
    • azure: handle errors from storage server: fetch before process and implement retries. #134 (mvertes)
    • 👷 distributed mode: pre-fork new workers at end of master #133 (mvertes)
    • textFile: fix compute of partitions for Azure #132 (mvertes)
    • 💾 save: upload datasets to azure for urls in wasb:// #131 (mvertes)
    • 👍 textFile: support file globbing, azure blobs only for now #130 (mvertes)
    • 👍 textFile: support reading from azure storage blobs #129 (mvertes)
    • Simplify top and take actions, and fix out of memory errors for large datasets. #128 (mvertes)
    • Aggregate now guarantees partitions ordering. Improve traces. #127 (mvertes)
    • textFile: read parquet from local and S3 directories #125 (mvertes)
    • ➕ Add Parquet support #124 (mvertes)
    • Readme: Fix appveyor badge #123 (mvertes)
    • 🛠 fix benchmark #122 (mvertes)
    • 🛠 Fix handling internal dependency on self. #121 (mvertes)

  • v0.6.11 Changes

    February 09, 2017

    Full Changelog

    🔀 Merged pull requests:

  • v0.6.10 Changes

    February 09, 2017

    Full Changelog

    🔀 Merged pull requests:

    • ➕ Add node 6 target for travis, use system default memory settings #119 (mvertes)
    • 👍 Allow to run on windows #118 (mvertes)

  • v0.6.9 Changes

    January 02, 2017

    Full Changelog

    🔀 Merged pull requests:

    • textFile: add a maxFiles option, to limit the number of files to process #117 (mvertes)
    • Increase number of streams over skale protocol #116 (mvertes)
    • stream() action: add option to terminate context on stream end #115 (mvertes)
    • doc: Fix TOC link #114 (mvertes)