All Versions
33
Latest Version
Avg Release Cycle
42 days
Latest Release
1241 days ago

Changelog History
Page 1

  • v1.2.2 Changes

    December 26, 2018

    Full Changelog

    ๐Ÿ”€ Merged pull requests:

    • โšก๏ธ Update dependencies #258 (mvertes)
    • โšก๏ธ Update dependencies #257 (mvertes)
    • Restored changelog using github_generate_changelog #256 (mvertes)
  • v1.2.1 Changes

    April 28, 2018

    Full Changelog

    Implemented enhancements:

    • ๐Ÿ‘ท workers: use global scope instead of worker context #236
    • โž• Add tests for machine learning library #233
    • โž• Add tests for ds.save() #232
    • โž• Add tests for sc.textfile() #231

    Closed issues:

    • โœ… document and test save() to CSV format #241
    • modernize javascript syntax #210

    ๐Ÿ”€ Merged pull requests:

    • โœ… test gzipped stream action #254 (mvertes)
    • ๐Ÿ‘ท Use global scope in worker context (#236) #253 (mvertes)
    • modernize javascript syntax. Final round. Resolves #210 #252 (mvertes)
    • modernize javascript syntax as per #210 #251 (mvertes)
    • modernize javascript syntax as per #210 #250 (mvertes)
    • modernize javascript syntax as per #210 #249 (mvertes)
    • modernize javascript syntax as per #210 #248 (mvertes)
    • modernize javascript syntax, as per #210 #247 (mvertes)
    • modernize javascript syntax as per #210 #246 (mvertes)
    • modernize javascript syntax, as per #210 #245 (mvertes)
    • modernize javascript syntax as per #210 #244 (mvertes)
    • ๐Ÿ‘Œ improve test skip #240 (mvertes)
    • โž• Add test for save() (#232) #239 (mvertes)
    • โœ… textfile: fix azure and add tests (#231) #238 (mvertes)
    • โž• Add test for textFile #237 (mvertes)
  • v1.2.0 Changes

    November 14, 2017

    ๐Ÿ“ฆ This is a major feature relase. Install it with npm

    ๐Ÿ†• New

    • Skale-engine is renamed to skale. Version is now 1.2.0, identical to 0.8.0.
    • โž• Add a machine learning library with classification, regression, clustering
    • ๐Ÿ‘ Allows dependencies to be deployed in workers with new routine sc.require(). This will ease considerably the integration of various connectors to data sources, databases, etc.
    • ๐Ÿ“š Major improvements to documentation website

    ๐Ÿ‘Œ Improvements

    • โœ… The test suite has been fully reworked, and now uses individual files that can be executed separately
    • โœ… Tests are considerably faster and easier to develop and debug
    • โœ… Both standalone and distributed engine are now systematically tested
    • ๐Ÿ‘ save(): now support output to CSV format
    • ๐Ÿ‘ท save(), textFile(): automatic forward of AWS env and credentials to workers
    • ๐Ÿ‘ท Workers: control garbage collect by command line option
    • Modernize javascript syntax
    • ๐ŸŽ Continuous integration: add MacOSX target in addition to Linux and Windows

    ๐Ÿ›  Fixes

    • ๐Ÿ›  Fix a problem insample()
    • ๐Ÿ›  Fix support of undefined keys in aggregateByKey()
    • ๐Ÿ›  Fix debug traces
  • v0.8.0 Changes

    November 14, 2017

    Full Changelog

    Closed issues:

    • โž• Add missing tests, refactor testing framework #205
    • ๐Ÿ‘ท External modules in worker #203
    • hey dude,I wonder has this program been applied to any application. #199
    • for loop over items used later as index #178

    ๐Ÿ”€ Merged pull requests:

    • ๐Ÿ“‡ rename skale-engine to skale (#181) #230 (mvertes)
    • โœ‚ remove deprecated examples/ml/benchmark #229 (mvertes)
    • โœ‚ remove deprecated ml/examples/logreg #228 (mvertes)
    • ml: document StandardScaler() #227 (mvertes)
    • ml: document classificationMetrics #226 (mvertes)
    • Document sgd.predict() #225 (mvertes)
    • document sc.require(). Fix examples #224 (mvertes)
    • ๐Ÿ‘Œ improve docs #223 (mvertes)
    • ๐Ÿ‘Œ improve docs #222 (mvertes)
    • ๐Ÿ›  fix link #221 (mvertes)
    • ๐Ÿ›  fix eslint warnings #220 (mvertes)
    • โšก๏ธ update doc site #219 (mvertes)
    • Convert DataSet Object and related functions to modern JS #218 (frytyler)
    • avoid using require.resolve() which may fail for old node versions #217 (mvertes)
    • โœ… Rename tape-test in test, get rid of mocha, resolves #205 #216 (mvertes)
    • โž• add new tests as per #205 #215 (mvertes)
    • โž• additional tests, as per #205 #214 (mvertes)
    • โž• additional tests, as per #205 #213 (mvertes)
    • โœ… tests: migrate to tape, as per #205 #212 (mvertes)
    • ๐Ÿ‘ท Implement dependency injection into workers, resolves #203 #211 (mvertes)
    • ๐Ÿ“„ docs: modularize, add logo #208 (mvertes)
    • ๐Ÿ‘ท Pass context to worker callbacks, add modules setting as per #203 (in progress) #207 (mvertes)
    • โœ… test: start to add tape test cases, as per #205 #206 (mvertes)
    • โœ… tests: simplify engine. Use standalone mode #204 (mvertes)
    • โšก๏ธ update dependencies #202 (mvertes)
    • ๐Ÿ‘• lint: do not scan site/ #201 (mvertes)
    • ๐Ÿš€ doc: fix deploy rule #200 (mvertes)
    • ๐Ÿ“š doc: use mkdocs-material for documentation website. Add build recipes. #198 (mvertes)
    • doc: rebuild toc #197 (mvertes)
    • ๐Ÿ›  fix ml.KMeans, add example based on classical iris dataset #196 (mvertes)
    • ๐Ÿ›  fix sample(). Add takeSample(). #195 (mvertes)
    • now compute area under Precision Recall Curve, improve examples #194 (mvertes)
    • ๐Ÿ“‡ rename binary-classification-metrics to classification-metrics #193 (mvertes)
    • README: add link to code of conduct and API reference #192 (mvertes)
    • Create CODE_OF_CONDUCT.md #191 (mvertes)
    • ml: partition adult dataset, add headers in CSV files #190 (mvertes)
    • ml: rename SGDClassifier in SGDLinearModel, add regression example #189 (mvertes)
    • ๐Ÿšš ml: remove deprecated logistic-regression dependency #188 (mvertes)
    • ml SGDClassifier: include optional intercept fitting #187 (mvertes)
    • ml: add SGDClassifier class #186 (mvertes)
    • ๐Ÿ“š contributing: add notes about documentation and coding rules #185 (mvertes)
    • ml: simplify a lot model evaluation metrics. Compute ROC AUC. #184 (mvertes)
    • ๐Ÿ›  Fix import of ml #183 (mvertes)
    • import skale-ml, as per #181 #182 (mvertes)
    • โšก๏ธ update dependencies #180 (mvertes)
    • ๐Ÿ›  fixed the use of '===' operator in all sources #177 (vsimko)
    • travis: add osx target #176 (mvertes)
    • ๐Ÿ›  Fix debug trace, update dependencies #175 (mvertes)
    • aggregateByKey: fix a bug where undefined key crashes post-shuffle #173 (mvertes)
    • ๐Ÿ’พ save: add support to CSV format output #172 (mvertes)
    • ๐Ÿ‘ท Automatically forward AWS env variables in context and workers #171 (mvertes)
    • ๐Ÿ‘ท workers: control garbage collect by command line option. Improve debug traces #170 (mvertes)
  • v0.7.2 Changes

    June 27, 2017

    Full Changelog

    ๐Ÿ”€ Merged pull requests:

    • โšก๏ธ update dependencies build files #169 (mvertes)
    • โšก๏ธ update dependencies #168 (mvertes)
    • ๐Ÿ‘ท workers: reduce amount of traces during shuffle #167 (mvertes)
    • ๐Ÿ‘ท worker: manually call garbage collector at end of task. Experimental #166 (mvertes)
    • โž• add interactive REPL shell, supporting async/await #165 (mvertes)
    • ๐Ÿ›  Fix and improved tracing of time measurements #164 (mvertes)
    • ๐Ÿ‘ท worker: allow to retry connections using -r <nbretry> option #163 (mvertes)
    • ๐Ÿ“œ dataset: fix parsing of shuffle in aggregateByKey, clean code #162 (mvertes)
    • ๐ŸŽ performance: block processing for pipelines at source level, part 2 #161 (mvertes)
    • ๐Ÿ‘• eslint: allow arrow functions and async/await #160 (mvertes)
    • ๐Ÿ›  Fix previous task serialization change which impacted sc.range() #159 (mvertes)
    • ๐ŸŽ Clean code, improve traces for performances, set maximum partitions. #158 (mvertes)
    • โšก๏ธ update dependencies #157 (mvertes)
    • textFile: Fix handling of gzipped files in local filesystem #156 (mvertes)
  • v0.7.1 Changes

    May 17, 2017

    Full Changelog

    ๐Ÿ”€ Merged pull requests:

    • API doc: add a section on environment variables #155 (mvertes)
    • โœ๏ธ doc: fix some typos #154 (mvertes)
    • ๐Ÿ›  Fix a worker crash when using ds.sample() with replacement. #153 (mvertes)
    • โž• add sample docker files #152 (mvertes)
    • doc: fix links #151 (mvertes)
    • mention the Skale Hacker's Guide #150 (mvertes)
    • โž• add a Skale Hacker's Guide #149 (mvertes)
    • ๐Ÿ‘ท Clean up dependency, more info at worker-controller connection #147 (mvertes)
    • โž• Added .npmignore #146 (mvertes)
    • ๐Ÿ‘ท worker: retry initial network connection to server #145 (mvertes)
  • v0.7.0 Changes

    April 04, 2017

    Full Changelog

    ๐Ÿ›  Fixed bugs:

    • textFile: fix a bug where the 1st file in S3 dir was skipped #126 (mvertes)

    Closed issues:

    • skale-engine version 0.5.3 regression? #61
    • sizeOf is incomplete and inaccurate #52

    ๐Ÿ”€ Merged pull requests:

    • โšก๏ธ update dependencies #143 (mvertes)
    • textFile, save: document new protocols and formats #142 (mvertes)
    • ๐Ÿ’พ save: support direct streaming to S3 #141 (mvertes)
    • textFile: support file globbing (i.e. src/**/*.js) in path argument #140 (mvertes)
    • ๐Ÿ’พ save: support direct streaming to azure. #139 (mvertes)
    • azure: handle server errors with internal retry policy filter #138 (mvertes)
    • AggregateByKey: faster processing of shuffle files #137 (mvertes)
    • ๐ŸŽ aggregateByKey, coGroup: performance improvements #136 (mvertes)
    • ๐ŸŽ Performance increase of aggregateByKey and coGroup #135 (mvertes)
    • azure: handle errors from storage server: fetch before process and implement retries. #134 (mvertes)
    • ๐Ÿ‘ท distributed mode: pre-fork new workers at end of master #133 (mvertes)
    • textFile: fix compute of partitions for Azure #132 (mvertes)
    • ๐Ÿ’พ save: upload datasets to azure for urls in wasb:// #131 (mvertes)
    • ๐Ÿ‘ textFile: support file globbing, azure blobs only for now #130 (mvertes)
    • ๐Ÿ‘ textFile: support reading from azure storage blobs #129 (mvertes)
    • Simplify top and take actions, and fix out of memory errors for large datasets. #128 (mvertes)
    • Aggregate now guarantees partitions ordering. Improve traces. #127 (mvertes)
    • textFile: read parquet from local and S3 directories #125 (mvertes)
    • โž• Add Parquet support #124 (mvertes)
    • Readme: Fix appveyor badge #123 (mvertes)
    • ๐Ÿ›  fix benchmark #122 (mvertes)
    • ๐Ÿ›  Fix handling internal dependency on self. #121 (mvertes)
  • v0.6.11 Changes

    February 09, 2017

    Full Changelog

    ๐Ÿ”€ Merged pull requests:

  • v0.6.10 Changes

    February 09, 2017

    Full Changelog

    ๐Ÿ”€ Merged pull requests:

    • โž• Add node 6 target for travis, use system default memory settings #119 (mvertes)
    • ๐Ÿ‘ Allow to run on windows #118 (mvertes)
  • v0.6.9 Changes

    January 02, 2017

    Full Changelog

    ๐Ÿ”€ Merged pull requests:

    • textFile: add a maxFiles option, to limit the number of files to process #117 (mvertes)
    • Increase number of streams over skale protocol #116 (mvertes)
    • stream() action: add option to terminate context on stream end #115 (mvertes)
    • doc: Fix TOC link #114 (mvertes)