All Versions
33
Latest Version
Avg Release Cycle
42 days
Latest Release
1995 days ago

Changelog History
Page 1

  • v1.2.2 Changes

    December 26, 2018

    Full Changelog

    πŸ”€ Merged pull requests:

    • ⚑️ Update dependencies #258 (mvertes)
    • ⚑️ Update dependencies #257 (mvertes)
    • Restored changelog using github_generate_changelog #256 (mvertes)
  • v1.2.1 Changes

    April 28, 2018

    Full Changelog

    Implemented enhancements:

    • πŸ‘· workers: use global scope instead of worker context #236
    • βž• Add tests for machine learning library #233
    • βž• Add tests for ds.save() #232
    • βž• Add tests for sc.textfile() #231

    Closed issues:

    • βœ… document and test save() to CSV format #241
    • modernize javascript syntax #210

    πŸ”€ Merged pull requests:

    • βœ… test gzipped stream action #254 (mvertes)
    • πŸ‘· Use global scope in worker context (#236) #253 (mvertes)
    • modernize javascript syntax. Final round. Resolves #210 #252 (mvertes)
    • modernize javascript syntax as per #210 #251 (mvertes)
    • modernize javascript syntax as per #210 #250 (mvertes)
    • modernize javascript syntax as per #210 #249 (mvertes)
    • modernize javascript syntax as per #210 #248 (mvertes)
    • modernize javascript syntax, as per #210 #247 (mvertes)
    • modernize javascript syntax as per #210 #246 (mvertes)
    • modernize javascript syntax, as per #210 #245 (mvertes)
    • modernize javascript syntax as per #210 #244 (mvertes)
    • πŸ‘Œ improve test skip #240 (mvertes)
    • βž• Add test for save() (#232) #239 (mvertes)
    • βœ… textfile: fix azure and add tests (#231) #238 (mvertes)
    • βž• Add test for textFile #237 (mvertes)
  • v1.2.0 Changes

    November 14, 2017

    πŸ“¦ This is a major feature relase. Install it with npm

    πŸ†• New

    • Skale-engine is renamed to skale. Version is now 1.2.0, identical to 0.8.0.
    • βž• Add a machine learning library with classification, regression, clustering
    • πŸ‘ Allows dependencies to be deployed in workers with new routine sc.require(). This will ease considerably the integration of various connectors to data sources, databases, etc.
    • πŸ“š Major improvements to documentation website

    πŸ‘Œ Improvements

    • βœ… The test suite has been fully reworked, and now uses individual files that can be executed separately
    • βœ… Tests are considerably faster and easier to develop and debug
    • βœ… Both standalone and distributed engine are now systematically tested
    • πŸ‘ save(): now support output to CSV format
    • πŸ‘· save(), textFile(): automatic forward of AWS env and credentials to workers
    • πŸ‘· Workers: control garbage collect by command line option
    • Modernize javascript syntax
    • 🍎 Continuous integration: add MacOSX target in addition to Linux and Windows

    πŸ›  Fixes

    • πŸ›  Fix a problem insample()
    • πŸ›  Fix support of undefined keys in aggregateByKey()
    • πŸ›  Fix debug traces
  • v0.8.0 Changes

    November 14, 2017

    Full Changelog

    Closed issues:

    • βž• Add missing tests, refactor testing framework #205
    • πŸ‘· External modules in worker #203
    • hey dude,I wonder has this program been applied to any application. #199
    • for loop over items used later as index #178

    πŸ”€ Merged pull requests:

    • πŸ“‡ rename skale-engine to skale (#181) #230 (mvertes)
    • βœ‚ remove deprecated examples/ml/benchmark #229 (mvertes)
    • βœ‚ remove deprecated ml/examples/logreg #228 (mvertes)
    • ml: document StandardScaler() #227 (mvertes)
    • ml: document classificationMetrics #226 (mvertes)
    • Document sgd.predict() #225 (mvertes)
    • document sc.require(). Fix examples #224 (mvertes)
    • πŸ‘Œ improve docs #223 (mvertes)
    • πŸ‘Œ improve docs #222 (mvertes)
    • πŸ›  fix link #221 (mvertes)
    • πŸ›  fix eslint warnings #220 (mvertes)
    • ⚑️ update doc site #219 (mvertes)
    • Convert DataSet Object and related functions to modern JS #218 (frytyler)
    • avoid using require.resolve() which may fail for old node versions #217 (mvertes)
    • βœ… Rename tape-test in test, get rid of mocha, resolves #205 #216 (mvertes)
    • βž• add new tests as per #205 #215 (mvertes)
    • βž• additional tests, as per #205 #214 (mvertes)
    • βž• additional tests, as per #205 #213 (mvertes)
    • βœ… tests: migrate to tape, as per #205 #212 (mvertes)
    • πŸ‘· Implement dependency injection into workers, resolves #203 #211 (mvertes)
    • πŸ“„ docs: modularize, add logo #208 (mvertes)
    • πŸ‘· Pass context to worker callbacks, add modules setting as per #203 (in progress) #207 (mvertes)
    • βœ… test: start to add tape test cases, as per #205 #206 (mvertes)
    • βœ… tests: simplify engine. Use standalone mode #204 (mvertes)
    • ⚑️ update dependencies #202 (mvertes)
    • πŸ‘• lint: do not scan site/ #201 (mvertes)
    • πŸš€ doc: fix deploy rule #200 (mvertes)
    • πŸ“š doc: use mkdocs-material for documentation website. Add build recipes. #198 (mvertes)
    • doc: rebuild toc #197 (mvertes)
    • πŸ›  fix ml.KMeans, add example based on classical iris dataset #196 (mvertes)
    • πŸ›  fix sample(). Add takeSample(). #195 (mvertes)
    • now compute area under Precision Recall Curve, improve examples #194 (mvertes)
    • πŸ“‡ rename binary-classification-metrics to classification-metrics #193 (mvertes)
    • README: add link to code of conduct and API reference #192 (mvertes)
    • Create CODE_OF_CONDUCT.md #191 (mvertes)
    • ml: partition adult dataset, add headers in CSV files #190 (mvertes)
    • ml: rename SGDClassifier in SGDLinearModel, add regression example #189 (mvertes)
    • 🚚 ml: remove deprecated logistic-regression dependency #188 (mvertes)
    • ml SGDClassifier: include optional intercept fitting #187 (mvertes)
    • ml: add SGDClassifier class #186 (mvertes)
    • πŸ“š contributing: add notes about documentation and coding rules #185 (mvertes)
    • ml: simplify a lot model evaluation metrics. Compute ROC AUC. #184 (mvertes)
    • πŸ›  Fix import of ml #183 (mvertes)
    • import skale-ml, as per #181 #182 (mvertes)
    • ⚑️ update dependencies #180 (mvertes)
    • πŸ›  fixed the use of '===' operator in all sources #177 (vsimko)
    • travis: add osx target #176 (mvertes)
    • πŸ›  Fix debug trace, update dependencies #175 (mvertes)
    • aggregateByKey: fix a bug where undefined key crashes post-shuffle #173 (mvertes)
    • πŸ’Ύ save: add support to CSV format output #172 (mvertes)
    • πŸ‘· Automatically forward AWS env variables in context and workers #171 (mvertes)
    • πŸ‘· workers: control garbage collect by command line option. Improve debug traces #170 (mvertes)
  • v0.7.2 Changes

    June 27, 2017

    Full Changelog

    πŸ”€ Merged pull requests:

    • ⚑️ update dependencies build files #169 (mvertes)
    • ⚑️ update dependencies #168 (mvertes)
    • πŸ‘· workers: reduce amount of traces during shuffle #167 (mvertes)
    • πŸ‘· worker: manually call garbage collector at end of task. Experimental #166 (mvertes)
    • βž• add interactive REPL shell, supporting async/await #165 (mvertes)
    • πŸ›  Fix and improved tracing of time measurements #164 (mvertes)
    • πŸ‘· worker: allow to retry connections using -r <nbretry> option #163 (mvertes)
    • πŸ“œ dataset: fix parsing of shuffle in aggregateByKey, clean code #162 (mvertes)
    • 🐎 performance: block processing for pipelines at source level, part 2 #161 (mvertes)
    • πŸ‘• eslint: allow arrow functions and async/await #160 (mvertes)
    • πŸ›  Fix previous task serialization change which impacted sc.range() #159 (mvertes)
    • 🐎 Clean code, improve traces for performances, set maximum partitions. #158 (mvertes)
    • ⚑️ update dependencies #157 (mvertes)
    • textFile: Fix handling of gzipped files in local filesystem #156 (mvertes)
  • v0.7.1 Changes

    May 17, 2017

    Full Changelog

    πŸ”€ Merged pull requests:

    • API doc: add a section on environment variables #155 (mvertes)
    • ✏️ doc: fix some typos #154 (mvertes)
    • πŸ›  Fix a worker crash when using ds.sample() with replacement. #153 (mvertes)
    • βž• add sample docker files #152 (mvertes)
    • doc: fix links #151 (mvertes)
    • mention the Skale Hacker's Guide #150 (mvertes)
    • βž• add a Skale Hacker's Guide #149 (mvertes)
    • πŸ‘· Clean up dependency, more info at worker-controller connection #147 (mvertes)
    • βž• Added .npmignore #146 (mvertes)
    • πŸ‘· worker: retry initial network connection to server #145 (mvertes)
  • v0.7.0 Changes

    April 04, 2017

    Full Changelog

    πŸ›  Fixed bugs:

    • textFile: fix a bug where the 1st file in S3 dir was skipped #126 (mvertes)

    Closed issues:

    • skale-engine version 0.5.3 regression? #61
    • sizeOf is incomplete and inaccurate #52

    πŸ”€ Merged pull requests:

    • ⚑️ update dependencies #143 (mvertes)
    • textFile, save: document new protocols and formats #142 (mvertes)
    • πŸ’Ύ save: support direct streaming to S3 #141 (mvertes)
    • textFile: support file globbing (i.e. src/**/*.js) in path argument #140 (mvertes)
    • πŸ’Ύ save: support direct streaming to azure. #139 (mvertes)
    • azure: handle server errors with internal retry policy filter #138 (mvertes)
    • AggregateByKey: faster processing of shuffle files #137 (mvertes)
    • 🐎 aggregateByKey, coGroup: performance improvements #136 (mvertes)
    • 🐎 Performance increase of aggregateByKey and coGroup #135 (mvertes)
    • azure: handle errors from storage server: fetch before process and implement retries. #134 (mvertes)
    • πŸ‘· distributed mode: pre-fork new workers at end of master #133 (mvertes)
    • textFile: fix compute of partitions for Azure #132 (mvertes)
    • πŸ’Ύ save: upload datasets to azure for urls in wasb:// #131 (mvertes)
    • πŸ‘ textFile: support file globbing, azure blobs only for now #130 (mvertes)
    • πŸ‘ textFile: support reading from azure storage blobs #129 (mvertes)
    • Simplify top and take actions, and fix out of memory errors for large datasets. #128 (mvertes)
    • Aggregate now guarantees partitions ordering. Improve traces. #127 (mvertes)
    • textFile: read parquet from local and S3 directories #125 (mvertes)
    • βž• Add Parquet support #124 (mvertes)
    • Readme: Fix appveyor badge #123 (mvertes)
    • πŸ›  fix benchmark #122 (mvertes)
    • πŸ›  Fix handling internal dependency on self. #121 (mvertes)
  • v0.6.11 Changes

    February 09, 2017

    Full Changelog

    πŸ”€ Merged pull requests:

  • v0.6.10 Changes

    February 09, 2017

    Full Changelog

    πŸ”€ Merged pull requests:

    • βž• Add node 6 target for travis, use system default memory settings #119 (mvertes)
    • πŸ‘ Allow to run on windows #118 (mvertes)
  • v0.6.9 Changes

    January 02, 2017

    Full Changelog

    πŸ”€ Merged pull requests:

    • textFile: add a maxFiles option, to limit the number of files to process #117 (mvertes)
    • Increase number of streams over skale protocol #116 (mvertes)
    • stream() action: add option to terminate context on stream end #115 (mvertes)
    • doc: Fix TOC link #114 (mvertes)