« Changelog History


skale v0.7.0 Release Notes

Release Date: 2017-04-04 // about 7 years ago

  • Full Changelog

    🛠 Fixed bugs:

    • textFile: fix a bug where the 1st file in S3 dir was skipped #126 (mvertes)

    Closed issues:

    • skale-engine version 0.5.3 regression? #61
    • sizeOf is incomplete and inaccurate #52

    🔀 Merged pull requests:

    • ⚡️ update dependencies #143 (mvertes)
    • textFile, save: document new protocols and formats #142 (mvertes)
    • 💾 save: support direct streaming to S3 #141 (mvertes)
    • textFile: support file globbing (i.e. src/**/*.js) in path argument #140 (mvertes)
    • 💾 save: support direct streaming to azure. #139 (mvertes)
    • azure: handle server errors with internal retry policy filter #138 (mvertes)
    • AggregateByKey: faster processing of shuffle files #137 (mvertes)
    • 🐎 aggregateByKey, coGroup: performance improvements #136 (mvertes)
    • 🐎 Performance increase of aggregateByKey and coGroup #135 (mvertes)
    • azure: handle errors from storage server: fetch before process and implement retries. #134 (mvertes)
    • 👷 distributed mode: pre-fork new workers at end of master #133 (mvertes)
    • textFile: fix compute of partitions for Azure #132 (mvertes)
    • 💾 save: upload datasets to azure for urls in wasb:// #131 (mvertes)
    • 👍 textFile: support file globbing, azure blobs only for now #130 (mvertes)
    • 👍 textFile: support reading from azure storage blobs #129 (mvertes)
    • Simplify top and take actions, and fix out of memory errors for large datasets. #128 (mvertes)
    • Aggregate now guarantees partitions ordering. Improve traces. #127 (mvertes)
    • textFile: read parquet from local and S3 directories #125 (mvertes)
    • ➕ Add Parquet support #124 (mvertes)
    • Readme: Fix appveyor badge #123 (mvertes)
    • 🛠 fix benchmark #122 (mvertes)
    • 🛠 Fix handling internal dependency on self. #121 (mvertes)