Skip to content
This repository has been archived by the owner on Jan 20, 2022. It is now read-only.

Releases: twitter/summingbird

Version 0.3.3

24 Jan 20:16
Compare
Choose a tag to compare
  • Depend on proper Tormenta version (fix semver hiccup)

Version 0.3.2

24 Jan 01:48
Compare
Choose a tag to compare
  • We don't want to hit runningState.fail twice: #425
  • also tail producer support: #423
  • fix merge planner bug: #417
  • shard fm: #416
  • Add sinking to stores: #408
  • Add NormalScaldingStore which contains only (K, V) pairs: #407

Offline perf enhancing

19 Dec 22:02
Compare
Choose a tag to compare
  • Bump the chill version - makes storm provided: #406
  • sort by batch if monoid is commutative: #411
  • Fix README to properly run Storm locally: #412
  • Feature/async summer store: #400

Report all the success

07 Dec 01:13
Compare
Choose a tag to compare
  • Add serializers for BatchID, Timestamp: #350
  • ADd a means to set defaults outside the planner: #351
  • fix bugs hdfs: #353
  • add default option setting: #356
  • Add options tests: #335
  • Add some hadoop defaults to the builder API: #359
  • Cleanup the Storm API a bit: #360
  • Put all Collector actions in one execute: #365
  • Producer API executors for storm and scalding: #367
  • standardize get or else scalding: #363
  • Fixes ticks: #368
  • spout metrics: #344
  • Add the summingbird prefix to the graphs: #370
  • add localOrShuffle: #371
  • Make the StormMetric Covariant: #373
  • Fix depreciation to be from sink: #375
  • add options to cfg: #376
  • Null out Tuple.values for GC: #374
  • Add timestamps to hadoop configs: https://github.com/twitter/summingbird/pull/377/files
  • add Options.toString: #378
  • Fix out of sync versions to keep: #379
  • Feature fix ffm: #381
  • Add an await timeout: #380
  • Add local or shuffle option: #384
  • Add dequeueAll to Queue: #386
  • Add in log4j and slf4j to the example: #392
  • Fixes naming in bolts for options to work right after plan: #391
  • Add error checking to the cache size: #393
  • Add more storm tests, add some new test graphs: #394
  • Proxy the select correctly on initialbatch: #389
  • Refactors the bolts from storm to be independent workers in online: #395
  • Pluggable caches in FinalFlatMap: #396
  • Uses multimerge: #399
  • ack on entry option: #398

Producer gets some scalding state control

06 Nov 18:50
Compare
Choose a tag to compare
  • Fix issue with externalizer: #316
  • Initial implementation of checkpoint state: #315
  • Move to sbt 0.13: #322
  • Move Dependants common code to graph: #321
  • CheckpointState -> HDFSState: #318
  • Change depthFirstOf to use List instead of Vector: #323
  • Add an optional parameter to set default parallelism for a storm source: #319
  • Add a method to prepare for optimizing FlatMapKeys: #305
  • fix the increased output issue: #327
  • Optimize iterator sums: #326
  • Make sure to register BatchID and Timespan: #324
  • Sum by key test: #330
  • Add slf4j logging to scalding: #331
  • Move the versioned store to scalding package: #332
  • storm logging: #333
  • Adds/extends some storm option tests: #334
  • Make VersionedState fail-safe: #337
  • Throw on Storm Submission w/ no online store: #338
  • General graph support online: #340
  • Summingbird config: #339

Bugfix for scalding BatchedStore merge

17 Oct 20:03
Compare
Choose a tag to compare

We were dropping the old data after the sum... Woops. Beefed up the tests and fixed the issue.

API Luxury

17 Oct 00:22
Compare
Choose a tag to compare
  • Add convenience methods to Producer: #307
  • Massively optimize Scalding merge/sumByKey: #303
  • Improve the WaitingState state machine: #302
  • Move code for common realtime planners (storm + akka): #299
  • Fix an issue with source minify in scalding: #298
  • Improve scalding tests: #296
  • Improve storm tests: #292
  • Use an AnyVal-like class rather than java.util.Date: #295
  • improve Batcher documentation: #293

Multi-sum madness

11 Oct 22:37
Compare
Choose a tag to compare
  • Use pipes instead of parentheses when naming online physical nodes: #273
  • Add Alsos in Producer2, OptProd2: #275
  • Multiple disjoint summers: #274
  • Make Tail sealed: #276
  • Scalding Laws not to use scalacheck: #278
  • Pull Online planner common code into core: #281
  • Use externalizer instead of meatlocker: #282
  • Standardize SourceBuilder Naming: #285
  • Add TailProducer, for graph ending point: #286
  • MemoryLaws not use scalacheck: #287
  • Added flatMapKeys to all platforms: #288
  • Added flatMapKeys to Builder API: #290
  • Add better type safety to Storm Spouts: #289
  • Add a streaming left join: #291

Wack-a-bug

08 Oct 00:48
Compare
Choose a tag to compare
  • Add support for map only jobs in producer api #269
  • Fixes naming of nodes, options are picked up correctly #267
  • Fix missing elements in case statements for applying online graph to storm #272

Updating the world, new planner

04 Oct 04:56
Compare
Choose a tag to compare
  • Bump the version numbers of the dependencies #260
  • Upgrade to Tormenta 0.5.2, Scalding 0.9.0, Bijection 0.5.3 betas: #191
  • Feature/storm new planner: #250
  • Feature/move dag to core: #255