This repository has been archived by the owner on Jan 20, 2022. It is now read-only.
Releases: twitter/summingbird
Releases · twitter/summingbird
Performance Bug Fix, Memory Platform duplicate execution fix
Performance bug fix
- Fixes a bug in the LTuple2 class. Add a test for it: #632
Scalding alignment improvements
Bring in some of the Config changes from scalding into Summingbird, as a result killing off most of its own configuration code around hadoop properties.
- Removing internal config setup from scalding platform: #629
- Remove store that no one seems to use and has no tests: #630
- Ianoc/optimization changes: #628
- Fixes tests: #626
- resilient to all stores being complete: #627
- Resilient to a store being ahead: #625
- move to scala test: #621
- Killing off Summingbird Java: #624
- Kill summingbird spark: #622
- Bumping sbt versions: #623
- Fixed erroneous comment in ClientStore's merge description: #620
New versions of Algebird and Scalding
- bumping Scalding to 0.15.0, algebird to 0.10.2
Summingbird 0.7.0 Released!
- Registering summingbird counters with tormenta spouts #553
- Add counters to default summers #571
- Fixes the types off the summingbird java storm api #601
- Adding explicit hadoop deps; dfs-datastores to 1.3.6 #592
- Replace deprecated ClassManifest and erasure #608
- Spark monad #607
- replace deprecated erasure by runtimeClass #609
- Revert "Remove StripNameNodes" #610
- refactored core-tests into separate sub-project #593
- Fix checking delta batch in readDeltaTimestamps in batched store when merging #612
- ensure at least one batch before merging #613
- MergeableStoreFactory extends java.io.Serializable #616
- Spout storm metrics foreach #617
- upgrade scalacheck #615
- Use latest bijection, algebird, scalding, storehaus, chill, and tormenta
Counters, self leftJoins, latest libraries, and more!
- Use latest bijection, algebird, scalding, storehaus, chill, and tormenta #565
- Remove scala 2.9 support #565
- Add counters to default summers #571
- Registering summingbird counters with tormenta spouts #553
- Remove StripNameNodes: #587
- Revert unneeded wrapper in DagOptimizer: #584
- Make some classes public so we can make custom platforms: #564
- IdentityKeyedProducer in ValueFlatMapToFlatMap Dag Optimizer rule: #580
- Lazy store init for CombinedServiceStoreFactory: #582
- Pass the reducers option down to leftJoin: #578
- Rename readBatched to readAfterLastBatch: #577
- Fixes BatchedStore interval calculation: #573
- Support for creating a store-service for Storm platform: #563
- Support leftJoin against a store in offline platform: #557
- Counters for ConcurrentMemory platform: #550
- Summingbird Storm/Online refactor: #544
- Memory platform counters: #548
- Example of using DagOptimizer: #538
Cross platform statistics, and java support
Rolls 0.5.0 and 0.5.1 since 0.5.0 never made it to maven central due to javadoc issues in java packages.
- Change the javac options for doc generation in java to be successful. (Blocks maven publishing)
0.5.0
- Bumps version of other projects. Changes to compile with latest scalding...: #533
- Safely checking for the internal storm Implementation detail: #528
- add implicit Successible and Predecessible for Timestamp: #530
- Removes redundant Future.unit call: #526
- Optimize CalendarBatcher a bit: #527
- Fixes java publishing to not error in the doc generation/publishing -- i...: #519
- Fix online plan bug with multiple serial summers and certain no-ops: #524
- Fixing tormentaSpout.registerMetric call in scheduleSpout: #521
- Use scalariform: #520
- Adds a test for a bug if a flatMap immediately before a leftJoin produce...: #518
- Fixed Storm stats bug with Promise: #514
- Platform-independent stats storm scalding: #503
- Experimental Java API and example: #499
- First pass at a spark platform for summingbird: #502
- Add summingbird logo: #504
- expose flow object to mutate function: #501
- Support java6 with our one java file: #498
- New async summers from algebird: #497
- Feature/stat store: #495
- Add some option documentation: #491
- Yet another cache: #470
- Monoid to semigroup: #487
Minor pt release, few fixes
Chunky bits again
- Add/use the multiplier option: #481
- add variations on pipeFactory to allow a map function before time extrac...: #482
- Make HDFSState public: #478
- Feature/ianoc frozen keys: #477
- Piping prune function through the VersionedStore factory method: #476
- Remove deprecation indirections: #472
- fix unidoc target: #469
- Add hadoop2 compression options: #466
- Few more profiler noticed changes, mostly Future.collect indexedSeq's. O...: #465
- Add deprecation: #463
- Vagrant folder added to .gitignore: #464
- Manually block up sections of output from caches into lists to avoid flo...: #453
- Fixes bug that meant storm tests weren't running: #460
- Factor batch from online: #455
- This moves from using the completeTopology approach to running it normal...: #458
- Code is called heavily, and in tests where we do it 100's of times it wa...: #457
- Clean up a little bit of this code. Uses seq/traversable once in some ap...: #456
- This refactors time out of several places inside the online code. Allows...: #454
- Move the hadoop defaults into scalding platform: #452
- Feature/add option to tune output sizes online: #451
- Move to using Mergable from storehaus instead of mergable store.: #450
- Feature/state deprecated ptrs: #449
- Adds BatchID interval to TS interval: #443
- Adds a scalding-test project: #447
- Make Commutativity settings a case object: #448
- Splits the storm test code out into its own package to help end users be...: #442
- Add toString to InitialBatchedStore: #444
- Feature/long to timestamp offline: #439
- Feature/add pruning support: #435
- Split the scalding platform out into packages: #434
- Add mima command support: #427
- Add PipeFactoryOps, with mapElements, flatMapElements and mapPipe: #432
- Feature/move code from scalding: #424
Chunky bits
Release tooling seems to have broken down. This release should not be used. Its 0.3.3 with just updated version numbers. 0.4.1 will be released shortly as a fixed version.