Skip to content

Latest commit

 

History

History
306 lines (266 loc) · 19.8 KB

CHANGES.md

File metadata and controls

306 lines (266 loc) · 19.8 KB
Raw

Summingbird

0.9.1

  • Fixes a bug in the LTuple2 class. Add a test for it: twitter#632

0.9.0

0.8.0

  • bumping Scalding to 0.15.0, algebird to 0.10.1

0.7.0

  • Registering summingbird counters with tormenta spouts #553
  • Add counters to default summers #571
  • Fixes the types off the summingbird java storm api #601
  • Adding explicit hadoop deps; dfs-datastores to 1.3.6 #592
  • Replace deprecated ClassManifest and erasure #608
  • Spark monad #607
  • replace deprecated erasure by runtimeClass #609
  • Revert "Remove StripNameNodes" #610
  • refactored core-tests into separate sub-project #593
  • Fix checking delta batch in readDeltaTimestamps in batched store when merging #612
  • ensure at least one batch before merging #613
  • MergeableStoreFactory extends java.io.Serializable #616
  • Spout storm metrics foreach #617
  • upgrade scalacheck #615
  • Use latest bijection, algebird, scalding, storehaus, chill, and tormenta

0.6.0

  • Use latest bijection, algebird, scalding, storehaus, chill, and tormenta twitter#565
  • Remove scala 2.9 support twitter#565
  • Add counters to default summers twitter#571
  • Registering summingbird counters with tormenta spouts twitter#553
  • Remove StripNameNodes: twitter#587
  • Revert unneeded wrapper in DagOptimizer: twitter#584
  • Make some classes public so we can make custom platforms: twitter#564
  • IdentityKeyedProducer in ValueFlatMapToFlatMap Dag Optimizer rule: twitter#580
  • Lazy store init for CombinedServiceStoreFactory: twitter#582
  • Pass the reducers option down to leftJoin: twitter#578
  • Rename readBatched to readAfterLastBatch: twitter#577
  • Fixes BatchedStore interval calculation: twitter#573
  • Support for creating a store-service for Storm platform: twitter#563
  • Support leftJoin against a store in offline platform: twitter#557
  • Counters for ConcurrentMemory platform: twitter#550
  • Summingbird Storm/Online refactor: twitter#544
  • Memory platform counters: twitter#548
  • Example of using DagOptimizer: twitter#538

0.5.1

  • Change the javac options for doc generation in java to be successful. (Blocks maven publishing)

0.5.0

  • Bumps version of other projects. Changes to compile with latest scalding...: twitter#533
  • Safely checking for the internal storm Implementation detail: twitter#528
  • add implicit Successible and Predecessible for Timestamp: twitter#530
  • Removes redundant Future.unit call: twitter#526
  • Optimize CalendarBatcher a bit: twitter#527
  • Fixes java publishing to not error in the doc generation/publishing -- i...: twitter#519
  • Fix online plan bug with multiple serial summers and certain no-ops: twitter#524
  • Fixing tormentaSpout.registerMetric call in scheduleSpout: twitter#521
  • Use scalariform: twitter#520
  • Adds a test for a bug if a flatMap immediately before a leftJoin produce...: twitter#518
  • Fixed Storm stats bug with Promise: twitter#514
  • Platform-independent stats storm scalding: twitter#503
  • Experimental Java API and example: twitter#499
  • First pass at a spark platform for summingbird: twitter#502
  • Add summingbird logo: twitter#504
  • expose flow object to mutate function: twitter#501
  • Support java6 with our one java file: twitter#498
  • New async summers from algebird: twitter#497
  • Feature/stat store: twitter#495
  • Add some option documentation: twitter#491
  • Yet another cache: twitter#470
  • Monoid to semigroup: twitter#487

0.4.2

  • Use scalding version 0.9.0rc17 which has some bug fixes
  • Add fully satisfiable flag to UniqueKeyedService: twitter#489
  • Mark the scalding platform as serializable, but also don't grab the platform in the scalding env: twitter#485
  • smoketest displaying error running example: twitter#483

0.4.1

  • Release tool failure fix from 0.4.0 release.

0.4.0

  • Add/use the multiplier option: twitter#481
  • add variations on pipeFactory to allow a map function before time extrac...: twitter#482
  • Make HDFSState public: twitter#478
  • Feature/ianoc frozen keys: twitter#477
  • Piping prune function through the VersionedStore factory method: twitter#476
  • Remove deprecation indirections: twitter#472
  • fix unidoc target: twitter#469
  • Add hadoop2 compression options: twitter#466
  • Few more profiler noticed changes, mostly Future.collect indexedSeq's. O...: twitter#465
  • Add deprecation: twitter#463
  • Vagrant folder added to .gitignore: twitter#464
  • Manually block up sections of output from caches into lists to avoid flo...: twitter#453
  • Fixes bug that meant storm tests weren't running: twitter#460
  • Factor batch from online: twitter#455
  • This moves from using the completeTopology approach to running it normal...: twitter#458
  • Code is called heavily, and in tests where we do it 100's of times it wa...: twitter#457
  • Clean up a little bit of this code. Uses seq/traversable once in some ap...: twitter#456
  • This refactors time out of several places inside the online code. Allows...: twitter#454
  • Move the hadoop defaults into scalding platform: twitter#452
  • Feature/add option to tune output sizes online: twitter#451
  • Move to using Mergable from storehaus instead of mergable store.: twitter#450
  • Feature/state deprecated ptrs: twitter#449
  • Adds BatchID interval to TS interval: twitter#443
  • Adds a scalding-test project: twitter#447
  • Make Commutativity settings a case object: twitter#448
  • Splits the storm test code out into its own package to help end users be...: twitter#442
  • Add toString to InitialBatchedStore: twitter#444
  • Feature/long to timestamp offline: twitter#439
  • Feature/add pruning support: twitter#435
  • Split the scalding platform out into packages: twitter#434
  • Add mima command support: twitter#427
  • Add PipeFactoryOps, with mapElements, flatMapElements and mapPipe: twitter#432
  • Feature/move code from scalding: twitter#424

0.3.3

  • Depend on proper Tormenta version (fix semver hiccup)

0.3.2

0.3.1

0.3.0

0.2.5

0.2.4

  • Fix off-by-one bug in scalding batched store: twitter#311

0.2.3

0.2.2

0.2.1

  • Add support for map only jobs in producer api twitter#269
  • Fixes naming of nodes, options are picked up correctly twitter#267
  • Fix missing elements in case statements for applying online graph to storm twitter#272

0.2.0

0.1.5

  • Control how futures are collected in Client Store: twitter#254
  • Producer[Platform, T] is covariant on T: twitter#251
  • Improve testing generators: twitter#249
  • Remove manifests from the core API: twitter#247
  • Dot graphs of our storm plan (what SB nodes go to physical nodes): twitter#236

0.1.4

0.1.3

0.1.2

0.1.1

  • Add --scalding.nothrowplan to not rethrow/exit with error on a flow plan error

0.1.0

  • new, producer-based API
  • Split Storm and Scalding platforms
  • Added in-memory platform
  • Complete DSL rebuild in anticipation of release.

0.0.4

  • fix compiler-induced bug in BatchAggregatorJob.

0.0.3

  • Ability to tee out data.

0.0.2

  • PresentingStore
  • Ability to join a Summingbird job against another SB job.

0.0.1

  • Initial code push.