Beam exits incubation period and graduates to top-level Apache project, Google support and contribution to open source integration for various data processing backends and more.
Beam recently graduated to a top-level project at Apache Software Foundation. Beam’s goals include letting one process unbounded, out-of-order, global-scale data with portable high-level data pipelines. Beam was initially an internal Google project later moved into Apache, and was in incubation from February, 2016 through late last year. The Beam project seeks to create a unified programming model for streaming and batch processing jobs, and to produce artifacts that can be consumed by a number of supported data processing engines. Beam seeks to
provide the world with an easy-to-use, but powerful model for data-parallel processing, both streaming and batch, portable across a variety of runtime platforms… The Beam SDKs use the same classes to represent both bounded and unbounded data, and the same transforms to operate on that data.
