Tag Archives: beam

Apache Big Data Seville 2016 – Scio, a Scala DSL for Apache Beam – Robert Gruener

Scio, a Scala DSL for Apache Beam – Robert Gruener

Learn about Scio, a Scala DSL for Apache Beam. Beam introduces a simple, unified programming model for both batch and streaming data processing while Scio brings it much closer to the high level API many data engineers are familiar with. We will cover design and implementation of the framework, including features like type safe BigQuery and REPL. There will also a live coding demo.

More information about this talk

Apache Big Data Seville 2017 – Introduction to Apache Beam – Jean-Baptiste Onofré, & Dan Halperin

Introduction to Apache Beam – Jean-Baptiste Onofré,  & Dan Halperin

Apache Beam is a unified programming model designed to provide efficient and portable data processing pipelines. The same Beam pipelines work in batch and streaming, and on a variety of open source and private cloud big data processing backends including Apache Flink, Apache Spark, and Google Cloud Dataflow. This talk will introduce Apache Beam’s programming model and mechanisms for efficient execution. The speakers will show how to build Beam pipelines, and demo how to use it to execute the same code across different runners.

More information about this talk