Python

Apache Beam: a unified programming model for data processing pipelines

In this article, we will review the concepts, the history and the future of Apache Beam, that may well become the new standard for data processing pipelines definition. […]

Get in control of your workflows with Apache Airflow

Below is a compilation of my notes taken during the presentation of Airflow by Christian Trebing from BlueYonder. Introduction Use case : how to handle data coming in regularly from customers ? Option 1 : use CRON only time triggers hard error handling inconvenient when overlapping Option 2 : Writing a workflow processing tool start is easy [...]

By |2019-06-19T07:08:27+00:00July 17th, 2016|Categories: Events, Tech Radar|Tags: , , , |0 Comments