DevOps

Spark Streaming part 3: tools and tests for Spark applications

Whenever services are unavailable, businesses experience large financial losses. Spark Streaming applications can break, like any other software application. A streaming application operates on data from the real world, hence the uncertainty is intrinsic to the application's input. Testing is essential to discover as many software defects and as much flawed logic as possible before [...]

By |2019-07-11T22:14:43+00:00June 19th, 2019|Categories: Big Data, Data Engineering|Tags: , , , , |4 Comments

Microsoft introduces Cloud Native Application Bundles

At DockerCon EU 2018 in Barcelona, Matt Butcher, Principal Engineer at Microsoft and inventor of Helm, introduced CNAB, Cloud Native Application Bundles, a packaging format for distributed applications, along with Duffle, a CLI tool to run these bundles. […]

By |2018-12-05T10:21:00+00:00December 4th, 2018|Categories: Container, DevOps|Tags: , , , |0 Comments

Multi-Repo, Multi-Node Gating at Massive Scale

This is a recap and personal review of Monty Taylor’s presentation of OpenStack’s Continuous Integration tool Zuul at the OpenSource Summit 2017 in Prague (not to mix with Netflix’ Zuul project). […]

By |2019-08-04T18:13:54+00:00October 24th, 2017|Categories: DevOps, Open Source Summit Europe 2017|Tags: , , |1 Comment

Get in control of your workflows with Apache Airflow

Below is a compilation of my notes taken during the presentation of Airflow by Christian Trebing from BlueYonder. Introduction Use case : how to handle data coming in regularly from customers ? Option 1 : use CRON only time triggers hard error handling inconvenient when overlapping Option 2 : Writing a workflow processing tool start is easy [...]

By |2019-06-19T07:08:27+00:00July 17th, 2016|Categories: Events, Tech Radar|Tags: , , , |0 Comments

A fresh look at testing Node.js projects: Mocha, Should and Travis

Today, I finally decided to spend some time around Travis. It’s been a weeks since that little green image on top of GitHub homepages has been buzzing me. Well, to be totally honest, this isn’t how I started my evening. First, after 2 years of good and faithfull service, I decided to drop Expresso and [...]

By |2019-06-25T09:33:57+00:00February 19th, 2012|Categories: DevOps, Node.js|Tags: , , , |0 Comments

Announcing Mecano, a set of functions for system deployment

Update July 2016, Mecano is now renamed Nikita. We are releasing Node Mecano on GitHub which gather common functions used while deploying systems. The idea was to group those functions into a comprehensive library. […]

By |2019-06-24T10:00:52+00:00February 12th, 2012|Categories: Node.js|Tags: , , , , , |0 Comments