Joris Rummens is a BigData architect and data engineer with 5 years of experience on Hadoop and distributed systems. He designed, built and operated ingestion workflows and real-time services while helping his clients define their needs and implement them.
He worked for several organizations each having their own unique environments and needs, on short expertise and support missions as well as long Big Data department building ones, and as an Hortonworks software architect and on operational and business-support positions.
His versatile skills on Big Data platforms enable him to work on various stages of a project and applications, from planification and architecture through prototyping and automation to administration and maintenance. He is used to collaborate with business people as well as with analysts, data scientists, engineers and operational teams.
Published articles
Multihoming on Hadoop
Categories: Infrastructure | Tags: HDFS, Kerberos, Network, Hadoop
Multihoming, which means having multiple networks attached to one node, is one of the main components to manage the heterogeneous network usage of an Apache Hadoop cluster. This article is an…
Mar 5, 2019
Running Enterprise Workloads in the Cloud with Cloudbreak
Categories: Big Data, Cloud Computing, DataWorks Summit 2018 | Tags: AWS, Cloudbreak, GCP, HDP, Azure, OpenStack, Operation, Hadoop
This article is based on Peter Darvasi and Richard Doktorics’ talk Running Enterprise Workloads in the Cloud at the DataWorks Summit 2018 in Berlin. It presents Hortonworks’ automated deployment tool…
May 28, 2018
Ambari - How to blueprint
Categories: Big Data, DevOps & SRE | Tags: Ambari, Ranger, Automation, CDH, DevOps, HDP, Operation, REST
As infrastructure engineers at Adaltas, we deploy Hadoop clusters. A lot of them. Let’s see how to automate this process with REST requests. While really handy for deploying one or two clusters, the…
Jan 17, 2018
Multi-Repo, Multi-Node Gating at Massive Scale
Categories: Cloud Computing, DevOps & SRE, Open Source Summit Europe 2017 | Tags: Ansible, CI/CD, Infrastructure, Jenkins, OpenStack, Red Hat, Zuul
This is a recap and personal review of Monty Taylor’s presentation of OpenStack’s Continuous Integration tool Zuul at the OpenSource Summit 2017 in Prague (not to mix with Netflix’ Zuul project…
Oct 24, 2017
HDP cluster monitoring
Categories: Big Data, DevOps & SRE, Infrastructure | Tags: Alert, Ambari, HDP, Metrics, Monitoring, REST
With the current growth of BigData technologies, more and more companies are building their own clusters in hope to get some value of their data. One main concern while building these infrastructures…
Jul 5, 2017