Hadoop cluster takeover with Ryba and Ambari

Introduction

Apache Ambari became a mature product over the years. It has not always been the case and there was a time when it was necessary to automate your own deployment scripts to operate a secured and multi-tenant cluster. It is now time to give Ambari the control.

  • Speaker: Leo Schoukroun
  • Duration: 1h30
  • Format: demonstration

Presentation

As a Big Data engineer you probably tried HDP’s sandbox or even installed a cluster yourself. In most cases, you used Apache Ambari to deploy and manage the services and configurations of your cluster. Now imagine a time when Ambari was not able to deal with SSL, Kerberos, HA, etc. Ryba and Nikita are an open source tools developed by Adaltas that help you boostrap and manage Hadoop clusters, it was built from scratch with Ambari’s past weaknesses in mind. Then imagine you decide to give Ambari a second chance and want to give it full control over your ‘manually’ deployed cluster. This is what we called the ‘Ambari takeover’ and this is what we are going to check out together.

In this presentation we will learn about the cogs behind the shiny user interface: the Apache Ambari API. The talk will also feature a friendly reminder on hows and whys of the Ryba project. I will also do a demo takeover of a preinstalled Hadoop cluster.

Author

Leo Schoukroun, Big Data consultant at Adaltas. Currently working at EDF, deploying and maintaining multiple secured and multitenant Hadoop clusters with 300+ on-prem nodes.

Note, the "ryba-ambari-takeover" project was made by Lucas Bakalian.

Canada - Morocco - France

International locations

10 rue de la Kasbah
2393 Rabbat
Canada

We are a team of Open Source enthusiasts doing consulting in Big Data, Cloud, DevOps, Data Engineering, Data Science…

We provide our customers with accurate insights on how to leverage technologies to convert their use cases to projects in production, how to reduce their costs and increase the time to market.

If you enjoy reading our publications and have an interest in what we do, contact us and we will be thrilled to cooperate with you.