Cloud computing
Obtenir de l'agilité, de l'efficacité, un contrôle des coûts et une meilleure analyse en déployant une infrastructure de données volumineuses dans le cloud tout en tenant compte des impératifs de sécurité et de l'héritage, n'est pas une mince tâche. La gestion d'un pool élastique de ressources dans un environnement multi-tenant tout en respectant les SLAs, l'intégrité des données et le budget sous contrôle ne l'est pas non plus.
Nous concevons, déployons et exploitons quotidiennement des solutions de cloud hybrides publiques et privées basées sur de multiples offres. Nous avons été impliqués dans différentes approches de la migration vers le cloud, de «Lift & Shift» à la refonte complète de la plateforme. Ces expériences apportent à nos consultants toute la profondeur et l’éventail des compétences nécessaires pour vous aider à naviguer, personnaliser et exploiter la nouvelle norme.
Nos consultants interviennent sur l'ensemble du cycle de vie d'un projet, de l'étude de faisabilité jusqu'à sa mise en production
Cloud migration
- Rassembler et documenter les exigences (fonctionnelles et non fonctionnelles)
- Architecture de la solution en fonction des exigences
- Définition de la roadmap et planification de projet
- Test, optimisation et procédures de cut-off
- Comparaison des services et offres de cloud public
Exploitation et optimisation
- Audit d'infrastructure, des processus and des coûts
- Automatisation du déploiement de l'infrastructure
- Définition et respect des objectifs (SLOs, SLAs)
- Infrastructure, réseau et exploitation des services
- Analyse, calcul et optimisation des coûts (Total Cost of Ownership, TCO)
Intégration et développement dans le Cloud
- Qualification et validation de technologies et de services
- Ingestion et préparation des pipelines de données
- Chargement des données et connection des systèmes
- Algorithmes d'apprentissage automatique (Machine Learning, ML)
- Traitements sur architecture Stream and Batch
Articles associés au Cloud
Keycloak deployment in EC2
Catégories : Cloud Computing, Data Engineering, Infrastructure | Tags : Security, EC2, Authentication, AWS, Docker, Keycloak, SSL/TLS, SSO
Why use Keycloak Keycloak is an open-source identity provider (IdP) using single sign-on (SSO). An IdP is a tool to create, maintain, and manage identity information for principals and to provide…
Par Stephan BAUM
14 mars 2023
Databricks logs collection with Azure Monitor at a Workspace Scale
Catégories : Cloud Computing, Data Engineering, Adaltas Summit 2021 | Tags : Metrics, Monitoring, Spark, Azure, Databricks, Log4j
Databricks is an optimized data analytics platform based on Apache Spark. Monitoring Databricks plateform is crucial to ensure data quality, job performance, and security issues by limiting access to…
Par Claire PLAYE
10 mai 2022
Using Cloudera Deploy to install Cloudera Data Platform (CDP) Private Cloud
Catégories : Big Data, Cloud Computing | Tags : Ansible, Cloudera, CDP, Cluster, Data Warehouse, Vagrant, IaC
Following our recent Cloudera Data Platform (CDP) overview, we cover how to deploy CDP private Cloud on you local infrastructure. It is entirely automated with the Ansible cookbooks published by…
23 juil. 2021
An overview of Cloudera Data Platform (CDP)
Catégories : Big Data, Cloud Computing, Data Engineering | Tags : SDX, Big Data, Cloud, Cloudera, CDP, CDH, Data Analytics, Data Hub, Data Lake, Data lakehouse, Data Warehouse
Cloudera Data Platform (CDP) is a cloud computing platform for businesses. It provides integrated and multifunctional self-service tools in order to analyze and centralize data. It brings security and…
19 juil. 2021
Find your way into data related Microsoft Azure certifications
Catégories : Cloud Computing, Data Engineering | Tags : Data Governance, Azure, Data Science
Microsoft Azure has certification paths for many technical job roles such as developer, Data Engineer, Data Scientist and solution architect among others. Each of these certifications consists of…
Par Barthelemy NGOM
14 avr. 2021
Connecting to ADLS Gen2 from Hadoop (HDP) and Nifi (HDF)
Catégories : Big Data, Cloud Computing, Data Engineering | Tags : NiFi, Hadoop, HDFS, Authentication, Authorization, Azure, Azure Data Lake Storage (ADLS), OAuth2
As data projects built in the Cloud are becoming more and more frequent, a common use case is to interact with Cloud storage from an existing on premise Big Data platform. Microsoft Azure recently…
Par Gauthier LEONARD
5 nov. 2020
Automate a Spark routine workflow from GitLab to GCP
Catégories : Big Data, Cloud Computing, Containers Orchestration | Tags : Learning and tutorial, Airflow, Spark, CI/CD, GitLab, GitOps, GCP, Terraform
A workflow consists in automating a succession of tasks to be carried out without human intervention. It is an important and widespread concept which particularly apply to operational environments…
16 juin 2020
Introducing Apache Airflow on AWS
Catégories : Big Data, Cloud Computing, Containers Orchestration | Tags : PySpark, Learning and tutorial, Airflow, Oozie, Spark, AWS, Docker, Python
Apache Airflow offers a potential solution to the growing challenge of managing an increasingly complex landscape of data management tools, scripts and analytics processes. It is an open-source…
Par Aargan COINTEPAS
5 mai 2020
Snowflake, the Data Warehouse for the Cloud, introduction and tutorial
Catégories : Business Intelligence, Cloud Computing | Tags : Cloud, Data Lake, Data Science, Data Warehouse, Snowflake
Snowflake is a SaaS-based data-warehousing platform that centralizes, in the cloud, the storage and processing of structured and semi-structured data. The increasing generation of data produced over…
7 avr. 2020
Cloudera CDP and Cloud migration of your Data Warehouse
Catégories : Big Data, Cloud Computing | Tags : Azure, Cloudera, Data Hub, Data Lake, Data Warehouse
While one of our customer is anticipating a move to the Cloud and with the recent announcement of Cloudera CDP availability mi-september during the Strata conference, it seems like the appropriate…
Par David WORMS
16 déc. 2019
Should you move your Big Data and Data Lake to the Cloud
Catégories : Big Data, Cloud Computing | Tags : DevOps, AWS, Azure, Cloud, CDP, Databricks, GCP
Should you follow the trend and migrate your data, workflows and infrastructure to GCP, AWS and Azure? During the Strata Data Conference in New-York, a general focus was put on moving customer’s Big…
Par Joris RUMMENS
9 déc. 2019
Insert rows in BigQuery tables with complex columns
Catégories : Cloud Computing, Data Engineering | Tags : GCP, BigQuery, Schema, SQL
Google’s BigQuery is a cloud data warehousing system designed to process enormous volumes of data with several features available. Out of all those features, let’s talk about the support of Struct…
Par César BEREZOWSKI
22 nov. 2019
Running Enterprise Workloads in the Cloud with Cloudbreak
Catégories : Big Data, Cloud Computing, DataWorks Summit 2018 | Tags : Cloudbreak, HDP, Operation, Hadoop, AWS, Azure, GCP, OpenStack
This article is based on Peter Darvasi and Richard Doktorics’ talk Running Enterprise Workloads in the Cloud at the DataWorks Summit 2018 in Berlin. It presents Hortonworks’ automated deployment tool…
Par Joris RUMMENS
28 mai 2018
Micro Services
Catégories : Cloud Computing, Containers Orchestration, Open Source Summit Europe 2017 | Tags : Mesos, CNCF, DNS, Encryption, gRPC, Istio, Linkerd, Micro Services, MITM, Service Mesh, Kubernetes, Proxy, SPOF, SSL/TLS
Back in the days, applications were monolithic and we could use an IP address to access a service. With virtual machines (VM), multiple hosts started to appear on the same machine with multiple apps…
Par David WORMS
14 nov. 2017
Multi-Repo, Multi-Node Gating at Massive Scale
Cat égories : Cloud Computing, DevOps & SRE, Open Source Summit Europe 2017 | Tags : Infrastructure, Jenkins, Red Hat, Zuul, Ansible, CI/CD, OpenStack
This is a recap and personal review of Monty Taylor’s presentation of OpenStack’s Continuous Integration tool Zuul at the OpenSource Summit 2017 in Prague (not to mix with Netflix’ Zuul project…
Par Joris RUMMENS
28 oct. 2017
Kubernetes Storage Primitives for Stateful Workloads
Catégories : Cloud Computing, Containers Orchestration, Open Source Summit Europe 2017 | Tags : Container Storage Interface (CSI), PVC, Azure, Docker, GCE, Kubernetes, Storage
This article is based on the presentation “Introduction to Kubernetes Storage Primitives for Stateful Workloads” from the OSS Convention Prague 2017 by the {Code} team. So, let’s start, what is…
Par Pierre SAUVAGE
28 oct. 2017
Node.js is now integrated to the Microsoft Azure platform
Catégories : Cloud Computing, Tech Radar | Tags : Linux, Azure, Cloud, Node.js
Node is now a first class citizen in the Microsoft Azure cloud environment alongside .Net, Java and PHP. This integration is the logical consequence of Microsoft’s involvement in the development of…
Par David WORMS
11 déc. 2011
