Metrics
Related articles
Internship in Data Engineering
Categories: Learning, Front End | Tags: Monitoring, Metrics, Kubernetes, Delta Lake, Elasticsearch, Hive, Kafka, Streaming, IaC
Job Description Data is a valuable business asset. Some call it the new oil. The data engineer collects, transform and refine raw data into information that can be used by business analysts and data…
By David WORMS
Oct 25, 2021
Storage size and generation time in popular file formats
Categories: Data Engineering, Data Science | Tags: Big Data, Avro, HDFS, JSON, ORC, Parquet, File Format, Hive, Data Lake
Choosing an appropriate file format is essential, whether your data transits on the wire or is stored at rest. Each file format comes with its own advantages and disadvantages. We covered them in a…
Mar 22, 2021
Auto-scaling Druid with Kubernetes
Categories: Big Data, Business Intelligence, Containers Orchestration | Tags: Metrics, Helm, Kubernetes, Cloud, Python, Operation, EC2, OLAP, CNCF, Data Analytics, Container Orchestration, Prometheus, Druid
Apache Druid is an open-source analytics data store which could leverage the auto-scaling abilities of Kubernetes due to its distributed nature and its reliance on memory. I was inspired by the talk…
Jul 16, 2019
HDP cluster monitoring
Categories: DevOps & SRE, Infrastructure, Big Data | Tags: Monitoring, Ambari, Metrics, REST, HDP, Alert
With the current growth of BigData technologies, more and more companies are building their own clusters in hope to get some value of their data. One main concern while building these infrastructures…
Jul 5, 2017
OS module on steroids with the SIGAR Node binding
Categories: Node.js | Tags: Monitoring, Metrics, File system, C++, Network, CPU
Today we are announcing the first release of the Node binding to the SIGAR library. Visit the project website or the source code repository on GitHub. SIGAR is a cross platform interface for gathering…
By David WORMS
Jan 11, 2012