Loading...
Home2018-11-05T13:43:57+00:00

BigData

Data Engineering

Data Collect, Data Preparation, Data Lake, Data Governance

Data Science

Writing algorithms, Spark, Machine Learning, exploration, statistics, Python, R

Data Streaming

Message Bus, Key Performance Indicator (KPI), Threshold Detection, Time Window Queries, Intelligent Behaviors

Data Analytics

Visualization, notebooks

Latest articles

Spark Streaming part 1: build data pipelines with Spark Structured Streaming

By |April 18th, 2019|Categories: Big Data, Data Engineering|Tags: , , , , |

Spark Structured Streaming is a new engine introduced with Apache Spark 2 used for processing streaming data. It is built on top of the existing Spark SQL engine and the Spark DataFrame. The Structured Streaming [...]

Gatsby.js, React and GraphQL for documentation websites

By |April 1st, 2019|Categories: Front End|Tags: , , , , , , |

In the last few months, I have started to redesign some of our Open Source project websites. This includes the websites of the Node.js CSV project, the Node.js HBase client and the Nikita project, our [...]

Publish Spark SQL DataFrame and RDD with Spark Thrift Server

By |March 25th, 2019|Categories: Big Data, Data Engineering|Tags: , , , , |

The distributed and in-memory nature of the Spark engine makes it an excellent candidate to expose data to clients which expect low latencies. Dashboards, notebooks, BI studios, KPIs-based reports tools commonly speak the JDBC/ODBC protocols [...]

Multihoming on Hadoop

By |March 5th, 2019|Categories: Adalas Summit 2018, Big Data, Data Engineering|Tags: , , |

Multihoming, which means having multiple networks attached to one node, is one of the main components to manage the heterogeneous network usage of an Apache Hadoop cluster. This article is an introduction to the concept [...]

Introduction to Cloudera Data Science Workbench

By |February 28th, 2019|Categories: Big Data, Data Engineering, Data Science, ML|Tags: , , , , , |

Cloudera Data Science Workbench is a platform that allows Data Scientists to create, manage, run and schedule data science workflows from their browser. Thus it enables them to focus on their main task that is deriving [...]

Apache Knox made easy!

By |February 4th, 2019|Categories: Adalas Summit 2018, Big Data, Cyber Security, Data Governance|Tags: , , , , , , , , |

Apache Knox is the secure entry point of a Hadoop cluster, but can it also be the entry point for my REST applications? […]