Hortonworks DataFlow (HDF)
Related articles
![Connecting to ADLS Gen2 from Hadoop (HDP) and Nifi (HDF) Connecting to ADLS Gen2 from Hadoop (HDP) and Nifi (HDF)](/static/419865d36eae6f723fb5fbae6471dd94/0fd76/hdp-hdf-to-adls-gen2.png)
Connecting to ADLS Gen2 from Hadoop (HDP) and Nifi (HDF)
Categories: Big Data, Cloud Computing, Data Engineering | Tags: NiFi, Hadoop, HDFS, Authentication, Authorization, Azure, Azure Data Lake Storage (ADLS), OAuth2
As data projects built in the Cloud are becoming more and more frequent, a common use case is to interact with Cloud storage from an existing on premise Big Data platform. Microsoft Azure recentlyā¦
Nov 5, 2020
![Curing the Kafka blindness with the UI manager Curing the Kafka blindness with the UI manager](/static/e2b1bcc4a520321501a23bf47ae8762a/0fd76/kafka-ui-manager.png)
Curing the Kafka blindness with the UI manager
Categories: Big Data | Tags: Ambari, Hortonworks, HDF, JMX, UI, Kafka, Ranger, HDP
Today itās really difficult for developers, operators and managers to visualize and monitor what happens in a Kafka cluster. This articles covers a new graphical interface to oversee Kafka. It wasā¦
Jun 20, 2018
![Data Lake ingestion best practices Data Lake ingestion best practices](/static/ce2a5014125352552b1973a02b49e5ef/0fd76/data-lake-ingestion.png)
Data Lake ingestion best practices
Categories: Big Data, Data Engineering | Tags: NiFi, Data Governance, HDF, Operation, Avro, Hive, ORC, Spark, Data Lake, File Format, Protocol Buffers, Registry, Schema
Creating a Data Lake requires rigor and experience. Here are some good practices around data ingestion both for batch and stream architectures that we recommend and implement with our customersā¦
By David WORMS
Jun 18, 2018
![MiNiFi: Data at Scales & the Values of Starting Small MiNiFi: Data at Scales & the Values of Starting Small](/static/9f65f513994b736bfcb4da80bcf5ab2e/0fd76/minifi.png)
MiNiFi: Data at Scales & the Values of Starting Small
Categories: Big Data, DevOps & SRE, Infrastructure | Tags: MiNiFi, NiFi, C++, HDF, Cloudera, HDP, IOT
This conference presented rapidly Apache NiFi and explained where MiNiFi came from: basically itās a NiFi minimal agent to deploy on small devices to bring data to a clusterās NiFi pipeline (ex: IoTā¦
Jul 8, 2017