Apache NiFi
- Learn more
- Official website
Related articles
![CDP part 6: end-to-end data lakehouse ingestion pipeline with CDP CDP part 6: end-to-end data lakehouse ingestion pipeline with CDP](/static/7a94c75cc23624f2251df27a75eb4d11/0fd76/cdp-end-to-end-architecture.png)
CDP part 6: end-to-end data lakehouse ingestion pipeline with CDP
Categories: Big Data, Data Engineering, Learning | Tags: NiFi, Business intelligence, Data Engineering, Iceberg, Spark, Big Data, Cloudera, CDP, Data Analytics, Data Lake, Data Warehouse
In this hands-on lab session we demonstrate how to build an end-to-end big data solution with Cloudera Data Platform (CDP) Public Cloud, using the infrastructure we have deployed and configured overā¦
Jul 24, 2023
![Connecting to ADLS Gen2 from Hadoop (HDP) and Nifi (HDF) Connecting to ADLS Gen2 from Hadoop (HDP) and Nifi (HDF)](/static/419865d36eae6f723fb5fbae6471dd94/0fd76/hdp-hdf-to-adls-gen2.png)
Connecting to ADLS Gen2 from Hadoop (HDP) and Nifi (HDF)
Categories: Big Data, Cloud Computing, Data Engineering | Tags: NiFi, Hadoop, HDFS, Authentication, Authorization, Azure, Azure Data Lake Storage (ADLS), OAuth2
As data projects built in the Cloud are becoming more and more frequent, a common use case is to interact with Cloud storage from an existing on premise Big Data platform. Microsoft Azure recentlyā¦
Nov 5, 2020
![Data Lake ingestion best practices Data Lake ingestion best practices](/static/ce2a5014125352552b1973a02b49e5ef/0fd76/data-lake-ingestion.png)
Data Lake ingestion best practices
Categories: Big Data, Data Engineering | Tags: NiFi, Data Governance, HDF, Operation, Avro, Hive, ORC, Spark, Data Lake, File Format, Protocol Buffers, Registry, Schema
Creating a Data Lake requires rigor and experience. Here are some good practices around data ingestion both for batch and stream architectures that we recommend and implement with our customersā¦
By David WORMS
Jun 18, 2018
![Apache Metron in the Real World Apache Metron in the Real World](/static/920d21f936b7d08905834ab69db92cf3/0fd76/metron.png)
Apache Metron in the Real World
Categories: Cyber Security, DataWorks Summit 2018 | Tags: Algorithm, NiFi, Solr, Storm, pcap, RDBMS, HDFS, Kafka, Metron, Spark, Data Science, Elasticsearch, SQL
Apache Metron is a storage and analytic platform specialized in cyber security. This talk was about demonstrating the usages and capabilities of Apache Metron in the real world. The presentation wasā¦
May 29, 2018
![MiNiFi: Data at Scales & the Values of Starting Small MiNiFi: Data at Scales & the Values of Starting Small](/static/9f65f513994b736bfcb4da80bcf5ab2e/0fd76/minifi.png)
MiNiFi: Data at Scales & the Values of Starting Small
Categories: Big Data, DevOps & SRE, Infrastructure | Tags: MiNiFi, NiFi, C++, HDF, Cloudera, HDP, IOT
This conference presented rapidly Apache NiFi and explained where MiNiFi came from: basically itās a NiFi minimal agent to deploy on small devices to bring data to a clusterās NiFi pipeline (ex: IoTā¦
Jul 8, 2017