From the course: Data Management with Apache NiFi
Unlock this course with a free trial
Join today to access over 25,500 courses taught by industry experts.
Run a dataflow with a process group - Apache NiFi Tutorial
From the course: Data Management with Apache NiFi
Run a dataflow with a process group
Well, our hard work creating the process group is now complete. We just have to see this data flow in action. Let's execute our workflow. And for that, we need to do a little bit of cleanup. Let's truncate the cars table so that it starts off as completely empty. Let's confirm the truncation by running select count star from cars. This should return zero, and yes indeed, it does. Now here is the data that we'll process using our data flow. Let me just place the 10 files that our Dataflow will process into the lunicorn-tools-datasets folder. This is where the Dataflow will pick them up using getfile. I'll then switch over to the grouped-outputs folder, which is where the final output of the Dataflow will be placed. The grouped and aggregated data. Back to our NiFi user interface, I'm going to select all of the processors except the ones within the process group. With all of the processors selected, let's go ahead and run this data flow. With the processors I want to run selected, I'm…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
-
(Locked)
Configure PutSQL for DML operations3m 19s
-
(Locked)
Execute SQL commands and convert write formats3m 20s
-
(Locked)
Convert between data formats4m 20s
-
(Locked)
Update attributes and writing files4m 16s
-
(Locked)
Run the flow end-to-end6m 33s
-
(Locked)
Modularize dataflows with process groups5m 29s
-
(Locked)
Run a dataflow with a process group2m 20s
-
(Locked)
-
-
-
-