From the course: Data Management with Apache NiFi

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Run a dataflow with a process group

Run a dataflow with a process group - Apache NiFi Tutorial

From the course: Data Management with Apache NiFi

Run a dataflow with a process group

Well, our hard work creating the process group is now complete. We just have to see this data flow in action. Let's execute our workflow. And for that, we need to do a little bit of cleanup. Let's truncate the cars table so that it starts off as completely empty. Let's confirm the truncation by running select count star from cars. This should return zero, and yes indeed, it does. Now here is the data that we'll process using our data flow. Let me just place the 10 files that our Dataflow will process into the lunicorn-tools-datasets folder. This is where the Dataflow will pick them up using getfile. I'll then switch over to the grouped-outputs folder, which is where the final output of the Dataflow will be placed. The grouped and aggregated data. Back to our NiFi user interface, I'm going to select all of the processors except the ones within the process group. With all of the processors selected, let's go ahead and run this data flow. With the processors I want to run selected, I'm…

Contents