From the course: Microsoft Fabric Analytics Engineer Associate (DP-600) Cert Prep by Microsoft Press

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Use Dataflow Gen2 for data preparation and transformation

Use Dataflow Gen2 for data preparation and transformation

- [Instructor] Let's talk about ingesting the data using Dataflow Gen2. We can start by bringing the data from various sources into Dataflow Gen2. These sources can include databases, cloud storage, or APIs. The data can come in different formats, such as structured. Example, your tables. They can also come in semi-structured. Example, JSON or XML files. Or unstructured, like our text files, images, et cetera. Then we have data transformation. Using Dataflow Gen2's visualization interface, we can make changes to the data. These changes may include removing duplicate entries, handling missing values or incomplete data, standardizing data formats, combining the data from different sources, summarizing or aggregation of the data, filtering out the data that we don't need, or even mapping the data to a specific structure or a format that we can use in future. The next we have is execute and monitor the Dataflow.…

Contents