From the course: Advanced SQL Project: Design and Manage a Database
Join today to access over 25,500 courses taught by industry experts.
Building the data pipeline - SQL Tutorial
From the course: Advanced SQL Project: Design and Manage a Database
Building the data pipeline
- [Instructor] In the last video, we took a look at the design plan for our data pipeline for iMedia Music. Now, in this video, let's put it all together and take a look at our comprehensive iMedia data pipeline. To get started, navigate to your exercise files area and locate the file called etl_script.sh. Once you open that file, you'll see contents that look like what you see on the screen here. Now, we have a number of different commands within this file, and most of which you are already familiar with. In fact, the extract, transform, and load phases are all included here, as we did before. The only thing that is really different is now including some specific commands. As we mentioned before, we want to know when this script has started and this echo "ETL script started" has the ability to tell us that. Next, we're actually going to specify where this specific iMedia database is, and then remove the foreign key constraints so that we can then implement the changes that we need…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.