From the course: Advanced Data Engineering with Snowflake

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

What we'll build

What we'll build

Let's put these DevOps practices to use with a scenario. The pipeline that we're going to build off of is the pipeline that we built in the first course. We'll rebuild it together in an upcoming exercise. The pipeline specifically tracks weather and wind speed in the city of Hamburg, Germany. Recall that we built this pipeline because of strange weather-related anomalies that affected food truck sales in that city. You can imagine that you're on a data engineering team and you've been tasked with updating the pipeline with new changes. The pipeline needs to now do the following: employ source control, support incremental changes to new database objects, and allow continuous deployment to staging and production environments. To do this, we'll use Snowflake's Git integration and GitHub for source control. We'll use the CREATE OR ALTER command to declaratively add and modify database objects. And finally, we'll use Snowflake CLI and GitHub Actions to test and deploy changes to the…

Contents