From the course: Advanced Data Engineering with Snowflake
Unlock this course with a free trial
Join today to access over 25,500 courses taught by industry experts.
What we'll build - Snowflake Tutorial
From the course: Advanced Data Engineering with Snowflake
What we'll build
Let's put these DevOps practices to use with a scenario. The pipeline that we're going to build off of is the pipeline that we built in the first course. We'll rebuild it together in an upcoming exercise. The pipeline specifically tracks weather and wind speed in the city of Hamburg, Germany. Recall that we built this pipeline because of strange weather-related anomalies that affected food truck sales in that city. You can imagine that you're on a data engineering team and you've been tasked with updating the pipeline with new changes. The pipeline needs to now do the following: employ source control, support incremental changes to new database objects, and allow continuous deployment to staging and production environments. To do this, we'll use Snowflake's Git integration and GitHub for source control. We'll use the CREATE OR ALTER command to declaratively add and modify database objects. And finally, we'll use Snowflake CLI and GitHub Actions to test and deploy changes to the…
Contents
-
-
-
DevOps in the world of data engineering4m 13s
-
(Locked)
DevOps with Snowflake3m 1s
-
(Locked)
What we'll build1m 21s
-
(Locked)
Source control in Snowflake with Git7m 51s
-
(Locked)
Set up the data pipeline using snowflake CLI10m 43s
-
(Locked)
Database change management (DCM)6m 23s
-
(Locked)
Declarative approach with CREATE OR ALTER13m 58s
-
(Locked)
Continuous integration and continuous delivery (CI/CD) for data pipelines4m 1s
-
(Locked)
Implementing continuous delivery for our data pipeline12m 10s
-
(Locked)
Recap and best practices for DevOps with Snowflake2m 22s
-
-