From the course: Advanced Data Engineering with Snowflake

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Continuous integration and continuous delivery (CI/CD) for data pipelines

Continuous integration and continuous delivery (CI/CD) for data pipelines - Snowflake Tutorial

From the course: Advanced Data Engineering with Snowflake

Start my 1-month free trial Buy for my team

Continuous integration and continuous delivery (CI/CD) for data pipelines

“

If DevOps practices help you collaborate with many teammates and increase your velocity in introducing changes, how do they help ensure that those changes are correct and reliable and don't negatively impact say a data pipeline, for example? This is where the concepts of continuous integration and continuous delivery often shortened to CI/CD play an important role. Continuous integration refers to the practice of introducing changes into a central code base and running automated tests and builds on those introduced changes. This practice helps teams quickly find and address any introduced bugs, while also validating the correctness of those new changes against the existing code base. If anything is out of the ordinary, say a test fails for some reason due to a breaking change, you're able to address it before the change is rolled out to large swathes of end users or systems. Oftentimes, this entire workflow is automated through the use of a third-party tool. Continuous delivery refers…

Contents