From the course: Google Cloud Professional Data Engineer Cert Prep (2025)

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Data pipeline triggers

Data pipeline triggers - Google Cloud Platform Tutorial

From the course: Google Cloud Professional Data Engineer Cert Prep (2025)

Start my 1-month free trial Buy for my team

Data pipeline triggers

“

- [Instructor] Imagine your garage as a data system and the light bulb as the data processing workflow in a data pipeline. The light bulb can be turned on or triggered in several ways, just like a data pipeline can be initiated by several types of triggers. Let's look at a few. First up, we have manual switch, event-based trigger. This is like a manual trigger. When you flip the switch, the light turns on. Similarly, in an event-based trigger in a data pipeline, the initiation of the data processing workflow occurs when a specific event happens. This could be a new file being uploaded to a storage bucket or a change in a database table. Next up, we have garage door opening, change data capture, CDC. When you open the garage door, it triggers the light to turn on. This is like a change data capture trigger in a data pipeline. This then starts the data processing workflow when it detects changes in the data source.…

Contents