From the course: Data Quality Testing with Great Expectations
Join today to access over 25,500 courses taught by industry experts.
GX workflows - Great Expectations Tutorial
From the course: Data Quality Testing with Great Expectations
GX workflows
One important thing I want to call out here, because this often causes confusion, is that there are actually two different ways teams can use GX in production. The first is what I'll call the configuration-driven workflow. In this setup, you develop expectations once using GX Core, usually in a notebook, like we just did in the previous exercises. Those expectations are then saved as files in the file-based data context. The directory that holds those files is checked into version control. In production, your pipeline code simply loads the existing expectation suites, runs checkpoints, and reacts to the results. This approach keeps expectations stable, versionable, and clearly separated from pipeline logic. The second approach is a code-driven workflow. Here, the production code both defines expectations and runs them as part of the same execution. Instead of loading pre-saved expectation suites, the pipeline dynamically creates expectations and immediately validates the data. This is…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.