We’ve been cooking up another fantastic collaboration with an open source project over the past few months! Prefect is an open source workflow management system that makes it easy to take your data pipelines and add semantics like retries, logging, dynamic mapping, caching, failure notifications, and more. While it was already possible to run validation with Great Expectations in a simple Python Task, you can now use a more convenient pre-built RunGreatExpectationsValidation Task in Prefect to kick off your data validation! Read on for more details, or jump straight to the Prefect docs to get started.
This is a companion discussion topic for the original entry at https://greatexpectations.io/blog/prefect-great-expectations/