Integrate GE with Azure Data Factory?

Is it possible to integrate GE with Azure Data Factory? It is possible in Airflow. Basically I would like GE to terminate the Data Factory pipeline run if a validation fails.

2 Likes

You can run a Checkpoint (that you configured), examine the validation result that it returns and do the termination yourself. Are you looking for a closer integration?

Yes, is there a way Data Factory will auto terminate at a checkpoint if GE returns validation failure?

1 Like

That’s a little old thread - are there any new insights here? how can GE and Azure Data Factories come closer?