We are currently looking for a data quality framework, and GE is on the list.
Our ETL is written in PySpark. Are we able to embed GE inside our current PySpark scripts, so we can perform ETL and DQ within the same process?
We are currently looking for a data quality framework, and GE is on the list.
Our ETL is written in PySpark. Are we able to embed GE inside our current PySpark scripts, so we can perform ETL and DQ within the same process?