Does GE support reconciliation in ETL data pipelines? I want to define a metric and compare its value between source and target data source/data asset, however the metric is queried differently at the source vs at the target due to a data transformation that occurred.
Take for example ‘number of users’ - the query for this operation differs at the source vs at the target - yet the result of the queries at both source and target should be equal. Also the query itself might not be a trivial one such as row count but instead a more granular SQL statement, for example.
I am looking at Evaluation Parameters, Custom Query expectations and How to compare two tables with the UserConfigurableProfiler | Great Expectations
but I am not sure if any cover this use case.
Thanks