I’m reading through the source code, and see that MetaSparkDFDataset does not have a column_aggregate_expectation classmethod. Can we not use column aggregates/have to implement our own for spark datasets?
1 Like
The method column_map_expectation is implemented in MetaSparkDFDataset's parent class - MetaDataset.
If you want to implement a new column aggregate expectation for Spark, decorate your method with
@MetaSparkDFDataset.column_aggregate_expectation
1 Like