Spark Column Aggregates

I’m reading through the source code, and see that MetaSparkDFDataset does not have a column_aggregate_expectation classmethod. Can we not use column aggregates/have to implement our own for spark datasets?

1 Like

The method column_map_expectation is implemented in MetaSparkDFDataset's parent class - MetaDataset.

If you want to implement a new column aggregate expectation for Spark, decorate your method with


1 Like