Pre-processing SQL query before executing expectations

Archive
1

Hi folks,

I’m working on migrating from v0.12 to 0.13 and I noticed that when I fetched a batch in 0.12 I could include a query in the batch_kwargs to, say, cast strings to numeric as a preprocessing step. This was super helpful as we have some postgres tables that need a bit of TLC before they’re ready for validation. Is there an analogue with BatchRequest in v0.13? Did this functionality migrate elsewhere during the refactor?

1 Like
2

This capability was not included in the initial version of the new API in 0.13. We have revisited this since and will release an update that will allow to create a Validator from a SQL query, using RuntimeDataConnector. Please watch for release anncouncements.

1 Like