Can we speed up execution by having expectations for multiple tables run in parallel?
The Modular Expectations API that was released as experimental in 0.13 formalizes the validation of Expectations as a computation DAG. This opens the way for optimizations in the future. There is no current effort on adding parallel processing or multithreading to the validation process. At some point the core team will revisit this when we do some sprints on performance optimization, but we do not have the dates yet.
This is important for my use case as well. I’ve experimented running queries in parallel with great expectations, but it isn’t clear if any of great expectations is multithread safe.