Databricks: how to generate Data Docs without having great_expectations.yml config file

Archive
1

I was wondering how can I generate docs using context.build_data_docs() in a databricks notebook without having a great_expectations.yml file

1 Like
2

This how-to guide shows a pattern of initializing a Data Context without a configuration file:
https://docs.greatexpectations.io/en/latest/guides/how_to_guides/configuring_data_contexts/how_to_instantiate_a_data_context_on_an_emr_spark_cluster.html

This specific guide is about EMR, but you can use the same code snippet on Databricks.

Once you have your Data Context in the notebook, you can call

context.build_data_docs()

to build Data Docs.

3

putting here new link because above is no longer working.
https://docs.greatexpectations.io/en/latest/guides/how_to_guides/configuring_data_contexts/how_to_instantiate_a_data_context_on_an_emr_spark_cluster.html

1 Like