Integrating Great Expectations with Databricks and Datahub

GX OSS Support
, ,
1

I am trying to integrate Great Expectations with Databricks (Unity Catalog Enabled Workspace) and then to Datahub, I tried the provided documentation by Great Expectations (Get started with Great Expectations and Databricks | Great Expectations). I followed CLI steps also (How to create a new Data Context with the CLI — great_expectations documentation). I have to use my Unity Catalog as Datasource and have to send the validation result to Datahub.

Is that possible, what I am trying to do with Great Expectations and Unity Catalog enabled Databricks Workspace.

2

Hello @sant-singh , I assume with “Datahub” you mean an external location? If not please explain “Datahub”.
If it’s an external location an “External location” must be configured in your Databricks workspace. See https://adb-.azuredatabricks.net/explore/locations/