Keep getting batch_definition name already exists - In Databricks

Hello everyone,

I am new to GX core and I am currently tryint to setup in Databricks notebook.

On my first instance I was able to script and run an expectation but from the next day while running the same script I keep getting batch_definition name already exists error.

Does batch definition needs to be referenced elsewhere ? Please help. Screenshot below

Hi there, there must be a context file created that stores all your data sources, data assets, and definitions. Once set, the same name cannot be used because it will already be present in the context file. So, you can simply use the “get data definition” function to retrieve the data definition. If you want to start from scratch, you will have to delete the “gx” folder that was created.