I am trying to create context in the dbfs using the below code:
import great_expectations as gx
from great_expectations import get_context
context = get_context(context_root_dir='/dbfs/great_expectations/")
considering great_expectations/ emplty folder exists in dbfs. Context object is not getting created in the directory.
And when I am trying to create a file data context at the same dbfs location. It is getting created in the drivers memory of databricks cluster.
Could you please put light on this issue.
Thanks