How to create GlobReader Generator when creating a new datasource via CLI

Archive
1

OK So when I create a new Datasource using

great_expectations datasource new

I end up with generator Section that looks like this:
generators:
subdir_reader:
class_name: SubdirReaderBatchKwargsGenerator
base_directory: …/…/DataLake/GE/Residential

Is there someway to influence Generator being used so that I can use GlobReader instead?

I’m also open to using the python code instead of CLI, It looks like the module docs will be useful to that respect. Just asking for CLI

Best,

2

To modify/add/remove BatchKwargsGenerators of a datasource, you have to edit the great_expectations.yml config file of you DataContext (project).

The CLI currently provides no control over BatchKwargsGenerators.

This reference explains how to configure various generators:
https://docs.greatexpectations.io/en/latest/module_docs/generator_module.html#generator-module