Fluent datasources bucket env variable substitution

GX Core Support
1

Hello guys,
I am using a fluent datasource of type pandas_s3. The problem is that when I run checkpoint the bucket variable it is not replaced and it gives me this error:

File “/usr/local/lib/python3.9/site-packages/botocore/handlers.py”, line 285, in validate_bucket_name
raise ParamValidationError(report=error_msg)
botocore.exceptions.ParamValidationError: Parameter validation failed:*
Invalid bucket name “${S3_BUCKET}”: Bucket name must match the regex “[a-zA-Z0-9.-_]{1,255}$” or be an ARN matching the regex "^arn:(aws).:(s3|s3-object-lambda):[a-z-0-9]:[0-9]{12}:accesspoint[/:][a-zA-Z0-9-.]{1,63}$|^arn:(aws).:s3-outposts:[a-z-0-9]+:[0-9]{12}:outpost[/:][a-zA-Z0-9-]{1,63}[/:]accesspoint[/:][a-zA-Z0-9-]{1,63}$*

variable S3_BUCKET is in the os.environ.items() in fact, the expectations_S3_store works.

Here my configuraton

stores:
  expectations_S3_store:
    class_name: ExpectationsStore
    store_backend:
      class_name: TupleS3StoreBackend
      bucket: ${S3_BUCKET}
      prefix: data_quality/expectations/
[.......]
fluent_datasources:
  datasource_raw:
    type: pandas_s3
    assets:
      my_asset_raw:
        type: parquet
        batching_regex: (.*)\.parquet
        connect_options:
          s3_prefix: data/raw_layer/global_data_raw/
    bucket: ${S3_BUCKET}

Thank you!

2

Has anyone else had the same issue with Fluent DataSource?