Write/Update Only S3-hosted Data Docs on S3

Archive
,
3

Hi Eugene, and thanks for such a detailed explanation.
One question - can we achieve having a shared validation store on s3, as you described while having separate GE Data Contexts (just with the same validation store parameters)?

PS Actually I checked my yaml config, and it has the s3 config for validations

validations_S3_store:
        class_name: ValidationsStore
        store_backend:
            class_name: TupleS3StoreBackend
            bucket: ${AWS_BUCKET}
            prefix: research/great_expectations/validations/

should that be sufficient? It still triggers GE to try remove keys from s3, so…

1 Like