# Creating Data source for s3 with pandas

**URL:** <https://discourse.greatexpectations.io/t/creating-data-source-for-s3-with-pandas/773>\
**Category:** Archive\
**Tags:** how-to, help-wanted, s3\
**Created:** [June 1, 2021, 8:04am UTC](https://discourse.greatexpectations.io/t/creating-data-source-for-s3-with-pandas/773 "2021-06-01T08:04:47Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Garima93](https://avatars.discourse-cdn.com/v4/letter/g/96bed5/32.png) [@Garima93](https://discourse.greatexpectations.io/u/Garima93)\
**Post date:** [June 1, 2021, 8:04am UTC](https://discourse.greatexpectations.io/t/creating-data-source-for-s3-with-pandas/773/1 "2021-06-01T08:04:47Z")

</div>

We are getting below error when we tried to configure Data Source and read data from s3 in pandas engine GE.

great\_expectations.exceptions.exceptions.BatchKwargsError: Unable to build batch\_kwargs. The asset may not be configured correctly. If s3 returned common prefixes it may not have been able to identify desired keys, and they are included in the incomplete batch\_kwargs object returned with this error.

We tried below configuration but it gives above error

pandas\_s3:  
class\_name: PandasDatasource  
batch\_kwargs\_generators:  
pandas\_s3\_generator:  
class\_name: S3GlobReaderBatchKwargsGenerator  
bucket: xxx-xxx-xxx-xxxxxx-bucket  
reader\_method: read\_csv  
reader\_options:  
sep: “,”  
delimiter: “/”  
assets:  
client\_csv\_file\_test:  
prefix: /xxx/xx-xx-xxxxx/xxxxx/  
regex\_filter: ‘/xxx/xx-xx-xxxxx/xxxxx/Client.\*.csv’  
module\_name: great\_expectations.datasource  
data\_asset\_type:  
class\_name: PandasDataset  
module\_name: great\_expectations.dataset

Can you please help here.

---

<div class="post-metadata">

**Author:** ![eugene.mandel](https://yyz1.discourse-cdn.com/flex031/user_avatar/discourse.greatexpectations.io/eugene.mandel/32/22_2.png) [@eugene.mandel](https://discourse.greatexpectations.io/u/eugene.mandel)\
**Post date:** [June 14, 2021, 3:28pm UTC](https://discourse.greatexpectations.io/t/creating-data-source-for-s3-with-pandas/773/2 "2021-06-14T15:28:31Z")

</div>

@Garima93 Could you please use GitHub issues to report this? Thank you!