# How do I work with multiple batches of data in GE?

**URL:** <https://discourse.greatexpectations.io/t/how-do-i-work-with-multiple-batches-of-data-in-ge/339>\
**Category:** Archive\
**Created:** [August 20, 2020, 9:05pm UTC](https://discourse.greatexpectations.io/t/how-do-i-work-with-multiple-batches-of-data-in-ge/339 "2020-08-20T21:05:33Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![jpcampbell42](https://avatars.discourse-cdn.com/v4/letter/j/838e76/32.png) [@jpcampbell42](https://discourse.greatexpectations.io/u/jpcampbell42)\
**Post date:** [August 20, 2020, 9:05pm UTC](https://discourse.greatexpectations.io/t/how-do-i-work-with-multiple-batches-of-data-in-ge/339/1 "2020-08-20T21:05:33Z")

</div>

In Great Expectations, a “Data Asset” is a logical collection of records, potentially split across different “batches.”

Often users mean one of three kinds of actions when they talk about “multibatch” workflows:

1. Performing an action, such as validation, on batches in serial, for example evaluating each new day’s data against the same expectation suite. We support that use case with a “batch kwargs generator”.

2. Using a collection of batches to compute statistics, for example to state an expectation about what the expected number of rows in a future **single** batch might be (building an anomaly detector). We call that “BatchLooping”.

3. Stating expectations about the relationship between multiple batches of data at the same time, such as expecting that the average number of rows in a **collection** of batches is in some defined range.

- Great Expectations does not currently support this use case, but we’re planning to build support in the future.

To use a batch kwargs generator with BigQuery, you would create batches by following the guide here: [https://docs.greatexpectations.io/en/latest/guides/how\_to\_guides/creating\_batches/how\_to\_load\_a\_database\_table\_view\_or\_query\_result\_as\_a\_batch.html](https://docs.greatexpectations.io/en/latest/guides/how_to_guides/creating_batches/how_to_load_a_database_table_view_or_query_result_as_a_batch.html) and modifying the `query_parameters` and the target query to loop over desired days.

Unfortunately, it’s not currently possible to use the QueryBatchKwargsGenerator to identify available partitions, so you would need to know the batches/days you want to loop over externally.