# GX Core Support

**URL:** https://discourse.greatexpectations.io/c/gx-core-support/11.md?page=1

[Latest](https://discourse.greatexpectations.io/latest.md) · [Categories](https://discourse.greatexpectations.io/categories.md) · [Tags](https://discourse.greatexpectations.io/tags.md)

**Page:** 2

---

## [ExpectTableRowCountToBeBetween seems to ignore row\_condition](https://discourse.greatexpectations.io/t/expecttablerowcounttobebetween-seems-to-ignore-row-condition/2275)

<div class="topic-metadata">

**Author:** [@mike\_f50](https://discourse.greatexpectations.io/u/mike_f50)\
**Replies:** 3\
**Last updated:** [October 31, 2025, 11:59am UTC](https://discourse.greatexpectations.io/t/expecttablerowcounttobebetween-seems-to-ignore-row-condition/2275 "2025-10-31T11:59:40Z")

</div>

In GX 1.5.7, my ExpectTableRowCountToBeBetween expectations seem to be ignoring their row\_conditions. Inspecting the results, the observed\_value in each case is the entire table row count, not just the rows satisfying t…

---

## [Multiple Full Data Scans When Validating a DataFrame with Multiple Expectations](https://discourse.greatexpectations.io/t/multiple-full-data-scans-when-validating-a-dataframe-with-multiple-expectations/2294)

<div class="topic-metadata">

**Author:** [@RohanSingh](https://discourse.greatexpectations.io/u/RohanSingh)\
**Replies:** 1\
**Last updated:** [October 27, 2025, 8:41am UTC](https://discourse.greatexpectations.io/t/multiple-full-data-scans-when-validating-a-dataframe-with-multiple-expectations/2294 "2025-10-27T08:41:39Z")

</div>

When validating a Spark DataFrame with multiple expectations, the Great Expectations validation process appears to trigger multiple full scans of the source data. This results in an exponential increase in the observed “…

---

## [GX validation Result returns broken query "unexpected\_index\_query"](https://discourse.greatexpectations.io/t/gx-validation-result-returns-broken-query-unexpected-index-query/2039)

<div class="topic-metadata">

**Author:** [@Jyoti\_Thakkar](https://discourse.greatexpectations.io/u/Jyoti_Thakkar)\
**Replies:** 3\
**Last updated:** [October 27, 2025, 8:26am UTC](https://discourse.greatexpectations.io/t/gx-validation-result-returns-broken-query-unexpected-index-query/2039 "2025-10-27T08:26:11Z")

</div>

Using GX 1.2.3 version we have set result\_format as “COMPLETE” and unexpected\_index\_query to true, we want to use unexpected\_index\_query to get the error records from dataframe. It seems that it is returning broken quer…

---

## [Implementing GX Core to process multiple files/tables](https://discourse.greatexpectations.io/t/implementing-gx-core-to-process-multiple-files-tables/2306)

<div class="topic-metadata">

**Author:** [@mara557](https://discourse.greatexpectations.io/u/mara557)\
**Replies:** 0\
**Last updated:** [October 25, 2025, 1:53pm UTC](https://discourse.greatexpectations.io/t/implementing-gx-core-to-process-multiple-files-tables/2306 "2025-10-25T13:53:27Z")

</div>

Hello everyone, I’m new to this and would like to ask whether it’s possible to implement the GX Core library so that it can run across multiple, unrelated files. We handle several projects where we may ingest dozens of…

---

## [Columns are missing in BatchData with Trino datasource](https://discourse.greatexpectations.io/t/columns-are-missing-in-batchdata-with-trino-datasource/2299)

<div class="topic-metadata">

**Author:** [@Jace](https://discourse.greatexpectations.io/u/Jace)\
**Replies:** 2\
**Last updated:** [October 22, 2025, 8:57am UTC](https://discourse.greatexpectations.io/t/columns-are-missing-in-batchdata-with-trino-datasource/2299 "2025-10-22T08:57:49Z")

</div>

Hi everyone, Here im trying to do validation with Trino connection. However it seems that GX are not recognizing or missing the columns information from table, because column type expectations are returning: “exception…

---

## [Is unexpected\_index\_query will be generated in result format "Summary"](https://discourse.greatexpectations.io/t/is-unexpected-index-query-will-be-generated-in-result-format-summary/2304)

<div class="topic-metadata">

**Author:** [@Swarup](https://discourse.greatexpectations.io/u/Swarup)\
**Replies:** 0\
**Last updated:** [October 11, 2025, 3:47pm UTC](https://discourse.greatexpectations.io/t/is-unexpected-index-query-will-be-generated-in-result-format-summary/2304 "2025-10-11T15:47:29Z")

</div>

Is yes can someone help me to get that?

---

## [Python 3.13 support](https://discourse.greatexpectations.io/t/python-3-13-support/2297)

<div class="topic-metadata">

**Author:** [@bidek56](https://discourse.greatexpectations.io/u/bidek56)\
**Replies:** 1\
**Last updated:** [October 8, 2025, 2:31pm UTC](https://discourse.greatexpectations.io/t/python-3-13-support/2297 "2025-10-08T14:31:44Z")

</div>

When can we expect Python 3.13 support for GE? Thx

---

## [Group By Expectations. 1.6.4](https://discourse.greatexpectations.io/t/group-by-expectations-1-6-4/2300)

<div class="topic-metadata">

**Author:** [@filiphjartstrom](https://discourse.greatexpectations.io/u/filiphjartstrom)\
**Replies:** 0\
**Last updated:** [October 7, 2025, 8:28am UTC](https://discourse.greatexpectations.io/t/group-by-expectations-1-6-4/2300 "2025-10-07T08:28:20Z")

</div>

Hello! I have searched the docs and git and cannot figure something out: Lets say i want to use the ExpectColumnSumToBeBetween expectation. How can I group by another column? For example: Group purchases by country and…

---

## [Need to know about the capabilities of Great Expectations tool](https://discourse.greatexpectations.io/t/need-to-know-about-the-capabilities-of-great-expectations-tool/2298)

<div class="topic-metadata">

**Author:** [@Parth](https://discourse.greatexpectations.io/u/Parth)\
**Replies:** 1\
**Last updated:** [September 25, 2025, 12:40pm UTC](https://discourse.greatexpectations.io/t/need-to-know-about-the-capabilities-of-great-expectations-tool/2298 "2025-09-25T12:40:39Z")

</div>

I have an application built in .NET, for which I need to validate the data by using a data quality tool before storing it. I need following requirements to be met by the tool: Simple deployment model Good Performance S…

---

## [Is there any alternative for GX v1 Data Profiler?](https://discourse.greatexpectations.io/t/is-there-any-alternative-for-gx-v1-data-profiler/2083)

<div class="topic-metadata">

**Author:** [@tegar](https://discourse.greatexpectations.io/u/tegar)\
**Replies:** 3\
**Last updated:** [September 8, 2025, 10:05am UTC](https://discourse.greatexpectations.io/t/is-there-any-alternative-for-gx-v1-data-profiler/2083 "2025-09-08T10:05:00Z")

</div>

Hi, our company deploying GX to handle data quality, I saw in earlier version we can run the data profiler using BasicDatasetProfiler, is there any alternative method or maybe current function that have the ability to do…

---

## [Problem with data\_source.add\_query\_asset](https://discourse.greatexpectations.io/t/problem-with-data-source-add-query-asset/2290)

<div class="topic-metadata">

**Author:** [@StacyStacy](https://discourse.greatexpectations.io/u/StacyStacy)\
**Replies:** 1\
**Last updated:** [September 1, 2025, 6:49pm UTC](https://discourse.greatexpectations.io/t/problem-with-data-source-add-query-asset/2290 "2025-09-01T18:49:04Z")

</div>

Not work standart expectations connection\_string = f"trino://{user}:{password}@{host}:{port}/{catalog}/{schema}?verify=false&http\_scheme=https" query\_asset = data\_source.add\_query\_asset( name=asset\_name, query=”sele…

---

## [Having Trouble with specifying context file with UNC path](https://discourse.greatexpectations.io/t/having-trouble-with-specifying-context-file-with-unc-path/2288)

<div class="topic-metadata">

**Author:** [@Laxmi884](https://discourse.greatexpectations.io/u/Laxmi884)\
**Replies:** 0\
**Last updated:** [August 25, 2025, 11:02pm UTC](https://discourse.greatexpectations.io/t/having-trouble-with-specifying-context-file-with-unc-path/2288 "2025-08-25T23:02:35Z")

</div>

I’m encountering an issue when specifying the context file path for checkpoints. When I use a mapped network drive (e.g., L:/My\_Folder), everything works fine. However, when I switch to using the UNC path (e.g., \\\\shared…

---

## [Keep getting batch\_definition name already exists - In Databricks](https://discourse.greatexpectations.io/t/keep-getting-batch-definition-name-already-exists-in-databricks/2285)

<div class="topic-metadata">

**Author:** [@Harpreet](https://discourse.greatexpectations.io/u/Harpreet)\
**Replies:** 1\
**Last updated:** [August 23, 2025, 2:09am UTC](https://discourse.greatexpectations.io/t/keep-getting-batch-definition-name-already-exists-in-databricks/2285 "2025-08-23T02:09:30Z")

</div>

Hello everyone, I am new to GX core and I am currently tryint to setup in Databricks notebook. On my first instance I was able to script and run an expectation but from the next day while running the same script I kee…

---

## [Connect to trino with special symbol](https://discourse.greatexpectations.io/t/connect-to-trino-with-special-symbol/2287)

<div class="topic-metadata">

**Author:** [@StacyStacy](https://discourse.greatexpectations.io/u/StacyStacy)\
**Replies:** 0\
**Last updated:** [August 21, 2025, 10:07am UTC](https://discourse.greatexpectations.io/t/connect-to-trino-with-special-symbol/2287 "2025-08-21T10:07:06Z")

</div>

Hello I’m trying connect to trino, but my password have special symbols(quote and quote\_plus not working in string conectation in SQLAlchemy (trino) context = gx.get\_context(mode="file") conn\_str = f"trino://{user}@{h…

---

## [ExpectMulticolumnSumToEqual: binary floating point arithmetic issue](https://discourse.greatexpectations.io/t/expectmulticolumnsumtoequal-binary-floating-point-arithmetic-issue/2277)

<div class="topic-metadata">

**Author:** [@jrfwhite](https://discourse.greatexpectations.io/u/jrfwhite)\
**Replies:** 0\
**Last updated:** [August 6, 2025, 3:46pm UTC](https://discourse.greatexpectations.io/t/expectmulticolumnsumtoequal-binary-floating-point-arithmetic-issue/2277 "2025-08-06T15:46:26Z")

</div>

Hello, first time poster here so apologies in advance, but here goes… I’m using the ExpectMulticolumnSumToEqual expectation (with v1.5.6) to check that the sum of some pandas DataFrame columns is equal to 100, for examp…

---

## [Expectations Suite: Expectations with same type only the last one is evaluated and results provided](https://discourse.greatexpectations.io/t/expectations-suite-expectations-with-same-type-only-the-last-one-is-evaluated-and-results-provided/2274)

<div class="topic-metadata">

**Author:** [@caudex](https://discourse.greatexpectations.io/u/caudex)\
**Replies:** 1\
**Last updated:** [August 5, 2025, 11:17am UTC](https://discourse.greatexpectations.io/t/expectations-suite-expectations-with-same-type-only-the-last-one-is-evaluated-and-results-provided/2274 "2025-08-05T11:17:12Z")

</div>

The problem i am having is where i have a validator and expectation suite with multiple of the same expectation types and only executes the last one in the list. I’ve added 3 expectations (2 with same type and 1 differe…

---

## [ERROR: Could not create .gitignore in Read-only file system](https://discourse.greatexpectations.io/t/error-could-not-create-gitignore-in-read-only-file-system/2255)

<div class="topic-metadata">

**Author:** [@Jimmy\_Jing](https://discourse.greatexpectations.io/u/Jimmy_Jing)\
**Replies:** 3\
**Last updated:** [August 4, 2025, 2:00pm UTC](https://discourse.greatexpectations.io/t/error-could-not-create-gitignore-in-read-only-file-system/2255 "2025-08-04T14:00:19Z")

</div>

Dear team, We are currently using Great Expectations (GX) version 1.4.6 in our firm. During initialization, a .gitignore file is created in the gx folder. This file is included in our code repository and pushed through …

---

## [Config variable substitution in great\_expectations.yml](https://discourse.greatexpectations.io/t/config-variable-substitution-in-great-expectations-yml/2272)

<div class="topic-metadata">

**Author:** [@JoaoLarrosa](https://discourse.greatexpectations.io/u/JoaoLarrosa)\
**Replies:** 0\
**Last updated:** [July 30, 2025, 8:27pm UTC](https://discourse.greatexpectations.io/t/config-variable-substitution-in-great-expectations-yml/2272 "2025-07-30T20:27:49Z")

</div>

Hi, guys! How you doing? :smiley: I’ve been studying GX to implement it in the company I work. We use Snowflake as our datalake. I’ve been facing trouble to replace variables declared in config\_variables.yml in great\_ex…

---

## [SUMMARY validation in SparkExecutionEngine triggers excessive collect() calls](https://discourse.greatexpectations.io/t/summary-validation-in-sparkexecutionengine-triggers-excessive-collect-calls/2269)

<div class="topic-metadata">

**Author:** [@Alvaro](https://discourse.greatexpectations.io/u/Alvaro)\
**Replies:** 0\
**Last updated:** [July 29, 2025, 10:43am UTC](https://discourse.greatexpectations.io/t/summary-validation-in-sparkexecutionengine-triggers-excessive-collect-calls/2269 "2025-07-29T10:43:32Z")

</div>

Hi everyone, I’ve been experimenting with Great Expectations on Spark, and I’ve noticed some unexpected behavior when switching from a “BASIC” validation to a “SUMMARY” validation that returns unexpected rows. I’m work…

---

## [Unable to run ‘ExpectColumnPairValuesToBeEqual’ with spark on Databricks](https://discourse.greatexpectations.io/t/unable-to-run-expectcolumnpairvaluestobeequal-with-spark-on-databricks/2062)

<div class="topic-metadata">

**Author:** [@motaslimi](https://discourse.greatexpectations.io/u/motaslimi)\
**Replies:** 9\
**Last updated:** [July 28, 2025, 12:12pm UTC](https://discourse.greatexpectations.io/t/unable-to-run-expectcolumnpairvaluestobeequal-with-spark-on-databricks/2062 "2025-07-28T12:12:38Z")

</div>

When I’m trying to validate any expectation with parameters column\_A, column\_B, I get the following error: \[CANNOT\_RESOLVE\_DATAFRAME\_COLUMN\] Cannot resolve dataframe column "col\_1". It’s probably because of illegal refe…

---

## [Not able to create a Expectation suite with Oracle DB and not able to generate data docs](https://discourse.greatexpectations.io/t/not-able-to-create-a-expectation-suite-with-oracle-db-and-not-able-to-generate-data-docs/2266)

<div class="topic-metadata">

**Author:** [@Manojkumar\_C](https://discourse.greatexpectations.io/u/Manojkumar_C)\
**Replies:** 0\
**Last updated:** [July 28, 2025, 7:10am UTC](https://discourse.greatexpectations.io/t/not-able-to-create-a-expectation-suite-with-oracle-db-and-not-able-to-generate-data-docs/2266 "2025-07-28T07:10:58Z")

</div>

We use both gx older and newer version. What is the recommended way to trigger HTML report in the new GX version to ensure it behaves like the older versions report? we use some temporary solution for querying the DB. w…

---

## [Unexpected\_list is limited to 200 rows even after i precise my result\_format to COMPLETE](https://discourse.greatexpectations.io/t/unexpected-list-is-limited-to-200-rows-even-after-i-precise-my-result-format-to-complete/2059)

<div class="topic-metadata">

**Author:** [@Hamza](https://discourse.greatexpectations.io/u/Hamza)\
**Replies:** 1\
**Last updated:** [July 23, 2025, 4:25am UTC](https://discourse.greatexpectations.io/t/unexpected-list-is-limited-to-200-rows-even-after-i-precise-my-result-format-to-complete/2059 "2025-07-23T04:25:59Z")

</div>

Hello, when i went from v0 to v1 the rows of unexpected\_values went from 83k to 1.9k as in 200 maximum rows per rule, is there any way to bypass this limit to have the same result I had before. Please note that my resul…

---

## [GE run fails on AWS Airflow with File System \[Errno 30\] Read-only file system: '/usr/local/airflow/dags/data-quality/gx'; 3080](https://discourse.greatexpectations.io/t/ge-run-fails-on-aws-airflow-with-file-system-errno-30-read-only-file-system-usr-local-airflow-dags-data-quality-gx-3080/1704)

<div class="topic-metadata">

**Author:** [@zfromsyd](https://discourse.greatexpectations.io/u/zfromsyd)\
**Replies:** 6\
**Last updated:** [July 16, 2025, 5:20pm UTC](https://discourse.greatexpectations.io/t/ge-run-fails-on-aws-airflow-with-file-system-errno-30-read-only-file-system-usr-local-airflow-dags-data-quality-gx-3080/1704 "2025-07-16T17:20:58Z")

</div>

Hi, We are upgrading Great Expectations to 0.18.10. We are currently experiencing a blocker issue from one of the packages that throws a read-only file system error. great-expectations version 0.18.10 airflow-provider…

---

## [Not able to create expectation suite and data docs in databricks using spark](https://discourse.greatexpectations.io/t/not-able-to-create-expectation-suite-and-data-docs-in-databricks-using-spark/2251)

<div class="topic-metadata">

**Author:** [@akhilrajput](https://discourse.greatexpectations.io/u/akhilrajput)\
**Replies:** 0\
**Last updated:** [July 9, 2025, 2:39pm UTC](https://discourse.greatexpectations.io/t/not-able-to-create-expectation-suite-and-data-docs-in-databricks-using-spark/2251 "2025-07-09T14:39:14Z")

</div>

Hi Team, We are doing a POC to implement Great Expectations in our Databricks data pipelines for that we wrote a code to read a csv file, created data context on Databricks volumes and tried creating expectations as par…

---

## [Performance of Spark Dataframe Execution Engine](https://discourse.greatexpectations.io/t/performance-of-spark-dataframe-execution-engine/2237)

<div class="topic-metadata">

**Author:** [@lcoogan](https://discourse.greatexpectations.io/u/lcoogan)\
**Replies:** 1\
**Last updated:** [July 7, 2025, 1:27pm UTC](https://discourse.greatexpectations.io/t/performance-of-spark-dataframe-execution-engine/2237 "2025-07-07T13:27:43Z")

</div>

Hello, I’ve been trying for the past few weeks to implement GX Core on some infrastructure that accesses data in a non-standard way. I don’t have a SQL connection string to expose GX to, but I can run PySpark code insid…

---

## [Does GX Support Unity Catalog enabled Workspace](https://discourse.greatexpectations.io/t/does-gx-support-unity-catalog-enabled-workspace/1395)

<div class="topic-metadata">

**Author:** [@sanath](https://discourse.greatexpectations.io/u/sanath)\
**Replies:** 2\
**Last updated:** [July 3, 2025, 3:21pm UTC](https://discourse.greatexpectations.io/t/does-gx-support-unity-catalog-enabled-workspace/1395 "2025-07-03T15:21:28Z")

</div>

I am exploring GX for one of the projects that I am working on and I am using Databricks in azure hosted environment I have my workspace integrated with the Unity catalog. In this situation how do I use GX as mounting is…

---

## [Connection Timeout and Suite/Checkpoint Not Found in Multi-threaded Execution (Using Separate Contexts per Thread)](https://discourse.greatexpectations.io/t/connection-timeout-and-suite-checkpoint-not-found-in-multi-threaded-execution-using-separate-contexts-per-thread/2242)

<div class="topic-metadata">

**Author:** [@DataWings](https://discourse.greatexpectations.io/u/DataWings)\
**Replies:** 0\
**Last updated:** [July 2, 2025, 5:33pm UTC](https://discourse.greatexpectations.io/t/connection-timeout-and-suite-checkpoint-not-found-in-multi-threaded-execution-using-separate-contexts-per-thread/2242 "2025-07-02T17:33:53Z")

</div>

Hi Great Expectations team and community, I’m using Great Expectations with PySpark DataFrames in Databricks for data validation, following this general flow wrapped in a function: Create a new EphermalDataContext Cre…

---

## [Can we specify the data schema in yaml config?](https://discourse.greatexpectations.io/t/can-we-specify-the-data-schema-in-yaml-config/1609)

<div class="topic-metadata">

**Author:** [@mike\_f50](https://discourse.greatexpectations.io/u/mike_f50)\
**Replies:** 8\
**Last updated:** [July 2, 2025, 11:32am UTC](https://discourse.greatexpectations.io/t/can-we-specify-the-data-schema-in-yaml-config/1609 "2025-07-02T11:32:47Z")

</div>

We currently set up our CSV batch requests with “inferSchema: True”. However, we sometimes receive a data file where a datetime column contains all nulls. As one might expect, the engine does not identify the column as…

---

## [How to run a checkpoint to validate multiple dataframes](https://discourse.greatexpectations.io/t/how-to-run-a-checkpoint-to-validate-multiple-dataframes/2015)

<div class="topic-metadata">

**Author:** [@May](https://discourse.greatexpectations.io/u/May)\
**Replies:** 5\
**Last updated:** [July 1, 2025, 12:28pm UTC](https://discourse.greatexpectations.io/t/how-to-run-a-checkpoint-to-validate-multiple-dataframes/2015 "2025-07-01T12:28:39Z")

</div>

Hi, I am using GX version 1.2.4 My scenario is to validate a spark dataframe where some columns are array, but GX does not support validating array. My current approach is splitting those array columns into new datafram…

---

## [Unable to load context](https://discourse.greatexpectations.io/t/unable-to-load-context/2239)

<div class="topic-metadata">

**Author:** [@Bhavana](https://discourse.greatexpectations.io/u/Bhavana)\
**Replies:** 0\
**Last updated:** [July 1, 2025, 12:14pm UTC](https://discourse.greatexpectations.io/t/unable-to-load-context/2239 "2025-07-01T12:14:47Z")

</div>

i have a data context created at a custom location using get\_context(mode = ‘file’, context\_root\_dir=path) function. after couple of days, when i try to load the existing context using get\_context(mode = ‘file’, context…

[Previous page](https://discourse.greatexpectations.io/c/gx-core-support/11.md)

[Next page](https://discourse.greatexpectations.io/c/gx-core-support/11.md?page=2)