How do I prevent GX from creating temporary tables in my DB?

[austin_gx]

View in #gx-community-support on Slack

@Albert_H_Sun: Hello everyone, do you have any idea on how to use GX to test data in a rdbms that doesn’t support CREATE TEMPORARY TABLE AS SELECT ? In my case I’m using tidb, which only supports grammar like :
CREATE TEMPORARY TABLE users (
id BIGINT,
name VARCHAR(100),
city VARCHAR(50),
PRIMARY KEY(id)
);

[austin_gx]

@Austin_Robinson_(GX): Hey @Albert_H_Sun! Thanks for reaching out.

You can pass create_temp_table as False to your Datasource.

Depending on how your datasource is configured, that may look like:

datasource = great_expectations.datasource.fluent.SQLDatasource(..., create_temp_table=False)

or something like:

datasource_config: dict = {
    "name": "my_datasource_name",
    "class_name": "Datasource",
    "module_name": "great_expectations.datasource",
    "execution_engine": {
        "class_name": "SqlAlchemyExecutionEngine",
        "module_name": "great_expectations.execution_engine",
        "connection_string": CONNECTION_STRING,
        "create_temp_table": False
    },
}

@Albert_H_Sun: @Austin_Robinson_(GX) thank you so much! Finally it works~~~~

[Mfaisal]

hi @austin_gx , Does this solution work for MS-SQL Server Data source ?

[austin_gx]

Hey @Mfaisal – tagging in @rachel.house or @nevintan to answer this definitively – but to my knowledge this should hold true for any datasources supported by GX.