I have configured confluent data source, like below. Where I want where condition to be completed using environment variable. This substitution is not working. Is this expected behaviour.
fluent_datasources:
my_snowflake_datasource:
type: snowflake
assets:
query_asset:
type: query
query: select * from table2 where col1 = ‘$col1’
The error I get is
(snowflake.connector.errors.ProgrammingError) 100038 (22018): Numeric value ‘$col1’ is not recognized
[SQL: CREATE OR REPLACE TEMPORARY TABLE gx_temp_bc9445ba AS SELECT *
FROM (SELECT * from table2 where col1 = ‘$col1’) AS anon_1
WHERE true]
(Background on this error at: Error Messages — SQLAlchemy 1.4 Documentation)
variable is set using. export col1=2
Datasource: Snowflake
Execution: Local CLI on Linux
GE Version: 0.18.1