When we are running below expectation, it is throwing below error.
expectation = gx.expectations.ExpectColumnValuesToBeOfType(
column="test2",
type_="NUMBER",
result_format= "COMPLETE",
)
Exception thrown:
{
"success": false,
"expectation_config": {
"type": "expect_column_values_to_be_of_type",
"kwargs": {
"result_format": "COMPLETE",
"column": "test2",
"type_": "LONG",
"batch_id": "my_data_source-my_dataframe_data_asset"
},
"meta": {}
},
"result": {},
"meta": {},
"exception_info": {
"exception_traceback": "Traceback (most recent call last):\n File \"/home/malam/development/data-qualities/great-expectation-dq/great_expectation_v1/ge-datasource/ge-spark-datasource/.venv/lib/python3.11/site-packages/great_expectations/validator/validator.py\", line 650, in graph_validate\n result = expectation.metrics_validate(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/home/malam/development/data-qualities/great-expectation-dq/great_expectation_v1/ge-datasource/ge-spark-datasource/.venv/lib/python3.11/site-packages/great_expectations/expectations/expectation.py\", line 1150, in metrics_validate\n expectation_validation_result: Union[ExpectationValidationResult, dict] = self._validate(\n ^^^^^^^^^^^^^^^\n File \"/home/malam/development/data-qualities/great-expectation-dq/great_expectation_v1/ge-datasource/ge-spark-datasource/.venv/lib/python3.11/site-packages/great_expectations/expectations/core/expect_column_values_to_be_of_type.py\", line 592, in _validate\n return self._validate_spark(\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/home/malam/development/data-qualities/great-expectation-dq/great_expectation_v1/ge-datasource/ge-spark-datasource/.venv/lib/python3.11/site-packages/great_expectations/expectations/core/expect_column_values_to_be_of_type.py\", line 453, in _validate_spark\n raise ValueError(\"No recognized spark types in expected_types_list\") # noqa: TRY003 # FIXME CoP\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nValueError: No recognized spark types in expected_types_list\n",
"exception_message": "No recognized spark types in expected_types_list",
"raised_exception": true
}
}