COMPLETE result_format not working on some expectations

GX Core Support
1

Hello Everyone,
I want to have the complete result of my validations and not just the basic. I run the following code to modify the checkpoint and then run it.

checkpoint = gx.checkpoint.SimpleCheckpoint(
            name=f"{asset_name.replace('/', '_')}_test",
            data_context=context,
            validations=[
                {
                    "batch_request": my_batch_request,
                    "expectation_suite_name": expectation,
                },
            ],
            runtime_configuration={
                    "result_format": {
                        "result_format": "COMPLETE",
                        "unexpected_index_column_names": ["column:1", "KID"],
                        "return_unexpected_index_query": True,
                        "include_unexpected_rows": True
                    },
                },
        )

        print("running expectations on: ", asset_name)
        checkpoint.run()

However I have noticed in the validation.json output, that it doesn’t create the COMPLETE result format for every expectation. My expectation suite has 3 expectations and looks like this:

{
  "data_asset_type": null,
  "expectation_suite_name": "Exp_1",
  "expectations": [
    {
      "expectation_type": "expect_column_values_to_be_unique",
      "kwargs": {
        "column": "column_1"
      },
      "meta": {
        "notes": {
          "content": "For testing purposes. **Markdown** `Supported`",
          "format": "markdown"
        }
      }
    },
    {
      "expectation_type": "expect_column_distinct_values_to_be_in_set",
      "kwargs": {
        "column": "column_1",
        "value_set": [
          "Kat 2: Pauke",
          "Kat 2: Grosse Trommel",
          "Kat 2: Kleine Trommel",
          "Kat 2: Becken",
          "Kat 2: Triangel",
          "Kat 2: Steeldrum",
          "Kat 3: Trompete",
          "Kat 3: Tuba",
          "Kat 3: Posaune",
          "Kat 4: Piccolofl\u00f6te",
          "Kat 4: Klarinette",
          "Kat 4: Saxophone",
          "Kat 4: Sousaphone",
          "Kat 5: Dudelsack",
          "Kat 6: Mikrophone",
          "Kat 6: Verst\u00e4rker",
          "Kat 6: Lautsprecher",
          "Kat 7: Minibus 9 Pl\u00e4tze",
          "Kat 7: Minibus 14 Pl\u00e4tze",
          "Kat 8: Anh\u00e4nger Minibus"
        ]
      },
      "meta": {
        "notes": {
          "content": "For testing purposes. **Markdown** `Supported`",
          "format": "markdown"
        }
      }
    },
    {
      "expectation_type": "expect_column_values_to_be_unique",
      "kwargs": {
        "column": "KID"
      },
      "meta": {
        "notes": {
          "content": "For testing purposes. **Markdown** `Supported`",
          "format": "markdown"
        }
      }
    }
  ],
  "ge_cloud_id": null,
  "meta": {
    "great_expectations_version": "0.16.16"
  }
]

The complete result is being generated however for “expect_column_values_to_be_unique” but not for “expect_column_distinct_values_to_be_in_set”.
Is there something specific I need to write in the expectation suite for that expectation?
OS_VERSION: Ubuntu 22.04
GX_VERSION: latest (edited)

2

Since you’re providing an index, I’m guessing you are looking for the primary key of each row that does not have its value from your set. In that case, you may want to use expect_column_values_to_be_in_set instead of expect_column_distinct_values_to_be_in_set. expect_column_distinct_values_to_be_in_set will only provide the aggregate result by design – it looks at distinct values first and then compares to the value_set.