Suppose i have a source table and has two columns first name and last name.By applying ETL logic some transformation happens and in the target table it is inserted as “First name Last name” in name column in target table.
Is it possible in great expectations to handle such kind of transformation logic with custom expectations or any way around.
Sure, it can be easily done by a custom expectation, you need to use the columnMapexpectation class for this one.
On a high level, Great Expectations renders the filter conditions to be sent to sqlalchemy , think of your condition as a sa.filter clause here. You can put any sql logic you want, and ge will pass that to backend sql alchemy as a filter.
Hope it helps !