TL;DR: pipeline debt is a species of technical debt that infests backend data systems. It drags down productivity and puts analytic integrity at risk. The best way to beat pipeline debt is a new twist on automated testing: pipeline tests, which are applied to data (instead of code) and at batch time (instead of compile or deploy time). We’re releasing Great Expectations, an open-source tool that make it easy to test data pipelines. Come take it for a spin!
This is a companion discussion topic for the original entry at https://greatexpectations.io/blog/down-with-pipeline-debt-introducing-great-expectations/