# Data Docs update problem

**URL:** <https://discourse.greatexpectations.io/t/data-docs-update-problem/2409>\
**Category:** GX Core Support\
**Tags:** how-to, help-wanted\
**Created:** [November 5, 2026, 1:15pm UTC](https://discourse.greatexpectations.io/t/data-docs-update-problem/2409 "2026-11-05T13:15:58Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Kamran](https://avatars.discourse-cdn.com/v4/letter/k/b9e5f3/32.png) [@Kamran](https://discourse.greatexpectations.io/u/Kamran)\
**Post date:** [November 5, 2026, 1:15pm UTC](https://discourse.greatexpectations.io/t/data-docs-update-problem/2409/1 "2026-11-05T13:15:58Z")

</div>

Hi,  
I have Airflow dag runs almost 100 Spark jobs and each spark job has a checkpoint run inside and every checkpoint has action for update data docs that immediately seen from gx UI. When I run the all task from dag sometimes it gives GX validations error about  
No such file or directory: ‘/XXXX/gx/uncommitted/data\_docs/local\_site/validations/XXX\_\_suites/XXX\_20260927\_27812261/20261105T075844.216073Z/XXX.html’ but ‘XXX’ is not my current validation task name. It gives error for other task. I believe it is concurrency problem because every checkpoint update shared data docs. Is it a problem to write concurrent update to data docs for every checkpoint? Should I update data docs at the end of the process or is there any other way? I do not get what is the problem? (I am new to Great Expectation)

---

<div class="post-metadata">

**Author:** ![joshstauffer](https://avatars.discourse-cdn.com/v4/letter/j/85e7bf/32.png) [@joshstauffer](https://discourse.greatexpectations.io/u/joshstauffer)\
**Post date:** [November 5, 2026, 2:42pm UTC](https://discourse.greatexpectations.io/t/data-docs-update-problem/2409/2 "2026-11-05T14:42:09Z")

</div>

Hey @Kamran, thanks for the question. I can’t say with certainty what’s happening without seeing the stack trace of the error and your config, but it’s very likely a concurrency issue caused by multiple processes writing to the same DataDocs directory. The individual file writes are probably not the issue, but there’s a race condition on the index rewrite that is probably causing this behavior.

Since the UpdateDataDocsAction updates the index without a lock, the best approach is to have a single data docs writer. Remove the UpdateDataDocsAction from your Checkpoint config and move the data docs build to the end of your dag, then have a task call context.build\_data\_docs() after every checkpoint has completed. You could also have that task run more regularly across the run, either at select places in the dag or on a schedule, if getting close to real-time updates in the UI is valuable. Either way, avoid having two or more task writing Data Docs concurrently, and this intermittent error should go away.

---

<div class="post-metadata">

**Author:** ![Kamran](https://avatars.discourse-cdn.com/v4/letter/k/b9e5f3/32.png) [@Kamran](https://discourse.greatexpectations.io/u/Kamran)\
**Post date:** [November 6, 2026, 2:13pm UTC](https://discourse.greatexpectations.io/t/data-docs-update-problem/2409/3 "2026-11-06T14:13:48Z")

</div>

Thanks for your time and quick answer Josh.
