# Not able to set persist to False using Spark Execution Engine

**URL:** <https://discourse.greatexpectations.io/t/not-able-to-set-persist-to-false-using-spark-execution-engine/1320>\
**Category:** GX Core Support\
**Created:** [August 7, 2023, 8:45pm UTC](https://discourse.greatexpectations.io/t/not-able-to-set-persist-to-false-using-spark-execution-engine/1320 "2023-08-07T20:45:43Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![jose.correia](https://yyz1.discourse-cdn.com/flex031/user_avatar/discourse.greatexpectations.io/jose.correia/32/251_2.png) [@jose.correia](https://discourse.greatexpectations.io/u/jose.correia)\
**Post date:** [August 7, 2023, 8:45pm UTC](https://discourse.greatexpectations.io/t/not-able-to-set-persist-to-false-using-spark-execution-engine/1320/1 "2023-08-07T20:45:43Z")

</div>

Hey Guys, I was trying to migrate GX from 0.16.5 and am not being able to, cause apparently since GX 0.16.12 supposedly there was a fix for the persist parameter to work. The thing is that I wanted it to be False, but it seems the parameter is not taking effect.  
Anyone facing similar problems?  
I was following this guide [How to connect to in-memory data in a Spark dataframe | Great Expectations](https://docs.greatexpectations.io/docs/0.15.50/guides/connecting_to_your_data/in_memory/spark/), which seems to have been removed. Also tried with fluent approach and still failing.  
Is the property persist being considered/passed? Shouldn’t it be one of the parameters in add\_or\_update\_spark ?

 ![image](https://canada1.discourse-cdn.com/flex031/uploads/greatexpectations/original/1X/9c31c1074d41ef63ba289ecfd0d5f82fd0cba70f.png)

---

<div class="post-metadata">

**Author:** ![jose.correia](https://yyz1.discourse-cdn.com/flex031/user_avatar/discourse.greatexpectations.io/jose.correia/32/251_2.png) [@jose.correia](https://discourse.greatexpectations.io/u/jose.correia)\
**Post date:** [August 8, 2023, 5:39pm UTC](https://discourse.greatexpectations.io/t/not-able-to-set-persist-to-false-using-spark-execution-engine/1320/2 "2023-08-08T17:39:58Z")

</div>

Created this PR to try to address it. [[BUGFIX] Fixed persist to be considered for spark fluent datasource by jmcorreia · Pull Request #8512 · great-expectations/great\_expectations · GitHub](https://github.com/great-expectations/great_expectations/pull/8512)