# Reflection being refreshed consecutively **URL:** \ **Category:** Uncategorized\ **Created:** [September 20, 2018, 3:33pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888 "2018-09-20T15:33:23Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![dli16](https://avatars.discourse-cdn.com/v4/letter/d/c5a1d2/32.png) [@dli16](https://community.dremio.com/u/dli16)\ **Post date:** [September 20, 2018, 3:33pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/1 "2018-09-20T15:33:23Z")
I see Dremio keep refreshing the reflection immediately after the prior one finishes: ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/1X/5a2caf1aa57d5fae17694bd34e19d9706cc9f1e6.png) This is a filtered job history view for the particular dataset(890a74b9-bb56-450f-b168-7ae93341bd60). The cycling lasts forever until I disable the reflection on this virtual dataset. Do you have any idea what causing this? Thank you. ---
**Author:** ![can](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/can/32/40_2.png) [@can](https://community.dremio.com/u/can)\ **Post date:** [September 20, 2018, 7:47pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/2 "2018-09-20T19:47:59Z")
Hey @dli16, seems a bit off. What are the Refresh Policies you’ve set on physical datasets that the Balances VDS selects from? ---
**Author:** ![dfleckinger](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/dfleckinger/32/370_2.png) [@dfleckinger](https://community.dremio.com/u/dfleckinger)\ **Post date:** [September 21, 2018, 11:28am UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/3 "2018-09-21T11:28:32Z")
For information, also experienced the same. No particular refresh plociy having a low Refresh delay. ---
**Author:** ![dli16](https://avatars.discourse-cdn.com/v4/letter/d/c5a1d2/32.png) [@dli16](https://community.dremio.com/u/dli16)\ **Post date:** [September 24, 2018, 7:02pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/4 "2018-09-24T19:02:20Z")
It’s 8 hours to refresh and 16 to expire. ---
**Author:** ![igreg](https://avatars.discourse-cdn.com/v4/letter/i/bcef8e/32.png) [@igreg](https://community.dremio.com/u/igreg)\ **Post date:** [February 12, 2019, 7:51pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/5 "2019-02-12T19:51:40Z")
Hi @can I’m also experiencing the same issue with one of my virtual datasets on Elasticsearch source. I have the Refresh Policy as “never refresh” and “never expire”. I’m using Dremio 3.0.6. I have many datasets with reflections however this one keeps refreshing indefinitely as soon as I create the reflection on the data set. I see “REFRESH REFLECTION” and “LOAD MATERIALIZATION METADATA” running one after another until I remove the reflection on the dataset. Is there some way to check whats causing this? ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/6/65d1f2cd9f8e956625e487587acc152b97d44d2e.png) ---
**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\ **Post date:** [February 12, 2019, 7:56pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/6 "2019-02-12T19:56:27Z")
Hi @igreg We have to completely disable reflections to stop refreshing. Can you please send us “select \* from sys.reflections” and send us the JSON download. Also is there a possibility someone is refreshing reflections via a REST API? Thanks @balaji.ramaswamy ---
**Author:** ![igreg](https://avatars.discourse-cdn.com/v4/letter/i/bcef8e/32.png) [@igreg](https://community.dremio.com/u/igreg)\ **Post date:** [February 12, 2019, 8:23pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/7 "2019-02-12T20:23:07Z")
Hi @balaji.ramaswamy Please find the output attached. I needed to mask out the displayColumns field. No one is invoking refresh via the API. This only happens when I initiate a new reflection. The existing reflections are not being refreshed. [tmp-untitled.zip](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/d/d04ced63dc85cc3a2e4ef916f93bbaef12f9de98.zip) (2.7 KB) ---
**Author:** ![igreg](https://avatars.discourse-cdn.com/v4/letter/i/bcef8e/32.png) [@igreg](https://community.dremio.com/u/igreg)\ **Post date:** [February 20, 2019, 7:05pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/8 "2019-02-20T19:05:40Z")
Hi @balaji.ramaswamy Just wondering if you had a chance to look? Looks like the issue is sporadic. It happens for some elasticsearch indexes but not others. ---
**Author:** ![igreg](https://avatars.discourse-cdn.com/v4/letter/i/bcef8e/32.png) [@igreg](https://community.dremio.com/u/igreg)\ **Post date:** [February 25, 2019, 4:03pm UTC](https://community.dremio.com/t/reflection-being-refreshed-consecutively/1888/9 "2019-02-25T16:03:41Z")
Just wanted to share some findings. It looks like whenever a dataset contains a column with an empty list as the value, it causes the reflection creation to fail. In dremio 3.0.6 this then causes the reflection to be retried indefinitely. In dremio 3.1.3 looks like infinite reflection retry does not happen any more however the reflection creation still fails. Please see the screenshot attached for an example. The “bids” and the “offers” column is an empty array. If I remove these columns from the reflection it succeeds. ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/3/3c02094cc4a8e1fe2e125f291cbf5f96c45a7bdb.png)