# Failure during post-substitution processing

**URL:** <https://community.dremio.com/t/failure-during-post-substitution-processing/3744>\
**Category:** Uncategorized\
**Created:** [July 24, 2019, 4:18pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744 "2019-07-24T16:18:44Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [July 24, 2019, 4:18pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/1 "2019-07-24T16:18:44Z")

</div>

Hi Dremio Team,  
we are seeing a lot of Failure during post-substitution processing. errors when executing a query. this makes reflections being not used, Thanks in advance.

dremio version: 3.2.4-201906051751050278-1bcce62

Error: Failure during post-substitution processing. Used reflections: [ce4624dd-644f-4169-bc3a-e551be9fd8b9]

same error multiple times

query profile attached [1450523e-e589-486c-b9f4-149be198f83c.zip](https://community.dremio.com/uploads/short-url/6QKc7SqmqmCTEbMTVGmpQMNhXLn.zip) (513.5 KB)

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [July 24, 2019, 11:40pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/2 "2019-07-24T23:40:51Z")

</div>

@smora

Which reflection in the below list you were expecting to be accelerated?

Query was accelerated

- fx\_pivot (RWH\_HDFS)
  - Raw Reflection (raw): considered, matched, chosen.

- fx\_pivot (RWH)
  - VDS\_RAW\_ALL (raw): considered, not matched.

- fx\_pivot (RWH\_LOCAL."\_helper")
  - Raw Reflection (raw): considered, not matched.

- rdv\_dynamic\_part (RWH\_HDFS)
  - Raw Reflection (raw): considered, matched, not chosen.

- rdv\_dynamic\_part\_20190708 (RWH\_LOACL2."\_helper")
  - Raw Reflection (raw): considered, not matched.

---

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [July 25, 2019, 1:07pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/3 "2019-07-25T13:07:23Z")

</div>

> [@balaji.ramaswamy](#):
>
> rdv\_dynamic\_part (RWH\_HDFS)
> 
> - Raw Reflection (raw): considered, matched, not chosen.

Hi Balaji

this one, its matched but not chosen due to substitution error.

rdv\_dynamic\_part (RWH\_HDFS)

- Raw Reflection (raw): considered, matched, not chosen.

Thanks

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [July 25, 2019, 3:45pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/4 "2019-07-25T15:45:23Z")

</div>

@smora

Would be good to get the server.log and see the excpetion

---

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [July 25, 2019, 5:21pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/5 "2019-07-25T17:21:51Z")

</div>

> [@balaji.ramaswamy](#):
>
> Would be good to get the server.log and see the excpetion

@balaji.ramaswamy

we are running in a multi node cluster, is there a way to find out on which executor this query was run? so that i can get log from the specific executor

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [July 25, 2019, 5:33pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/6 "2019-07-25T17:33:43Z")

</div>

Exception should be on the coordinator log

---

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [July 25, 2019, 5:59pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/7 "2019-07-25T17:59:08Z")

</div>

Attached log. Thanks.[syslog.zip](https://community.dremio.com/uploads/short-url/bXKe18kwd6j0aK5kYSA0k8ZhnL0.zip) (13.4 KB)

---

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [July 26, 2019, 5:16pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/8 "2019-07-26T17:16:07Z")

</div>

@balaji.ramaswamy  
you got a chance to look at the log?

Thanks

---

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [August 8, 2019, 2:00pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/9 "2019-08-08T14:00:57Z")

</div>

@balaji.ramaswamy

Any update on this issue?

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [August 8, 2019, 2:54pm UTC](https://community.dremio.com/t/failure-during-post-substitution-processing/3744/10 "2019-08-08T14:54:04Z")

</div>

@smora

Sorry did not get a chance to look yet, Can you please get the reflection id for this reflection from sys.reflections and the materialization\_id for the same reflection\_id from sys.materializations and search for those in this logfile. Would it be possible to put the error stack here?

Thanks  
@balaji.ramaswamy
