# Query Status Stuck In "Starting" ~60 min. Before Failing

**URL:** <https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673>\
**Category:** Uncategorized\
**Created:** [January 31, 2019, 3:08pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673 "2019-01-31T15:08:11Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![kevthebandit](https://avatars.discourse-cdn.com/v4/letter/k/f6c823/32.png) [@kevthebandit](https://community.dremio.com/u/kevthebandit)\
**Post date:** [January 31, 2019, 3:08pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/1 "2019-01-31T15:08:11Z")

</div>

Hello,

We have been using Dremio 2.0 for a few months and recently copied all our tables/reflections over to using Dremio 3.0. We have a basic query that is able to run in the Dremio 2.0 server environment in about ~30 seconds, but the same query is stuck in “starting” status for over 60 min. before failing and giving us the details of “Invalid Query Exception” and “Failed”.

The queries are the exactly the same.  
Our Queue control settings are exactly the same.

Any ideas on what to try to better troubleshoot?

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [January 31, 2019, 3:48pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/2 "2019-01-31T15:48:47Z")

</div>

@kevthebandit

Can you try and disable “planner.experimental.pclean\_logical” via the support key under admin-support? and retry the query?

Thanks  
@balaji.ramaswamy

---

<div class="post-metadata">

**Author:** ![kevthebandit](https://avatars.discourse-cdn.com/v4/letter/k/f6c823/32.png) [@kevthebandit](https://community.dremio.com/u/kevthebandit)\
**Post date:** [January 31, 2019, 3:51pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/3 "2019-01-31T15:51:03Z")

</div>

@balaji.ramaswamy

Thank you for the suggestion.

the “planner.experimental.pclean\_logical” is already unchecked in both environments. Sorry for not calling that out in my first post.

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [January 31, 2019, 3:53pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/4 "2019-01-31T15:53:48Z")

</div>

Hi @kevthebandit

Can you please compare the differences in convert to rel between the 2.x and 3.x plan? Also do the same for Logical planning as most lilely the 1 minute would have been spent on logical planning. Do you have both profiles? Can you please send it across? the one from 2.x and the one from 3.x?

Thanks  
@balaji.ramaswamy

---

<div class="post-metadata">

**Author:** ![kevthebandit](https://avatars.discourse-cdn.com/v4/letter/k/f6c823/32.png) [@kevthebandit](https://community.dremio.com/u/kevthebandit)\
**Post date:** [January 31, 2019, 4:13pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/5 "2019-01-31T16:13:12Z")

</div>

@balaji.ramaswamy

**Dremio 3.x - Query does NOT work**  
Convert To Rel (139 ms)  
Logical Planning (734 ms)

**Dremio 2.x - Query does work**  
Convert To Rel (79 ms)  
Logical Planning (959 ms)

What part of the “Job Profile” would be helpful? Query, Planning (what part within planning), Acceleration, or Error?

---

<div class="post-metadata">

**Author:** ![kevthebandit](https://avatars.discourse-cdn.com/v4/letter/k/f6c823/32.png) [@kevthebandit](https://community.dremio.com/u/kevthebandit)\
**Post date:** [January 31, 2019, 4:50pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/6 "2019-01-31T16:50:01Z")

</div>

Tahnks for your help!

I think I found the downloadable profile you were talking about. Please let me know if you meant something different. [Profile\_2.x.zip](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/2/267af64fe1337916a9431b86c13867b19973b634.zip) (237.1 KB)  
[619c6c5c-ff76-4133-a3ea-1e36315dde60.zip](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/4/416f23f0f97252cb921b3071c2d80a3f6e707ca1.zip) (241.5 KB)

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [January 31, 2019, 6:06pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/7 "2019-01-31T18:06:49Z")

</div>

Hi @kevthebandit

Few things,

1. The query you ran on 3.0.6 is a prepare statement while the one on 2.0.5 is not. We would need to compare the same query. Would it be possible to send the prepare statement profile from 2.0.5?

2. We need verbose planner on , turn on **planner.verbose\_profile** under admin-support-support key

3. Are the reflections used on both versions the same?

Thanks  
@balaji.ramaswamy

---

<div class="post-metadata">

**Author:** ![kevthebandit](https://avatars.discourse-cdn.com/v4/letter/k/f6c823/32.png) [@kevthebandit](https://community.dremio.com/u/kevthebandit)\
**Post date:** [February 1, 2019, 12:44pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/8 "2019-02-01T12:44:59Z")

</div>

Thanks for all your responses and help!

1. Attached is the 2.x prepare statement  
[prepare\_statement\_profile\_dremio\_2.x.zip](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/e/e64a0a651ee6464b810602661432d3d7c6c11388.zip) (78.5 KB)

2. I turned on the planner.verbose\_profile for both Dremio 3.x and 2.x server environments

3. The prepare statement that successfully completes shows me reflections used, the prepare statements for Dremio 3.x where the prepare statements fails, it does not show me the names of reflections chosen within “Job Profile \> Acceleration”. Still looking for detail so I can compare the two.

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [February 1, 2019, 2:26pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/9 "2019-02-01T14:26:43Z")

</div>

Hi @kevthebandit

Can you please send us the r profiles with verbose on, we will look and see what changed. If you are not able to find the missing reflections, that should be ok for now

Thanks  
@balaji.ramaswamy

---

<div class="post-metadata">

**Author:** ![kevthebandit](https://avatars.discourse-cdn.com/v4/letter/k/f6c823/32.png) [@kevthebandit](https://community.dremio.com/u/kevthebandit)\
**Post date:** [February 1, 2019, 2:44pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/10 "2019-02-01T14:44:03Z")

</div>

How do I find the r (reflection) profiles? Do you mean the full download profile for the same query in each environment like I sent before? Attached are the full profiles for each query run, when the planner.verbose\_profile switch turned on.

Let me know if you mean something different.

[prepare\_statement\_dremio\_2.x-verbose\_on.zip](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/f/f2d6d787878ada63e484ecd27d02d220bcdd3ccc.zip) (78.5 KB)  
[prepare\_statement\_Dremio\_3.x-verbose\_on.zip](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/7/7595acc2fb13db53bd2ab29c2f4ab33fbd844eb0.zip) (494.3 KB)

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [February 1, 2019, 4:07pm UTC](https://community.dremio.com/t/query-status-stuck-in-starting-60-min-before-failing/2673/11 "2019-02-01T16:07:00Z")

</div>

Hi @kevthebandit

The verbose profiles certainly helps. Let us not worry about the same set of reflections getting considered between the 2 profiles for now. Let me look into what has changed and get back to you

Thanks  
@balaji.ramaswamy
