# Dremio on kubernate volume mount take more time to load data

**URL:** <https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263>\
**Category:** Uncategorized\
**Created:** [November 16, 2018, 11:53am UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263 "2018-11-16T11:53:57Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Vikash\_Singh](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/vikash_singh/32/1069_2.png) [@Vikash\_Singh](https://community.dremio.com/u/Vikash_Singh)\
**Post date:** [November 16, 2018, 11:53am UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/1 "2018-11-16T11:53:57Z")

</div>

I have used latest docker images for dremio and deployed it on kubernate with cluster .I have mounted

/opt/dremio/data to the azure file share .after that i have connected SQL server as datasource.

when i am quering and create reflection it takes much time some time even a minutes to create reflection.i can’t see any error log

---

<div class="post-metadata">

**Author:** ![anthony](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/anthony/32/670_2.png) [@anthony](https://community.dremio.com/u/anthony)\
**Post date:** [November 16, 2018, 3:14pm UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/2 "2018-11-16T15:14:41Z")

</div>

Hi there - Were you able to see my response on your other thread here? [Not able to set reflection](https://community.dremio.com/t/not-able-to-set-reflection/2233/4?u=anthony)

Pasting my response here - “It seems like it’s still processing and may be taking awhile. It may be worth noting your executor node is really small and undersized, it is below our recommended minimum requirements - [https://docs.dremio.com/deployment/system-requirements.html#server-or-instance](https://docs.dremio.com/deployment/system-requirements.html#server-or-instance)”

It may be worth scaling up your cluster to see if performance increases.

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/vikash_singh/32/1069_2.png) [@Vikash\_Singh](https://community.dremio.com/u/Vikash_Singh)\
**Post date:** [November 16, 2018, 3:33pm UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/3 "2018-11-16T15:33:26Z")

</div>

I have put both coordinator and executer to 8 cpu ,16 gb ram best on yur last reply after that performance was happy for me but when i was mounted volume on azure file share its hunting down performance on each query

---

<div class="post-metadata">

**Author:** ![anthony](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/anthony/32/670_2.png) [@anthony](https://community.dremio.com/u/anthony)\
**Post date:** [November 16, 2018, 3:41pm UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/4 "2018-11-16T15:41:41Z")

</div>

Understood. I am guessing there may be a read latency to Azure. Can you share [a query profile](https://www.dremio.com/tutorials/share-query-profile-dremio/) to verify this?

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/vikash_singh/32/1069_2.png) [@Vikash\_Singh](https://community.dremio.com/u/Vikash_Singh)\
**Post date:** [November 17, 2018, 6:10am UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/5 "2018-11-17T06:10:00Z")

</div>

Thanks anthony,here is the Profile for Job took 2s to execute

[86f91d26-8aa1-41a3-97d8-8d50e5c7761a.zip](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/4/4feec123708ffdd4345521e2fe39ced2017f1423.zip) (29.4 KB)

---

<div class="post-metadata">

**Author:** ![anthony](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/anthony/32/670_2.png) [@anthony](https://community.dremio.com/u/anthony)\
**Post date:** [November 17, 2018, 6:04pm UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/6 "2018-11-17T18:04:31Z")

</div>

Can you clarify - is the issue that the reflection takes too long to create or the query takes too long to run?

For the query you sent the query profile for, can you test a query with less columns instead of the ~240+ columns it has and see if that is faster?

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/vikash_singh/32/1069_2.png) [@Vikash\_Singh](https://community.dremio.com/u/Vikash_Singh)\
**Post date:** [November 20, 2018, 9:50am UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/7 "2018-11-20T09:50:36Z")

</div>

i have followed your thought .i have used less column of approx 150,I am querying though jdbc connector

Still query takes long time as expected from dremio. May i know how to optimize Query .I already have enabled Raw Reflection and saved in space .May i know where should i look how much time my query took to execute since we are going to use Dremio for production Big Data

---

<div class="post-metadata">

**Author:** ![anthony](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/anthony/32/670_2.png) [@anthony](https://community.dremio.com/u/anthony)\
**Post date:** [November 20, 2018, 3:39pm UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/8 "2018-11-20T15:39:36Z")

</div>

For testing purposes, can you select 20 columns and see if that improves? What are the CPU/mem for the coordinator? 8cores/16gb?

The query itself is taking less than 1 second to execute, but Dremio’s query planning is taking ~2s.

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/vikash_singh/32/1069_2.png) [@Vikash\_Singh](https://community.dremio.com/u/Vikash_Singh)\
**Post date:** [November 20, 2018, 4:43pm UTC](https://community.dremio.com/t/dremio-on-kubernate-volume-mount-take-more-time-to-load-data/2263/9 "2018-11-20T16:43:15Z")

</div>

Mine configuration 8 cpu co-ordinator,8 cpu executor,8 cpu master i have confugration of 32 cpu 128gb ram still query take long time
