Dremio HA cluster is behaving strangely with hive querry.
Some time the query get completed within 20 Sec but some time it took more than 20min to complete.
When I have check the in job profile we found that
Under the Thread Overview
for Phase 0 - under the filed Min Blocked Time is 14 min and minimum sleep time 6min,
Further for the Phase 0 - under filed Blocked on Upstream it took 14Min.
When I check for detail time summery of job with respect to operator -
The most of time taken was by hive_sub_scan as below .
|SqlOperatorImpl ID||Type||Avg Wait Time||Max Wait Time|
I am using the same hive source with other single node dremio cluster and with that node I am getting the stable performance.
Could you please help me to find the root cause for issue i am facing with HA DREMIo cluster.