Refresh is very slowing time

Hello Guys.

I have a serious problem with refresh dataset in dremio.

My version is


With configuration

We use drive since the beginning of this year, but the last weeks, we are facing multiple coordinator failures, we identify that refresh routines are taking longer than usual, but we not found the cause this problem.

I need help, because Dremio is very important for our daily work
Exemples of problem

The coordinator failuring, more 90% of CPU

Maybe we are facing the same issue. Some refresh jobs never complete, the only thing we can do is to restart the engine.
The support said they have fix this issue in version 21.1.6

Hi guys, the exact same problem happened with us.

We are using Dremio via AWS Marketplace and this started last monday (2022-09-19) from nothing, we didnt change any configuration.

We were also using Dremio 21.0. We found the release note telling this was fix so we updated to 21.5 but the problem was still there. After one week investigating and trying to find the cause we went back to Dremio 15.0.0 which is stable and working fine.

Our production enviroment relies on Dremio and is very frustating to know that this can happen to it. After one week without data, the business is now questioning if Dremio is a good choice for us.

We are using/paying for Dremio Enterprise Edition via AWS Marketplace, which seems unstable and we dont have any kind of official support when this happens. We will now evaluate other options.

@tiibra Sorry you had to go through this rough experience, please give me one more chance to help you. Let us first make sure you are hitting the same issue. Do you have a profile that you can share?