If a high cost query requires all the memory allocated to a particular queue and is currently executing, what happens if there is another high cost query that is submitted ? Does it have to wait for the first query to get completed ? or is there a Fair Scheduler kind of concept where both queries get executed ?
Dremio currently spills only 2 operators in Sorts and Aggregates, If a high cost query requires all the memory allocated to a particular queue and is currently executing, if a second query is submitted and if no direct memory left, then the queries will run out of memory and need to be resubmitted
1 Like