Query cancelled because it exceeded the memory limits set by the administrator

1

Hi, can you please help me with proper setup.

I have
1x coordinator (10cpus 10gb mem)
3x executor (14cpus 50gb mem)

i run simple update on table with cca 700M rows.

here is the profile:
060f776d-be6d-4ca1-b040-365017fef751.zip (150.9 KB)

Thanks
Jaro

2

Hi Jaro,

could you please share the executor’s server.log file when the query failed?
Also, could you please upgrade to 25.0.8 as it has some other important fixes.

Thanks,
Prashanth

3

Hi Prashanth, thanks for reply. Attaching server.log from executors.

I’m using dremio-oss image, is there new update available too?

executor_0_server.zip (76.6 KB)
executor_1_server.zip (81.8 KB)
executor_2_server.zip (77.9 KB)

Our physical configuration is 10nods of 16cpus and i think 64gb of mem each.

Thanks for your advice
Jaro

4

Looks like the log file got rolled over. From the profile, the issue happened on 2024-08-27. Could you please upload the log files for this.

Thanks,
Prashanth

5

Can you please retry the query with the support key planner.use_max_rowcount set to false ?

Thanks,
Prashanth

6

Hey @prashanthb i have changed the setting but it failed again.
Jaro

7

I have run the query again (with adjusted setting)
executors_server_log.zip (197.1 KB)
b9658bb9-61e4-483f-bfba-da4a8ce5a409.zip (201.1 KB)
thanks
Jaro

8

Hi Jaro,

By setting the support key to false we were able to get around the initial issue that was reported.

Looks like you are hitting another issue that we addressed recently and should be a part of 25.1 payload sometime in September. Can we circle back to this after an upgrade? Sorry and thank you for reporting this

Thanks,
Prashanth

9

Hi @prashanthb, thank you for investigating the issue. Not being able to perform larger operations would be a major obstacle in my project. isn’t there a workaround available, prior to the update is available, please?
Would the update be available for -oss community edition, please?

Thanks
Jaro

10

Hi @prashanthb,
I have another instance of the same error, this time by executing select.
Intresting is that the query finishes without reflection and fails with reflection.

here is the profile:
ab6942bf-4988-416a-8e34-c7a635e201b8.zip (228.4 KB)

Thank you for your help.
Jaro

11

Hi Jaro,

25.1.0 has been released and is available for oss community edition.

Thanks,
Prashanth

12

Hi @prashanthb, we have just performed an update and unfortunately it did not help.

on top we generally observe cca 5x slower performance on same data and setup.
331a8d2b-5982-4695-b0ee-5379a9af1466.zip (173.5 KB)

Thanks for helping me.

Jaro