Queries on sys.project.history.jobs are very slow and easily hit 32000 bytes limit

Hello there,

Thank you for contacting Dremio.
I understand that you are observing below error on running query select * from sys.project.history.jobs
Field exceeds the size limit of 32000 bytes.

Regarding your queries:

  • will it be possible to raise the 32k limit on dremio cloud, given that it is not even possible to query system views with that?

The default limit for the property limits.single_field_size_bytes is set to 32K. As of now, the Support Key can only be updated by Dremio internal team. To review the same from our end, I have sent a Private message regarding the above. Please reply to the same Private Message with your OrgID.

  • can we expect queries on this (small) table to become faster in the future? we’d like to rely on this table to set up some monitoring dashboards.

To assist you better on this, we would first need to review the current execution time. Once we review the above details, we will share the suggestions accordingly.

Feel free to update if you have any queries/concerns.