Cannot get all records in Dremio query on v19

1

If the query result is around 1m. The query cannot get all records on GUI. Seems it is due to some threads reach to the result limit.

Is there any option we could change the limit?

2

@popejune There is a UI truncation that can happen based on number of records returned, are you able to run the query via a JDBC tool, truncation will not happen then

3

Hi @balaji.ramaswamy

Yes, it is in Prod. But there are some user using Dremio GUI to do the data analysis. It always cause some confuse. Is it possible to increase the number?

4

@popejune Would it not be possible to use a JDBC tool for those users also? Reason is increasing the limit can cause excessive arrow files (results) to be written and can fill up your local disks on the executors

5

Hi @balaji.ramaswamy , OK, understand. But could you let me know how to change? we would give a expected number in our dev env. We could revert if some issue happened.

6

@popejune planner.output_limit_size

7

Thanks @balaji.ramaswamy