Attempting to write a too large value for field with index

21

@Muffex

Currently no, we are constantly working on increasing these limits and will be announced as have higher limits

Thanks
Bali

22

Thank you. At least this is an unambiguous answer.
Hope you will be able to increase the limit asap.
regards

23

Hi @balaji.ramaswamy , any updates on increasing the limit of a field? Thank you

24

@acornea If this is for the field width then this is not yet done

25

@balaji.ramaswamy field size, I think we have found out that we can increase the field size using support key: limits.single_field_size_bytes

And the next limit would be 65536 bytes, is that correct?

26

@acornea This can cause Garbage collection issues when set higher than 32K, kindly monitor

27

We also need larger field sizes.

@balaji.ramaswamy have there been any garbage collector updates that make this work better since May 2021?

28

@lukekim Currently Dremio supports only up to 32K, Dremio is working on using a better GC algorithm that does not do a “stop the world” event for a Full GC. For now if you do end up increasing the limit, please monitor your GC

29

Thanks for the info. Any estimate on when the better GC will be implemented?

30

@lukekim Thanks for the remainder, I have cross checked and will let you know when I have an answer