IndexOutOfBoundsException

Hello

Dremio v4.9 on Kubernetes with 3 executors and 1 master.

I am facing an error IndexOutOfBoundsException: index: 8320, length: 1 (expected: range(0, 8192)).

error is

  SYSTEM ERROR: IndexOutOfBoundsException: index: 8320, length: 1 (expected: range(0, 8192))

SqlOperatorImpl HASH_AGGREGATE
Location 6:0:2
Fragment 6:0

[Error Id: bd5bb2dd-f4a9-4030-8fb8-006e2b49b02d on dremio-executor-2.dremio-cluster-pod.dremio.svc.cluster.local:0]

  (java.lang.IndexOutOfBoundsException) index: 8320, length: 1 (expected: range(0, 8192))
org.apache.arrow.memory.ArrowBuf.checkIndexD():326
org.apache.arrow.memory.ArrowBuf.chk():313
org.apache.arrow.memory.ArrowBuf.getByte():515
org.apache.arrow.vector.complex.UnionVector.getVector():1022
org.apache.arrow.vector.complex.UnionVector.getVector():1018
org.apache.arrow.vector.complex.UnionVector.isNull():1125
org.apache.arrow.vector.complex.UnionVector.isSet():1144
com.dremio.s.HashTableGen17050$BatchHolder.isKeyMatchInternalBuild():821
com.dremio.sabot.op.common.hashtable.HashTableTemplate$BatchHolder.isKeyMatch():212
com.dremio.sabot.op.common.hashtable.HashTableTemplate$BatchHolder.access$1000():127
com.dremio.sabot.op.common.hashtable.HashTableTemplate.put():583
com.dremio.sabot.op.aggregate.hash.HashAggTemplate.addBatch():293
com.dremio.sabot.op.aggregate.hash.HashAggOperator.consumeData():160
com.dremio.sabot.driver.SmartOp$SmartSingleInput.consumeData():240
com.dremio.sabot.driver.StraightPipe.pump():59
com.dremio.sabot.driver.Pipeline.doPump():108
com.dremio.sabot.driver.Pipeline.pumpOnce():98
com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run():339
com.dremio.sabot.exec.fragment.FragmentExecutor.run():288
com.dremio.sabot.exec.fragment.FragmentExecutor.access$1400():94
com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run():711
com.dremio.sabot.task.AsyncTaskWrapper.run():112
com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop():225
com.dremio.sabot.task.slicing.SlicingThread.run():156

@Rohithzr Do your datasets have mixed types, CAST the column to a single type and save as VDS, then query the VDS instead

Thanks a lot. I’ll give it a try.