com.dremio.common.exceptions.UserException: Failed to initialize Hive record reader

1

Running query on Hive source I receive this error:

  2019-07-31 07:12:22,694 [e1 - 22bec0a8-c913-b396-92ac-827c564ffc00:frag:1:0] INFO  c.d.e.s.h.e.HiveORCVectorizedReader - User Error Occurred [ErrorId: e06c8540-8c57-4702-bf72-bea8f629d658]
    com.dremio.common.exceptions.UserException: Failed to initialize Hive record reader
            at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:773) ~[dremio-common-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.exec.store.hive.exec.HiveAbstractReader.createExceptionWithContext(HiveAbstractReader.java:319) [dremio-hive-plugin-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.exec.store.hive.exec.HiveAbstractReader.setup(HiveAbstractReader.java:218) [dremio-hive-plugin-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.op.scan.ScanOperator$1.run(ScanOperator.java:220) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.op.scan.ScanOperator$1.run(ScanOperator.java:216) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at java.security.AccessController.doPrivileged(Native Method) [na:1.8.0_212]
            at javax.security.auth.Subject.doAs(Subject.java:422) [na:1.8.0_212]
            at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836) [hadoop-common-2.8.3.jar:na]
            at com.dremio.sabot.op.scan.ScanOperator.setupReaderAsCorrectUser(ScanOperator.java:216) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.op.scan.ScanOperator.setupReader(ScanOperator.java:189) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.op.scan.ScanOperator.outputData(ScanOperator.java:261) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.driver.SmartOp$SmartProducer.outputData(SmartOp.java:516) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.driver.StraightPipe.pump(StraightPipe.java:56) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.driver.Pipeline.doPump(Pipeline.java:109) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.driver.Pipeline.pumpOnce(Pipeline.java:99) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run(FragmentExecutor.java:307) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run(FragmentExecutor.java:303) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at java.security.AccessController.doPrivileged(Native Method) [na:1.8.0_212]
            at javax.security.auth.Subject.doAs(Subject.java:422) [na:1.8.0_212]
            at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836) [hadoop-common-2.8.3.jar:na]
            at com.dremio.sabot.exec.fragment.FragmentExecutor.run(FragmentExecutor.java:260) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.exec.fragment.FragmentExecutor.access$1200(FragmentExecutor.java:92) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run(FragmentExecutor.java:632) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.task.AsyncTaskWrapper.run(AsyncTaskWrapper.java:104) [dremio-sabot-kernel-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop(SlicingThread.java:226) [dremio-ce-sabot-scheduler-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
            at com.dremio.sabot.task.slicing.SlicingThread.run(SlicingThread.java:156) [dremio-ce-sabot-scheduler-3.2.4-201906051751050278-1bcce62.jar:3.2.4-201906051751050278-1bcce62]
    Caused by: java.lang.ArrayIndexOutOfBoundsException: null

If I run Preview on same query it works fine.
Version: 3.2.4

2

@babu Can you attach the profile to take a look.

Are you querying on ORC fileformats ?

3

What do you mean by saying profile?
Yes, quering ORC fileformats

4

Profile is a Dremio summary file which will have the Job information like query,hosts on which it ran, resource utilization,errors etc…!!

You can download the profile like below

Go to JOBS–> click on the queiry you ran --> on the right side you will see job details, at the bottom on the right side you will have “DownloadProfile”. Once you click, one Zip file will be downloaded, Please attach that file here.

We will review the profile and come back to you

@Venugopal_Menda

5

a0276601-47c4-42b8-9c9e-4f676ca570d6.zip (9.1 KB)

Here you go.

6

Hi @babu

This looks one of the issues we fixed in our latest verions. Can you upgrade to latest version > 3.2.5 and run your query.

Upgrade Procedure:
https://docs.dremio.com/deployment/standalone/standalone-install-upgrade.html

Thanks
@Venugopal_Menda

7

Thank you. Will do and report :slight_smile:

8

Thanks @Venugopal_Menda. Problem resolved.

9

This problem is still there. We are on 4.9.3 and experiencing the issue.

10

Hi @github81,

Just responded in the below thread, please upload the query profile