Raw reflection creation failed on dremio build 3.1

#1

Hello,

I am trying to create a simple raw reflections from a s3 partitioned dataset, but the foot print says " **Reflection can not accelerate. 1 refresh jobs attempts failed, will reattempt"

also a bunch of errors in the server log

2019-05-13 17:47:24,602 [e3 - 2326c2d4-3bee-9157-ebb6-b383f9e9e200:frag:1:2] ERROR c.d.s.exec.fragment.FragmentExecutor - NoClassDefFoundError: Could not initialize class com.yahoo.memory.WritableMemoryImpl
com.dremio.common.exceptions.UserException: NoClassDefFoundError: Could not initialize class com.yahoo.memory.WritableMemoryImpl
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:746) ~[dremio-common-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.exec.fragment.FragmentExecutor.retire(FragmentExecutor.java:443) ~[dremio-sabot-kernel-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.exec.fragment.FragmentExecutor.finishRun(FragmentExecutor.java:376) ~[dremio-sabot-kernel-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.exec.fragment.FragmentExecutor.run(FragmentExecutor.java:284) ~[dremio-sabot-kernel-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.exec.fragment.FragmentExecutor.access$1000(FragmentExecutor.java:93) ~[dremio-sabot-kernel-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run(FragmentExecutor.java:619) ~[dremio-sabot-kernel-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.task.AsyncTaskWrapper.run(AsyncTaskWrapper.java:103) ~[dremio-sabot-kernel-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop(SlicingThread.java:123) ~[dremio-extra-sabot-scheduler-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.task.slicing.SlicingThread.run(SlicingThread.java:68) ~[dremio-extra-sabot-scheduler-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
Caused by: java.lang.RuntimeException: java.lang.NoClassDefFoundError: Could not initialize class com.yahoo.memory.WritableMemoryImpl
at com.dremio.common.DeferredException.addThrowable(DeferredException.java:100) ~[dremio-common-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.exec.fragment.FragmentExecutor.transitionToFailed(FragmentExecutor.java:478) ~[dremio-sabot-kernel-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
at com.dremio.sabot.exec.fragment.FragmentExecutor.run(FragmentExecutor.java:280) ~[dremio-sabot-kernel-3.1.11-201904261857420193-c674472.jar:3.1.11-201904261857420193-c674472]
… 5 common frames omitted

I am using the dremio Community Edition 3.1.11-201904261857420193-c674472, any suggests I could try to be able to fix it ?

#2

Hello @marvinwu,

Could you share the profile for the failed job?

#3

Hello @ben,

sure, I have attached the profiles below

2596b4c5-7676-4cbb-a3a7-5dcfc2380bdd.zip (3.2 KB)

#4

@marvinwu, this is the LOAD MATERIALIZATION METADATA job. Can you tru and find the REFRESH REFLECTION job?

#5

@ben, sure will try to do that