Hi,
Running the community version 4.2.2 on a single node we are facing an issue with Refection/Materialization that no longer exists but still try to be refreshed.
Launching dremio-admin to clean orphans have no effect and we keep getting the following in server.log:
2020-09-18 11:16:58,349 [dremio-general-1] ERROR c.d.s.reflection.ReflectionManager - Couldn’t handle reflection entry 4b9890c7-3629-45d8-9899-b7c3de811b8d
java.lang.IllegalStateException: Reflection in refreshing state should have a materialization in RUNNING state but was DONE instead
at com.google.common.base.Preconditions.checkState(Preconditions.java:589)
at com.dremio.service.reflection.ReflectionManager.handleRefreshingEntry(ReflectionManager.java:359)
at com.dremio.service.reflection.ReflectionManager.handleEntry(ReflectionManager.java:324)
at com.dremio.service.reflection.ReflectionManager.handleEntries(ReflectionManager.java:280)
at com.dremio.service.reflection.ReflectionManager.run(ReflectionManager.java:195)
at com.dremio.common.WakeupHandler$1.run(WakeupHandler.java:67)
at com.dremio.common.concurrent.ContextMigratingExecutorService.lambda$decorate$3(ContextMigratingExecutorService.java:192)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2020-09-18 11:16:59,362 [scheduler-22] WARN c.d.s.r.MaterializationCache - couldn’t expand materialization 8d3a2d69-8351-4f09-92bb-a53ee5d77209
java.lang.NullPointerException: null
at com.dremio.service.reflection.store.ReflectionGoalsStore.checkGoalVersion(ReflectionGoalsStore.java:188)
at com.dremio.service.reflection.ReflectionServiceImpl.getDescriptor(ReflectionServiceImpl.java:815)
at com.dremio.service.reflection.ReflectionServiceImpl.access$2100(ReflectionServiceImpl.java:124)
at com.dremio.service.reflection.ReflectionServiceImpl$CacheHelperImpl.expand(ReflectionServiceImpl.java:946)
at com.dremio.service.reflection.MaterializationCache.updateEntry(MaterializationCache.java:174)
at com.dremio.service.reflection.MaterializationCache.safeUpdateEntry(MaterializationCache.java:166)
at com.dremio.service.reflection.MaterializationCache.updateCache(MaterializationCache.java:127)
at com.dremio.service.reflection.MaterializationCache.compareAndSetCache(MaterializationCache.java:99)
at com.dremio.service.reflection.MaterializationCache.refresh(MaterializationCache.java:92)
at com.dremio.service.reflection.ReflectionServiceImpl.refreshCache(ReflectionServiceImpl.java:412)
at com.dremio.service.reflection.ReflectionServiceImpl$CacheRefresher.run(ReflectionServiceImpl.java:1021)
at com.dremio.service.scheduler.LocalSchedulerService$CancellableTask.run(LocalSchedulerService.java:187)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Any way to get rid of these errors?
Cheers,
Berni