Raw reflection creation failed

Hi Team,

I am creating a raw reflection on a dataset by specifying partition & sort field. When I check reflection history, I see job is completed but Footprint says “Reflection can not accelerate. 1 refresh jobs attempts failed, will reattempt”. Can see below logs in server.log:

com.dremio.common.exceptions.UserException: Failure while attempting to read metadata for table “__accelerator”.“5bee1764-f97a-456d-9d2a-ed4de8f1b9e4”.“9fa75a23-21c2-4291-8b12-3631618cbfea” from source.
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:746) ~[dremio-common-2.0.5-201806021755080191-767cfb5.jar:2.0.5-201806021755080191-767cfb5]
at com.dremio.exec.catalog.DatasetManager.createDataset(DatasetManager.java:403) [dremio-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar:2.0.5-201806021755080191-767cfb5]
at com.dremio.exec.catalog.CatalogImpl.createDataset(CatalogImpl.java:474) [dremio-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar:2.0.5-201806021755080191-767cfb5]
at com.dremio.exec.catalog.DelegatingCatalog.createDataset(DelegatingCatalog.java:152) [dremio-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar:2.0.5-201806021755080191-767cfb5]
at com.dremio.service.reflection.LoadMaterializationHandler.refreshMetadata(LoadMaterializationHandler.java:120) [dremio-services-accelerator-2.0.5-201806021755080191-767cfb5.jar:2.0.5-201806021755080191-767cfb5]
at com.dremio.service.reflection.LoadMaterializationHandler.toResult(LoadMaterializationHandler.java:84) [dremio-services-accelerator-2.0.5-201806021755080191-767cfb5.jar:2.0.5-201806021755080191-767cfb5]
at com.dremio.exec.planner.sql.handlers.commands.DirectWriterCommand.plan(DirectWriterCommand.java:87) [dremio-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar:2.0.5-201806021755080191-767cfb5]
at com.dremio.exec.work.foreman.AttemptManager.run(AttemptManager.java:305) [dremio-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar:2.0.5-201806021755080191-767cfb5]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_181]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_181]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_181]
Caused by: java.lang.RuntimeException: java.io.IOException: Timeout occured during I/O request for sabot:<>

Tried by removing all reflections and re-creating after restarting dremio service but error still persist. Sufficient space available at ‘/var/lib/dremio/pdfs/accelerator’ (20G).

Please suggest. Thank you in advance.

According to your screenshot, the raw reflection actually completed successfully. Also, the job profile you attached is for a query, not reflection. If the raw reflection creation actually did fail, can you attach that profile please?

@anthony
Upgraded to 2.6 Community edition and able to successfully create Raw reflection.

1 Like