Can't create Raw Reflection

Dremio Cloud
1

Hi,

I’m getting Failure getting source [__accelerator]. error when trying to create a Raw Reflection of Delta table.

Does anyone know how to fix this?

Thanks,
Aljaz

Screenshot 2022-06-03 at 13.05.11
Screenshot 2022-06-03 at 13.05.111920×1101 62.9 KB

2

Hello @asoderznik,

Could you please provide the profile for this failed raw reflection query?. You can “download profile” and attach it here.

3

Hi @Basapuram_Kumar ,

thanks for the reply. Here is the downloaded profile:

52a7cc7c-9be7-41d8-b377-f41ad3da104d.zip (24,4 KB)

4

In the raw profile tab, there is an error sub-tab that includes the stack trace. It says:

java.io.IOException: com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied;

The referenced source __accelerator is the S3 location specified in path.dist. This is the distributed file system where the accelerations (i.e. reflection materializations) are written to and shared among the executors.

5

@asoderznik Try below steps

  • Restart 10.0.37.13 and see if that fixes the issue
  • To get to the RCA of why this happened
  • Log on to 10.0.37.13
  • ps -ef | grep dremio
  • Get the server.log on the date it was last restarted,
  • There will be a section where the plugins like __accelerator will be loaded and marked “Healthy” or “Pending” or “Unavailable”, if not “Healthy” there should a reason mentioned

Also if you have AWS support give them the extension ID printed in the error message and that will tell you the exact reason