Samples Data Source is Showing Access Denied

1

Hello,

This started to show out of the blue when I navigate to Samples.“samples.dremio.com” bucket even though I didn’t touch it:

Samples data source
Samples data source956×105 11.3 KB

Any idea what’s going on?

2

Can anyone give me any pointer as to why this might be happening? I’m still stuck here

3

@yalmasri If you give that Extended Request ID to AWS they should tell you what is going on

4

I don’t think AWS has anything to do with this, it’s only me :face_in_clouds:

When dremio.conf looks like this the issue shows:

paths: {
  # the local path for dremio to store data.
  local: "/var/lib/dremio"

  # the distributed path Dremio data including job results, downloads, uploads, etc
  #dist: "pdfs://"${paths.local}"/pdfs"
  dist: "dremioS3:///dremio"
}

services: {
  coordinator.enabled: true,
  coordinator.master.enabled: true,
  executor.enabled: true,
  flight.use_session_service: true
}

However, when I comment out this, it all goes well.

dist: "dremioS3:///dremio"

Not sure how this is affecting the connection to the samples.dremio.com bucket, I also have core-site.xml added, and here it’s for the reference:

<?xml version="1.0"?>
<configuration>
<property>
    <name>fs.dremioS3.impl</name>
    <description>The FileSystem implementation. Must be set to com.dremio.plugins.s3.store.S3FileSystem</description>
    <value>com.dremio.plugins.s3.store.S3FileSystem</value>
</property>
<property>
    <name>fs.s3a.access.key</name>
    <description>Minio server access key ID.</description>
    <value>minio</value>
</property>
<property>
    <name>fs.s3a.secret.key</name>
    <description>Minio server secret key.</description>
    <value>secret</value>
</property>
<property>
    <name>fs.s3a.aws.credentials.provider</name>
    <description>The credential provider type.</description>
    <value>org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider</value>
</property>
<property>
    <name>fs.s3a.endpoint</name>
    <description>Endpoint can either be an IP or a hostname, where Minio server is running . However the endpoint value cannot contain the http(s) prefix. E.g. 175.1.2.3:9000 is a valid endpoint. </description>
    <value>192.xxx.xxx.xxx:9000</value>
</property>
<property>
    <name>fs.s3a.path.style.access</name>
    <description>Value has to be set to true.</description>
    <value>true</value>
</property>
<property>
    <name>dremio.s3.compat</name>
    <description>Value has to be set to true.</description>
    <value>true</value>
</property>
<property>
    <name>fs.s3a.connection.ssl.enabled</name>
    <description>Value can either be true or false, set to true to use SSL with a secure Minio server.</description>
    <value>false</value>
</property>
</configuration>

Any clues?

5

@yalmasri Can you try to create a folder under your bucket Dremio and give that as the path on dist:///

Let me check what is the relation and get back to you

6

Now dist looks like this:

dist: "dremioS3:///dremio/data"

But nothing changed, unfortunately.