Error create Reflections

Dremio University
1

Hi!

I am doing a proof of concept with dremio docker on local version 24.2.6, trying to create a reflection I get this error:

UnknownFormatConversionException: Conversion = ‘Unknown format (pdfs) conversion for path /opt/dremio/data/pdfs/accelerator/5b71eb52-6ad4-48f0-9bf6-2c7b3b43a120/33c95870-b2ed-44ec-8db4-16f428515bad_0 Error Message : No File System scheme matches’

2

@abuitrago With 21.x and above, PDFS or in other words local is no longer supported. You have to write your reflections to a distributed storage like S3. See documentation below

3

Hi @balaji.ramaswamy I am getting an same error, I am using GCS as source object, And we are using csv file. Can you please explain me this error and how I can solve this.

4

@fenilj This is unrelated to your source object, on you dremio.conf, you need a dist:/// parameter pointing to a GCS location, see documentation above

5

Thanks Let me check my config.

6

You can also use a local filesystem folder like this:

In dremio.conf, do something like this:

paths: {
  # the local path for dremio to store data.
  local: "/Users/bennychow/dev/dremioData/data"

  # the distributed path Dremio data including job results, downloads, uploads, etc
  dist: "file:///Users/bennychow/dev/dremioData/pdfs"}