Export to Azure Blob Storage

1

Hello,

I am trying to reverse ETL datasets from Dremio into Azure Blob Storage using dbt. I found this article describing how to do it: https://www.dremio.com/resources/tutorials/high-performance-parallel-exports/#toc_item_Introduction

I configured my source with CTAS support per the article.

However, when I execute a query like the following:

create table
    "Data Lake"."04-dir"."application"."retl"
  as (
    WITH input_mart AS (
    SELECT
        *
    FROM
        "data mart"."application"."input_data"
)

SELECT
    *
FROM
    input_mart
  )

I get an error:

Cannot create the table because '04-dir' container does not exist.

The container definitely exists so not sure why Dremio thinks it doesn’t.

Still on an ancient version of Dremio so maybe this is a bug. Waiting for Dremio Cloud Azure to come out before upgrading.

Thanks for your help!

2

Well, I played around a bit and got it to work. It seems that when creating the Source you need to set the Root Path (Advanced Options) to /. If you put a path in there to the directory you want to store the results it fails. Hopefully that is just a bug in our old version of Dremio as that is not documented and not ideal, but it works

3

@drew If you put a path, then Dremio will start from that path and append "Data Lake"."04-dir"."application". to it so if you are always going to give the fully qualified path from root then just leave the root path to default which is /