Dbt Reflection Partition Transformations

Dremio Cloud
1

In the Dremio Cloud UI we have the option to partition reflections on transformations of specific field types without creating specific fields to partition by. For instance, on a date column, we can partition by Year or Month without creating a column in the underlying dataset for Year or Month.

image
image496×355 13.8 KB

How is this done in dbt? In the below code, assuming I wanted to partition by the Year of the as_of_date field, what is the syntax?

{{ config(
    materialized='reflection',
    reflection_type='raw',
    partition_by=['as_of_date'],
    tags = ["reflection"]
)}}
2

Hi!
Thanks for reaching out. This functionality is not currently supported in the latest version of dbt-dremio; however, our engineers have a working PR (Move reflections to rest API calls by bcmeireles · Pull Request #256 · dremio/dbt-dremio · GitHub ) which will enable the scenario you mentioned above.

3

@caseykarst - The changes listed in the PR look great. Thanks for pointing me to it!

1 Like
4

Great to hear the PR meets your requirements!
If you have any other feedback about dbt-dremio I would love to hear it!
You can email me directly at Casey dot Karst at Dremio.com.
Thanks!
Casey