Error running query on reflection

1

Hi,

Dremio is throwing an error on my query when I enable reflections on the data. I can run the query without reflections without any problems.

The error is “Cannot convert RexNode to equivalent Dremio expression. RexNode Class: org.apache.calcite.rex.RexOver, RexNode Digest: COUNT($3) OVER (PARTITION BY $0 ORDER BY $1 ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW)”

The query profiles for the successful and failing queries are attached. Does anyone have any idea what could be happening?

-Mike

success-78ab50cf-e353-4abe-b7b2-247fd53be8b6.zip (36.5 KB) fail-d302a0c6-9228-4309-91f1-bd9914dee291.zip (54.2 KB)

2

Hi - is there any update on this? We’re still running into this error on the most recent release (4.3.1).

3

Hello @panomike

Can we get the DDL’s for the below?

cp36434.METRICS3_STG.FACEBOOK_VIEWS.METRIC_CAMPAIGNS_DAILY
cp36434.METRICS3_STG.TWITTER_VIEWS.METRIC_CAMPAIGNS_HOURLY

Also, may i know the source?

We need to repro this.

Thanks,
@Rakesh_Malugu

4

Hey @Rakesh_Malugu,

See the attached SQL for the DDL for those tables. This is running on Snowflake.

Thanks!
dremio-ddl.sql.zip (2.1 KB)

5

Hello @panomike

Apart of the query says that

"SUM(t2.__billed_charge_local_micro_microdollars / 1000000) AS spend "

where t2 is “cp36434”.metrics3_stg.twitter_views.metric_campaigns_hourly" .

In the provided DDL I do not see this column. Can you confirm?

Thanks,
@Rakesh_Malugu

6

Hi @Rakesh_Malugu,

Sorry about that - the field got removed as I was cleaning up internal SQL DDL for upload here.

That field is a DECIMAL field - I have attached an updated DDL.

Thanks,
Mike
dremio-ddl-2.sql.zip (2.6 KB)

7

@panomike

I see that the failed query is not used the reflection at all.

Can you confirm once again, that the query got failed just because you created the reflection on the data?

If query got failed using the reflection then I can check. But here the failed query didn’t used accelerations and failed in planning state itself.

So, I do not see the evidence that the problem is with the creation of reflection here.

Thanks,
@Rakesh_Malugu