For some reason my dremio query for bigquery (custom ARP connector) is not pushed down. Even simple query with sum() is not pushed down, and the aggregation always happens in dremio.
What are the best ways how to find out why Dremio did not push some query down? I checked the ARP file several times and cannot figure out why it won’t push the query down. Some logs with info what prevents pushdown would be helpful!
Can you share the query profile with us?
SELECT sum(t.latitude) AS col
FROM lukas_bigquery_westeros_knights."solar-melody-287313".my_own_data.bikeshare_stations AS t
profile.zip (8.6 KB)
Thanks @Rakesh_Malugu !
@Rakesh_Malugu Did u have a chance to look at it please?
This is the connector https://github.com/panoramichq/dremio-bigquery-connector - it is mostly copy & paste from Snowflake connector, and modified where it was needed.
I could not figure out why this query is not pushed down. The sum seems to be correctly defined in the APR. What I am looking for is some information in Dremio Query plan, why certain query could not be pushed down. How can I debug this?
I am wondering if you should first submit your connector and then take it forward