Hi @balaji.ramaswamy ,
I am testing how runtime filtering works. For that i have ran below query once with planner.filter.runtime_filter
and exec.non_partitioned_parquet.enable_runtime_filter
support key enabled and once disabled. I found no such difference in job profile. I have both job profile for reference.
SELECT sum(price) as sum_price,custumer_state,product_category_name,EXTRACT(YEAR FROM order_purchase_timestamp) as order_year from minio.dremio.olist.order_items join (select order_id as order_id,customer_unique_id as customer_unique_id,TO_TIMESTAMP(order_purchase_timestamp, 'YYYY-MM-DD HH24:MI:SS', 1) as order_purchase_timestamp ,customer_state as custumer_state from minio.dremio.olist.orders join minio.dremio.olist.customer on orders.customer_id = customer.customer_id) new_orders on order_items.order_id = new_orders.order_id join minio.dremio.olist.products on order_items.product_id = products.product_id group by custumer_state,price,product_category_name,EXTRACT(YEAR FROM order_purchase_timestamp);
19c18ee3-7e6c-4c33-8595-4d8b635a6273.zip (26.8 KB)
28e3f84e-3ad6-4520-9e39-957833f66bdf.zip (26.6 KB)