Do I understand it right that, having an incremental refresh policy on a physical dataset, Dremio will attempt to refresh reflections for derived datasets also incrementally?
If this is the case, then does Dremio support incremental reflections for derived datasets with unions?
The reason I’m asking is that, according to Dremio documentation, incremental reflections don’t work for derived datasets with joins.
I plan to have a derived dataset with a code like this:
SELECT f1, f2 FROM my_datasource UNION ALL SELECT f2, f1 FROM my_datasource
where my_datasource is a physical dataset with a raw reflection with incremental refresh policy.