Incremental reflection update question

If I use a modified date as the “Identify new records using the field”, and a record from the underlying data source is deleted, will the incremental reflection update also remove the deleted record or will it only add records with a modified_date > the previous max(modified_date)- leaving deleted records in the reflection?

Hi @summersmd

Only append-only datasets are supported for Incremental Update Mode. Updates and deletions of underlying files leads to incorrect results. Dremio recommends using Full Refresh in this case.

Incremental Reflections

Thanks
@balaji.ramaswamy