Question about incremental reflection refreshes

1

I see in your documentation that

** All other datasets (physical and virtual). An administrator specifies a monotonically increasing field such as an auto-incrementing key that must be of type BigInt. Incremental updating is not available for datasets without any BigInt fields. This allows the system to fetch the records that have been created since the last time the acceleration was updated.*

What about records in a database table in Oracle, where the key does not change but other fields in the record may have changed. Are these changes picked up during an incremental refresh? Is it possible to use a timestamp column as the key so that newly edited records can be included?

2

Hi @summersmd

Starting 3.2 we support the below

  • As of Dremio 3.2, incremental refresh is supported for datasets with columns fields of
    BigInt, Int, Timestamp, Date, Varchar, Float, Double, and Decimal data types.
  • In releases prior to Dremio 3.2, incremental refresh is supported for datasets with BigInt columns only.

[https://docs.dremio.com/acceleration/updating-reflections.html#full-and-incremental-refresh](http://Incremental Refresh)