Dremio and Timescale for realtime time-series data reflection

Hi @balaji.ramaswamy,

Currently i have project that involved streaming data from IoT and IIoT. One of the requirement is plotting fast and can easily scroll and jump to specified time index.

We are using timescale/pgsql to store time series, but we want to use data reflection to cache the data for optimized for querying and displaying to console.

Can we do data reflection in realtime? I mean when the data is arrived the reflection is directly updated.

Or do you have any other ideas around this?


Hello @wellytambunan

The only way out now is to do on demand refresh metadata (SQL) followed by Refresh reflection (API) as part of your pipeline