I have same aggregation reflections which have a big footprint of many GigaBytes, and some which have small footprints (some MegaBytes).
Expected query duration of the big ones : 10 seconds
Expected query duration of the small ones : less than 1 seconds
I currently use Amazon S3 as Dremio’s distributed storage.
I would like to be able to choose the distributed storage for every acceleration when I need it, so that I can use fast storage layers when I need, and S3 when I don’t need results in sub-second delay.
Any thoughts ?