Problem on create large dataset

Hi guys,

I am trying to create a dataset from a S3 folder containing a lot of files each of them containing data from a hour, but the request that get the structure of data is not responding.

Have you tried re-designing your file structure and using the power of Dremio’s partitioned datasets

(towards the bottom). We do this at our site on a NAS


Thanks a lot. I will try this.