S3 select PARQUET Dremio + MinIO

1

Hello,

Would it be possible to know if the S3 Select action is available when Dremio is connected to MinIO and when the data is in PARQUET format ? That is, is it possible to use the S3 API of MinIO to only retrieve filtered data so that Dremio processes only that filtered data and not the whole data ?

Thanks in advance.

Best regards,

Tristan Labetoulle

2

@tlabet When you write a SQL with a FILTER, if the column used in the FILTER is a partition column then Dremio should prune all partitions except the ones that matches the FILTER, if it is a non-partition column then Dremio should do a FILTER PUSH down