I produced some parquet files by using to_parquet(). The engine used is pyarrow ==9.0.0, I then put the files onto HDFS and promote the files in Dremio. Dataset preview shows the data correctly. But once the files are promoted and I tried to query the dataset, i get no result return.
Am I missing something?