I think dremio has an issue reading parquet format 2.6 - which is now the default for pyarrow v9+. You can pass parquet_format=“1.0” when writing the parquet file and you’ll get the old default behavior- which dremio should be happier with.
I think dremio has an issue reading parquet format 2.6 - which is now the default for pyarrow v9+. You can pass parquet_format=“1.0” when writing the parquet file and you’ll get the old default behavior- which dremio should be happier with.