OPTIMIZE and VACUUM table cannot reduce iceberg metadata file size

9

I found this answer from @ajay098

And once I changed the compression to gzip, it is working like a charm!!!

In short, run this

ALTER TABLE TABLE_NAME SET TBLPROPERTIES (
            'write.parquet.compression-codec' = 'gzip'
             );

and then do the normal VACUUM with OLDER_THAN and RETAIN_LAST;