@Dave0m Looks like you’re still struggling to get your use case running. See if this helps: S3 key prefix - dir0, dir1...dirN but no object/file name? - #2 by lenoyjacob
This does not work in all cases (like parquet or Iceberg datasets, i.e. post “unlimited splits”) and YMMV. But the method I posted above will work for all datasets.