Cannot choose Dataset Format for folder containing '_SUCCESS' file

1

An empty file named _SUCCESS is created when Spark finishes writing to a folder, however Dremio complains Something went wrong when I try to choose format for a folder containing _SUCCESS.

2

Hi @raptium

What is the format of the files Spark has generated? If it is for example Parquet, what happens if you promote the folder containing all the Parquet files and the empty _SUCCESS file or if you are querying through an external Hive table then that case does it work?

Example: Folder name is “Employees” and it contains emp1.parquet, emp2.parquet, _SUCCESS

Then either promote “Employees” or create an external Hive table for 'Employees" and query the table Employees through Dremio

Thanks
@balaji.ramaswamy