There is some documentation here for working with datasets via SQL. Is this documentation complete? There is no documented way to format a PDS via SQL.
- For file system sources, edit the source and click on the metadata tab and check “Automatically format files into physical datasets when users issue queries”, if user issues a query, Dremio should automatically format the datasets. However if you are formatting CSV format, then please keep an eye as the default CSV options, example comma as the delimiter may not apply for you and the promotion would result in wrong data. If it is JSON or PARQUET you should be good
- Using REST API Promote Dataset