Executing multiple queries on Iceberg table in one single job

1

Hi Team,

Our application requires multiple update statements on Iceberg to be executed as a batch. However, each query is runs as a separate job which makes tracking the status of the entire batch difficult for us. Please let us know if there is a way to issue multiple SQL commands in a single dremio job.

Thanks
Sumi

2

@Sumithra Each SQL statement will be a separate job in Dremio

3

Hi @balaji.ramaswamy ,

Thank you for your response. Can we tag these jobs as a batch?

Thanks
Sumi

4

@Sumithra Take a look at the queries.json under the Dremio log folder for the current and under /log/archive for last 30 days. There is a lot of information you can find to group by queries. Please let me know if that helps, if not on what you are trying to group