Is there a way to check the status of a query in Dremio which indicates the query completion status/progress which we usually get in other compute engines like spark indicating % of job completed.
Or does Dremio have any plan for this feature in future.
Please let us know your thoughts on this
We currently have no direct way of telling how much a query is done but you can use the JOB API to get the status
To find out how much is done, open the job profile and see from bottom-up on how many operators have records displayed
Could you please elaborate on the second point of seeing the records in operators.
I don’t see any specific column indicating records in the operators.
Attaching my job profile screen for reference.
Scroll down to the operators and you can see number of records, looking at your screenshot, maybe STREAMING_AGGREGATE in process?