Query Completion Status

#1

Hey guys,

Is there a way to check the status of a query in Dremio which indicates the query completion status/progress which we usually get in other compute engines like spark indicating % of job completed.

Or does Dremio have any plan for this feature in future.

Please let us know your thoughts on this

Thanks,
Jalandhar

#2

@jalandhar

We currently have no direct way of telling how much a query is done but you can use the JOB API to get the status

To find out how much is done, open the job profile and see from bottom-up on how many operators have records displayed

#3

Thanks @balaji.ramaswamy

Could you please elaborate on the second point of seeing the records in operators.

I don’t see any specific column indicating records in the operators.

Attaching my job profile screen for reference.

Screenshot 2020-08-13 at 1.18.10 PM
Screenshot 2020-08-13 at 1.18.10 PM2264×1030 181 KB

#4

@jalandhar

Scroll down to the operators and you can see number of records, looking at your screenshot, maybe STREAMING_AGGREGATE in process?

Thanks
@balaji.ramaswamy