# Information about RowsScanned from historical jobs

**URL:** <https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798>\
**Category:** Uncategorized\
**Created:** [July 12, 2023, 5:23pm UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798 "2023-07-12T17:23:29Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![Lincoln\_Borges](https://avatars.discourse-cdn.com/v4/letter/l/7feea3/32.png) [@Lincoln\_Borges](https://community.dremio.com/u/Lincoln_Borges)\
**Post date:** [July 12, 2023, 5:23pm UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798/1 "2023-07-12T17:23:29Z")

</div>

Hi,

I want to analyze the last few days the jobs that Dremio in my company has been running to check what Views are generating the most “Row Scanned” and the frequency with which users execute them.

I tried to use sys.projetct.history.jobs / sys.history.jobs, but here we are using Dremio Software.

So I downloaded the “queries.2023-07-11.0.json” inside log/coordinator/archive, but this “queries.json” has only two columns, that is, Query ID and Outcome.

I thought that with the Query ID (from this “queries.json”) I could find for each one of them the “Row Scanned” information, but the API v3 return does not have this “Row Scanned”.

Can someone help me?

I just want something very similar to this, but on Excel or a CSV to analyze the statistics.

 ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/3/37dc050cae989163ea7c5bd2fe99f021a95c131d.jpeg)

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [July 12, 2023, 9:07pm UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798/2 "2023-07-12T21:07:00Z")

</div>

@Lincoln_Borges Are you saying your queries.json has only 2 columns in the entire file?

Are you running into this issue?

[https://docs.dremio.com/software/release-notes/200-release/#breaking-changes](https://docs.dremio.com/software/release-notes/200-release/#breaking-changes)

Can you please attach the queries.json if data in it is not sensitive?

---

<div class="post-metadata">

**Author:** ![Lincoln\_Borges](https://avatars.discourse-cdn.com/v4/letter/l/7feea3/32.png) [@Lincoln\_Borges](https://community.dremio.com/u/Lincoln_Borges)\
**Post date:** [July 13, 2023, 11:18am UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798/3 "2023-07-13T11:18:57Z")

</div>

@balaji.ramaswamy Im attaching the “queries.json” file that I have in the “/var/dremio\_efs/log/coordinator” folder.

[queries.zip](https://community.dremio.com/uploads/short-url/4uLoAmI80To9xZNqcHMuQPBDMNm.zip) (338.8 KB)

As you can see, just have these two pieces of information:

![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/d/da56f676a249d4ef095d5829139f2779f5d32c76.png)

Is it possible to have more information so I can do a better analysis of the user and what they are consuming on my Dremio Software.

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [July 13, 2023, 5:18pm UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798/4 "2023-07-13T17:18:50Z")

</div>

@Lincoln_Borges queries.json should have way more number of columns,

- What version of Dremio is this?
- What kind of deployment is this? Like K8’s/Yarn etc
- Send us your logback.xml from the `conf` folder

---

<div class="post-metadata">

**Author:** ![Lincoln\_Borges](https://avatars.discourse-cdn.com/v4/letter/l/7feea3/32.png) [@Lincoln\_Borges](https://community.dremio.com/u/Lincoln_Borges)\
**Post date:** [July 13, 2023, 6:44pm UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798/5 "2023-07-13T18:44:59Z")

</div>

@balaji.ramaswamy,

> Send us your logback.xml from the conf folder

Here:  
[logback.zip](https://community.dremio.com/uploads/short-url/pBSpSMEThGeVEwo0SN8Dk4ZnFf1.zip) (1.4 KB)

> What kind of deployment is this? Like K8’s/Yarn etc

I will check with the tech department. The only thing I know is that Dremio is running on an AWS EC2 machine.

> What version of Dremio is this?

This one:  
 ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/d/d20404d3addbb3feca38fea430ecb363e2628131.png)

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [July 15, 2023, 8:26pm UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798/6 "2023-07-15T20:26:46Z")

</div>

@Lincoln_Borges It seems like you have a very old logback.xml, during upgrade, do you copy over `conf` folder from the previous version? Here is a logback.xml from 23.x which should be same as 24.x

Can try one of the 2 things below

- Copy over the logback.xml from v24 to your current logback.xml folder under the `<DREMIO-INSTALL-DIR>/conf`
- Copy the one attached and overwrite the one under `<DREMIO-INSTALL-DIR>/conf`

Restart coordinator, run some queries, check if queries.json has got back all columns

[logback.xml.zip](https://community.dremio.com/uploads/short-url/p27XfIpYsimrt7sYm7nXk2XhMc1.zip) (1.8 KB)

---

<div class="post-metadata">

**Author:** ![Lincoln\_Borges](https://avatars.discourse-cdn.com/v4/letter/l/7feea3/32.png) [@Lincoln\_Borges](https://community.dremio.com/u/Lincoln_Borges)\
**Post date:** [July 18, 2023, 11:26am UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798/7 "2023-07-18T11:26:56Z")

</div>

@balaji.ramaswamy

It worked!

With this logback.xml you provided, my “queries.json” has lots of information now.

Thank you 🙂

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [July 22, 2023, 6:35am UTC](https://community.dremio.com/t/information-about-rowsscanned-from-historical-jobs/10798/8 "2023-07-22T06:35:39Z")

</div>

@Lincoln_Borges Glad it worked, thanks for the update
