Dremio Metadata refresh

1

Hi Dremio Team,

Please let me know,

  1. When Dataset Discovery in Meta data refresh at source level will execute select count(*) from table?We are facing table lock due to this query when table holds ~30 M data.

  2. Can we disable the count checking?

Thanks,
Ajay Babu Maguluri.

2

@AjayBabuM

Currently for an RDBMS source, Dremio gets rowcount with the above method? What is the source?

Thanks
Bali

3

Hi Balaji,
Thanks for quick reply.

It’s MySQL. What acutally that count using for.Can we disable the count checking?

Thanks,
Ajay Babu Maguluri.

4

Currently no @AjayBabuM , it is used for planner estimates, let me see if we can find an alternate method

5

Thanks,

It will happen at Dataset Discovery → Fetch every or Dataset Details → Fetch mode time?