INFORMATION_SCHEMA table information not available until table has been queried

Dremio Cloud
1

Hi,

INFORMATION_SCHEMA table information not available until table has been queried…

We are making Iceberg tables on AWS S3 available in metastores in Dremio Cloud.

I rely on INFORMATION_SCHEMA.TABLES and INFORMATION_SCHEMA.COLUMNS to discover the tables present and columns available to build queries to be run against these tables.

When we make new tables available or change schemas of the tables - the information for the tables seems not to be available in INFORMATION_SCHEMA unless I first do a SELECT * FROM the tables.

I would expect INFORMATION_SCHEMA to reflect the objects available without me having to query the objects first.

Are my expectations too high or misguided?

Thanks,
Jamie

2

@Jamie Current behavior is that only promoted datasets are part of information_schema."tables".

3

Hi, So does ALTER TABLE REFRESH METADATA… force promotion, or can that only be done by querying the table?
Thanks

4

@Jamie Either works, it is not FORCE PROMOTION but AUTO PROMOTION

You can also use API