INFORMATION_SCHEMA.COLUMNS query fails in web ui, succeeds in datagrip

Hello!

On our helm chart based setup (image sha256:95bb1841335c41ae32b1e9fb9a4c779ec047903e94cc66e0a6b7ed3657feddfe) if I try to query information_schema.columns I get

IllegalArgumentException: No enum constant com.dremio.common.types.TypeProtos.MinorType.TIMEMICRO.Show less

However, the same query from DataGrip and through the JDBC driver returns correctly.

Please let me know whether there is a way to query this information also from the Web UI.

Thank you,
Matteo

@ma82 Are you able to send us the profile from the query that failed via UI and the successful query from JDBC?

Hi @balaji.ramaswamy,

thank you for your reply.

I reproduced the problem and checked the generated jobs: both the query from DataGrip and the one from the Web UI are actually listed as “failed”, with the same error.

However, DataGrip rather strangely manages to show valid-looking output and doesn’t emit any error.

For what concerns sending you the profile: are you suggesting to upload the zip files that one can download from the UI?

In that case, is it OK if I avoid sending the header.json file that appears in them?

There seems to be a lot of private information in it.

@ma82 Yes, send me other files, you can leave header.json

Thank you @balaji.ramaswamy

I could reproduce once more using the simple query

select * from information_schema.columns

  • web ui in preview mode: the query succeeded and the corresponding dremio job is in status completed
  • web ui in run mode: the query failed with the previously reported error and the corresponding dremio job is in status failed
  • datagrip: 500 rows appeared in the client, no error was shown but the corresponding dremio job is in status failed

Here are the profiles:

community-dremio-com-8116.zip (29.4 KB)

It would be very valuable for us to be able to query this table.

Thank you for any help on this!

@ma82 It seems like one of the datatypes is causing this, do you have any TIMESTAMP(6) like MICRO seconds datatypes?

1 Like

@balaji.ramaswamy

I think this problem was generated by a mysql source, which we removed yesterday for other reasons [*]: we don’t currently have this problem in production anymore.

We’re planning to simplify the deployment of dremio instances in our qa environments: when we have them we’ll try and find out what mysql types were generating this issue on the dremio side and send you an update.

Thank you for your help!

[*] We’re in the process of moving away from a PoC federation setup to more consistently use s3 as our main data source.