Unable to query COLUMNS data after reprovisioning default engine

The query to get columns data from information schema tables
select * from INFORMATION_SCHEMA.COLUMNS results in the error nullPointerException with the following message

{"errorMessage":"Unexpected error occurred","context":["SqlOperatorImpl INFO_SCHEMA_SUB_SCAN","Location 0:0:6","Fragment 0:0"],"moreInfo":""}

Previously, this query ran only on the default engine and threw the same error even before when it was run on other engines

It has to do with file system authentication. How is “dremio” user authenticating to where you have local and dist pointed to? In linux the default user is “dremio”, so it needs to have permissions to the db, fs, catalog, etc. folders that dremio uses.

Our deployment is the standard AWS Marketplace community one, I am assuming all that would be taken care of? no?

@udaykrishna5

Can you please share the job profile

81c8f7db-2de2-4518-a8a8-090b09f0ba01.zip (11.4 KB)

@balaji.ramaswamy here’s a copy of the query profile

@udaykrishna5

Sorry for the late reply,

Looks like we are hitting an NPE. Does this happen only when the FILTER has a regex? What happens, if you remove the FILTER?

There was no filer just running select * from INFORMATION_SCHEMA.COLUMNS led to NPE as well.
upgraded to 4.7 the error does not seem to exist anymore