ORC does not support type conversion from file type string (235) to reader type array<string> (25)

1

ORC split generation failed with exception: org.apache.orc.impl.SchemaEvolution$IllegalEvolutionException: ORC does not support type conversion from file type string (235) to reader type array (25)

Dremio

Build

4.9.1-202010230218060541-2e764ed0

Edition

Enterprise Edition

@balaji.ramaswamy could you help check

2

@ljd520cc Are you trying to cast? Do you have the profile?

3

PTS_093a4999-d035-41e6-8fa7-186c50552eec.zip (7.4 KB)

Please see the attached profile.

4

no any cast logics, just run ‘select * from a Hive table’, but in another environment, it works well, the Dremio version also is 4.9.1-202010230218060541-2e764ed0

5

desc_d111cd1d-dd65-439e-8d25-68b92df3edfd.zip (6.4 KB)

I tried to use desc to show table metadata, but failed with message “IllegalFormatConversionException: d != java.lang.String”

6

forget_014fee92-f948-40c6-8220-ee0b40aff743.zip (7.2 KB)

Unable to forget its metadata as well.
IllegalEvolutionException: ORC does not support type conversion from file type string (235) to reader type array (25)

@balaji.ramaswamy

7

@ljd520cc It seems like there is schema evolution (mixed types), similar to the post below

Are you able to provide the output of “describe formatted pts_db_sit.t2_br_eod_set” and also “hive --orcfiledump hdfs://”