Display European characters correctly in Dremio

1

Hi,

I am trying to store European characters in Dremio. I found that characters are being changes as � or ‘’ or other character once being stored /read in dremio.

Can you please help me on how to store the data correctly.
I tried to load from Excel, csv or load from pandas . But none of them worked.
I also tried to load from S3 into dremio. But the same issue.

Can anyone please help me.

Thanks

2

Hi @ajayacharya , are your files encoded in UTF-8 ?
I once had this problem with ASCII encoded files.

3

Hi @ajayacharya
If the information is stored correctly in the underlying files, note that your shell environment matters to display the information.

You’ll need to export the following variable to display UTF-8 correctly:

export LANG=en_US.UTF-8
export LC_CTYPE=en_US.UTF-8

(en_US.UTF-8 is the example from my setup).

Thanks,
bob