In the Dremio UI, my modified column is showing:
1522186660010261
with a “# modified” in the column header which says it is a INT datatype.
Can we support displaying it as a timestamp with year, month, day, hour, mi, seconds, etc…??
It is a int, but it is also a int64 timestamp. Using pyarrow the parquet schema is shown below.
my_parquetfile.schema
<pyarrow._parquet.ParquetSchema object at 0x7fd0d8e4f448>
InvestmentVehicle_Id: BYTE_ARRAY UTF8
year: BYTE_ARRAY UTF8
month: BYTE_ARRAY UTF8
yyyymmdd: INT64
dwh_filename: BYTE_ARRAY UTF8
modified: INT64 TIMESTAMP_MICROS