If we upload the text file converted into json file directly into dremio and then query it can we be able to see the text data?
@rohith.krishnakumar When you say convert file to JSON, then load into Dremio, are you loading as JSON then Dremio will display regular varchar columns as texts and if there are JSON structs and lists they will be complex types
No, I mean we’ve a text file in an object storage and to even access it in dremio, we’ve gotta choose the JSON / Parquet / CSV etc format yeah? So, if we build a mechanism to convert the unstructured text/pdf file to convert it to a valid JSON post text extraction, would we be able to query it?
@rohith.krishnakumar If the format of the file is text or CSV, you can only promote as that but later ina view you can us convert_from and change the field to struct