Download File Formats:
- JSON download produces invalid JSON. The array output should contain an open bracket at the start, commas between records and a close bracket at the end.
- Can we add a TAB delimited text option for downloads? Saving to CSV is problematic if your data contains commas.
- Can we add a Parquet option for downloads as well?
A dataset which contains a calculated column defaults to a CHAR datatype instead of VARCHAR.
A. Create a test.txt text file with two lines. ‘a’ for header and ‘XYZ’ as the row
B. Create a data set with the following SQL statement and call it test_union_all
SELECT ‘123456789’ as new_column, a FROM "test.txt"
SELECT ‘987’ as new_column, a FROM "test.txt"
C. The following statements works:
SELECT * FROM “@test_user”.test_union_all where new_column = '123456789’
SELECT * FROM “@test_user”.test_union_all where new_column like '987%'
D. The following statement fails:
SELECT * FROM “@test_user”.test_union_all where new_column = '987’
E. Reworking the original SQL statement and introducing cast( as varchar) fixes the dataset.
SELECT cast(‘123456789’ as varchar) as new_column, a FROM “Drill Examples”."test.txt"
SELECT cast(‘987’ as varchar) as new_column, a FROM “Drill Examples”.“test.txt”
The char vs varchar column definitions also impacts Microsoft SQL Server tables and joins between char/varchar columns of varying length.
A value of ‘12345’ saved in a my_column_name char(6) SQL Server column can only be queried or joined passing in my_column_name = '12345 ’ with an space padded at the end.
- Add the option to install in a directory other than c:\programs files\Dremio… Not everyone has administrative rights on their PC in our team.