Query Error Details: Column Name and Row Number

1

I received the following error: GandivaException: Failed to cast the string 1,925 to double.

Is there a way to receive a more detailed error message that specifies the column and row where an error occurred? For larger datasets where multiple columns are CAST(column_name AS DOUBLE) for explicit data types, it would be helpful to know the column that is triggering the error message, so the issue can be resolved in a staging table (i.e., REGEXP_REPLACE).

2

@datalifenyc The column name is not displayed, but here is a method you can try to narrow down. Look at the error tab and see which operator it is complaining about. It might be something like PROJECT xx-xx-xx, with that info, open the planning tab, scroll down to Final Physical Transformation and look at the PROJECT phase-number-opertor id and in that PROJECT hopefully there are not too many casts

1 Like
3

Thanks @balaji.ramaswamy. I will keep this error handling approach in mind for future issues.