The dataset is pipe-delimited csv which was working till 2.0.8. After upgrade to 2.1.5, I am getting error like
Error processing input: , line=141877, char=62914560. Content parsed: [ ]
Is it possible to ignore these kinds of error and continue with processing query
The same works when read using spark dataframe