We recently discovered that the results from Dremio when ordering by a column that contains NaN are inconsistent. Here is a screenshot of the results of querying the attached parquet file.
DecimationEdgeCaseValues.zip (1.0 KB)
As you can see the value
NaN appears twice in different places where it is expected that they appear together as it is the case when ordering by ascending order.
Is this a known issue? Any recommendations to deal with this?
Thanks in advance.