Unexpected results when ordering by column with NaN values

We recently discovered that the results from Dremio when ordering by a column that contains NaN are inconsistent. Here is a screenshot of the results of querying the attached parquet file.
DecimationEdgeCaseValues.zip (1.0 KB)

As you can see the value NaN appears twice in different places where it is expected that they appear together as it is the case when ordering by ascending order.

Is this a known issue? Any recommendations to deal with this?

Thanks in advance.

1 Like

As a new user I was not allowed to upload the case where the column is ordered in ascending order.
Here are the results of running the same query but with ASC instead.

@gleonoliva Welcome to the Dremio Community! We’ve raised this with engineering. Will keep you posted.

1 Like

@gleonoliva this should be fixed in v23.1.0.