Unexpected results when ordering by column with NaN values

1

We recently discovered that the results from Dremio when ordering by a column that contains NaN are inconsistent. Here is a screenshot of the results of querying the attached parquet file.
DecimationEdgeCaseValues.zip (1.0 KB)

nan_parquet_sql
nan_parquet_sql1996×581 25.5 KB

As you can see the value NaN appears twice in different places where it is expected that they appear together as it is the case when ordering by ascending order.

Is this a known issue? Any recommendations to deal with this?

Thanks in advance.

1 Like
2

As a new user I was not allowed to upload the case where the column is ordered in ascending order.
Here are the results of running the same query but with ASC instead.

image
image1083×615 26.8 KB

3

@gleonoliva Welcome to the Dremio Community! We’ve raised this with engineering. Will keep you posted.

1 Like
4

@gleonoliva this should be fixed in v23.1.0.

image
image2730×936 142 KB