Field 'xyz' exceeds the size limit of 32000 bytes (though I don't have that filed in the Query)

Field ‘xyz’ exceeds the size limit of 32000 bytes (though I don’t have that filed in the query).

I found that xyz field size is crossing the dremio limit of 32000 bytes and gave only required fields in the query with out that xyz field.

Still Dremio is throwing error “Field ‘xyz’ exceeds the size limit of 32000 bytes”. Please advise. This is very annoying & blocker.

I am using 4.6.1 Dremio version.

@koti

What is the source? Does this happen during promotion? Can you please send us the profile

Thanks
Bali

@koti

This is failing before we come to the physical plan so we are hitting the columns that are not selected and fail. Will check on this and get back to you

Thanks
Bali

hi,

This is failing before we come to the physical plan so we are hitting the columns that are not selected and fail. Will check on this and get back to you

Is there any update on this one ?
This issue is impacting very badly.

@koti

Are you able to provide us the profile for this failed query?

Thanks
Bali

Here is the profile of the Query.
Screenshot of the error is also attached. The filed throwing error is not in the Select list of the Query.

85af1387-f2e3-4ea9-aef7-dc15dd873d85.zip (5.6 KB)

Solution to fix this is, Create a view in mongoDB or any other Source with the fields you need without that xyz field 32000 bytes field causing the error. Then, access the view from Dremio, It works fine.

1 Like