We started getting this error in complex queries where specific VDS is joined to itself and then joined to glue tables.
This VDS(mediaMapping
) has raw reflection on it.
When running query we have this error: IllegalStateException: IllegalStateException: Memory was leaked by query. Memory leaked: (720896)
But when we disable reflection on mediaMapping query runs fine.
success.zip (79,6 КБ)
failed.zip (52,1 КБ)
I attached both profiles. Recreation of reflection doesnt help.
This qeury started to fail yesterday after i updated schema of glue tables used in it: changed some bigint
columns to int
(including join columns used in query) - updated glue and parquet file. But mediaMapping
table join columns are int
also.
UPDATE: above failed query with reflection of mediaMapping in use was able to succeed if i change this
cast one of the glue table join keys tobigint
. mapping.sourcemedia_id is int
btw.
this is the profile:
14ec6b37-a9b6-493b-8a7b-5efafac0b6c3.zip (52,8 КБ)
Build
25.0.7-202407181421320869-2632b04f
Edition
AWS Edition (activated)