IllegalStateException: Memory was leaked by query. Memory leaked: (2097152)

1

When i run a query with filter on 1 field it runs

select * from tablename where from_dt < ‘2020-04-01’ limit 1000 it works fine

but when i add another field to the filter it starts giving me this error.

select * from tablename where from_dt < ‘2020-04-01’ and to_dt > ‘2020-04-01’ limit 1000
It does not work at all. and it gives below error

Strangely, from_dt field already reduced the data search and so to_dt>‘2020-04-01’ should actually woudl have run fatser.

Instead it gave Memoy leak exception.

I checked there was no OutofMemoery Exception. Few lines from statcktrace aer below

:"SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory leaked: (2097152)\nAllocator(row-group-reader) 0/2097152/12582912/9223372036854775807 (res/actual/peak/limit)\n\n\nFragment 1:0\n\n[Error Id: 14d0d9b9-acfb-4789-b00d-9c6611d3366b on gueulpadmf001.devfg.rbc.com:-1]\n\n (com.dremio.common.exceptions.ExecutionSetupException) Failed to create scan operator.\n com.dremio.exec.store.parquet.ParquetOperatorCreator.create():82\n com.dremio.exec.store.parquet.ParquetOperatorCreator.create():66\n com.dremio.sabot.driver.OperatorCreatorRegistry.getProducerOperator():94\n com.dremio.sabot.driver.PipelineCreator$CreatorVisitor.visitSubScan():210\n com.dremio.sabot.driver.PipelineCreator$CreatorVisitor.visitSubScan():115\n com.dremio.exec.physical.base.AbstractSubScan.accept():85\n com.dremio.sabot.driver.PipelineCreator$CreatorVisitor.visitOp():247\n

I also saw there was a field with titled bacthSchema which has strange characters

“batchSchema”:"EAAAAAAACgAMAAAACAAEAAoAAAAIAAAACAAAAAAAAAC7AQAAVG4AABBuAADUbQAAoG0AAGhtAAA0bQAA/GwAAMRsAACMbAAAVGwAABxsAADgawAAoGsAAGRrAAAsawAA6GoAAKhqAAB0agAAOGoAAABqAADIaQAAjGkAAERpAAAAaQAAsGgAAHRoAAAoaAAA8GcAALRnAAB0ZwAAOGcAAPhmAAC0ZgAAbGYAADBmAADsZQAAtGUAAHRlAAAsZQAA8GQAALBkAAB0ZAAAPGQAAABkAAC8YwAAgGMAAERjAAAMYwAA0GIAAJBiAABQYgAAEGIAANBhAACQYQAAWGEAABhhAADcYAAAnGAAAGBgAAAYYAAA2F8AAJRfAABYXwAAIF8AAOReAACoXgAAaF4AADBeAAD4XQAAvF0AAHxdAABAXQAABF0AAMhcAACQXAAAVFwAABxcAADgWwAAoFsAAGBbAAAoWwAA6FoAAKRaAABoWgAAIFoAAOhZAACoWQAAbFkAADBZAAD0WAAAtFgAAHhYAAA4WAAA9FcAALhXAACEVwAAUFcAAAxXAADMVgAAlFYAAFxWAAAgVgAA6FUAAKRVAABYVQAAFFUAANhUAACcVAAAYFQAACBUAADgUwAAmFMAAFxTAAAYUwAA2FIAAJRSAABcUgAAHFIAANxRAACkUQAAbFEAADBRAAD0UAAAuFAAAHhQAABAUAAABFAAAMBPAACATwAAQE8AAPxOAADATgAAgE4AADxOAAD8TQAAwE0AAIhNAABITQAAEE0AANRMAACMTAAAVEwAABhMAADkSwAAqEsAAGhLAAAoSwAA+EoAAMBKAACMSgAAUEoAABhKAADgSQAApEkAAGhJAAAoSQAA7EgAALBIAAB0SAAAMEgAAOxHAACoRwAAaEcAADRHAAD8RgAAwEYAAIRGAABIRgAAEEYAANRFAACURQAAWEUAABhFAADgRAAAoEQAAFxEAAAgRAAA6EMAALBDAABwQwAALEMAAPBCAAC4QgAAfEIAAEhCAAD8QQAAvEEAAHxBAAA8QQAAAEEAAMRAAACIQAAATEAAAAxAAADMPwAAjD8AAFA/AAAIPwAAzD4AAJA+AABYPgAAED4AANQ9AACUPQAAWD0AABw9AADgPAAAnDwAAFw8AAAcPAAA2DsAAJg7AABYOwAAHDsAANg6AACgOgAAXDoAABA6AADIOQAAhDkAAEg5AAAMOQAAzDgAAIg4AABUOAAAGDgAANw3AACYNwAAWDcAAAw3AADQNgAAlDYAAFg2AAAcNgAA5DUAAKA1AABcNQAAGDUAAMg0AABwNAAAJDQAANgzAACgMwAAYDMAACAzAADoMgAAoDIAAFgyAAAQMgAAyDEAAIQxAAA8MQAA/DAAAMAwAAB8MAAAQDAAAPwvAACwLwAAaC8AABQvAADALgAAhC4AAEQuAAAELgAAvC0AAHgtAABALQAACC0AANQsAACgLAAAZCwAACQsAADoKwAAqCsAAGwrAAAkKwAA5CoAAKQqAABgKgAAHCoAANgpAACUKQAAUCkAABwpAADoKAAAsCgAAHwoAABIKAAAFCgAANgnAACcJwAAXCcAACAnAADgJgAAqCYAAGQmAAAQJgAAtCUAAGAlAAAEJQAAsCQAAFQkAAAAJAAApCMAAGgjAAAoIwAA8CIAALAiAABwIgAAMCIAAPQhAAC0IQAAdCEAADghAAD4IAAAsCAAAHQgAAAoIAAA4B8AAJgfAABQHwAACB8AAMAeAAB8HgAARB4AAPwdAAC4HQAAdB0AACwdAAD4HAAAvBwAAHgcAAA4HAAA/BsAALQbAABoGwAAHBsAAOAaAACcGgAAXBoAABAaAADQGQAAjBkAAFAZAAAQGQAA1BgAAJQYAABYGAAAGBgAAOgXAACsFwAAaBcAACgXAADkFgAApBYAAGgWAAAwFgAA7BUAAKgVAABoFQAAKBUAAOgUAACsFAAAdBQAADAUAADsEwAAqBMAAFgTAAAUEwAA1BIAAJQSAABIEgAA+BEAALARAABoEQAAJBEAAOAQAACkEAAAXBAAABQQAADMDwAAfA8AADwPAAD0DgAAoA4AAFgOAAAYDgAA3A0AAJgNAABYDQAAGA0AANAMAACMDAAATAwAAAQMAADECwAAhAsAAFALAAAYCwAA2AoAAJQKAABYCgAAEAoAANgJAACcCQAAYAkAACQJAADoCAAArAgAAHAIAAA0CAAA9AcAALwHAACEBwAASAcAAAgHAADEBgAAdAYAACQGAADgBQAAoAUAAGQFAAAgBQAA3AQAAJgEAABYBAAAGAQAANQDAACYAwAAVAMAABQDAADMAgAAiAIAAEACAAD4AQAAsAEAAGgBAAAoAQAA8AAAALwAAACEAAAATAAAAAQAAACqmP//FAAAABQAAAAUAAAAAAACARgAAAAAAAAAAAAAAFye//8AAAABQAAAABMAAAAkX2RyZW1pb18kX3VwZGF0ZV8kAO6Y//8UAAAAFAAAABQAAAAAAAgBEAAAAAAAAAAAAAAA3Jj//wkAAAB0cmFuc19lbmQAAAAimf//FAAAABQAAAAUAAAAAAAIARAAAAAAAAAAAAAAABCZ//8LAAAAdHJhb

2

from date < t1 and to date > t1 should result in a null set unless there is a time component to it. if it is only date, then null set.

the error also said “Failed to create scan operator.”

did you wanted to imply:

from date <= t1 and to date >= t1 ?