cdjd.org.apache.arrow.memory.BaseAllocator - Memory was leaked by query. Memory leaked

1

I’m using dremio 18 JDBC driver . console show this message


[ERROR] [19:51:09] cdjd.org.apache.arrow.memory.BaseAllocator - Memory was leaked by query. Memory leaked: (6717440)
Outstanding child allocators :
  Allocator(dremio-client-connections) 0/7512064/12122624/1908932608 (res/actual/peak/limit)
Allocator(ROOT) 0/6651904/12122624/1908932608 (res/actual/peak/limit)

[WARN ] [19:51:09] cdjd.com.dremio.exec.client.DremioClient - Error while cleaning up resources in DremioClient
java.lang.IllegalStateException: Memory was leaked by query. Memory leaked: (8073216)
Allocator(dremio-client-connections) 0/8073216/12122624/1908932608 (res/actual/peak/limit)

	at cdjd.org.apache.arrow.memory.BaseAllocator.close(BaseAllocator.java:437)
	at cdjd.com.dremio.common.AutoCloseables.close(AutoCloseables.java:139)
	at cdjd.com.dremio.exec.client.DremioClient.cleanUpResources(DremioClient.java:868)
	at cdjd.com.dremio.exec.client.DremioClient.close(DremioClient.java:428)
	at com.dremio.jdbc.impl.DremioConnectionImpl.closeOrWarn(DremioConnectionImpl.java:718)
	at com.dremio.jdbc.impl.DremioConnectionImpl.cleanup(DremioConnectionImpl.java:731)
	at com.dremio.jdbc.impl.DremioHandler.onConnectionClose(DremioHandler.java:34)
	at cdjd.org.apache.calcite.avatica.AvaticaConnection.close(AvaticaConnection.java:216)
	at org.pentaho.di.core.database.Database.closeConnectionOnly(Database.java:820)
	at org.pentaho.di.core.database.Database.disconnect(Database.java:801)
	at org.pentaho.di.trans.steps.tableinput.TableInput.dispose(TableInput.java:279)
	at org.pentaho.di.trans.step.RunThread.run(RunThread.java:142)
	at java.lang.Thread.run(Thread.java:748)
	Suppressed: java.lang.IllegalStateException: Memory was leaked by query. Memory leaked: (6717440)
Outstanding child allocators :
  Allocator(dremio-client-connections) 0/7512064/12122624/1908932608 (res/actual/peak/limit)
Allocator(ROOT) 0/6651904/12122624/1908932608 (res/actual/peak/limit)

		at cdjd.org.apache.arrow.memory.BaseAllocator.close(BaseAllocator.java:437)
		at cdjd.org.apache.arrow.memory.RootAllocator.close(RootAllocator.java:29)
		... 12 common frames omitted
2

@rongfengliang

Was the memory leak just before Dremio was brought down? Are you able to provide us with the complete server.log?

3

Thanks. I had checked dremio server status it’s not down. current server.log is too big and contains some security information. We can’t share It. I will check the server.log message