How to debug dremio-oss in idea?

1

how to debug dremio-oss in idea?

2

You can run normally dremio with dremio start, then in any IDE for example IntelliJ, attach to this process and make debug, but you can only to code from opensource , but if you need debug some private parts you can debug using jars compiled from dremio directory

I reported some bugs to dremio using this process

3

I can run DremioDaemon in my local idea, but when I execute the query sql, I get an error Error setting up remote fragment execution.

image
image1193×347 22.3 KB

4

please sent logs files to review, in the majority cases, debug is not necesary, with view files is sufficient, also sent query profile Share Query Profile with Dremio | Tutorial

5

87ebcd0a-a393-4780-a712-4a418ce90fa0.zip (14.5 KB)
Attached is the query profile

6

You have a standalone cluster? or how many nodes?
please share server log to review why your dremio are losing connection

7

image
image1908×1063 351 KB

I started it from the source code on my local computer. These are the screenshots of my startup. I can’t find my server log.

8

I added the following jvm parameters and now I can execute the query on my local computer. Do you understand these parameters? -Djava.library.path=/Users/fuliu/Documents/github/dremio-oss/distribution/server/target/dremio-community-25.2.0-202410241428100111-a963b970/dremio-community-25.2.0-202410241428100111-a963b970/lib/DEFAULT_ARCH
–add-opens
java.base/java.lang=ALL-UNNAMED
–add-opens
java.base/java.nio=ALL-UNNAMED
–add-opens
java.base/java.util=ALL-UNNAMED
–add-opens
java.base/java.net=ALL-UNNAMED
–add-opens
java.base/sun.nio.ch=ALL-UNNAMED
-Ddremio.plugins.path=/Users/fuliu/Documents/github/dremio-oss/distribution/server/target/dremio-community-25.2.0-202410241428100111-a963b970/dremio-community-25.2.0-202410241428100111-a963b970/plugins
-Xmx4096m
-XX:MaxDirectMemorySize=8192m
-Dio.netty.maxDirectMemory=-1
-Dio.netty.tryReflectionSetAccessible=true
-XX:+UseG1GC

9

from java 9, java is modularized, and some packages are not exposed by default, so you need use add-opens and Xmx and XX are memory parametrs of jvm

10

I tested it and it only needs one parameter -Dio.netty.tryReflectionSetAccessible=true to work. What will be the impact if –add-opens is missing?