Unable to Run Queries on Dremio and Encountering ( Failure in web socket handling)

Dremio is starting fine and when I try to run the queries after adding the database, the query is executing forever and I am sessing the following errors in the log:

2019-09-16 23:37:59,595 [qtp453884081-90] ERROR c.d.dac.server.socket.SocketServlet - Failure in web socket handling.
org.eclipse.jetty.websocket.api.BadPayloadException: java.util.zip.DataFormatException: invalid distance too far back
at org.eclipse.jetty.websocket.common.extensions.compress.PerMessageDeflateExtension.incomingFrame(PerMessageDeflateExtension.java:89) ~[websocket-common-9.4.15.v20190215.jar:9.4.15.v20190215]
at org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:201) ~[websocket-common-9.4.15.v20190215.jar:9.4.15.v20190215]
at org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:221) ~[websocket-common-9.4.15.v20190215.jar:9.4.15.v20190215]
at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:246) ~[websocket-common-9.4.15.v20190215.jar:9.4.15.v20190215]
at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:577) ~[websocket-common-9.4.15.v20190215.jar:9.4.15.v20190215]
at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:434) ~[websocket-common-9.4.15.v20190215.jar:9.4.15.v20190215]

Have any of you encountered similar issue?

Hi @jkanuri

Would you be able to send us the full server.log? Also a HAR file would help

To generate the HAR file for Chrome

  1. Open Google Chrome and go to the page where the issue is occurring.
  2. From the Chrome menu bar select View > Developer > Developer Tools.
  3. From the panel opened, select the Network tab.
  4. Look for a round record button ( Record button ) in the upper left corner of the tab, and make sure it is red. If it is grey, click it once to start recording.
  5. Check the box Preserve log.
  6. Click the Clear button ( Clear button ) to clear out any existing logs from the Network tab.
  7. Reproduce the issue that you were experiencing before, while the network requests are being recorded.
  8. Once you have reproduced the issue, right-click anywhere on the grid of network requests, select Save as HAR with Content , and save the file to your computer.
  9. Upload your HAR file to your ticket or attach it to your email so that our Support team can analyze it.

Hi Balaji,
I attached the server.log and server.out files to this email. I think the issue is more on the server side as it happens as soon as the Dremio application is UP.

I will send you the HAR once I record it.

Thanks

Jai Kanuri

(Attachment dremio_logs.tar.gz is missing)

Hi Balaji
The attachment was rejected. Please find the zip file attachment.

Thanks

Jai Kanuri

dremio_server.out.zip (38.3 KB)

dremio_server.log.zip (43.3 KB)

@jkanuri

Hi,

What version of Java are you running? And are you running any proxies/load balancers in front of Dremio?

Hub Doron

I am using Java 1.8. It is a single instance Dremio and not using any proxies or load balancer.

@jkanuri Can you provide the full Java version? The reason I ask is that the error message you are seeing is very similar to https://bugs.java.com/bugdatabase/view_bug.do?bug_id=JDK-8189789, which is a JDK issue.

@jkanuri

Updating your response here

openjdk version “1.8.0_201”

OpenJDK Runtime Environment (build 1.8.0_201-b09)

OpenJDK 64-Bit Server VM (build 25.201-b09, mixed mode)

I was able to create a new instance and able to use Dremio without any issue.

I used Oracle Java instead of OpenJDK in the new instance.

java version “1.8.0_202”

Java™ SE Runtime Environment (build 1.8.0_202-b08)

Java HotSpot™ 64-Bit Server VM (build 25.202-b08, mixed mode)