HTTP 404 Not Found while running Dremio data pull to CSV

1

Hi All, I am getting below Illegal error while running the query in Dremio.

Error:
Caused by: javax.ws.rs.NotFoundException: HTTP 404 Not Found
at org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:1020) ~[jersey-client-2.25.1.jar:na]
at org.glassfish.jersey.client.JerseyInvocation.translate(JerseyInvocation.java:819) ~[jersey-client-2.25.1.jar:na]
at org.glassfish.jersey.client.JerseyInvocation.access$700(JerseyInvocation.java:92) ~[jersey-client-2.25.1.jar:na]
at org.glassfish.jersey.client.JerseyInvocation$2.call(JerseyInvocation.java:701) ~[jersey-client-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:315) ~[jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:297) ~[jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:228) ~[jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:444) ~[jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:697) ~[jersey-client-2.25.1.jar:na]
at com.dremio.plugins.elastic.ElasticConnectionPool$ElasticConnection.execute(ElasticConnectionPool.java:634) [dremio-elasticsearch-plugin-3.0.6-201812082352540436-1f684f9.jar:3.0.6-201812082352540436-1f684f9]
… 17 common frames omitted
2018-12-13 05:10:37,910 [FABRIC-rpc-event-queue] INFO c.d.exec.work.foreman.QueryManager - Fragment 23edd1b4-c51b-09f5-98d1-fb3ffcc28100:3:1 failed, cancelling remaining fragments.
2018-12-13 05:10:37,925 [FABRIC-rpc-event-queue] WARN c.d.exec.work.foreman.AttemptManager - Exception sending result to client
com.dremio.common.exceptions.UserRemoteException: INVALID_DATASET_METADATA ERROR: Failure executing Elastic request get next search result: HTTP 404 Not Found.

Request: http://96.118.212.189:9200/_search/scroll
Response Status 404
Response Reason Not Found

Logs: server.zip (9.4 KB)

…But am not using mentioned URL in my datasets. My query is working fine in preview option but not working for full load. (CSV generation.

Can you please help me to resolve this error. Any help is greatly appreciated.

Regards,
Hareesh

2

Hi @HAREESH

From the Dremio coordinator, are you able to do curl command to say get the list of ES indices?

Thanks
@balaji.ramaswamy

3

Thanks @balaji.ramaswamy for the response. Can you please provide me the command.

Regards,
Hareesh

4

curl -X GET “es-host:port/index-name”

Example:

curl -X GET “localhost:9200/hareesh”

port by default is 9200

5

@balaji.ramaswamy am able to do curl command with ES host indices. Can you please let me know if any other solution for this to resolve.

used query in Dremio UI:
SELECT
“@timestamp” AS req_date,
extract_pattern(message,’(?<=Label=)(.)(?=,LastValue)’,0,‘INDEX’) AS operation,
extract_pattern(message,’\d+’,0,‘INDEX’) AS lastvalue,
servicename,
“cspUserId” AS username,
“serviceVersion” AS version,
extract_pattern(message,’(?<=Label=)(.)(?=,LastAccess)’,0,‘INDEX’) AS lastaccess
FROM
“E-167”.“logstash-billing-2018.12.14”.billing
AS syslog
WHERE regexp_like( message,’.?\QLabel=\E.?’)and extract_pattern(message,’(?<=Label=)(.)(?=,LastValue)’,0,‘INDEX’) not like ‘%:%’
UNION ALL
SELECT
“@timestamp” AS req_date,
extract_pattern(message,’(?<=Label=)(.)(?=,LastValue)’,0,‘INDEX’) AS operation,
extract_pattern(message,’\d+’,0,‘INDEX’) AS lastvalue,
servicename,
“cspUserId” AS username,
“serviceVersion” AS version,
extract_pattern(message,’(?<=Label=)(.)(?=,LastAccess)’,0,‘INDEX’) AS lastaccess
FROM
“E-167”.“logstash-customer-2018.12.14”.customer
AS syslog
WHERE regexp_like( message,’.?\QLabel=\E.?’)and extract_pattern(message,’(?<=Label=)(.)(?=,LastValue)’,0,‘INDEX’) not like ‘%:%’
UNION ALL
SELECT
“@timestamp” AS req_date,
extract_pattern(message,’(?<=Label=)(.)(?=,LastValue)’,0,‘INDEX’) AS operation,
extract_pattern(message,’\d+’,0,‘INDEX’) AS lastvalue,
servicename,
“cspUserId” AS username,
“serviceVersion” AS version,
extract_pattern(message,’(?<=Label=)(.)(?=,LastAccess)’,0,‘INDEX’) AS lastaccess
FROM
“E-167”.“logstash-order-2018.12.14”.“order”
AS syslog
WHERE regexp_like( message,’.?\QLabel=\E.?’)and extract_pattern(message,’(?<=Label=)(.*)(?=,LastValue)’,0,‘INDEX’) not like ‘%:%’

PS; UNION query is not working whereas individual query is getting executed without any (issues)

Thanks,
Hareesh

6

Hi @HAREESH

The failed query would have generated a job, can you please send us the job profile from the failed job?

How To Share A Query Profile

Thanks
@balaji.ramaswamy