Hi, I created an ElasticSearch source in dremio. Getting this error when trying to open it - maxClauseCount is set to 1024.
This is fixed in 3.01. Are you indeed running 3.01?
yes，dremio-community-3.0.1-201811132128360291-804fe82，elasticsearch-6.4.2
This was fixed in 3.0.1, but we’re currently looking how this is still reproducible. Thanks for your patience.
Do you happen to have a profile when this failure occurred that you can send to us? Thanks.
Does the Dremio server.log have the full error message? That would be helpful for us to debug.
thanks!
I get the same error using the Postgres sink.
2018-12-05 15:57:37,389 [qtp971578330-120] ERROR c.d.d.server.GenericExceptionMapper - Unexpected exception when processing GET http://drill.auiag.corp
:9047/apiv2/source/Greenplum%20Production/folder/ctx?nocache=1543985858857 : org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount is se
t to 1024
org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount is set to 1024
at org.apache.lucene.search.BooleanQuery$Builder.add(BooleanQuery.java:125) ~[lucene-core-6.6.0.jar:6.6.0 5c7a7b65d2aa7ce5ec96458315c661a18b320
241 - ishan - 2017-05-30 07:29:46]
at org.apache.lucene.search.BooleanQuery$Builder.add(BooleanQuery.java:138) ~[lucene-core-6.6.0.jar:6.6.0 5c7a7b65d2aa7ce5ec96458315c661a18b320
241 - ishan - 2017-05-30 07:29:46]
at com.dremio.datastore.indexed.LuceneQueryConverter.toBooleanQuery(LuceneQueryConverter.java:125) ~[dremio-services-datastore-3.0.1-2018111321
28360291-804fe82.jar:3.0.1-201811132128360291-804fe82]
at com.dremio.datastore.indexed.LuceneQueryConverter.toLuceneQuery(LuceneQueryConverter.java:55) ~[dremio-services-datastore-3.0.1-201811132128
360291-804fe82.jar:3.0.1-201811132128360291-804fe82]
at com.dremio.datastore.indexed.CoreIndexedStoreImpl.find(CoreIndexedStoreImpl.java:293) ~[dremio-services-datastore-3.0.1-201811132128360291-8
04fe82.jar:3.0.1-201811132128360291-804fe82]
at com.dremio.datastore.CoreBaseTimedStore$TimedIndexedStoreImplCore.find(CoreBaseTimedStore.java:155) ~[dremio-services-datastore-3.0.1-201811
132128360291-804fe82.jar:3.0.1-201811132128360291-804fe82]
at com.dremio.datastore.indexed.LocalIndexedStore.find(LocalIndexedStore.java:60) ~[dremio-services-datastore-3.0.1-201811132128360291-804fe82.
jar:3.0.1-201811132128360291-804fe82]
at com.dremio.dac.service.collaboration.CollaborationTagStore.find(CollaborationTagStore.java:79) ~[dremio-dac-backend-3.0.1-201811132128360291
-804fe82.jar:3.0.1-201811132128360291-804fe82]
at com.dremio.dac.service.collaboration.CollaborationHelper.getTagsForIds(CollaborationHelper.java:270) ~[dremio-dac-backend-3.0.1-201811132128
360291-804fe82.jar:3.0.1-201811132128360291-804fe82]
at com.dremio.dac.model.namespace.NamespaceTree.populateInstance(NamespaceTree.java:114) ~[dremio-dac-backend-3.0.1-201811132128360291-804fe82.
jar:3.0.1-201811132128360291-804fe82]
at com.dremio.dac.model.namespace.NamespaceTree.newInstance(NamespaceTree.java:94) ~[dremio-dac-backend-3.0.1-201811132128360291-804fe82.jar:3.
0.1-201811132128360291-804fe82]
at com.dremio.dac.service.source.SourceService.newNamespaceTree(SourceService.java:438) ~[dremio-dac-backend-3.0.1-201811132128360291-804fe82.j
ar:3.0.1-201811132128360291-804fe82]
at com.dremio.dac.service.source.SourceService.listFolder(SourceService.java:455) ~[dremio-dac-backend-3.0.1-201811132128360291-804fe82.jar:3.0
.1-201811132128360291-804fe82]
at com.dremio.dac.service.source.SourceService.getFolder(SourceService.java:427) ~[dremio-dac-backend-3.0.1-201811132128360291-804fe82.jar:3.0.
1-201811132128360291-804fe82]
at com.dremio.dac.resource.SourceResource.getFolder(SourceResource.java:194) ~[dremio-dac-backend-3.0.1-201811132128360291-804fe82.jar:3.0.1-20
1811132128360291-804fe82]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_181]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_181]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_181]
at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_181]
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) ~
[jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) ~[jerse
y-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) ~[jers
ey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvid
er.java:205) ~[jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) ~[jer
sey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) ~[jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) ~[jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) ~[jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) ~[jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:na]
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:na]
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) [jersey-container-servlet-core-2.25.1.jar:na]
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) [jersey-container-servlet-core-2.25.1.jar:na]
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606
]
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:365) [jetty-servlets-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606
]
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) [jetty-servlet-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:95) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.Server.handle(Server.java:499) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258) [jetty-server-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544) [jetty-io-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) [jetty-util-9.2.22.v20170606.jar:9.2.22.v20170606]
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) [jetty-util-9.2.22.v20170606.jar:9.2.22.v20170606]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_181]
my server is in intranent,it’s difficult to sent log out.
I just type some server.log
2018-12-05 18:23:40, 472 [qtp1661048214-159] ERROR c.d.d.server.GenericExceptionMapper - Unexpected exception when processing Get http://xxx.xxx.xxx.xxx:9047/apiv2/source/elk?nocache=1544005695835 : org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount is set to 1024
org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount is set to 1024
at org.apache.lucene.search.BooleanQuery$Builder.add(BooleanQuery.java:125) ~[lucene-core-6.6.0.jar:6.6.0 5c7a7b65d2aa7ce5ec96458315c661a18b320241 - ishan - 2017-05-30 07:29:46]
at org.apache.lucene.search.BooleanQuery$Builder.add(BooleanQuery.java:138) ~[lucene-core-6.6.0.jar:6.6.0 5c7a7b65d2aa7ce5ec96458315c661a18b320241 - ishan - 2017-05-30 07:29:46]
241 - ishan - 2017-05-30 07:29:46]
…
like " [kieranclulow]" above
This is still an issue in build 3.0.5-201812021947440442-9a23f45
Hi @lwjun88
The complete fix for this issue is in 3.0.6. Kindly download from the Dremio Downloads page
Thanks
@balaji.ramaswamy