Unable to Start Dremio on First Run

Hi Team,

When I install Dremio and attempt to open it up for the first time, it appears as though Dremio is stuck on:
2018-09-28 10:01:48,739 [main] INFO c.d.datastore.LocalKVStoreProvider - Starting LocalKVStoreProvider

and the Server.out file has:

Error: Could not find or load main class com.dremio.dac.daemon.DremioDaemon
Java HotSpot™ 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0

I’ve also verified my Java version is 64 Bit:

java version “1.8.0_181”
Java™ SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot™ 64-Bit Server VM (build 25.181-b13, mixed mode)

Any insights would be much appreciated!

Thank you!

Hi @mathew.lee

Wondering if you can send me the server.log as an attachment? Also is this a fresh install or an upgrade from a previous version?

Thanks
@balaji.ramaswamy

Hi Balaji,

Thank you for responding and sorry for the delayed response!

I tried uninstalling dremio and reinstalling the latest version of Dremio, however the install gets blocked by Symnatec by my company as the file hasn’t been seen by more than 100 users? Either way, I’ve requested it be unblocked however no response for 2-3 weeks.

In the meantime, do we have a slightly older version I could use (or instructions on how to compile the source myself) as a workaround in the meantime?

Thank you!
Mathew

Hi @balaji.ramaswamy,

I was finally able to get Dremio reinstalled (fresh install) on my computer at work, however I’m running into the same issue I faced in my original post.

How would I go about sending you the server.log file as an attachment?

Appreciate the help!

Thanks,
Mathew

Hi @mathew.lee

Is your Dremio startup stuck at “Error: Could not find or load main class com.dremio.dac.daemon.DremioDaemon”. Similarly can you tail server.log and paste the last 50 lines? or scroll to the place where there is an error after the startup command and paste the latest error from server.log?

Thanks
@balaji.ramaswamy

Hi @balaji.ramaswamy,

Is this what you are looking for:

2018-10-30 16:36:23,353 [main] INFO com.dremio.exec.util.GuavaPatcher - Google’s Stopwatch patched for old HBase Guava version.
2018-10-30 16:36:23,552 [main] INFO com.dremio.exec.util.GuavaPatcher - Google’s Closeables patched for old HBase Guava version.
2018-10-30 16:36:23,863 [main] INFO com.dremio.common.config.SabotConfig - Configuration and plugin file(s) identified in 276ms.
Base Configuration:
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-common-2.1.6-201809161906440178-edb5b4d.jar!/sabot-default.conf

Intermediate Configuration and Plugin files, in order of precedence:
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-common-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-backend-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-common-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-elasticsearch-plugin-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-elasticsearch-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-hive-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-jdbc-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-mongo-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-scheduler-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-hbase-plugin-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-hive-plugin-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-jdbc-plugin-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-mongo-plugin-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-pdfs-plugin-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-provision-common-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-s3-plugin-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-logical-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-accelerator-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-coordinator-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-datastore-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-jobs-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-namespace-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-options-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-resourcescheduler-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-users-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/dremio-yarn-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf
- jar:file:/C:/Program%20Files/Dremio/jars/3rdparty/dremio-hive-exec-shaded-2.1.6-201809161906440178-edb5b4d.jar!/sabot-module.conf

2018-10-30 16:36:23,951 [main] INFO com.dremio.config.DremioConfig - Applying provided system property to config: -Dpaths.spilling=file:/C:/Users/71099884/AppData/Local/Dremio/spill
2018-10-30 16:36:23,952 [main] INFO com.dremio.config.DremioConfig - Applying provided system property to config: -Dpaths.local=C:\Users\71099884\AppData\Local\Dremio\data
2018-10-30 16:36:23,952 [main] INFO com.dremio.config.DremioConfig - Applying provided system property to config: -Dpaths.db=C:\Users\71099884\AppData\Local\Dremio\db
2018-10-30 16:36:23,953 [main] INFO com.dremio.config.DremioConfig - Applying provided system property to config: -Dpaths.dist=file:/C:/Users/71099884/AppData/Local/Dremio/pdfs
2018-10-30 16:36:23,954 [main] INFO com.dremio.config.DremioConfig - Applying provided system property to config: -Dservices.coordinator.auto-upgrade=true
2018-10-30 16:36:24,418 [main] INFO c.d.common.scanner.BuildTimeScan - Loaded prescanned packages [com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.provision, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.store, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.resource, com.dremio.resource.basic, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.storage, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.exec.store.hive, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, org.apache.hadoop.hive, com.dremio.storage, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.storage, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.exec.store, com.dremio.storage, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.jobs, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.resource, com.dremio.resource.basic] from locations [jar:file:/C:/Program%20Files/Dremio/jars/dremio-common-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-backend-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-common-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-scheduler-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-hive-plugin-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-logical-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-accelerator-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-datastore-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-jobs-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json]
2018-10-30 16:36:26,784 [main] INFO c.d.common.scanner.ClassPathScanner - Scanning packages [com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.plugins.elastic, com.dremio.extras.plugins.elastic, com.dremio.exec.store.jdbc, com.dremio.plugins.mongo, com.dremio.extra.exec.store.dfs, com.dremio.exec.planner.acceleration.substitution, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.exec.store.hbase, com.dremio.exec.expr.fn.impl.conv, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.exec.store.hive, com.dremio.exec.store.jdbc, com.dremio.plugins.mongo, com.dremio.exec.store, com.dremio.provision, com.dremio.plugins.s3.store, com.dremio.plugins.adl, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.options, com.dremio.resource, com.dremio.resource.basic, com.dremio.service.users, com.dremio.provision.yarn.service, org.apache.hadoop.hive] in locations [jar:file:/C:/Program%20Files/Dremio/jars/dremio-elasticsearch-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-elasticsearch-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-hive-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-jdbc-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-mongo-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-hbase-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-jdbc-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-mongo-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-pdfs-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-provision-common-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-s3-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-coordinator-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-namespace-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-options-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-resourcescheduler-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-users-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-yarn-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/3rdparty/dremio-hive-exec-shaded-2.1.6-201809161906440178-edb5b4d.jar!/] took 2351ms
2018-10-30 16:36:26,940 [main] INFO c.d.datastore.LocalKVStoreProvider - Starting LocalKVStoreProvider

Thank you,
Mathew

Hi @mathew.lee

This seems to be stuck at “Starting LockKVStoreProvider”, the next step would be to enable “debug” in the logback.xml file and see what is happening. You should find below entry in logback.xml under Dremio conf folder, replace info with debug, restart coordinator and see if you can see the error.

Turn it back to info once we know the error

If the above does not help then next would be to turn it on at the root level, this is very verbose so make sure to turn it off after we see the error

Thanks
@balaji.ramaswamy

Hi @balaji.ramaswamy,

Ok, I was able to change the logback.xml file over to debug, but where does the error get displayed? In the server.log file again?

Thanks,
Mat

Last 50 lines from server.log:

2018-10-31 11:52:41,995 [main] INFO com.dremio.config.DremioConfig - Applying provided system property to config: -Dpaths.db=C:\Users\71099884\AppData\Local\Dremio\db

2018-10-31 11:52:41,995 [main] INFO com.dremio.config.DremioConfig - Applying provided system property to config: -Dpaths.dist=file:/C:/Users/71099884/AppData/Local/Dremio/pdfs

2018-10-31 11:52:41,995 [main] INFO com.dremio.config.DremioConfig - Applying provided system property to config: -Dservices.coordinator.auto-upgrade=true

2018-10-31 11:52:42,223 [main] DEBUG c.d.common.scanner.ClassPathScanner - Scanning classpath for resources with pathname “META-INF/dremio-module-scan/registry.json”.

2018-10-31 11:52:42,224 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-common-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,224 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-backend-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,225 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-common-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,225 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-scheduler-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,225 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-hive-plugin-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,226 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,226 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-logical-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,226 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-accelerator-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,226 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-datastore-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,226 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-jobs-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json.

2018-10-31 11:52:42,452 [main] INFO c.d.common.scanner.BuildTimeScan - Loaded prescanned packages [com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.provision, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.store, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.resource, com.dremio.resource.basic, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.storage, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.exec.store.hive, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, org.apache.hadoop.hive, com.dremio.storage, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.storage, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.exec.store, com.dremio.storage, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.jobs, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.resource, com.dremio.resource.basic] from locations [jar:file:/C:/Program%20Files/Dremio/jars/dremio-common-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-backend-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-common-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-scheduler-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-hive-plugin-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-logical-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-accelerator-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-datastore-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-jobs-2.1.6-201809161906440178-edb5b4d.jar!/META-INF/dremio-module-scan/registry.json]

2018-10-31 11:52:42,453 [main] DEBUG c.d.common.scanner.ClassPathScanner - Scanning classpath for resources with pathname “sabot-module.conf”.

2018-10-31 11:52:42,454 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-common-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,454 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-backend-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,455 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-common-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,455 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-elasticsearch-plugin-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,455 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-elasticsearch-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,456 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-hive-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,456 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-jdbc-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,456 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-mongo-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,456 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,457 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-scheduler-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,457 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-hbase-plugin-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,457 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-hive-plugin-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,458 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-jdbc-plugin-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,458 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-mongo-plugin-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,459 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-pdfs-plugin-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,459 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-provision-common-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,460 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-s3-plugin-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,461 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,461 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-logical-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,462 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-accelerator-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,463 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-coordinator-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,464 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-datastore-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,464 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-jobs-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,464 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-namespace-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,465 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-options-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,465 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-resourcescheduler-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,466 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-users-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,467 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-yarn-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,473 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/3rdparty/dremio-hive-exec-shaded-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,474 [main] DEBUG c.d.common.scanner.ClassPathScanner - Scanning classpath for resources with pathname “META-INF/dremio-module-scan/registry.json”.

2018-10-31 11:52:42,474 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-common-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,475 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-backend-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,475 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-dac-common-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,476 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-scheduler-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,476 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-hive-plugin-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,477 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,477 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-sabot-logical-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,477 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-accelerator-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,478 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-datastore-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:42,479 [main] DEBUG c.d.common.scanner.ClassPathScanner - - collected resource’s classpath root URL jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-jobs-2.1.6-201809161906440178-edb5b4d.jar!/.

2018-10-31 11:52:43,963 [main] INFO c.d.common.scanner.ClassPathScanner - Scanning packages [com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.plugins.elastic, com.dremio.extras.plugins.elastic, com.dremio.exec.store.jdbc, com.dremio.plugins.mongo, com.dremio.extra.exec.store.dfs, com.dremio.exec.planner.acceleration.substitution, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.exec.store.hbase, com.dremio.exec.expr.fn.impl.conv, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.exec.store.hive, com.dremio.exec.store.jdbc, com.dremio.plugins.mongo, com.dremio.exec.store, com.dremio.provision, com.dremio.plugins.s3.store, com.dremio.plugins.adl, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.options, com.dremio.resource, com.dremio.resource.basic, com.dremio.service.users, com.dremio.provision.yarn.service, org.apache.hadoop.hive] in locations [jar:file:/C:/Program%20Files/Dremio/jars/dremio-elasticsearch-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-elasticsearch-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-hive-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-jdbc-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-plugin-mongo-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-extra-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-hbase-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-jdbc-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-mongo-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-pdfs-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-provision-common-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-s3-plugin-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-coordinator-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-namespace-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-options-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-resourcescheduler-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-services-users-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/dremio-yarn-2.1.6-201809161906440178-edb5b4d.jar!/, jar:file:/C:/Program%20Files/Dremio/jars/3rdparty/dremio-hive-exec-shaded-2.1.6-201809161906440178-edb5b4d.jar!/] took 1481ms

2018-10-31 11:52:44,042 [main] INFO c.d.datastore.LocalKVStoreProvider - Starting LocalKVStoreProvider

Could you run jstack pid for this process to see what and where the process really stuck?

How would I determine the PID for Dremio?

Thanks,
Mathew

This is what I get from the Server.out file:

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000007fefd12b2b2, pid=468, tid=0x000000000000348c

JRE version: Java™ SE Runtime Environment (8.0_191-b12) (build 1.8.0_191-b12)
Java VM: Java HotSpot™ 64-Bit Server VM (25.191-b12 mixed mode windows-amd64 compressed oops)
Problematic frame:
C [KERNELBASE.dll+0xb2b2]

Failed to write core dump. Minidumps are not enabled by default on client versions of Windows

An error report file with more information is saved as:
C:\Program Files\Dremio\hs_err_pid468.log

If you would like to submit a bug report, please visit:
http://bugreport.java.com/bugreport/crash.jsp
The crash happened outside the Java Virtual Machine in native code.
See problematic frame for where to report the bug.

Java HotSpot™ 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0

#####################
Which gives me the PID but when I try to use jstack, it says no such process.

Thanks,
Mathew

Hi @mathew.lee

Windows task manager would show you the pid, also in case you want to run jstack on this PID, on Windows it is slightly different.

Here is how you take a Java thread dump (equivalent of jstack on Linux) on Windows.

The user executing jstack.exe must be the same user who owns the JVM process or have sufficient privileges to access it

We need to use PsExec.exe tool (http://technet.microsoft.com/en-us/sysinternals/bb897553.aspx) to execute jstack.exe

Command to use is below (be sure that when launching the console you “run as administrator”)

C:\PSTools>psexec -s c:\Java\jdk1.80_151\bin\jstack.exe -l 4180 >dump.txt

You should be able to find the Dremio PID from the task manager

Detailed step by step commands are in the below knowledge base from Redhat

Generate Java Thread Dump on Windows

Kindly let me know if you have other questions

Looks like process is crashing - it is not hanging. Take a look at:

As it advices you to do

Hmmm - I’ve got the log file but I’m not quite sure what I’m looking for, would it help to post here?

Ok, I will give the process a try - but when I inspect the task manager there is no PID shown for dremio (it doesn’t appear to be running). That lead me to look for it in the server.out file where I found the PID, but jstack said it does not exist as a process (might that be because the process crashed and is not even hanging?)

Really appreciate all the help everyone!

@mathew.lee

Under your Dremio log folder any other files like a core file? Also what version of Windows is this? Any firewalls running or anti virus?

Really appreciate your patience on this

Thanks
@balaji.ramaswamy

No core file :/, Windows 7, we do have Symantec endpoint protection running at my workplace.

No worries, I definitely appreciate the prompt responses!

sure, you can post it here

Register to memory mapping:

RAX=0x0000000000000018 is an unknown value
RBX=0x0000000000000000 is an unknown value
RCX=0x0000000000000000 is an unknown value
RDX=0x0000000000000000 is an unknown value
RSP=0x000000000248d4c0 is pointing into the stack for thread: 0x000000000207f800
RBP=0x00000000000009a8 is an unknown value
RSI=0x0000000000000000 is an unknown value
RDI=0x00000000000009a8 is an unknown value
R8 =0x000000000248d4b8 is pointing into the stack for thread: 0x000000000207f800
R9 =0x00000000000009a8 is an unknown value
R10=0x0000000000000000 is an unknown value
R11=0x0000000000000000 is an unknown value
R12=0x000000000248d870 is pointing into the stack for thread: 0x000000000207f800
R13=0x000000005e16a100 is an unknown value
R14=0x000000005e16da70 is an unknown value
R15=0x000000000248d8e8 is pointing into the stack for thread: 0x000000000207f800

Stack: [0x0000000002390000,0x0000000002490000], sp=0x000000000248d4c0, free space=1013k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [KERNELBASE.dll+0xb2b2]
C [kernel32.dll+0x15cdf]
C [librocksdbjni1096869024958681686.dll+0x30ef73]
C [librocksdbjni1096869024958681686.dll+0x3111a5]
C [librocksdbjni1096869024958681686.dll+0x310d9b]
C [librocksdbjni1096869024958681686.dll+0x2911bb]
C [librocksdbjni1096869024958681686.dll+0x260478]
C [librocksdbjni1096869024958681686.dll+0x262195]
C [librocksdbjni1096869024958681686.dll+0x2611c5]
C [librocksdbjni1096869024958681686.dll+0x2608f5]
C [librocksdbjni1096869024958681686.dll+0x1d29cb]
C [librocksdbjni1096869024958681686.dll+0x1d3afd]
C [librocksdbjni1096869024958681686.dll+0x1d2f3e]
C [librocksdbjni1096869024958681686.dll+0x1d4b48]
C [librocksdbjni1096869024958681686.dll+0x1d46af]
C [librocksdbjni1096869024958681686.dll+0x1d84e8]
C [librocksdbjni1096869024958681686.dll+0x1db574]
C 0x0000000002778c27

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j org.rocksdb.RocksDB.open(JLjava/lang/String;[[B[J)[J+0
j org.rocksdb.RocksDB.open(Lorg/rocksdb/DBOptions;Ljava/lang/String;Ljava/util/List;Ljava/util/List;)Lorg/rocksdb/RocksDB;+86
j com.dremio.datastore.ByteStoreManager.openDB(Lorg/rocksdb/DBOptions;Ljava/lang/String;Ljava/util/List;Ljava/util/List;)Lorg/rocksdb/RocksDB;+8
j com.dremio.datastore.ByteStoreManager.start()V+339
j com.dremio.datastore.CoreStoreProviderImpl.start()V+12
j com.dremio.datastore.LocalKVStoreProvider.start()V+14
j com.dremio.dac.cmd.upgrade.Upgrade.run()Lcom/dremio/dac/cmd/upgrade/UpgradeStats;+105
j com.dremio.dac.daemon.DremioDaemon.main([Ljava/lang/String;)V+31
v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x0000000058c3d800 JavaThread “Service Thread” daemon [_thread_blocked, id=13120, stack(0x00000000596e0000,0x00000000597e0000)]
0x0000000058c3c800 JavaThread “C1 CompilerThread2” daemon [_thread_blocked, id=10088, stack(0x0000000059550000,0x0000000059650000)]
0x0000000058c3b800 JavaThread “C2 CompilerThread1” daemon [_thread_blocked, id=3028, stack(0x0000000059320000,0x0000000059420000)]
0x0000000058be0800 JavaThread “C2 CompilerThread0” daemon [_thread_blocked, id=11692, stack(0x0000000059110000,0x0000000059210000)]
0x0000000058bdd000 JavaThread “Attach Listener” daemon [_thread_blocked, id=8600, stack(0x0000000058fe0000,0x00000000590e0000)]
0x0000000058bdc800 JavaThread “Signal Dispatcher” daemon [_thread_blocked, id=10452, stack(0x0000000058960000,0x0000000058a60000)]
0x000000005772a800 JavaThread “Finalizer” daemon [_thread_blocked, id=13224, stack(0x0000000058ad0000,0x0000000058bd0000)]
0x0000000057723000 JavaThread “Reference Handler” daemon [_thread_blocked, id=10828, stack(0x0000000058850000,0x0000000058950000)]
=>0x000000000207f800 JavaThread “main” [_thread_in_native, id=12668, stack(0x0000000002390000,0x0000000002490000)]

Other Threads:
0x00000000576da000 VMThread [stack: 0x0000000058670000,0x0000000058770000] [id=13440]
0x0000000058cc7800 WatcherThread [stack: 0x00000000597f0000,0x00000000598f0000] [id=11212]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap:
PSYoungGen total 269312K, used 113071K [0x00000000d5580000, 0x00000000f6980000, 0x0000000100000000)
eden space 248320K, 37% used [0x00000000d5580000,0x00000000db1a1860,0x00000000e4800000)
from space 20992K, 89% used [0x00000000e4800000,0x00000000e5a4a4a0,0x00000000e5c80000)
to space 24064K, 0% used [0x00000000f5200000,0x00000000f5200000,0x00000000f6980000)
ParOldGen total 84992K, used 19529K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 22% used [0x0000000080000000,0x00000000813126a0,0x0000000085300000)
Metaspace used 19772K, capacity 19990K, committed 20096K, reserved 1067008K
class space used 2291K, capacity 2366K, committed 2432K, reserved 1048576K

Card table byte_map: [0x0000000011b20000,0x0000000011f30000] byte_map_base: 0x0000000011720000

Marking Bits: (ParMarkBitMap*) 0x0000000071be3e30
Begin Bits: [0x0000000012940000, 0x0000000014940000)
End Bits: [0x0000000014940000, 0x0000000016940000)

Polling page: 0x0000000000440000

CodeCache: size=245760Kb used=7778Kb max_used=7778Kb free=237981Kb
bounds [0x0000000002760000, 0x0000000002f00000, 0x0000000011760000]
total_blobs=2596 nmethods=2162 adapters=346
compilation: enabled

Compilation events (10 events):
Event: 9.352 Thread 0x0000000058c3c800 2165 3 sun.nio.ch.Util::getTemporaryDirectBuffer (55 bytes)
Event: 9.353 Thread 0x0000000058c3c800 nmethod 2165 0x0000000002ef99d0 code [0x0000000002ef9c00, 0x0000000002efa608]
Event: 9.353 Thread 0x0000000058c3c800 2166 3 sun.nio.ch.IOUtil::writeFromNativeBuffer (137 bytes)
Event: 9.354 Thread 0x0000000058c3c800 nmethod 2166 0x0000000002efa9d0 code [0x0000000002efaba0, 0x0000000002efb568]
Event: 9.354 Thread 0x0000000058c3c800 2167 3 sun.nio.ch.Util::offerFirstTemporaryDirectBuffer (53 bytes)
Event: 9.354 Thread 0x0000000058c3c800 nmethod 2167 0x0000000002efb850 code [0x0000000002efba60, 0x0000000002efc478]
Event: 9.358 Thread 0x0000000058c3c800 2168 ! 3 sun.nio.ch.NativeThreadSet::remove (50 bytes)
Event: 9.358 Thread 0x0000000058c3c800 nmethod 2168 0x0000000002efc850 code [0x0000000002efc9c0, 0x0000000002efce08]
Event: 9.358 Thread 0x0000000058c3c800 2169 3 java.nio.channels.spi.AbstractInterruptibleChannel::end (50 bytes)
Event: 9.359 Thread 0x0000000058c3c800 nmethod 2169 0x0000000002efcfd0 code [0x0000000002efd1a0, 0x0000000002efd8f8]

GC Heap History (10 events):
Event: 4.152 GC heap before
{Heap before GC invocations=3 (full 0):
PSYoungGen total 68608K, used 66232K [0x00000000d5580000, 0x00000000d9d80000, 0x0000000100000000)
eden space 63488K, 100% used [0x00000000d5580000,0x00000000d9380000,0x00000000d9380000)
from space 5120K, 53% used [0x00000000d9880000,0x00000000d9b2e2d8,0x00000000d9d80000)
to space 5120K, 0% used [0x00000000d9380000,0x00000000d9380000,0x00000000d9880000)
ParOldGen total 84992K, used 80K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 0% used [0x0000000080000000,0x0000000080014010,0x0000000085300000)
Metaspace used 11597K, capacity 11708K, committed 11904K, reserved 1060864K
class space used 1346K, capacity 1363K, committed 1408K, reserved 1048576K
Event: 4.159 GC heap after
Heap after GC invocations=3 (full 0):
PSYoungGen total 68608K, used 5113K [0x00000000d5580000, 0x00000000ddb80000, 0x0000000100000000)
eden space 63488K, 0% used [0x00000000d5580000,0x00000000d5580000,0x00000000d9380000)
from space 5120K, 99% used [0x00000000d9380000,0x00000000d987e638,0x00000000d9880000)
to space 5120K, 0% used [0x00000000dd680000,0x00000000dd680000,0x00000000ddb80000)
ParOldGen total 84992K, used 1390K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 1% used [0x0000000080000000,0x000000008015b9a8,0x0000000085300000)
Metaspace used 11597K, capacity 11708K, committed 11904K, reserved 1060864K
class space used 1346K, capacity 1363K, committed 1408K, reserved 1048576K
}
Event: 4.864 GC heap before
{Heap before GC invocations=4 (full 0):
PSYoungGen total 68608K, used 68601K [0x00000000d5580000, 0x00000000ddb80000, 0x0000000100000000)
eden space 63488K, 100% used [0x00000000d5580000,0x00000000d9380000,0x00000000d9380000)
from space 5120K, 99% used [0x00000000d9380000,0x00000000d987e638,0x00000000d9880000)
to space 5120K, 0% used [0x00000000dd680000,0x00000000dd680000,0x00000000ddb80000)
ParOldGen total 84992K, used 1390K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 1% used [0x0000000080000000,0x000000008015b9a8,0x0000000085300000)
Metaspace used 15619K, capacity 15750K, committed 16000K, reserved 1062912K
class space used 1811K, capacity 1878K, committed 1920K, reserved 1048576K
Event: 4.911 GC heap after
Heap after GC invocations=4 (full 0):
PSYoungGen total 132096K, used 5112K [0x00000000d5580000, 0x00000000ddb80000, 0x0000000100000000)
eden space 126976K, 0% used [0x00000000d5580000,0x00000000d5580000,0x00000000dd180000)
from space 5120K, 99% used [0x00000000dd680000,0x00000000ddb7e1c0,0x00000000ddb80000)
to space 5120K, 0% used [0x00000000dd180000,0x00000000dd180000,0x00000000dd680000)
ParOldGen total 84992K, used 3473K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 4% used [0x0000000080000000,0x00000000803644c0,0x0000000085300000)
Metaspace used 15619K, capacity 15750K, committed 16000K, reserved 1062912K
class space used 1811K, capacity 1878K, committed 1920K, reserved 1048576K
}
Event: 6.456 GC heap before
{Heap before GC invocations=5 (full 0):
PSYoungGen total 132096K, used 132088K [0x00000000d5580000, 0x00000000ddb80000, 0x0000000100000000)
eden space 126976K, 100% used [0x00000000d5580000,0x00000000dd180000,0x00000000dd180000)
from space 5120K, 99% used [0x00000000dd680000,0x00000000ddb7e1c0,0x00000000ddb80000)
to space 5120K, 0% used [0x00000000dd180000,0x00000000dd180000,0x00000000dd680000)
ParOldGen total 84992K, used 3473K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 4% used [0x0000000080000000,0x00000000803644c0,0x0000000085300000)
Metaspace used 18343K, capacity 18486K, committed 18688K, reserved 1064960K
class space used 2123K, capacity 2206K, committed 2304K, reserved 1048576K
Event: 6.496 GC heap after
Heap after GC invocations=5 (full 0):
PSYoungGen total 132096K, used 5105K [0x00000000d5580000, 0x00000000e6b80000, 0x0000000100000000)
eden space 126976K, 0% used [0x00000000d5580000,0x00000000d5580000,0x00000000dd180000)
from space 5120K, 99% used [0x00000000dd180000,0x00000000dd67c590,0x00000000dd680000)
to space 15360K, 0% used [0x00000000e5c80000,0x00000000e5c80000,0x00000000e6b80000)
ParOldGen total 84992K, used 14372K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 16% used [0x0000000080000000,0x0000000080e09008,0x0000000085300000)
Metaspace used 18343K, capacity 18486K, committed 18688K, reserved 1064960K
class space used 2123K, capacity 2206K, committed 2304K, reserved 1048576K
}
Event: 7.879 GC heap before
{Heap before GC invocations=6 (full 0):
PSYoungGen total 132096K, used 132081K [0x00000000d5580000, 0x00000000e6b80000, 0x0000000100000000)
eden space 126976K, 100% used [0x00000000d5580000,0x00000000dd180000,0x00000000dd180000)
from space 5120K, 99% used [0x00000000dd180000,0x00000000dd67c590,0x00000000dd680000)
to space 15360K, 0% used [0x00000000e5c80000,0x00000000e5c80000,0x00000000e6b80000)
ParOldGen total 84992K, used 14372K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 16% used [0x0000000080000000,0x0000000080e09008,0x0000000085300000)
Metaspace used 18354K, capacity 18550K, committed 18688K, reserved 1064960K
class space used 2123K, capacity 2206K, committed 2304K, reserved 1048576K
Event: 7.900 GC heap after
Heap after GC invocations=6 (full 0):
PSYoungGen total 263680K, used 15343K [0x00000000d5580000, 0x00000000e7680000, 0x0000000100000000)
eden space 248320K, 0% used [0x00000000d5580000,0x00000000d5580000,0x00000000e4800000)
from space 15360K, 99% used [0x00000000e5c80000,0x00000000e6b7bee0,0x00000000e6b80000)
to space 20992K, 0% used [0x00000000e4800000,0x00000000e4800000,0x00000000e5c80000)
ParOldGen total 84992K, used 17948K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 21% used [0x0000000080000000,0x0000000081187000,0x0000000085300000)
Metaspace used 18354K, capacity 18550K, committed 18688K, reserved 1064960K
class space used 2123K, capacity 2206K, committed 2304K, reserved 1048576K
}
Event: 8.427 GC heap before
{Heap before GC invocations=7 (full 0):
PSYoungGen total 263680K, used 263663K [0x00000000d5580000, 0x00000000e7680000, 0x0000000100000000)
eden space 248320K, 100% used [0x00000000d5580000,0x00000000e4800000,0x00000000e4800000)
from space 15360K, 99% used [0x00000000e5c80000,0x00000000e6b7bee0,0x00000000e6b80000)
to space 20992K, 0% used [0x00000000e4800000,0x00000000e4800000,0x00000000e5c80000)
ParOldGen total 84992K, used 17948K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 21% used [0x0000000080000000,0x0000000081187000,0x0000000085300000)
Metaspace used 18354K, capacity 18550K, committed 18688K, reserved 1064960K
class space used 2123K, capacity 2206K, committed 2304K, reserved 1048576K
Event: 8.450 GC heap after
Heap after GC invocations=7 (full 0):
PSYoungGen total 269312K, used 18729K [0x00000000d5580000, 0x00000000f6980000, 0x0000000100000000)
eden space 248320K, 0% used [0x00000000d5580000,0x00000000d5580000,0x00000000e4800000)
from space 20992K, 89% used [0x00000000e4800000,0x00000000e5a4a4a0,0x00000000e5c80000)
to space 24064K, 0% used [0x00000000f5200000,0x00000000f5200000,0x00000000f6980000)
ParOldGen total 84992K, used 19529K [0x0000000080000000, 0x0000000085300000, 0x00000000d5580000)
object space 84992K, 22% used [0x0000000080000000,0x00000000813126a0,0x0000000085300000)
Metaspace used 18354K, capacity 18550K, committed 18688K, reserved 1064960K
class space used 2123K, capacity 2206K, committed 2304K, reserved 1048576K
}

Deoptimization events (10 events):
Event: 8.540 Thread 0x000000000207f800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000002e2a110 method=java.util.regex.Pattern$Curly.match0(Ljava/util/regex/Matcher;IILjava/lang/CharSequence;)Z @ 31
Event: 8.540 Thread 0x000000000207f800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000002dd84fc method=java.util.regex.Pattern$CharProperty.match(Ljava/util/regex/Matcher;ILjava/lang/CharSequence;)Z @ 18
Event: 8.540 Thread 0x000000000207f800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000002e2a110 method=java.util.regex.Pattern$Curly.match0(Ljava/util/regex/Matcher;IILjava/lang/CharSequence;)Z @ 31
Event: 8.540 Thread 0x000000000207f800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000002dd84fc method=java.util.regex.Pattern$CharProperty.match(Ljava/util/regex/Matcher;ILjava/lang/CharSequence;)Z @ 18
Event: 8.551 Thread 0x000000000207f800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x0000000002de28f4 method=java.util.regex.Matcher.reset()Ljava/util/regex/Matcher; @ 47
Event: 8.669 Thread 0x000000000207f800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x0000000002bf9e58 method=java.io.WinNTFileSystem.normalize(Ljava/lang/String;)Ljava/lang/String; @ 128
Event: 8.719 Thread 0x000000000207f800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000002e9e280 method=java.util.Collections$UnmodifiableCollection$1.(Ljava/util/Collections$UnmodifiableCollection;)V @ 17
Event: 8.719 Thread 0x000000000207f800 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000002d790f8 method=java.util.Collections$UnmodifiableCollection$1.hasNext()Z @ 4
Event: 8.719 Thread 0x000000000207f800 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000002d912d8 method=java.util.Collections$UnmodifiableCollection$1.next()Ljava/lang/Object; @ 4
Event: 8.720 Thread 0x000000000207f800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x0000000002d5ef50 method=java.lang.reflect.Constructor.newInstance([Ljava/lang/Object;)Ljava/lang/Object; @ 4

Classes redefined (0 events):
No events

Internal exceptions (10 events):
Event: 4.331 Thread 0x000000000207f800 Exception <a ‘java/lang/ClassNotFoundException’: net/logstash/logback/composite/loggingevent/MessageJsonProviderCustomizer> (0x00000000d7262a38) thrown at [C:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u191\11896\hotspot\src\share\vm\classfile\system
Event: 4.334 Thread 0x000000000207f800 Exception <a ‘java/lang/ClassNotFoundException’: net/logstash/logback/composite/loggingevent/ArgumentsJsonProviderBeanInfo> (0x00000000d72d5288) thrown at [C:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u191\11896\hotspot\src\share\vm\classfile\system
Event: 4.335 Thread 0x000000000207f800 Exception <a ‘java/lang/ClassNotFoundException’: net/logstash/logback/composite/loggingevent/ArgumentsJsonProviderCustomizer> (0x00000000d7340550) thrown at [C:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u191\11896\hotspot\src\share\vm\classfile\syst
Event: 4.338 Thread 0x000000000207f800 Exception <a ‘java/lang/ClassNotFoundException’: net/logstash/logback/composite/loggingevent/StackTraceJsonProviderBeanInfo> (0x00000000d73b4618) thrown at [C:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u191\11896\hotspot\src\share\vm\classfile\syste
Event: 4.339 Thread 0x000000000207f800 Exception <a ‘java/lang/ClassNotFoundException’: net/logstash/logback/composite/loggingevent/StackTraceJsonProviderCustomizer> (0x00000000d741f8a8) thrown at [C:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u191\11896\hotspot\src\share\vm\classfile\sys
Event: 4.509 Thread 0x000000000207f800 Exception <a ‘java/lang/NoSuchFieldError’: method resolution failed> (0x00000000d7cb50f8) thrown at [C:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u191\11896\hotspot\src\share\vm\prims\methodHandles.cpp, line 1167]
Event: 4.510 Thread 0x000000000207f800 Exception <a ‘java/lang/NoSuchFieldError’: method resolution failed> (0x00000000d7cc2418) thrown at [C:\re\workspace\8-2-build-windows-amd64-cygwin\jdk8u191\11896\hotspot\src\share\vm\prims\methodHandles.cpp, line 1167]
Event: 4.914 Thread 0x000000000207f800 Implicit null exception at 0x0000000002a0fc87 to 0x0000000002a10071
Event: 4.914 Thread 0x000000000207f800 Implicit null exception at 0x0000000002931a49 to 0x0000000002931e09
Event: 5.598 Thread 0x000000000207f800 Implicit null exception at 0x0000000002d66bc8 to 0x0000000002d6731d

Events (10 events):
Event: 9.615 loading class com/dremio/datastore/MetricUtils
Event: 9.615 loading class com/dremio/datastore/MetricUtils done
Event: 9.615 loading class com/dremio/datastore/MetricUtils$CloseableTimer
Event: 9.615 loading class com/dremio/datastore/MetricUtils$CloseableTimer done
Event: 9.616 loading class com/dremio/datastore/MetricUtils$1
Event: 9.616 loading class com/dremio/datastore/MetricUtils$1 done
Event: 9.616 loading class org/rocksdb/ColumnFamilyDescriptor
Event: 9.616 loading class org/rocksdb/ColumnFamilyDescriptor done
Event: 9.617 loading class org/rocksdb/ColumnFamilyOptions
Event: 9.617 loading class org/rocksdb/ColumnFamilyOptions done

Dynamic libraries:
0x000000013f620000 - 0x000000013f657000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\java.exe
0x0000000077560000 - 0x00000000776ff000 C:\Windows\SYSTEM32\ntdll.dll
0x0000000077440000 - 0x000000007755f000 C:\Windows\system32\kernel32.dll
0x000007fefd120000 - 0x000007fefd18a000 C:\Windows\system32\KERNELBASE.dll
0x0000000074de0000 - 0x0000000074e75000 C:\Windows\System32\SYSFER.DLL
0x000007fefef90000 - 0x000007feff06b000 C:\Windows\system32\ADVAPI32.dll
0x000007fefe320000 - 0x000007fefe3bf000 C:\Windows\system32\msvcrt.dll
0x000007fefd570000 - 0x000007fefd58f000 C:\Windows\SYSTEM32\sechost.dll
0x000007fefe660000 - 0x000007fefe78d000 C:\Windows\system32\RPCRT4.dll
0x0000000077340000 - 0x000000007743a000 C:\Windows\system32\USER32.dll
0x000007fefe800000 - 0x000007fefe867000 C:\Windows\system32\GDI32.dll
0x000007fefe7f0000 - 0x000007fefe7fe000 C:\Windows\system32\LPK.dll
0x000007feff110000 - 0x000007feff1db000 C:\Windows\system32\USP10.dll
0x000007fefbaa0000 - 0x000007fefbc94000 C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.18837_none_fa3b1e3d17594757\COMCTL32.dll
0x000007fefd4c0000 - 0x000007fefd531000 C:\Windows\system32\SHLWAPI.dll
0x0000000077710000 - 0x0000000077717000 C:\Windows\system32\psapi.dll
0x000007fefd540000 - 0x000007fefd56e000 C:\Windows\system32\IMM32.DLL
0x000007feff4b0000 - 0x000007feff5b9000 C:\Windows\system32\MSCTF.dll
0x000000006f3e0000 - 0x000000006f4b2000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\msvcr100.dll
0x00000000713c0000 - 0x0000000071c64000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\server\jvm.dll
0x000007fef3fc0000 - 0x000007fef3fc9000 C:\Windows\system32\WSOCK32.dll
0x000007feff7f0000 - 0x000007feff83d000 C:\Windows\system32\WS2_32.dll
0x000007feff840000 - 0x000007feff848000 C:\Windows\system32\NSI.dll
0x000007fef8a90000 - 0x000007fef8acb000 C:\Windows\system32\WINMM.dll
0x000007fefc160000 - 0x000007fefc16c000 C:\Windows\system32\VERSION.dll
0x000000006f5a0000 - 0x000000006f5af000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\verify.dll
0x000000006f570000 - 0x000000006f599000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\java.dll
0x000000006f550000 - 0x000000006f566000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\zip.dll
0x000007fefd590000 - 0x000007fefe31b000 C:\Windows\system32\SHELL32.dll
0x000007fefe460000 - 0x000007fefe65d000 C:\Windows\system32\ole32.dll
0x000007fefd110000 - 0x000007fefd11f000 C:\Windows\system32\profapi.dll
0x0000000066900000 - 0x000000006691a000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\net.dll
0x000007fefc940000 - 0x000007fefc995000 C:\Windows\system32\mswsock.dll
0x000007fefcae0000 - 0x000007fefcae7000 C:\Windows\System32\wship6.dll
0x000007fefaf00000 - 0x000007fefaf15000 C:\Windows\system32\NLAapi.dll
0x000007fef7390000 - 0x000007fef73a5000 C:\Windows\system32\napinsp.dll
0x000007fef7370000 - 0x000007fef7389000 C:\Windows\system32\pnrpnsp.dll
0x000007fefc6c0000 - 0x000007fefc71b000 C:\Windows\system32\DNSAPI.dll
0x000007fef7190000 - 0x000007fef719b000 C:\Windows\System32\winrnr.dll
0x000007fef7100000 - 0x000007fef7110000 C:\Windows\system32\wshbth.dll
0x000007fefc230000 - 0x000007fefc237000 C:\Windows\System32\wshtcpip.dll
0x000007fefa5a0000 - 0x000007fefa5c7000 C:\Windows\system32\IPHLPAPI.DLL
0x000007fefa590000 - 0x000007fefa59b000 C:\Windows\system32\WINNSI.DLL
0x000007fef70f0000 - 0x000007fef70f8000 C:\Windows\system32\rasadhlp.dll
0x000007fefa3a0000 - 0x000007fefa3f3000 C:\Windows\System32\fwpuclnt.dll
0x000000006f540000 - 0x000000006f54d000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\management.dll
0x000007fefca40000 - 0x000007fefca58000 C:\Windows\system32\CRYPTSP.dll
0x000007fefc5c0000 - 0x000007fefc607000 C:\Windows\system32\rsaenh.dll
0x000007fefd1b0000 - 0x000007fefd1ce000 C:\Windows\system32\USERENV.dll
0x000007fefcf60000 - 0x000007fefcf6f000 C:\Windows\system32\CRYPTBASE.dll
0x000007fefa370000 - 0x000007fefa388000 C:\Windows\system32\dhcpcsvc.DLL
0x000007fefa350000 - 0x000007fefa361000 C:\Windows\system32\dhcpcsvc6.DLL
0x000000006f3c0000 - 0x000000006f3d1000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\nio.dll
0x000007febe940000 - 0x000007febef36000 C:\Users\71099884\AppData\Local\Temp\librocksdbjni1096869024958681686.dll
0x000007fed8270000 - 0x000007fed830c000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\MSVCP140.dll
0x000007fed8f80000 - 0x000007fed8f96000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\VCRUNTIME140.dll
0x000007fed9070000 - 0x000007fed9074000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-runtime-l1-1-0.dll
0x000007fec5fc0000 - 0x000007fec60b6000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\ucrtbase.DLL
0x000007fed91e0000 - 0x000007fed91e3000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-core-timezone-l1-1-0.dll
0x000007fedb980000 - 0x000007fedb983000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-core-file-l2-1-0.dll
0x000007fed9690000 - 0x000007fed9693000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-core-localization-l1-2-0.dll
0x000007fed9200000 - 0x000007fed9203000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-core-synch-l1-2-0.dll
0x000007fed9560000 - 0x000007fed9563000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-core-processthreads-l1-1-1.dll
0x000007fedb990000 - 0x000007fedb993000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-core-file-l1-2-0.dll
0x000007fed9050000 - 0x000007fed9054000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-string-l1-1-0.dll
0x000007fed9180000 - 0x000007fed9183000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-heap-l1-1-0.dll
0x000007fed9060000 - 0x000007fed9064000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-stdio-l1-1-0.dll
0x000007fed91b0000 - 0x000007fed91b4000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-convert-l1-1-0.dll
0x000007fed90c0000 - 0x000007fed90c3000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-locale-l1-1-0.dll
0x000007fed90b0000 - 0x000007fed90b5000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-math-l1-1-0.dll
0x000007fed90a0000 - 0x000007fed90a5000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-multibyte-l1-1-0.dll
0x000007fed9040000 - 0x000007fed9043000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-time-l1-1-0.dll
0x000007fed9190000 - 0x000007fed9193000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-filesystem-l1-1-0.dll
0x000007fed91a0000 - 0x000007fed91a3000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-environment-l1-1-0.dll
0x000007fed9030000 - 0x000007fed9033000 C:\Program Files\Java\jdk1.8.0_191\jre\bin\api-ms-win-crt-utility-l1-1-0.dll
0x000007fef7f70000 - 0x000007fef8095000 C:\Windows\system32\dbghelp.dll

VM Arguments:
jvm_args: -Dhadoop.home.dir=C:\Program Files\Dremio\winutils -Djava.util.logging.config.class=org.slf4j.bridge.SLF4JBridgeHandler -Ddremio.log.path=C:\Users\71099884\AppData\Local\Dremio\log -Dpaths.local=C:\Users\71099884\AppData\Local\Dremio\data -Dpaths.dist=file:/C:/Users/71099884/AppData/Local/Dremio/pdfs -Dpaths.db=C:\Users\71099884\AppData\Local\Dremio\db -Dpaths.spilling=[file:/C:/Users/71099884/AppData/Local/Dremio/spill] -Dservices.coordinator.auto-upgrade=true -Xmx2048m -XX:MaxDirectMemorySize=4096m -XX:MaxPermSize=512m
java_command: com.dremio.dac.daemon.DremioDaemon dremio start
java_class_path (initial): C:\Program Files\Dremio\conf;C:\Program Files\Dremio\jars\dremio-common-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-dac-backend-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-dac-common-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-dac-daemon-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-dac-ui-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-elasticsearch-plugin-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-extra-plugin-elasticsearch-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-extra-plugin-hive-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-extra-plugin-jdbc-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-extra-plugin-mongo-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-extra-plugin-parquet-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-extra-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-extra-sabot-scheduler-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-hbase-plugin-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-hive-plugin-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-jdbc-plugin-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-mongo-plugin-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-pdfs-plugin-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-protocol-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-provision-common-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-s3-plugin-2.1.6-201809161906440178-edb5b4d.jar;C:\Program Files\Dremio\jars\dremio-sabot-kernel-2.1.6-201809161906440178-edb5b4d.jar;C:\Program F
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=C:\Program Files\Java\jdk1.8.0_191\jre
PATH=C:\windows\system32;C:\Program Files\Python37\Scripts;C:\Program Files\Python37;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\Oracle\instantclient_18_3; C:\Oracle\instantclient_18_3; C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\Program Files\Microsoft MPI\Bin;C:\Oracle\product\11.2.0\client_1\bin;C:\ProgramData\Oracle\Java\javapath;C:\Program Files (x86)\RSA SecurID Token Common;C:\Program Files\RSA SecurID Token Common;C:\Program Files (x86)\Intel\iCLS Client;C:\Program Files\Intel\iCLS Client;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0;C:\windows\Utils;C:\Program Files (x86)\Intel\UCRT;C:\Program Files\Intel\UCRT;C:\Program Files (x86)\Intel\Intel® Management Engine Components\DAL;C:\Program Files\Intel\Intel® Management Engine Components\DAL;C:\Program Files (x86)\Intel\Intel® Management Engine Components\IPT;C:\Program Files\Intel\Intel® Management Engine Components\IPT;C:\Program Files\Lenovo\Touch Fingerprint Software;C:\Go\bin;C:\Program Files\Git\cmd;C:\Program Files\Microsoft SQL Server\130\Tools\Binn;C:\Program Files (x86)\Reflection;C:\Program Files\Intel\WiFi\bin;C:\Program Files\Common Files\Intel\WirelessCommon;C:\Program Files\dotnet;C:\PostgreSQL\pg10\bin;C:\Program Files\nodejs;C:\Users\71099884\AppData\Roaming\Python\Python36\Scripts;C:\Program Files\Java\jdk1.8.0_191\bin;C:\Oracle\instantclient_18_3;C:\Users\71099884\AppData\Roaming\npm;C:\Program Files\Microsoft VS Code\bin;C:\Users\71099884\AppData\Local\Programs\Microsoft VS Code\bin; C:\Oracle\instantclient_18_3; C:\Program Files (x86)\Microsoft SDKs\TypeScript\3.0;C:\Users\71099884\AppData\Roaming\npm;C:\Program Files\Java\jdk1.8.0_191\bin;C:\Program Files\Java\jdk1.8.0_191\jre\bin
USERNAME=71099884
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 78 Stepping 3, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows 7 , 64 bit Build 7601 (6.1.7601.24214)

CPU:total 4 (initial active 4) (2 cores per cpu, 2 threads per core) family 6 model 78 stepping 3, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, rtm, 3dnowpref, lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx

Memory: 4k page, physical 8027488k(1432244k free), swap 16053076k(7586584k free)

vm_info: Java HotSpot™ 64-Bit Server VM (25.191-b12) for windows-amd64 JRE (1.8.0_191-b12), built on Oct 6 2018 09:29:03 by “java_re” with MS VC++ 10.0 (VS2010)

time: Thu Nov 01 00:38:36 2018
elapsed time: 9 seconds (0d 0h 0m 9s)