Hi all,
I am operating on a Macbook Pro (2018). Just downloaded the new version of Dremio and now when I click “start” it just says “Dremio is not running”. Any ideas of how to fix this?
Thanks.
Can you share the logs please?
Here is from the server log file:
2018-09-04 21:20:33,288 [main] INFO c.d.common.scanner.BuildTimeScan - Loaded prescanned packages [com.dremio.storage, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.storage, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.service.jobs, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.resource, com.dremio.resource.basic, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, com.dremio.exec.store, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.storage, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.provision, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.store, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.resource, com.dremio.resource.basic, com.dremio.storage, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.exec.store.hive, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.options, com.dremio.service.namespace, com.dremio.service.users, com.dremio.resource, com.dremio.resource.basic, org.apache.hadoop.hive] from locations [jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-sabot-kernel-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-common-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-sabot-logical-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-extra-sabot-scheduler-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-services-jobs-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-services-accelerator-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-dac-common-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-services-datastore-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-dac-backend-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-hive-plugin-2.1.4-201808302048550610-0981242.jar!/META-INF/dremio-module-scan/registry.json]
2018-09-04 21:20:34,417 [main] INFO c.d.common.scanner.ClassPathScanner - Scanning packages [com.dremio.extras.plugins.elastic, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.server.options, com.dremio.provision, com.dremio.plugins.mongo, com.dremio.plugins.mongo, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.service.jobs, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.service.namespace, com.dremio.plugins.elastic, com.dremio.service.users, com.dremio.exec.store.jdbc, com.dremio.provision.yarn.service, com.dremio.exec.store.jdbc, com.dremio.exec.store, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.plugins.s3.store, com.dremio.plugins.adl, com.dremio.extra.exec.store.dfs, com.dremio.exec.planner.acceleration.substitution, com.dremio.exec.store.hbase, com.dremio.exec.expr.fn.impl.conv, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.exec.store.hive, com.dremio.resource, com.dremio.resource.basic, com.dremio.options, org.apache.hadoop.hive] in locations [jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-extra-plugin-elasticsearch-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-provision-common-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-extra-plugin-mongo-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-mongo-plugin-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-services-namespace-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-elasticsearch-plugin-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-services-users-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-extra-plugin-hive-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-jdbc-plugin-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-yarn-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-extra-plugin-jdbc-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-pdfs-plugin-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-services-coordinator-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-s3-plugin-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-extra-sabot-kernel-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-hbase-plugin-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-services-resourcescheduler-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/dremio-services-options-2.1.4-201808302048550610-0981242.jar!/, jar:file:/Applications/Dremio.app/Contents/Java/dremio/jars/3rdparty/dremio-hive-exec-shaded-2.1.4-201808302048550610-0981242.jar!/] took 1125ms
2018-09-04 21:20:34,485 [main] INFO c.d.datastore.LocalKVStoreProvider - Starting LocalKVStoreProvider
2018-09-04 21:20:37,146 [main] INFO c.d.datastore.LocalKVStoreProvider - LocalKVStoreProvider is up
2018-09-04 21:20:37,975 [main] INFO c.d.datastore.LocalKVStoreProvider - Stopping LocalKVStoreProvider
2018-09-04 21:20:38,223 [main] INFO c.d.datastore.LocalKVStoreProvider - Stopped LocalKVStoreProvider
2018-09-04 21:20:38,229 [main] ERROR c.dremio.common.CatastrophicFailure - Catastrophic Failure Occurred, exiting. Information message: Failed to start services, daemon exiting.
java.lang.IllegalArgumentException: invalid version: 20Aramark_edited"
at com.dremio.service.namespace.dataset.DatasetVersion.parseLong(DatasetVersion.java:50) ~[dremio-services-namespace-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.service.namespace.dataset.DatasetVersion.(DatasetVersion.java:43) ~[dremio-services-namespace-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.dac.service.datasets.DatasetVersionMutator$VersionDatasetKey.(DatasetVersionMutator.java:472) ~[dremio-dac-backend-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.dac.service.datasets.DatasetVersionMutator$VersionDatasetKeySerializer.revert(DatasetVersionMutator.java:424) ~[dremio-dac-backend-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.dac.service.datasets.DatasetVersionMutator$VersionDatasetKeySerializer.revert(DatasetVersionMutator.java:403) ~[dremio-dac-backend-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.datastore.Serializer.deserialize(Serializer.java:34) ~[dremio-services-datastore-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.datastore.KVStoreTuple.loadValue(KVStoreTuple.java:128) ~[dremio-services-datastore-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.datastore.KVStoreTuple.getObject(KVStoreTuple.java:113) ~[dremio-services-datastore-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.datastore.LocalKVStore.extractKey(LocalKVStore.java:51) ~[dremio-services-datastore-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.datastore.LocalKVStore.access$200(LocalKVStore.java:29) ~[dremio-services-datastore-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.datastore.LocalKVStore$ConvertingEntry.getKey(LocalKVStore.java:144) ~[dremio-services-datastore-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.dac.cmd.upgrade.DatasetConfigUpgrade.upgrade(DatasetConfigUpgrade.java:101) ~[dremio-dac-daemon-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.dac.cmd.upgrade.Upgrade.run(Upgrade.java:211) ~[dremio-dac-daemon-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.dac.cmd.upgrade.Upgrade.run(Upgrade.java:171) ~[dremio-dac-daemon-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:103) ~[dremio-dac-daemon-2.1.4-201808302048550610-0981242.jar:2.1.4-201808302048550610-0981242]
It looks like this may be an upgrade?
Have a look at: Dremio version upgrade and backward compatibility
Yes, this is the newest version that I just downloaded.
Can you describe what 20Aramark_edited is a bit more in detail? Is it a VDS? If yes, do you recall what source it is reading from? Can you recall the query?