Can't start Dremio after upgrade to 2.0.1

1

Hello,
I upgraded from 1.4.4 installation using the tar distribution by replacing the old Dremio directory with the contents of the 2.0.1 tarball; then I run bin/dremio-admin --config /etc/dremio upgrade and got the following output:

$ bin/dremio-admin --config /etc/dremio upgrade
2018-04-30 10:12:16,147 [main] INFO  com.dremio.common.config.SabotConfig - Configuration and plugin file(s) identified in 65ms.
Base Configuration:
	- jar:file:/opt/dremio/jars/dremio-common-2.0.1-201804132205050000-10b1de0.jar!/sabot-default.conf

Intermediate Configuration and Plugin files, in order of precedence:
	- jar:file:/opt/dremio/jars/dremio-sabot-logical-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-jdbc-plugin-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-extra-sabot-scheduler-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-services-accelerator-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-provision-common-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-hive-plugin-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-services-users-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-dac-backend-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-common-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-services-coordinator-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-pdfs-plugin-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-mongo-plugin-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-hbase-plugin-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-dac-common-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-s3-plugin-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-services-jobs-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-yarn-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-services-namespace-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-sabot-kernel-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-services-datastore-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf
	- jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-2.0.1-201804132205050000-10b1de0.jar!/sabot-module.conf

Override File: file:/etc/dremio/sabot-override.conf

2018-04-30 10:12:16,409 [main] INFO  c.d.common.scanner.BuildTimeScan - Loaded prescanned packages [com.dremio.storage, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.service.namespace, com.dremio.service.users, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.service.users, com.dremio.exec.store, com.dremio.storage, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.service.namespace, com.dremio.service.users, org.apache.hadoop.hive, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.provision, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.service.jobs, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.store, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.service.jobs, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.service.namespace, com.dremio.service.users, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.storage, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.service.namespace, com.dremio.service.users, com.dremio.storage, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs] from locations [jar:file:/opt/dremio/jars/dremio-sabot-logical-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-extra-sabot-scheduler-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-services-accelerator-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-hive-plugin-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-dac-backend-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-common-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-dac-common-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-services-jobs-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-sabot-kernel-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json, jar:file:/opt/dremio/jars/dremio-services-datastore-2.0.1-201804132205050000-10b1de0.jar!/META-INF/dremio-module-scan/registry.json]
2018-04-30 10:12:17,190 [main] INFO  c.d.common.scanner.ClassPathScanner - Scanning packages [com.dremio.extras.plugins.elastic, com.dremio.exec.store.jdbc, com.dremio.sabot.task.slicing.SlicingTaskPool, com.dremio.service.accelerator, com.dremio.service.reflection, com.dremio.service.voting, com.dremio.provision, com.dremio.extra.exec.store.dfs, com.dremio.exec.planner.acceleration.substitution, com.dremio.exec.store.jdbc, org.apache.hadoop.hive, com.dremio.exec.fn.hive, com.dremio.plugins.mongo, com.dremio.service.users, com.dremio.dac, com.dremio.dac.support.SupportService, com.dremio.exec.store.mock, com.dremio.common.logical, com.dremio.exec.store.dfs, com.dremio.plugins.elastic, com.dremio.exec.store, com.dremio.plugins.mongo, com.dremio.exec.store.hbase, com.dremio.exec.expr.fn.impl.conv, com.dremio.plugins.s3.store, com.dremio.plugins.adl, com.dremio.service.jobs, com.dremio.provision.yarn.service, com.dremio.service.namespace, com.dremio.exec.ExecConstants, com.dremio.exec.catalog, com.dremio.exec.compile, com.dremio.exec.expr, com.dremio.exec.physical, com.dremio.exec.planner.physical.PlannerSettings, com.dremio.exec.server.options, com.dremio.exec.store, com.dremio.exec.store.dfs.implicit.ImplicitFilesystemColumnFinder, com.dremio.exec.rpc.user.security, com.dremio.sabot, org.apache.hadoop.hive] in locations [jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-s3-plugin-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-2.0.1-201804132205050000-10b1de0.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-2.0.1-201804132205050000-10b1de0.jar!/] took 779ms
2018-04-30 10:12:17,228 [main] INFO  c.d.datastore.LocalKVStoreProvider - Starting LocalKVStoreProvider
2018-04-30 10:12:18,483 [main] INFO  c.d.datastore.LocalKVStoreProvider - LocalKVStoreProvider is up
KVStore version is 1.4.4-201801230630490666-6d69d32
Skipping ReIndex stores [1.0.9, 1.3.0)
Skipping Setting dataset expiry [1.0.9, 1.1.1)
Skipping Setting acceleration refresh and grace policy [1.0.9, 1.2.0)
Mark materializations created before 1.5 as deprecated [1.0.6, 1.5.0)
  Marking materialization with id [MaterializationId{id=88c52f79-c432-435a-af77-9b8c9dacf9bf}] (for reflection [ReflectionId{id=24925446-63ba-4502-a83b-9ee1818da2f8}], series [0]) as deprecated
  Marking materialization with id [MaterializationId{id=6ef57931-6c57-49a3-8928-df2186a51eb9}] (for reflection [ReflectionId{id=24925446-63ba-4502-a83b-9ee1818da2f8}], series [1]) as deprecated
  Marking materialization with id [MaterializationId{id=b962e4b2-d846-49cd-8941-1b9fad6bb93d}] (for reflection [ReflectionId{id=40473c9a-823a-454c-8d02-2e02f965dcb2}], series [0]) as deprecated
  Marking materialization with id [MaterializationId{id=eef31a44-e087-4971-864c-d6d2b4eb1576}] (for reflection [ReflectionId{id=40473c9a-823a-454c-8d02-2e02f965dcb2}], series [1]) as deprecated
  Marking materialization with id [MaterializationId{id=f36578cf-b129-4f32-bd66-9d34e817581a}] (for reflection [ReflectionId{id=5e6aa650-02bf-404e-b6ce-afb9ce325287}], series [0]) as deprecated
  Marking materialization with id [MaterializationId{id=ec2b8cb4-e57e-417f-96e6-983556683c4f}] (for reflection [ReflectionId{id=5e6aa650-02bf-404e-b6ce-afb9ce325287}], series [1]) as deprecated
  Marking materialization with id [MaterializationId{id=39f3275b-a7e1-4da0-a128-a2c87b8ffee7}] (for reflection [ReflectionId{id=5e6aa650-02bf-404e-b6ce-afb9ce325287}], series [2]) as deprecated
  Marking materialization with id [MaterializationId{id=0458d0ba-8fb0-4fda-b8cb-ef233eb89d2a}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [0]) as deprecated
  Marking materialization with id [MaterializationId{id=e7fb704c-300d-4017-b217-d0795f6bf28c}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [1]) as deprecated
  Marking materialization with id [MaterializationId{id=9a99e8a1-18c0-43c6-b5bd-761626818a82}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [2]) as deprecated
  Marking materialization with id [MaterializationId{id=bbc05a0a-abc6-4515-9d7a-7743e67a7dc7}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [3]) as deprecated
  Marking materialization with id [MaterializationId{id=d3552a11-acf5-422b-aeae-aea35dcf46c4}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [4]) as deprecated
  Marking materialization with id [MaterializationId{id=51ef124f-060b-465e-b09a-df06cbf748d9}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [5]) as deprecated
  Marking materialization with id [MaterializationId{id=4b51cae7-0034-408d-93cd-6bd490afb145}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [6]) as deprecated
  Marking materialization with id [MaterializationId{id=d14711d7-0d96-4dc6-917d-20445b6dd732}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [7]) as deprecated
  Marking materialization with id [MaterializationId{id=51f6f2e7-293a-432a-8c61-b3bc165afa71}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [8]) as deprecated
  Marking materialization with id [MaterializationId{id=79266ab1-5172-45da-891d-e12df00df0cd}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [9]) as deprecated
  Marking materialization with id [MaterializationId{id=2d277a6a-4b74-461f-92d0-53aa203dd710}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [10]) as deprecated
  Marking materialization with id [MaterializationId{id=8a47471f-48aa-40d4-84d2-cdf4315999f2}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [11]) as deprecated
  Marking materialization with id [MaterializationId{id=276232b0-db52-4710-b36d-6c6edee6a3d8}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [12]) as deprecated
  Marking materialization with id [MaterializationId{id=3e82fe07-396f-4625-bde0-3e9255eb6b98}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [13]) as deprecated
  Marking materialization with id [MaterializationId{id=2bfd4d80-b381-4825-9c5f-9d7e6da9b11c}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [14]) as deprecated
  Marking materialization with id [MaterializationId{id=1ae2e9fe-ecb0-4cdb-8765-06b44645022b}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [15]) as deprecated
  Marking materialization with id [MaterializationId{id=42860191-cb2e-4486-839a-5d6edd564b34}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [16]) as deprecated
  Marking materialization with id [MaterializationId{id=4436a0fd-4338-4617-8b51-6ec141ab6c49}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [17]) as deprecated
  Marking materialization with id [MaterializationId{id=27f64091-2cfb-4c60-9fc8-abad65f006e6}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [18]) as deprecated
  Marking materialization with id [MaterializationId{id=b0ba77dc-29e1-4a80-ae9d-959ef7c008ae}] (for reflection [ReflectionId{id=6531c8d4-a197-4cfb-ada4-21ce5856e2d3}], series [19]) as deprecated
  Marking materialization with id [MaterializationId{id=b21079e7-d1df-4126-9174-46b4ed291e53}] (for reflection [ReflectionId{id=708254f3-5855-4a23-88d3-3a979e8f1bd5}], series [0]) as deprecated
  Marking materialization with id [MaterializationId{id=1d95ae1b-392f-43b1-a0f3-8289a9547912}] (for reflection [ReflectionId{id=708254f3-5855-4a23-88d3-3a979e8f1bd5}], series [1]) as deprecated
  Marking materialization with id [MaterializationId{id=6668a124-8809-4617-8f59-c7bd57f3b7e0}] (for reflection [ReflectionId{id=b143be10-e2ae-4eb5-9097-de889ad5fa4d}], series [0]) as deprecated
  Marking materialization with id [MaterializationId{id=9aaaf193-eb15-42f4-a764-1930ebce044f}] (for reflection [ReflectionId{id=b143be10-e2ae-4eb5-9097-de889ad5fa4d}], series [1]) as deprecated
  Deprecated 31 materializations. These will be deleted after configured grace period
  Removed 6 from the old materialization store
Migrate from accelerations to reflections [1.0.6, 1.5.0)
  Migrating dataset [[local, REDACTED]] with acceleration [120113d9-0571-456a-b1a7-61e14208fbef]
    - failed to migrate layout ... field [id] cannot be both a sort and a partition]
  Migrating dataset [[@demo, REDACTED]] with acceleration [38d92ff7-b178-46ed-ae7e-8aee9e445dbc]
  Migrating dataset [[REDACTED, REDACTED, REDACTED]] with acceleration [49357be7-842f-4716-8223-7cc75b483eee]
  Migrating dataset [[REDACTED, REDACTED, REDACTED]] with acceleration [59bcbbd1-5199-4f81-b85f-f8451c35d557]
  Migrating dataset [[REDACTED, REDACTED, config]] with acceleration [6ff0f438-b84e-476a-bef0-dd2a0f0c9deb]
  Migrating dataset [[local, REDACTED]] with acceleration [aac1fb38-f4c7-4e75-b406-8bdcff71bf39]
    - failed to migrate layout [Layout{id=LayoutId{id=5e6aa650-02bf-404e-b6ce-afb9ce325287}, ...  field [id] cannot be both a sort and a partition]
  Migrating dataset [[@demo, REDACTED]] with acceleration [c9bf428a-c519-40e8-9f9e-09501e6629c7]
  Clearing out old stores...
  Clearing out old stores complete
ReIndex stores [1.2.0, 1.5.0)
ReIndexing dac-namespace, 258 Elements ReIndexed.
Deleting internal sources [1.0.6, 1.5.0)
  deleting '$scratch'
  deleting '__accelerator'
  deleting '__datasetDownload'
  deleting '__home'
  deleting '__jobResultsStore'
  deleting '__logs'
  deleting '__materialization'
  deleting '__support'
  deleting 'INFORMATION_SCHEMA'
  deleting 'sys'
Migrate from acceleration settings to reflection settings [1.0.6, 1.5.0)
  Migrating source [REDACTED]
  Migrating source [REDACTED]
  Migrating source [REDACTED]
Convert Join Info [1.0.6, 1.5.0)
2018-04-30 10:12:19,728 [main] INFO  c.d.datastore.LocalKVStoreProvider - Stopping LocalKVStoreProvider
2018-04-30 10:12:20,210 [main] INFO  c.d.datastore.LocalKVStoreProvider - Stopped LocalKVStoreProvider
Updated:
	0 accelerations
	0 layouts
	0 materialized layouts
	0 materializations

Now when I start Dremio it fails with the following error:

Catastrophic failure occurred. Exiting. Information follows: Failed to start services, daemon exiting.
com.dremio.common.exceptions.UserException: Unknown source INFORMATION_SCHEMA
	at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:746)
	at com.dremio.exec.catalog.CatalogServiceImpl.refreshSource(CatalogServiceImpl.java:330)
	at com.dremio.exec.catalog.CatalogServiceImpl.start(CatalogServiceImpl.java:166)
	at com.dremio.service.SingletonRegistry$AbstractServiceReference.start(SingletonRegistry.java:137)
	at com.dremio.service.ServiceRegistry.start(ServiceRegistry.java:74)
	at com.dremio.service.SingletonRegistry.start(SingletonRegistry.java:33)
	at com.dremio.dac.daemon.DACDaemon.startServices(DACDaemon.java:171)
	at com.dremio.dac.daemon.DACDaemon.init(DACDaemon.java:177)
	at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:131)

Any pointers on what the issue could be? Apparently an internal source named INFORMATION_SCHEMA was removed by the migration so I’m not sure what the catalog service is looking for.

2

Hey there,

Did you have reflections configured on your cluster? If so, there is a known bug upgrading that requires that you first of all disable the reflections first.

See here: https://docs.dremio.com/advanced-administration/upgrade/tarball.html

Try following the steps described there first. If you’re still getting issues upgrading let me know, and I’ll take another look.

Thanks,

Christy

3

Yes the cluster had reflections configured but I didn’t see that note about upgrading; this is a development installation so I can start from scratch, or is there any workaround that does not require the previous Dremio to be running?

4

Well, you could manually go in and remove the data files on each node. But honestly, at that point, it might be easier to start from scratch.

Christy