I’m attempting to launch Dremio on Ubuntu, I followed these instructions which seem to map to the Tarball installation instructions pretty closely:
When I run sudo systemctl start dremio the command seems to succeed, but nothing happens and the app doesn’t launch. Am I missing a step?
Did the service successfully start? systemctl status dremio ? Is Dremio running? If it succeeded, you can simply access Dremio via web browser via http://host:9047
Hey Anthony! Thanks for jumping in here - that’s super helpful, I was looking for a command like that but couldn’t find it somehow. This is what I got (I’ll investigate on my end too), but this probably makes more intuitive sense to you than it does to me so if this gives you an ideas let me know.
dremio.service - Dremio Daemon Server
Loaded: loaded (/etc/systemd/system/dremio.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Sat 2018-06-23 19:40:37 UTC; 51min ago
Process: 11567 ExecStop=/opt/dremio/bin/dremio --config /opt/dremio/conf stop (code=exited, status=0/SUCCESS)
Main PID: 11467 (code=exited, status=1/FAILURE)
Jun 23 19:40:29 ubuntu-s-1vcpu-1gb-nyc1-01 systemd[1]: Starting Dremio Daemon Server...
Jun 23 19:40:29 ubuntu-s-1vcpu-1gb-nyc1-01 dremio[11415]: starting dremio, logging to /opt/dremio/log/server.out
Jun 23 19:40:30 ubuntu-s-1vcpu-1gb-nyc1-01 systemd[1]: Started Dremio Daemon Server.
Jun 23 19:40:31 ubuntu-s-1vcpu-1gb-nyc1-01 systemd[1]: Started Dremio Daemon Server.
Jun 23 19:40:33 ubuntu-s-1vcpu-1gb-nyc1-01 systemd[1]: Started Dremio Daemon Server.
Jun 23 19:40:37 ubuntu-s-1vcpu-1gb-nyc1-01 systemd[1]: dremio.service: Main process exited, code=exited, status=1/FAILURE
Jun 23 19:40:37 ubuntu-s-1vcpu-1gb-nyc1-01 dremio[11567]: no dremio to stop because kill -0 of pid 11467 failed with status 1
Jun 23 19:40:37 ubuntu-s-1vcpu-1gb-nyc1-01 systemd[1]: dremio.service: Unit entered failed state.
Jun 23 19:40:37 ubuntu-s-1vcpu-1gb-nyc1-01 systemd[1]: dremio.service: Failed with result 'exit-code'.Can you share /opt/dremio/log/server.out & /opt/dremio/log/server.log please?
Happy to! Here is server.out
Sat Jun 23 19:10:27 UTC 2018 Starting dremio on ubuntu-s-1vcpu-1gb-nyc1-01
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 3913
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 3913
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.1.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.0.13.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
Exception in thread "main" com.dremio.common.exceptions.UserException: function com.dremio.exec.expr.fn.impl.conv.OrderedBytesBigIntConvertFrom scanned twice in the following locations:
[jar:file:/opt/dremio/jars/dremio-s3-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hive-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-s3-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-2.0.5-201806021755080191-767cfb5.jar!/]
Do you have conflicting jars on the classpath?
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648)
at com.dremio.common.scanner.ClassPathScanner.verifyClassUnicity(ClassPathScanner.java:430)
at com.dremio.common.scanner.ClassPathScanner.scan(ClassPathScanner.java:412)
at com.dremio.common.scanner.RunTimeScan.fromPrescan(RunTimeScan.java:58)
at com.dremio.common.scanner.ClassPathScanner.fromPrescan(ClassPathScanner.java:452)
at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:130)
Sat Jun 23 19:11:27 UTC 2018 Starting dremio on ubuntu-s-1vcpu-1gb-nyc1-01
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 3913
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 3913
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.1.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.0.13.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
Exception in thread "main" com.dremio.common.exceptions.UserException: function com.dremio.exec.expr.fn.impl.conv.OrderedBytesBigIntConvertFrom scanned twice in the following locations:
[jar:file:/opt/dremio/jars/dremio-s3-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hive-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-s3-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-2.0.5-201806021755080191-767cfb5.jar!/]
Do you have conflicting jars on the classpath?
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648)
at com.dremio.common.scanner.ClassPathScanner.verifyClassUnicity(ClassPathScanner.java:430)
at com.dremio.common.scanner.ClassPathScanner.scan(ClassPathScanner.java:412)
at com.dremio.common.scanner.RunTimeScan.fromPrescan(RunTimeScan.java:58)
at com.dremio.common.scanner.ClassPathScanner.fromPrescan(ClassPathScanner.java:452)
at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:130)
Sat Jun 23 19:17:38 UTC 2018 Starting dremio on ubuntu-s-1vcpu-1gb-nyc1-01
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 3913
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 3913
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.1.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.0.13.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
Exception in thread "main" com.dremio.common.exceptions.UserException: function com.dremio.exec.expr.fn.impl.conv.OrderedBytesBigIntConvertFrom scanned twice in the following locations:
[jar:file:/opt/dremio/jars/dremio-s3-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hive-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-s3-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-2.0.5-201806021755080191-767cfb5.jar!/]
Do you have conflicting jars on the classpath?
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648)
at com.dremio.common.scanner.ClassPathScanner.verifyClassUnicity(ClassPathScanner.java:430)
at com.dremio.common.scanner.ClassPathScanner.scan(ClassPathScanner.java:412)
at com.dremio.common.scanner.RunTimeScan.fromPrescan(RunTimeScan.java:58)
at com.dremio.common.scanner.ClassPathScanner.fromPrescan(ClassPathScanner.java:452)
at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:130)
Sat Jun 23 19:18:06 UTC 2018 Starting dremio on ubuntu-s-1vcpu-1gb-nyc1-01
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 3913
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 3913
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.1.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.0.13.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
Exception in thread "main" com.dremio.common.exceptions.UserException: function com.dremio.exec.expr.fn.impl.conv.OrderedBytesBigIntConvertFrom scanned twice in the following locations:
[jar:file:/opt/dremio/jars/dremio-s3-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hive-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-s3-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-mongo-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/3rdparty/dremio-hive-exec-shaded-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-mongo-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-yarn-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-2.0.5-201806021755080191-767cfb5.jar!/]
Do you have conflicting jars on the classpath?
at com.dremio.common.exceptions.UserException$Builder.build(UserException.java:648)
at com.dremio.common.scanner.ClassPathScanner.verifyClassUnicity(ClassPathScanner.java:430)
at com.dremio.common.scanner.ClassPathScanner.scan(ClassPathScanner.java:412)
at com.dremio.common.scanner.RunTimeScan.fromPrescan(RunTimeScan.java:58)
at com.dremio.common.scanner.ClassPathScanner.fromPrescan(ClassPathScanner.java:452)
at com.dremio.dac.daemon.DremioDaemon.main(DremioDaemon.java:130)
Sat Jun 23 19:24:33 UTC 2018 Starting dremio on ubuntu-s-1vcpu-1gb-nyc1-01
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 3913
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 3913
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.1.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/dremio/jars/3rdparty/logback-classic-1.0.13.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
Exception in thread "main" com.dremio.common.exceptions.UserException: function com.dremio.exec.expr.fn.impl.conv.OrderedBytesBigIntConvertFrom scanned twice in the following locations:
[jar:file:/opt/dremio/jars/dremio-s3-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-namespace-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-hbase-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-services-users-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-services-coordinator-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-elasticsearch-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-pdfs-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-hive-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-elasticsearch-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-plugin-jdbc-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-hive-plugin-1.4.4-201801230630490666-6d69d32.jar!/, jar:file:/opt/dremio/jars/dremio-jdbc-plugin-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-provision-common-2.0.5-201806021755080191-767cfb5.jar!/, jar:file:/opt/dremio/jars/dremio-extra-sabot-kernel-2.0.5-201806021755080191-767cfb5.jar!/,
the logs are too long to share - does this help, I can find a way to share that or I can start over and see if I can shorter logs (I was trying lots of things as you can imagine before I knew about the status check). I had to delete a few lines off the .out too actually.
I am going to start over - I’ll post here in just a few (shouldn’t take long) if I run into the same issues, I have conflicting jars which could be the source of the problem just for starters so I think a refresh try is warranted.
Agreed. FYI the script you initially linked to is using an older version of Dremio 1.4.4. It may be worth downloading and using the latest 2.0.5
That was the issue! Running beautifully on version 2.0.5. Let me know if you want to me mark this as resolved or what the best thing to do is, super helpful Anthony. I recommend this setup guide for Ubuntu for anyone using Digital Ocean, long term I’d be running elsewhere but I like to develop on DO to just keep my local environment clean when I’m just experimenting.