Dremio Installation

1

Hi, I’m new to dremio. I want to install dremio in my Linux system. Can you please provide steps for installation and configuration file. I have tried everything that are specifies in the website. I followed the the steps below earlier:

  1. wget https://download.dremio.com/community-server/1.0.8-201707190805180330-27f36e1/dremio-community-1.0.8-201707190805180330_27f36e1_1.noarch.rpm
  2. yum install dremio-community-1.0.8-201707190805180330_27f36e1_1.noarch.rpm
  3. sudo chkconfig --level 3456 dremio on
  4. sudo service dremio start
  5. navigate to the Dremio UI at http://localhost:9047.
    at the end dremio was not running. So i need in-detail installation along with dremo-conf file
2

can anyone please reply on this…

3

hello @rajtej
can you see if this process is running, do you have to look at the running log, try it without 127.0.0.1

4

i didnt get you. how to try without 127.0.0.1

5

Just curious why you’re using a very old Dremio version?
Also can you check using

netstat -an | grep 9047

whether the port is up?

1 Like
6

Also, take a look at the ‘server.log’ file for ERROR in the coordinator and executor nodes. You should find the server.log file in the directory /var/log. If the file is not present in that directory check out /opt/dremio/log.

7

@rajtej

Please do the below 2,

#1 Download the latest version of Dremio -->> Download Dremio
#2 Follow installation docs -->> Install Dremio

Please reach out if you have any issues

Thanks
@balaji.ramaswamy

8

Network

The following ports must be open to either access the Dremio UI or for communication between nodes:

760×334

#Install script

sudo groupadd -r dremio

sudo useradd -r -g dremio -d /var/lib/dremio -s /sbin/nologin dremio

sudo mkdir /opt/dremio

sudo mkdir /opt/dremio/log && sudo chown dremio : dremio /opt/dremio/log

sudo mkdir /opt/dremio/run && sudo chown dremio : dremio /opt/dremio/run

sudo mkdir /opt/dremio/data && sudo chown dremio : dremio /opt/dremio/data

# Latest version link can be obtained on https://www.dremio.com/download/ under 'TAR'

cd /tmp

wget https : //download.dremio.com/community-server/dremio-community-LATEST.tar.gz

sudo tar -xvf dremio-community-LATEST.tar.gz -C /opt/dremio/ --strip-components=1

sudo ln -s /opt/dremio/conf /etc/dremio

sudo cp /opt/dremio/share/dremio.service /etc/systemd/system/dremio.service

# Add service

sudo systemctl daemon-reload

sudo systemctl start dremio

# Optionally, set Dremio service to start on boot:

sudo systemctl enable dremio

Verifying the installation

Open a browser and go to <master_node_ip>:9047 . It will ask to create admin User for the first time.

Once logged in, click on the button (at the top-right of the page). It will show Node Activity under Cluster section.

Fix /tmp directory file creation issue.

netstat -pluton | grep 9047 (Verify whether port 9047 is open or not )

Go theoogh the /opt/dremio/log/server.out:

sudo mount /tmp -o remount,exec ( I looked “https://stackoverflow.com/questions/13502156/what-are-possible-causes-of-failed-to-map-segment-from-shared-object-operation” and saw)

netstat -pluton | grep 9047

I updated the live maximum number of descriptors:

echo "65536" > /proc/sys/fs/file-max

The, updated for reboot:

vi /etc/sysctl .conf

fs. file -max = 65536

vi /opt/dremio/log/server .out (And looked at the logs)

According to “https://community.dremio.com/t/dremio-dockers-stop-as-soon-as-i-started-them/2523” we need to “remove” the data/db directory:

[root@915468-ElasticDemo tmp] # cd /opt/dremio/data

[root@915468-ElasticDemo data] # mkdir ~/dremio-backup

[root@915468-ElasticDemo data] # mv db ~/dremio-backup/

[root@915468-ElasticDemo data] # service dremio restart

[root@915468-ElasticDemo data] # vi /opt/dremio/log/server.out

If your getting error through librocksdb. (Please follow the below instruction to fix it

Ref: Startup failing... librocksdb

# cd /etc/dremio/

# vi dremio-env

# sudo reboot

# service dremio status

dremio is running.

modifications in dremio- env

# Extra Java options - shared between dremio and dremio-admin commands

#

DREMIO_JAVA_EXTRA_OPTS=-Djava.io.tmpdir= /mnt/snas/dremio