Network
The following ports must be open to either access the Dremio UI or for communication between nodes:
#Install script
sudo groupadd -r dremio
sudo useradd -r -g dremio -d /var/lib/dremio -s /sbin/nologin dremio
sudo mkdir /opt/dremio
sudo mkdir /opt/dremio/log && sudo chown dremio : dremio /opt/dremio/log
sudo mkdir /opt/dremio/run && sudo chown dremio : dremio /opt/dremio/run
sudo mkdir /opt/dremio/data && sudo chown dremio : dremio /opt/dremio/data
# Latest version link can be obtained on https://www.dremio.com/download/ under 'TAR'
cd /tmp
wget https : //download.dremio.com/community-server/dremio-community-LATEST.tar.gz
sudo tar -xvf dremio-community-LATEST.tar.gz -C /opt/dremio/ --strip-components=1
sudo ln -s /opt/dremio/conf /etc/dremio
sudo cp /opt/dremio/share/dremio.service /etc/systemd/system/dremio.service
# Add service
sudo systemctl daemon-reload
sudo systemctl start dremio
# Optionally, set Dremio service to start on boot:
sudo systemctl enable dremio
Verifying the installation
Open a browser and go to <master_node_ip>:9047 . It will ask to create admin User for the first time.
Once logged in, click on the button (at the top-right of the page). It will show Node Activity under Cluster section.
Fix /tmp directory file creation issue.
netstat -pluton | grep 9047 (Verify whether port 9047 is open or not )
Go theoogh the /opt/dremio/log/server.out:
sudo mount /tmp -o remount,exec ( I looked “https://stackoverflow.com/questions/13502156/what-are-possible-causes-of-failed-to-map-segment-from-shared-object-operation” and saw)
netstat -pluton | grep 9047
I updated the live maximum number of descriptors:
echo "65536" > /proc/sys/fs/file-max
The, updated for reboot:
vi /etc/sysctl .conf
fs. file -max = 65536
vi /opt/dremio/log/server .out (And looked at the logs)
According to “https://community.dremio.com/t/dremio-dockers-stop-as-soon-as-i-started-them/2523” we need to “remove” the data/db directory:
[root@915468-ElasticDemo tmp] # cd /opt/dremio/data
[root@915468-ElasticDemo data] # mkdir ~/dremio-backup
[root@915468-ElasticDemo data] # mv db ~/dremio-backup/
[root@915468-ElasticDemo data] # service dremio restart
[root@915468-ElasticDemo data] # vi /opt/dremio/log/server.out
If your getting error through librocksdb. (Please follow the below instruction to fix it
Ref: Startup failing... librocksdb
# cd /etc/dremio/
# vi dremio-env
# sudo reboot
# service dremio status
dremio is running.
modifications in dremio- env
# Extra Java options - shared between dremio and dremio-admin commands
#
DREMIO_JAVA_EXTRA_OPTS=-Djava.io.tmpdir= /mnt/snas/dremio