Dremio on Raspberry Pi

kean · September 22, 2018, 12:16pm

Hi, I am thinking of learning Dremio with my Raspberry PI cluster. Performance is not a concern. Any advice about the idea?

Cheers.

kelly · September 22, 2018, 1:09pm

I don’t know if anyone has tried that.

If you’re looking to get a feel for cluster operations and don’t have a cluster, the Helm chart for K8s might be helpful:

github.com

dremio/containers/blob/master/charts/dremio/README.md

# Dremio + Kubernetes Cluster Setup

## Overview

This is a Helm chart to deploy a Dremio cluster in kubernetes. It uses a persistent volume for the master node. An appropriate distributed file store (S3, ADLS, HDFS, etc) should be used for paths.dist as this deployment will lose locally persisted reflections and uploads.

This assumes you already have kubernetes cluster setup, kubectl configured to talk to your kubernetes cluster and helm setup in your cluster.

Review and update values.yaml to reflect values for your environment before installing the helm chart. This is specially important for for the memory and cpu values - your kubernetes cluster should have sufficient resources to provision the pods with those values. If your kubernetes installation does not support serviceType LoadBalancer, it is recommended to comment the serviceType value in values.yaml file before deploying.

#### Installing the helm chart
Run this from the charts directory
```bash
cd charts
helm install --wait dremio
```
If it takes longer than a couple of minutes to complete, check the status of the pods to see where they are waiting. If they are pending scheduling due to limited memory or cpu, either adjust the values in values.yaml and restart the process or add more resources to your kubernetes cluster. 

#### Connect to the Dremio UI
If your kubernetes supports serviceType LoadBalancer, you can get to the Dremio UI on the load balancer external ip.

This file has been truncated. show original

Topic		Replies	Views
Dremio, Docker, and Kubernetes	8	6458	April 29, 2019
Unable deploy Dremio to Kubernetes with Helm	3	1208	November 12, 2020
Unable to install dremio helm chart on kubernetes AWS EKS	3	1322	August 30, 2019
Unable to deploy dremio on kubernetes,	3	2299	July 17, 2019
Dremio custom connector installation on kubernetes cluster	8	1252	May 8, 2021

Dremio on Raspberry Pi

Related Topics