Why is Google Cloud not supported?

1

Can someone shed some light on why Google Cloud seems to have zero support from Demio?

I can understand BigQuery (usage-based billing could be expensive). But why not GCE for deployment or GCS for bucket storage?

We’re currently using BigQuery and GCE/K8 and I’d like to advocate for Dremio - but it’s hard without any support on the platform.

2

Hi, We have multiple users successfully running in GCE. Dremio can be deployed in GCE using either a standalone installations with GCE VMs, or in Kubernetes using the Dremio helm charts available on Github at https://github.com/dremio/dremio-cloud-tools.

3

Thanks for the reply. I understand that you can deploy to GCP, I’m just saying there is no documentation about it like there is for Amazon or Azure. You could probably deploy to Amazon or Azure without documentation also. It’s feels strange to omit one of the big three cloud vendors - should I be worried about problems on GCP?

But more importantly, there is not support for (AFAIK) for reading CSV/JSON from GCS. If there was, I could export a BigQuery table and then use Dremio with it just like I would with S3. This would be huge.

As we all know, Dremio is the deluxe version of Apache Drill which is the OSS implementation of Google Dremel which is the foundation of BigQuery. BigQuery is great till you start getting the bills and have to adjust your query strategies to process less bytes. Supporting GCS would make an easy path for people to test migration from BQ.

1 Like
4

Sure understood. FYI, we run Dremio on GCP as part of test framework and for our own infrastructure purposes, there should be no reason to worry about problems GCP.

Regarding GCS, we are continuing to look at adding support for GCS and should be able to provide more clarity on that in a bit.

1 Like
5

Great - thanks! looking forward to hearing more.

6

I would love to see dremio working with GCS and BigQuery as well!

7

hello guys! any update on this?

Under distStorage.type, I still see only - aws, azure, azureStorage - being supported - https://github.com/dremio/dremio-cloud-tools/blob/master/charts/dremio_v2/docs/Values-Reference.md#diststoragetype.

Is there a way to use GCS? Is there an example of how to set it up ?