Connecting to Azure Databricks as external source from Dremio (CE)

1

I believe there is no builtin connector in Dremio for azure Databricks?

If true, what is the recommended approach by dremio to achieve this connectivity? We have hive metastore schemas and objects in our Azure Databricks environment. We are using ADLS2 as storage layer for Databricks.

I can connect directly to ADLS2 from within Dremio, however, meta layer is lost and we can only see raw folders, and content. I mean, i can load the content but it’s all file based and unlike object (e.g. view), which i could directly if i connect via Databricks.

Please suggest the recommended approach to achieve this.

Thanks.

2

@sulemanb Does the HMS in Azure have a IP and port that you can add as a Hie source?