I’ve noticed Dremio has support for:
- Azure Data Lake Gen1 (deprecated by Microsoft)
- Azure Storage v2
Azure Storage v2 consists out of two products in Azure:
- Azure Data Lake Gen2 (ADLS)
- Azure Blob Storage v2
ADSL is actually build on top of Azure Blob Storage. It inherits almost all aspects of blob and adds some things on top. Now all Dremio docs talk about using ADLS.
My question: Does Dremio actually utilize ADLS enhancements? Or is it fine to just use Azure Blob. There’s no difference in storage costs between ADLS and Blob but transactions fees of ADLS are higher (+ migration efforts from blob to ADLS).