in dremio-oss ,the daemon pom.xml import some dremio-ce-*-plugin,What is the difference with the plugins in dremio-oss?In particular, if I want to add a new jdbc data source, what is the relationship with these dremio-ce plugins?
Dremio CE plugins (that you can see in daemon pom.xml
) are optional dependencies adding or extending features to dremio-oss
. As you can see there are mentioned in a special community-edition
profile that you can not include by adding -Ddremio.oss-only
to your Maven commandline. Those dependencies are governed by the “Dremio Free Software License 1.0” while the code present in dremio-oss
repository is governed by the Apache Software License 2.0 (which is a FLOSS license).
If you want to add a new JDBC data source, you would need to use the ARP framework which requires the use of the Dremio CE JDBC plugin.
Is it the same for Kafka? Does it also use the ARP framework?
If there exists a Apache Kafka JDBC driver that you can use with the ARP framework, most likely. But otherwise you may need to write your own storage plugin which is more complicated than simply using the ARP framework.