Can we have ODBC and JDBC as a Data Source Type in Dremio

Hello Team,

We are looking for method in which we can have Source as a ODBC and JDBC as a Data Source Type in Sources Tab in Dremio.

Thanks and Regards,
Lavish Patodi

6 Likes

Hey @lavish_patodi we don’t support generic ODBC/JDBC sources right now. This is to ensure correct pushdowns (in-DB processing) into each source depending the SQL dialect and optimal performance. What sources are you interested in working with?

It would be nice if there was a plan to add a Sybase ODBC/JDBC source. MS SQL Server was originally a fork of Sybase so the syntax and optimization is pretty similar.

You just gave me a T-SQL flashback from the 90s… :slight_smile:

I assume you mean ASE and not IQ?

Both … !

IQ is a different beast through…

Hello Can,

Thanks for your inputs. Currently, we are working on HDFS as a source data type.

@lavish_patodi got it. Are you looking to add a JDBC/ODBC source currently not supported? Would be great to get info on that.

Hello Can,

Yes Indeed we are looking for it.

It will be great if you guys can work out on the same.

Thanks and Regards,
Lavish Patodi

@can am expecting @lavish_patodi wants to connect to source like Sybase IQ/SAP HANA via jdbc/odbc/native-drivers

Above products are used for enterprise data analytics .

Regards
Ankit

I support @lavish_patodi’s call for ODBC data sources. I would be interested in using Dremio but a lot of my professional life revolves around industrial historians such as OSISoft PI which are accessible only through ODBC and OLEDB.

1 Like

I would also like to see JDBC support for Sybase (ASE first, then IQ in terms of importance to me).

Thanks!

I’m looking at this to connect SQL Server to Informix sources, but since Informix isn’t on the list of supported sources a generic JDBC connection would be great as well!

A generic jdbc driver to connect any db that supports ansi sql is definitely needed. Only ansi sql support is good enough to start with which can be pushed down. IMO most of the dbs support Ansi sql anyway.

5 Likes

Agree with @sambitdixit, a generic JDBC driver that supports basic connections would be sufficient for most use cases if it is (generally) ANSI compliant.

I think this would be valuable.

Increase RDBMS data sources would be extremely useful to consider Dremio in more use cases. In particular I would need Sybase IQ as a data source.

1 Like

This is not something you can do at this time.

Hi,

it’s a pretty old thread, but I try it anyway…

I have almost only use cases with proprietary on-premise databases like SQL Anywhere 16 or even less known dbms, but they all provide ODBC/JDBC drivers. Tools like Qlik can directly connect to them.

At the moment I can work around that by extracting the data via Python Scripts(pyodbc) and store them as parquet files and then load to dremio. But I think this is quite hacky solution. For production, I would need to write additional software to manage/control the extracts etc… . Another point with the parquet workaround would be, that the data is not encrypted at rest, so IT guys etc. could open it as they like. As far as I have seen there is no support for any encrypted files in dremio? Would be also solveable with tools like cryptopmator…but would be much nicer to have it in one tool. :slight_smile:

I know the oldschool/on-premise use cases are not super fancy, but are a hard requirement of 96% of my customers. I personally would wish that these tools use apis and not this ancient crap…but that’s how it is…

Please correct me if I overlooked something or if there is an easier solution for the odbc conn things. :slight_smile:

KR,

Peter

If your dbms have some JDBC driver, you can look at ARP. For ODBC, still no luck for now.

We need JDBC driver for SAP IQ. At present I am using the SAP ASE connector that is available here to connect to SAP IQ which is like “so close yet so far”. I learnt it the hard way that advanced queries where SQL functions are used will not work and dremio will throw errors in such scenarios. This is just not good enough for production usecases. Please consider SAP IQ for developing a connector.