Connecting Dremio with Python

pj185095 · August 22, 2024, 11:24am

Hello Everyone,

I am trying to connect to Dremio Cloud via python and have tried various approach but failing to connect to Dremio. Is there any documentation which can be followed?

Tried this: Python | Dremio Documentation
Getting failure:

Traceback (most recent call last):
  File "example.py", line 1, in <module>
    from dremio.arguments.parse import get_config
ImportError: cannot import name 'get_config' from 'dremio.arguments.parse'

Tried ODBC as well:
ODBC driver works on admin level privleges, but I dont have those elevated permission so cant really work on that. Any alternative would be appreciated

balaji.ramaswamy · August 26, 2024, 6:07am

@pj185095 Have you followed steps in below link?

github.com

dremio-hub/arrow-flight-client-examples/blob/main/python/README.md

# Python Arrow Flight Client Application Example

## Quickstart

1. Install [Python 3](https://www.python.org/downloads/)
1. Download and install the [dremio-flight-endpoint whl file](https://github.com/dremio-hub/arrow-flight-client-examples/releases)
    - `python -m pip install <PATH TO WHEEL>`
1. Create a local folder to store the client file and config file.
    1. Create a file named `example.py` in created folder. Copy the contents of `arrow-flight-client-examples/python/example.py` into `example.py`.
    1. Create a file named `config.yaml` in created folder. Copy the contents of `arrow-flight-client-examples/python/config_template.yaml` into `config.yaml`.
    1. Uncomment the options in `config.yaml` as needed, appending the argument after the key. ie. `username: my_username`. You can either delete the options that are not being used or leave them commented.
        - e.g. If you are connecting to a local instance of Dremio, your config file would look like:
        ```
        username: my_username
        password: my_password
        query: SELECT 1
        ```
1. Run the Python Arrow Flight Client by navigating to the created folder in the previous step and running the command `python3 example.py`.

## How to connect to Dremio Cloud

This file has been truncated. show original

Topic		Replies	Views
Outdated Python Arrow Flight Client Example	0	160	May 4, 2024
Connecting Python and Dremio (windows) Dremio University	13	3993	February 24, 2024
Does Dremio Cloud support Arrow Flight? Dremio Cloud	4	1383	March 24, 2022
Connect to Dremio Cloud using Arrow Flight, from Jupyter Notebook? Dremio Cloud	4	1673	July 19, 2022
Connecting to arrow flight with dremio_client in python	5	6598	January 22, 2023

Connecting Dremio with Python

Related Topics