# Arrow flight protocol

**URL:** <https://community.dremio.com/t/arrow-flight-protocol/3855>\
**Category:** Uncategorized\
**Created:** [August 12, 2019, 1:55pm UTC](https://community.dremio.com/t/arrow-flight-protocol/3855 "2019-08-12T13:55:07Z")\
**Posts on this page:** 20\
**Page:** 3

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [March 17, 2020, 2:28pm UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/41 "2020-03-17T14:28:32Z")

</div>

hi @rymurr  
yes, figured its just a typo in README.md  
-Denable **d**

I see you published ver 4.1.8 in docker hub, any specific changes related to flight protocol in this version?

---

<div class="post-metadata">

**Author:** ![rymurr](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/rymurr/32/1739_2.png) [@rymurr](https://community.dremio.com/u/rymurr)\
**Post date:** [March 18, 2020, 7:32pm UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/42 "2020-03-18T19:32:36Z")

</div>

Hey @smora,

There is nothing in 4.1.8 that should affect flight. Please let us know if I am wrong!

Best,  
Ryan

---

<div class="post-metadata">

**Author:** ![VahagnBleyan](https://avatars.discourse-cdn.com/v4/letter/v/a87d85/32.png) [@VahagnBleyan](https://community.dremio.com/u/VahagnBleyan)\
**Post date:** [March 21, 2020, 4:57pm UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/43 "2020-03-21T16:57:34Z")

</div>

Hi @rymurr, when you planning to release dremio-oss image with arrow flight protocol ?

---

<div class="post-metadata">

**Author:** ![rymurr](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/rymurr/32/1739_2.png) [@rymurr](https://community.dremio.com/u/rymurr)\
**Post date:** [March 23, 2020, 1:44pm UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/44 "2020-03-23T13:44:49Z")

</div>

Hey @VahagnBleyan,

We are currently working to incorporate the plugin into the product. In the meantime check out [https://github.com/dremio-hub/dremio-flight-connector/blob/master/Dockerfile](https://github.com/dremio-hub/dremio-flight-connector/blob/master/Dockerfile) this is an example of how to easily add the flight connector to the `dremio-oss` image.

---

<div class="post-metadata">

**Author:** ![Rutuja](https://avatars.discourse-cdn.com/v4/letter/r/a183cd/32.png) [@Rutuja](https://community.dremio.com/u/Rutuja)\
**Post date:** [March 31, 2020, 5:34am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/45 "2020-03-31T05:34:31Z")

</div>

Hi @rymurr

I m facing a similar issue. I tried connecting to dremio using python , but getting an error as:

File “pyarrow/\_flight.pyx”, line 944, in pyarrow.\_flight.FlightClient.authenticate  
File “pyarrow/\_flight.pyx”, line 68, in pyarrow.\_flight.check\_flight\_status  
pyarrow.\_flight.FlightUnavailableError: gRPC returned unavailable error, with message: failed to connect to all addresses

---

<div class="post-metadata">

**Author:** ![rymurr](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/rymurr/32/1739_2.png) [@rymurr](https://community.dremio.com/u/rymurr)\
**Post date:** [April 6, 2020, 8:35am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/46 "2020-04-06T08:35:11Z")

</div>

Hey @Rutuja,

It is hard to say from this only:

1. what version of Dremio are you using
2. what version of the flight connector are you using
3. can you verify in the server logs that the flight connector has started
4. can you telnet to port 47470 from localhost or from an external machine

Best,  
Ryan

---

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [May 25, 2020, 1:04pm UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/47 "2020-05-25T13:04:34Z")

</div>

Hi @rymurr  
looks like host binding fix is broken in latest ver of dremio(\>=4.1)

after specifying -Ddremio.flight.host=0.0.0.0, service is still attached to local ip

```
dremio@dremio-master-0:/opt/dremio$ ss -tuln
Netid State Recv-Q Send-Q Local Address:Port Peer Address:Port              
tcp LISTEN 0 128 ::ffff:10.42.4.109:47470 :::*                  
tcp LISTEN 0 128 :::45678 :::*                  
tcp LISTEN 0 50 :::9047 :::*                  
tcp LISTEN 0 1 ::ffff:127.0.0.1:42744 :::*                  
tcp LISTEN 0 128 :::31010 :::*                  
dremio@dremio-master-0:/opt/dremio$
```

---

<div class="post-metadata">

**Author:** ![rymurr](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/rymurr/32/1739_2.png) [@rymurr](https://community.dremio.com/u/rymurr)\
**Post date:** [May 26, 2020, 8:43am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/48 "2020-05-26T08:43:47Z")

</div>

hey @smora this flag was removed in the flight connector and flight should bind to all interfaces now, see [https://github.com/dremio-hub/dremio-flight-connector](https://github.com/dremio-hub/dremio-flight-connector) for the updated jvm params

---

<div class="post-metadata">

**Author:** ![smora](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@smora](https://community.dremio.com/u/smora)\
**Post date:** [May 27, 2020, 1:34pm UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/49 "2020-05-27T13:34:34Z")

</div>

hi @rymurr  
same result with all these options

> -Ddremio.flight.host=0.0.0.0  
> -Ddremio.flight.host=localhost  
> did not specify -Ddremio.flight.host

in all the cases service is binding to local ip address and remote clients not able to establish a connection  
could it be related to ssl changes? i see `InetAddress.getlocalHost().getHostName() is passed to sslHelper` by default

> :ffff:10.42.4.109:47470 instead of ::::47470

---

<div class="post-metadata">

**Author:** ![mtance](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/mtance/32/3115_2.png) [@mtance](https://community.dremio.com/u/mtance)\
**Post date:** [March 14, 2021, 8:02am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/50 "2021-03-14T08:02:44Z")

</div>

Hi,

we have latest version of Dremio on Docker, and we also cannot manage to access remote Arrow flight.

From host to container works:  
telnet 172.17.0.2 32010  
Trying 172.17.0.2…  
Connected to 172.17.0.2.

But remote, not. Iptables rules are forwarding, but there is no listening port 32010 on all interfaces.

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 15, 2021, 3:10am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/51 "2021-03-15T03:10:31Z")

</div>

@mtance Is the IP your coordinator host? When you say “cannot manage to access remote Arrow flight.”, do you see an error? Can you please share more info

---

<div class="post-metadata">

**Author:** ![mtance](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/mtance/32/3115_2.png) [@mtance](https://community.dremio.com/u/mtance)\
**Post date:** [March 15, 2021, 10:15am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/52 "2021-03-15T10:15:23Z")

</div>

This is info from settings:

 ![slika](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/a/aa4c2b7794467319547aec6e77b102545af96480.png)

So, If I want to connect to Arrow Flight (using telnet) on coordinator host via 172.17.0.2:32010 it is working, but if I want to connect on coordinator host via external WAN IP, it is not working. Iptables firewall rule in made, so there is issue with binding service port 32010 on Dremio I think.

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 17, 2021, 3:58am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/53 "2021-03-17T03:58:19Z")

</div>

@mtance

What is the exact error you are getting?

---

<div class="post-metadata">

**Author:** ![mtance](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/mtance/32/3115_2.png) [@mtance](https://community.dremio.com/u/mtance)\
**Post date:** [March 17, 2021, 5:12am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/54 "2021-03-17T05:12:44Z")

</div>

Hi,

when I tried to connect from host to container - locally I got telnet Connection successfull, when I try to connect outside - via internet i got Connection timed out (before I make firewall iptables rule I got Connection refused).

Thanks

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 17, 2021, 5:17am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/55 "2021-03-17T05:17:06Z")

</div>

@mtance

Have you checked with your network team on why connection timed out, can you ping “172.17.0.2” continuously?

---

<div class="post-metadata">

**Author:** ![mtance](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/mtance/32/3115_2.png) [@mtance](https://community.dremio.com/u/mtance)\
**Post date:** [March 17, 2021, 5:46am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/56 "2021-03-17T05:46:34Z")

</div>

Hi,

localy from host to Dremio container it is working properly.  
[root@srv~]# telnet 172.17.0.2 32010  
Trying 172.17.0.2…  
Connected to 172.17.0.2.

Iptables on Docker host  
Chain DOCKER (2 references)  
target prot opt source destination  
RETURN all – anywhere anywhere  
DNAT tcp – anywhere anywhere tcp dpt:32010 to:172.17.0.2:32010  
DNAT tcp – anywhere anywhere tcp dpt:eba to:172.17.0.2:45678  
DNAT tcp – anywhere anywhere tcp dpt:31010 to:172.17.0.2:31010  
DNAT tcp – anywhere anywhere tcp dpt:9047 to:172.17.0.2:9047

Dremio container bindings:  
dremio@4c83a382cb88:/opt/dremio$ ss -tuln  
Netid State Recv-Q Send-Q Local Address:Port Peer Address:Port  
tcp LISTEN 0 1 127.0.0.1:35711 0.0.0.0:\*  
tcp LISTEN 0 128 0.0.0.0:31010 0.0.0.0:\*  
tcp LISTEN 0 50 0.0.0.0:2181 0.0.0.0:\*  
tcp LISTEN 0 128 0.0.0.0:32010 0.0.0.0:\*  
tcp LISTEN 0 128 0.0.0.0:45678 0.0.0.0:\*  
tcp LISTEN 0 128 0.0.0.0:32817 0.0.0.0:\*  
tcp LISTEN 0 50 0.0.0.0:9047 0.0.0.0:\*

I think there should be issue with binding port on Docker Dremio image settings. Maybe there is no port 32010 defined?

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 17, 2021, 5:48am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/57 "2021-03-17T05:48:33Z")

</div>

@mtance

Any chance you can test this in a non-docker deployment like a GCE VM? just to narrow down that it is something to do with Docker?

---

<div class="post-metadata">

**Author:** ![mtance](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/mtance/32/3115_2.png) [@mtance](https://community.dremio.com/u/mtance)\
**Post date:** [March 17, 2021, 6:10am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/58 "2021-03-17T06:10:58Z")

</div>

Unfortunately not. We need to have in Docker.

---

<div class="post-metadata">

**Author:** ![mtance](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/mtance/32/3115_2.png) [@mtance](https://community.dremio.com/u/mtance)\
**Post date:** [March 20, 2021, 7:38am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/59 "2021-03-20T07:38:00Z")

</div>

Hi, anyone has a solution? I thinks there is issue with docker image, that isn’t bind port 32010 by default.

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 22, 2021, 6:34am UTC](https://community.dremio.com/t/arrow-flight-protocol/3855/60 "2021-03-22T06:34:54Z")

</div>

@mtance

Let us try something, change the ODBC/JDBC port to 32010 and use 31010 for flight and see if flight works and ODBC breaks, just to narrow down the issue

In dremio.conf add  
services.coordinator.client-endpoint.port: 32010  
services.coordinator.flight.port: 31010

Restart cluster

[Previous page](https://community.dremio.com/t/arrow-flight-protocol/3855.md?page=2)
