#arrow #udf #flight

arrow-udf-flight

Client for remote Arrow UDFs

1 unstable release

0.1.0 May 7, 2024

#7 in #udf

Download history 123/week @ 2024-05-02 1478/week @ 2024-05-09 1798/week @ 2024-05-16 906/week @ 2024-05-23

4,305 downloads per month

Apache-2.0

125KB
2.5K SLoC

Java 1.5K SLoC // 0.2% comments Python 790 SLoC // 0.2% comments Rust 159 SLoC // 0.2% comments

Remote UDF based on Arrow Flight

Crate Docs

Run user-defined functions in a separate process and call them via Arrow Flight RPC.

Server

Currently the following languages are supported:

Please click the link to see the specific usage.

Client

Add the following lines to your Cargo.toml:

[dependencies]
arrow-udf-flight = "0.1"
use arrow_udf_flight::Client;

// Connect to the UDF server
let client = Client::new("localhost:8815").await.unwrap();

// Call functions
let input: RecordBatch = ...;
let output: RecordBatch = client.call("gcd", &input).await.unwrap();

Communication Protocol

The communication protocol between client and server is based on Arrow Flight RPC.

Details to be added.

Dependencies

~17–28MB
~417K SLoC