8 releases

0.2.1 Nov 27, 2024
0.2.0 Oct 31, 2024
0.1.2 Oct 18, 2024
0.0.2 Oct 15, 2024
0.0.1 May 28, 2024

#446 in Network programming

Download history 8/week @ 2024-09-18 14/week @ 2024-09-25 85/week @ 2024-10-09 1893/week @ 2024-10-16 1177/week @ 2024-10-23 2197/week @ 2024-10-30 2259/week @ 2024-11-06 2106/week @ 2024-11-13 2053/week @ 2024-11-20 1008/week @ 2024-11-27 1051/week @ 2024-12-04 1622/week @ 2024-12-11 1573/week @ 2024-12-18 4/week @ 2024-12-25 442/week @ 2025-01-01

3,954 downloads per month

MPL-2.0 license

210KB
4K SLoC

:showtitle: :toc: left :icons: font

Qorb

Qorb is a work-in-progress Connection Pooling library, heavily inspired by the "Cueball" connection pooling library.

Overview

Qorb's main interface is the link:Pool object.

This pool relies on two interfaces that can be customized:

  • The link:Resolver interface identifies how to locate backend servers. link:DnsResolver provides a default implementation which queries DNS entries to access the set of backends.
  • The link:Connector interface identifies how to connect to a single backend. Within this method, the connect method is essential, but the is_valid and on_recycle methods can optionally be implemented to perform (respectively) health checks and perform cleanup actions before used connections are returned to the pool.

Examples

To get up and running with a client, server, and DNS system, link:examples/README.adoc[refer to the README in the examples directory].

In particular, the link:examples/tcp_echo_workload/main.rs[TCP echo workload] example demonstrates how to create a connection pool with a custom TCP connection.

This provides a setup for generating a workload to an arbitrary number of backends, and then walks through the tools to inspect the connection pool.

Terminology

  • Service: A named entity which refers to a program that is running with one or more instantiations as distinct backends.
  • Backend: An specific instance of a program running a service. Each backend should provide the same interface, such that a client can access any one of the backends implementing a service interchangeably.
  • Resolver: A client-side entity responsible for translating service name into backend location. A common example of a resolver is "DNS".
  • Slot: An allocated commitment to create a connection to a particular backend. A slot may be "connected" if the connection has been established, or "connecting" if the backend hasn't yet been reached.
  • Slot Set: A group of slots all attempting to access a particular backend. The number of slots which are allocated for each backend is controlled by qorb, but may be adjusted via user-configurable policy.
  • Pool: The a group of connections to one or more backends, from which a client of qorb can "claim" a connection. The pool manages resolvers, finds backends, creates slots for backends, and vends out connected slots to clients.

TODO List

Things I'd like to do before getting more eyes on this:

  • Add dtrace probes
  • Add a baseline test suite

Dependencies

~10–41MB
~634K SLoC