#router #path #tree #match #url

matchit

A blazing fast URL router and path matcher

6 releases (3 breaking)

new 0.4.0 May 17, 2021
0.3.2 Mar 7, 2021
0.2.0 Dec 23, 2020
0.1.0 Dec 21, 2020

#151 in Network programming

Download history 6/week @ 2021-01-21 13/week @ 2021-01-28 4/week @ 2021-02-04 32/week @ 2021-02-11 8/week @ 2021-02-18 18/week @ 2021-02-25 62/week @ 2021-03-04 6/week @ 2021-03-11 3/week @ 2021-03-18 55/week @ 2021-03-25 13/week @ 2021-04-01 14/week @ 2021-04-08 24/week @ 2021-04-15 3/week @ 2021-04-22 14/week @ 2021-04-29 15/week @ 2021-05-06

87 downloads per month
Used in httprouter

MIT license

73KB
1.5K SLoC

MatchIt

Documentation Version License Actions

A blazing fast URL router and path matcher.

use matchit::Node;

fn main() -> Result<(), Box<dyn std::error::Error>> {
    let mut matcher = Node::new();
    matcher.insert("/home", "Welcome!")?;
    matcher.insert("/users/:id", "A User")?;

    let matched = matcher.at("/users/1")?;
    assert_eq!(matched.params.get("id"), Some("1"));
    assert_eq!(*matched.value, "A User");

    Ok(())
}

matchit relies on a tree structure which makes heavy use of common prefixes, effectively a radix tree. This makes lookups extremely fast. See below for technical details.

The tree is optimized for high performance and a small memory footprint. It scales well even with very long paths and a large number of routes. A compressing dynamic trie (radix tree) structure is used for efficient matching.

Parameters

As you can see, :id is a named parameter. The values are accessible via Params, which stores a list of keys and values. You can get the value of a parameter by name, params.get("id"), or by iterating through the list.

The registered path can contain two types of parameters:

Syntax    Type
:name     named parameter
*name     catch-all parameter

Named Parameters

Named parameters are dynamic path segments. They match anything until the next / or the path end:

Pattern: /user/:user

 /user/gordon              match
 /user/you                 match
 /user/gordon/profile      no match
 /user/                    no match

Note: Since the tree only supports explicit matches, you can not register static routes and parameters for the same path segment. For example you can not register the patterns /user/new and /user/:user at the same time. This is a limitation that will be addressed in the future.

Catch-All parameters

The second type are catch-all parameters and have the form *name. Like the name suggests, they match everything. Therefore they must always be at the end of the pattern:

Pattern: /src/*filepath

 /src/                     match
 /src/somefile.go          match
 /src/subdir/somefile.go   match

How does it work?

The matcher relies on a tree structure which makes heavy use of common prefixes, it is basically a compact prefix tree (or Radix tree). Nodes with a common prefix share a parent. Here is a short example what the routing tree for the GET request method could look like:

Priority   Path             Handle
9          \                *<1>
3          ├s               None
2          |├earch\         *<2>
1          |└upport\        *<3>
2          ├blog\           *<4>
1          |    └:post      None
1          |         └\     *<5>
2          ├about-us\       *<6>
1          |        └team\  *<7>
1          └contact\        *<8>

Every *<num> represents the memory address of a handler function (a pointer). If you follow a path trough the tree from the root to the leaf, you get the complete route path, e.g /blog/:post, where :post is just a placeholder (parameter) for an actual post name. Unlike hash-maps, a tree structure also allows us to use dynamic parts like the :post parameter, since we actually match against the routing patterns instead of just comparing hashes. This works very efficiently.

Because URL paths have a hierarchical structure and make use only of a limited set of characters (byte values), it is very likely that there are a lot of common prefixes. Storing the routes in this structure allows us to easily reduce the routing into a very small number of branches.

For even better scalability, the child nodes on each tree level are ordered by priority, where the priority is just the number of handles registered in child nodes. This means that nodes that are part of the most routing paths are always evaluated first, increasing the chance of reaching the correct route on our first try.

-----------------------------------

Benchmarks

As it turns out, this method of routing is extremely fast. In fact, matchit is one of the fastest, if not the fastest router out there. Here's a simple benchmark matching 4 paths against 130 registered routes. Matchit find the correct route in under 300 nanoseconds, blowing other regex based routers out of the water. You can view the benchmark code in the bench.rs file.

Compare Routers/matchit 
time:   [276.36 ns 276.70 ns 277.03 ns]

Compare Routers/actix   
time:   [36.218 us 36.241 us 36.265 us]

Compare Routers/regex   
time:   [24.111 us 24.221 us 24.345 us]

Compare Routers/route-recognizer
time:   [4.5428 us 4.5599 us 4.5801 us]

No runtime deps