#memoization #cache #proc-macro

memoize

Attribute macro for auto-memoizing functions with somewhat-simple signatures

14 releases

0.3.1 Aug 9, 2022
0.3.0 Apr 2, 2022
0.2.1 Jan 1, 2022
0.2.0 Dec 24, 2021
0.1.4 Oct 16, 2020

#50 in Rust patterns

Download history 5609/week @ 2022-06-04 2642/week @ 2022-06-11 5641/week @ 2022-06-18 2251/week @ 2022-06-25 5757/week @ 2022-07-02 6004/week @ 2022-07-09 5190/week @ 2022-07-16 3951/week @ 2022-07-23 3150/week @ 2022-07-30 3240/week @ 2022-08-06 3009/week @ 2022-08-13 4381/week @ 2022-08-20 6397/week @ 2022-08-27 6735/week @ 2022-09-03 4099/week @ 2022-09-10 1377/week @ 2022-09-17

19,888 downloads per month
Used in rusht

MIT license

7KB

memoize

Docs.rs Crates.rs CI

A #[memoize] attribute for somewhat simple Rust functions: That is, functions with one or more Clone-able arguments, and a Clone-able return type. That's it.

NEWS: The crate has been updated so that you don't need to separately import lru, lazy_static, and other dependencies. Now everything should work automatically. Remember to enable the full feature to use LRU caching and other additional features.

Read the documentation (cargo doc --open) for the sparse details, or take a look at the examples/, if you want to know more:

// From examples/test2.rs

use memoize::memoize;

#[memoize]
fn hello(arg: String, arg2: usize) -> bool {
  arg.len()%2 == arg2
}

fn main() {
  // `hello` is only called once here.
  assert!(! hello("World".to_string(), 0));
  assert!(! hello("World".to_string(), 0));
  // Sometimes one might need the original function.
  assert!(! memoized_original_hello("World".to_string(), 0));
}

This is expanded into (with a few simplifications):

std::thread_local! {
  static MEMOIZED_MAPPING_HELLO : RefCell<HashMap<(String, usize), bool>> = RefCell::new(HashMap::new());
}

pub fn memoized_original_hello(arg: String, arg2: usize) -> bool {
  arg.len() % 2 == arg2
}

#[allow(unused_variables)]
fn hello(arg: String, arg2: usize) -> bool {
  let r = MEMOIZED_MAPPING_HELLO.with(|hm| {
    let mut hm = hm.borrow_mut();
    hm.get(&(arg.clone(), arg2.clone())).cloned()
  });
  if let Some(r) = r {
    return r;
  }

  let r = memoized_original_hello(arg.clone(), arg2.clone());

  MEMOIZED_MAPPING_HELLO.with(|hm| {
    let mut hm = hm.borrow_mut();
    hm.insert((arg, arg2), r.clone());
  });

  r
}

Further Functionality

As can be seen in the above example, each thread has its own cache by default. If you would prefer that every thread share the same cache, you can specify the SharedCache option like below to wrap the cache in a std::sync::Mutex. For example:

#[memoize(SharedCache)]
fn hello(key: String) -> ComplexStruct {
  // ...
}

You can choose to use an LRU cache. In fact, if you know that a memoized function has an unbounded number of different inputs, you should do this! In that case, use the attribute like this:

// From examples/test1.rs
// Compile with --features=full
use memoize::memoize;

#[derive(Debug, Clone)]
struct ComplexStruct {
  // ...
}

#[memoize(Capacity: 123)]
fn hello(key: String) -> ComplexStruct {
  // ...
}

Adding more caches and configuration options is relatively simple, and a matter of parsing attribute parameters. Currently, compiling will fail if you use a parameter such as Capacity without the feature full being enabled.

Another parameter is TimeToLive, specifying how long a cached value is allowed to live:

#[memoize(Capacity: 123, TimeToLive: Duration::from_secs(2))]

chrono::Duration is also possible, but would have to first be converted to std::time::Duration

#[memoize(TimeToLive: chrono::Duration::hours(3).to_std().unwrap())]

The cached value will never be older than duration provided and instead recalculated on the next request.

Contributions

...are always welcome! This being my first procedural-macros crate, I am grateful for improvements of functionality and style. Please send a pull request, and don't be discouraged if it takes a while for me to review it; I'm sometimes a bit slow to catch up here :) -- Lewin

Dependencies

~230–770KB
~17K SLoC