#rayon #iterator

rayon_iter_concurrent_limit

Limit the concurrency of an individual rayon parallel iterator method with a convenient macro

6 releases

0.2.0 Feb 29, 2024
0.1.0 Feb 19, 2024
0.1.0-alpha4 Feb 18, 2024
0.1.0-alpha3 Feb 4, 2024

#290 in Concurrency

Download history 28/week @ 2024-02-08 309/week @ 2024-02-15 136/week @ 2024-02-22 348/week @ 2024-02-29 88/week @ 2024-03-07 63/week @ 2024-03-14 43/week @ 2024-03-21 32/week @ 2024-03-28 8/week @ 2024-04-04 7/week @ 2024-04-11 49/week @ 2024-04-18 32/week @ 2024-04-25 81/week @ 2024-05-02

169 downloads per month
Used in 3 crates (2 directly)

MIT/Apache

21KB
87 lines

rayon_iter_concurrent_limit

Latest Version Documentation msrv build

Limit the concurrency of an individual rayon parallel iterator method with a convenient macro.

The documentation outlines the motivation, implementation, and limitations of this crate.

Example

use rayon::iter::{IntoParallelIterator, ParallelIterator};
use rayon_iter_concurrent_limit::iter_concurrent_limit;

const N: usize = 1000;
let output = iter_concurrent_limit!(2, (0..100), map, |i: usize| -> usize {
    let alloc = vec![i; N];              // max of 2 concurrent allocations
    alloc.into_par_iter().sum::<usize>() // runs on all threads
})
.map(|alloc_sum| -> usize {
    alloc_sum / N                        // max of 2 concurrent executions
})
.collect::<Vec<usize>>();
assert_eq!(output, (0..100).into_iter().collect::<Vec<usize>>());

Licence

rayon_iter_concurrent_limit is licensed under either of

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

Dependencies

~1.5MB
~25K SLoC