#rayon #iterator

rayon_iter_concurrent_limit

Limit the concurrency of an individual rayon parallel iterator method with a convenient macro

6 releases

0.2.0 Feb 29, 2024
0.1.0 Feb 19, 2024
0.1.0-alpha4 Feb 18, 2024
0.1.0-alpha3 Feb 4, 2024

#819 in Concurrency

Download history 95/week @ 2024-07-20 106/week @ 2024-07-27 141/week @ 2024-08-03 107/week @ 2024-08-10 142/week @ 2024-08-17 271/week @ 2024-08-24 222/week @ 2024-08-31 85/week @ 2024-09-07 172/week @ 2024-09-14 332/week @ 2024-09-21 124/week @ 2024-09-28 99/week @ 2024-10-05 92/week @ 2024-10-12 131/week @ 2024-10-19 200/week @ 2024-10-26 194/week @ 2024-11-02

619 downloads per month
Used in 4 crates (2 directly)

MIT/Apache

21KB
87 lines

rayon_iter_concurrent_limit

Latest Version Documentation msrv build

Limit the concurrency of an individual rayon parallel iterator method with a convenient macro.

The documentation outlines the motivation, implementation, and limitations of this crate.

Example

use rayon::iter::{IntoParallelIterator, ParallelIterator};
use rayon_iter_concurrent_limit::iter_concurrent_limit;

const N: usize = 1000;
let output = iter_concurrent_limit!(2, (0..100), map, |i: usize| -> usize {
    let alloc = vec![i; N];              // max of 2 concurrent allocations
    alloc.into_par_iter().sum::<usize>() // runs on all threads
})
.map(|alloc_sum| -> usize {
    alloc_sum / N                        // max of 2 concurrent executions
})
.collect::<Vec<usize>>();
assert_eq!(output, (0..100).into_iter().collect::<Vec<usize>>());

Licence

rayon_iter_concurrent_limit is licensed under either of

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

Dependencies

~1.5MB
~25K SLoC