#task #partitioning #hash #count #test-runner #hash-based #pick

task_partitioner

helper lib that allows partitioning named tasks by count or hash

2 releases

0.1.1 Nov 25, 2022
0.1.0 Nov 25, 2022

#971 in Testing

Download history 69/week @ 2025-10-08 222/week @ 2025-10-15 61/week @ 2025-10-22 45/week @ 2025-10-29 48/week @ 2025-11-05 81/week @ 2025-11-12 73/week @ 2025-11-19 72/week @ 2025-11-26 122/week @ 2025-12-03 61/week @ 2025-12-10 84/week @ 2025-12-17 71/week @ 2025-12-24 73/week @ 2025-12-31 92/week @ 2026-01-07 98/week @ 2026-01-14 117/week @ 2026-01-21

389 downloads per month
Used in laze

MIT/Apache

10KB
232 lines

Support for partitioning task runs across several machines.

At the moment this only supports simple hash-based and count-based sharding. In the future it could potentially be made smarter: e.g. using data to pick different sets of binaries and tests to run, with an aim to minimize total build and test times.


Introduction

This Rust library allows partitioning a list of tasks to multiple workers, by count or by hash. It was cut out from the awesome nextest.

License

task_partitioner is licensed under the terms of the Apache License (Version 2.0), or MIT.

Dependencies

~335–750KB
~17K SLoC