mktool

This is a collection of utilities that provide alternate implementations for parts of the pkgsrc mk infrastructure.

Many targets under pkgsrc/mk are implemented using a combination of shell and awk, and can suffer from a lack of performance, especially when input sizes grow.

For example, with the profligation of Go modules used in newer Go software, www/grafana now has over 5,000 distfiles. This exposes various issues in the current pkgsrc scripts that are difficult to work around. This tool implements replacements with the following performance improvements when running in www/grafana on a 32-core SmartOS host:

As pkgsrc strives to be as portable as possible, at no point will any of the commands implemented by mktool become mandatory. This tool simply exists for those who are able to run Rust software to dramatically improve pkgsrc performance.

Installation

Install using cargo:

$ cargo install mktool

and add the following to mk.conf:

TOOLS_PLATFORM.mktool=  ${HOME}/.cargo/bin/mktool

You will also need to apply changes to pkgsrc. The changes are in the dev/mktool branch, and you can get them all as a single patch file here.

Commands

These are the commands currently implemented:

All of the replacements are activated upon setting TOOLS_PLATFORM.mktool. In addition, packages no longer have build dependencies on pkgtools/digest and pkgtools/mktools (unless specifically requested).

Minimum Support Rust Version

Currently 1.74.0.

The edition is set to 2021, so in theory I'd like to have 1.56.0 as the MSRV, but newer releases are currently required due to clap and tokio dependency requirements.