106 releases
new 0.15.6 | Dec 13, 2024 |
---|---|
0.15.0 | Nov 14, 2024 |
0.12.26 | Jun 25, 2024 |
0.12.22 | Mar 20, 2024 |
0.0.1-alpha.4 | Mar 23, 2023 |
#91 in Database interfaces
1,522 downloads per month
670KB
3.5K
SLoC
Trunk CLI
The Trunk CLI allows for building, publishing and installing Postgres extensions of all kinds. It abstracts away complexities of extension development and management with the following commands:
trunk build
- Compiles extensions into publishable and installable artifacts.trunk publish
- Publishes extensions to the Trunk registry, making them available to the Postgres community for discovery and installation.trunk install
- Downloads Postgres extensions from the Trunk registry and installs in whichever environment trunk is run.
Installation
The Trunk CLI is hosted at crates.io and can be installed with cargo
.
curl https://sh.rustup.rs -sSf | sh
cargo install pg-trunk
- To check you're version of Trunk, invoke
trunk --version
. - To upgrade to the latest version of Trunk, run
cargo install pg-trunk
.
trunk build
The build
command allows for compiling and packaging Postgres extensions from source. Packaged extensions are written to
.trunk/<extension-name>-<extension-version>.tar.gz
.
❯ trunk build --help
Usage: trunk build [OPTIONS]
Options:
-p, --path <PATH> [default: .]
-o, --output-path <OUTPUT_PATH> [default: ./.trunk]
--version <VERSION>
--name <NAME>
--platform <PLATFORM>
--dockerfile <DOCKERFILE_PATH>
--install-command <INSTALL_COMMAND>
-h, --help Print help
PGRX Based Extensions
Extensions can be built in many ways, and PGRX allows for us to do so with Rust. Trunk makes building and packaging PGRX based extensions easier than ever.
Example trunk build
with PGRX based extension
pgmq:
❯ trunk build
Building from path .
Detected that we are building a pgrx extension
Detected pgrx version range 0.7.4
Using pgrx version 0.7.4
Building pgrx extension at path .
.
.
.
Creating package at: ./.trunk/pgmq-0.5.0.tar.gz
Create Trunk bundle:
pgmq.so
extension/pgmq--0.5.0.sql
extension/pgmq.control
manifest.json
Packaged to ./.trunk/pgmq-0.5.0.tar.gz
C & SQL Based Extensions
Extensions can also be written in C & SQL. Let's take a look at how we can build C & SQL based extensions with Trunk.
Example trunk build
with C & SQL based extension pg_cron
❯ trunk build --name pg_cron --version 1.5.2
Building from path .
Detected a Makefile, guessing that we are building an extension with 'make', 'make install...'
Using install command make install
Building with name pg_cron
Building with version 1.5.2
.
.
.
Creating package at: ./.trunk/pg_cron-1.5.2.tar.gz
Create Trunk bundle:
bitcode/pg_cron/src/entry.bc
bitcode/pg_cron/src/job_metadata.bc
bitcode/pg_cron/src/misc.bc
bitcode/pg_cron/src/pg_cron.bc
bitcode/pg_cron/src/task_states.bc
bitcode/pg_cron.index.bc
pg_cron.so
extension/pg_cron--1.0--1.1.sql
extension/pg_cron--1.0.sql
extension/pg_cron--1.1--1.2.sql
extension/pg_cron--1.2--1.3.sql
extension/pg_cron--1.3--1.4.sql
extension/pg_cron--1.4--1.4-1.sql
extension/pg_cron--1.4-1--1.5.sql
extension/pg_cron.control
manifest.json
Packaged to ./.trunk/pg_cron-1.5.2.tar.gz
Some extensions are part of larger projects and include Makefiles with references to parent directories. Examples of such extensions include those found in postgres/contrib. Trunk can help us build and package these types of extensions as well.
Example trunk build
with C & SQL based extension pg_stat_statements
Create a custom Dockerfile named Dockerfile.pg_stat_statements
at the root of the postgres/contrib
repository:
ARG PG_VERSION=15
FROM quay.io/coredb/c-builder:pg${PG_VERSION}
USER root
# Postgres build dependencies. Additional system dependencies for the extension can be added here.
# https://wiki.postgresql.org/wiki/Compile_and_Install_from_source_code
RUN apt-get update && apt-get install -y build-essential libreadline-dev zlib1g-dev flex bison libxml2-dev libxslt-dev libssl-dev libxml2-utils xsltproc ccache
# Copy working directory into container
COPY --chown=postgres:postgres . .
# Necessary step for building extensions in postgres/contrib
RUN ./configure
# Run make in the pg_stat_statements directory
RUN cd contrib/pg_stat_statements && make
Run trunk build
with --dockerfile
and --install-command
flags:
❯ trunk build \
--name pg_stat_statements \
--version 1.10.0 \
--dockerfile Dockerfile.pg_stat_statements \
--install-command \
"cd contrib/pg_stat_statements \
&& make install \
&& set -x \
&& mv /usr/local/pgsql/share/extension/* /usr/share/postgresql/15/extension \
&& mv /usr/local/pgsql/lib/* /usr/lib/postgresql/15/lib"
Building from path .
Detected a Makefile, guessing that we are building an extension with 'make', 'make install...'
Using Dockerfile at Dockerfile.pg_stat_statements
Using install command /bin/sh -c cd contrib/pg_stat_statements && make install && set -x && mv /usr/local/pgsql/share/extension/* /usr/share/postgresql/15/extension && mv /usr/local/pgsql/lib/* /usr/lib/postgresql/15/lib
Building with name pg_stat_statements
Building with version 1.10.0
.
.
.
Creating package at: ./.trunk/pg_stat_statements-1.10.0.tar.gz
Create Trunk bundle:
pg_stat_statements.so
extension/pg_stat_statements--1.0--1.1.sql
extension/pg_stat_statements--1.1--1.2.sql
extension/pg_stat_statements--1.2--1.3.sql
extension/pg_stat_statements--1.3--1.4.sql
extension/pg_stat_statements--1.4--1.5.sql
extension/pg_stat_statements--1.4.sql
extension/pg_stat_statements--1.5--1.6.sql
extension/pg_stat_statements--1.6--1.7.sql
extension/pg_stat_statements--1.7--1.8.sql
extension/pg_stat_statements--1.8--1.9.sql
extension/pg_stat_statements--1.9--1.10.sql
extension/pg_stat_statements.control
manifest.json
Packaged to ./.trunk/pg_stat_statements-1.10.0.tar.gz
trunk publish
The publish
command allows you to publish your newly-minted Postgres extension to the Trunk registry.
❯ trunk publish --help
Usage: trunk publish [OPTIONS] --version <VERSION> <NAME>
Arguments:
<NAME>
Options:
-v, --version <VERSION>
-f, --file <FILE>
-d, --description <DESCRIPTION>
-D, --documentation <DOCUMENTATION>
-H, --homepage <HOMEPAGE>
-l, --license <LICENSE>
-r, --registry <REGISTRY> [default: https://registry.pgtrunk.io]
-R, --repository <REPOSITORY>
-h, --help Print help
-
Sign in at the Trunk registry and click
Profile
. -
Under
API Token
, clickCreate New Token
. -
export TRUNK_API_TOKEN=<your-new-token>
-
Run the following from the same directory your extension is in:
❯ trunk publish pgmq \
--version 0.5.0 \
--description "Message Queue for postgres" \
--documentation "https://tembo-io.github.io/coredb/extensions/pgmq" \
--repository "https://github.com/tembo-io/coredb" \
--license "Apache-2.0" \
--homepage "https://www.coredb.io"
trunk install
The install
command allows you to install Postgres extensions from the Trunk registry. Trunk will automatically install any
additional extension dependencies that exist in the registry.
❯ trunk install --help
Usage: trunk install [OPTIONS] <NAME>
Arguments:
<NAME>
Options:
-p, --pg-config <PG_CONFIG>
-f, --file <FILE>
-v, --version <VERSION> [default: latest]
-r, --registry <REGISTRY> [default: https://registry.pgtrunk.io]
-h, --help Print help
❯ trunk install pgmq
Using pg_config: /usr/bin/pg_config
Using pkglibdir: "/usr/lib/postgresql/15/lib"
Using sharedir: "/usr/share/postgresql/15"
Downloading from: https://cdb-plat-use1-prod-pgtrunkio.s3.amazonaws.com/extensions/pgmq/pgmq-0.5.0.tar.gz
Dependencies: ["pg_partman"]
Installing pgmq 0.5.0
[+] pgmq.so => /usr/lib/postgresql/15/lib
[+] extension/pgmq--0.5.0.sql => /usr/share/postgresql/15
[+] extension/pgmq.control => /usr/share/postgresql/15
Dependencies
~23–39MB
~635K SLoC