3 releases (stable)

new 1.0.1 Jan 9, 2025
1.0.0 Jan 8, 2025
0.1.0 Jan 8, 2025

#162 in Database implementations

Download history 123/week @ 2025-01-02

129 downloads per month
Used in tern

MIT/Apache

55KB
1K SLoC

tern

A database migration library and CLI supporting embedded migrations written in SQL or Rust.

It aims to support static SQL migration sets, but expands to work with migration queries written in Rust that are either statically determined or that need to be dynamically built at the time of being applied. It also aims to do this while being agnostic to the particular choice of crate for database interaction.

Executors

The abstract Executor is the type responsible for actually connecting to a database and issuing queries. Right now, this project supports all of the sqlx pool types via the generic Pool, so that includes PostgreSQL, MySQL, and SQLite. These can be enabled via feature flag.

Adding more executors is welcomed! That can be in PR form or as a feature request. Adding an executor seems like it should not be hard.

Usage

Embedded migrations are prepared, built, and ran off a directory living in a Rust project's source. These stages are handled by three separate traits, but implementing any of them is generally not necessary. tern exposes derive macros that supply everything needed:

  • MigrationSource: Given the required source macro attribute, which is a path to the directory containing the migrations, it prepares the migration set that is required of the given operation requested.
  • MigrationContext: Generates what is needed of the context to be an acceptable type used in the Runner. It has the field attribute executor_via that can decorate a field of the struct that has some Executor, or connection type. The context can build migration queries and run them.

Put together, that looks like this.

use tern::executor::SqlxPgExecutor;
use tern::{MigrationSource, MigrationContext, Runner};

/// `$CARGO_MANIFEST_DIR/src/migrations` is a collection of migration files.
/// The optional `table` attribute permits a custom location for a migration
/// history table.
#[derive(MigrationSource, MigrationContext)]
#[tern(source = "src/migrations", table = "example")]
struct Example {
   // `Example` itself needs to be an executor without the annotation.
   #[tern(executor_via)]
    executor: SqlxPgExecutor,
}

let executor = SqlxPgExecutor::new("postgres://user@localhost").await.unwrap();
let context = Example { executor };
let mut runner = Runner::new(context);
let report: tern::Report = runner.apply_all().await.unwrap();
println!("{report:#?}");

For a more in-depth example, see the examples.

Rust migrations

Migrations can be expressed in Rust, and these can take advantage of the arbitrary migration context to flexibly build the query at runtime. To do this, the context needs to know how to build the query, and what migration to build it for. This is achieved using some convention, a hand-written trait implementation, and another macro:

use tern::error::TernResult;
use tern::migration::{Query, QueryBuilder};
use tern::Migration;

/// This is the convention: it needs to be called this for the macro
/// implementation.  This macro has an attribute `no_transaction` that
/// instructs the context associated to it by `QueryBuilder` below to run
/// the query outside of a transaction.
#[derive(Migration)]
pub struct TernMigration;

impl QueryBuilder for TernMigration {
    /// The context from above.
    type Ctx = Example;

    async fn build(&self, ctx: &mut Self::Ctx) -> TernResult<Query> {
        // Really anything can happen here.  It just depends on what
        // `Self::Ctx` can do.
        let sql = "SELECT 1;";
        let query = Query::new(sql);
        Ok(query)
    }
}

CLI

With the feature flag "cli" enabled, this exposes a CLI that can be imported into your own migration project:

> $ my-migration-project --help
Usage: my-migration-project <COMMAND>

Commands:
  migrate  Operations on the set of migration files
  history  Operations on the table storing the history of these migrations
  help     Print this message or the help of the given subcommand(s)

Options:
  -h, --help  Print help
> $ my-migration-project migrate --help
Usage: my-migration-project migrate <COMMAND>

Commands:
  apply-all     Run any available unapplied migrations
  list-applied  List previously applied migrations
  new           Create a new migration with an auto-selected version and the given description
  help          Print this message or the help of the given subcommand(s)

Options:
  -h, --help  Print help

Minimum supported Rust version

tern's MSRV is 1.81.0.

Licence

This project is licensed under either of:


lib.rs:

The CLI for the tern migration library.

This exports the [App] type and ContextOptions, which help turn a project using tern into a CLI.

The App is the CLI. ContextOptions exists to connect a generic context to the CLI since it is the CLI that supplies the database URL, surely required of the context, but not anything else the context might need to initialize.

Dependencies

~6–14MB
~166K SLoC