#path #utf-8 #unicode

no-std typed-path

Provides typed variants of Path and PathBuf for Unix and Windows

14 releases (7 breaking)

0.8.0 Feb 25, 2024
0.7.0 Nov 4, 2023
0.3.2 Mar 27, 2023
0.2.1 Dec 12, 2022
0.1.0 Aug 25, 2022

#36 in Filesystem

Download history 1131/week @ 2023-12-23 3148/week @ 2023-12-30 3901/week @ 2024-01-06 3829/week @ 2024-01-13 3860/week @ 2024-01-20 4325/week @ 2024-01-27 4209/week @ 2024-02-03 4513/week @ 2024-02-10 4346/week @ 2024-02-17 4337/week @ 2024-02-24 5707/week @ 2024-03-02 5141/week @ 2024-03-09 5066/week @ 2024-03-16 4373/week @ 2024-03-23 5185/week @ 2024-03-30 4349/week @ 2024-04-06

19,742 downloads per month
Used in 23 crates (10 directly)

MIT/Apache

650KB
10K SLoC

Typed Path

Crates.io Docs.rs CI RustC 1.58.1+

Provides typed variants of Path and PathBuf for Unix and Windows.

Install

[dependencies]
typed-path = "0.8"

As of version 0.7, this library also supports no_std environments that depend on alloc. To build in this manner, remove the default std feature:

[dependencies]
typed-path = { version = "...", default-features = false }

Why?

Some applications need to manipulate Windows or UNIX paths on different platforms, for a variety of reasons: constructing portable file formats, parsing files from other platforms, handling archive formats, working with certain network protocols, and so on.

-- Josh Triplett

Check out this issue of a discussion for this. The functionality actually exists within the standard library, but is not exposed!

This means that parsing a path like C:\path\to\file.txt will be parsed differently by std::path::Path depending on which platform you are on!

use std::path::Path;

fn main() {
    // On Windows, this prints out:
    //
    // * Prefix(PrefixComponent { raw: "C:", parsed: Disk(67) })
    // * RootDir
    // * Normal("path")
    // * Normal("to")
    // * Normal("file.txt")]
    //
    // But on Unix, this prints out:
    //
    // * Normal("C:\\path\\to\\file.txt")
    let path = Path::new(r"C:\path\to\file.txt");
    for component in path.components() {
        println!("* {:?}", component);
    }
}

Usage

Byte paths

The library provides a generic Path<T> and PathBuf<T> that use [u8] and Vec<u8> underneath instead of OsStr and OsString. An encoding generic type is provided to dictate how the underlying bytes are parsed in order to support consistent path functionality no matter what operating system you are compiling against!

use typed_path::WindowsPath;

fn main() {
    // On all platforms, this prints out:
    //
    // * Prefix(PrefixComponent { raw: "C:", parsed: Disk(67) })
    // * RootDir
    // * Normal("path")
    // * Normal("to")
    // * Normal("file.txt")]
    //
    let path = WindowsPath::new(r"C:\path\to\file.txt");
    for component in path.components() {
        println!("* {:?}", component);
    }
}

UTF8-enforced paths

Alongside the byte paths, this library also supports UTF8-enforced paths through Utf8Path<T> and Utf8PathBuf<T>, which internally use str and String. An encoding generic type is provided to dictate how the underlying characters are parsed in order to support consistent path functionality no matter what operating system you are compiling against!

use typed_path::Utf8WindowsPath;

fn main() {
    // On all platforms, this prints out:
    //
    // * Prefix(Utf8WindowsPrefixComponent { raw: "C:", parsed: Disk(67) })
    // * RootDir
    // * Normal("path")
    // * Normal("to")
    // * Normal("file.txt")]
    //
    let path = Utf8WindowsPath::new(r"C:\path\to\file.txt");
    for component in path.components() {
        println!("* {:?}", component);
    }
}

Checking paths

When working with user-defined paths, there is an additional layer of defense needed to prevent abuse to avoid path traversal attacks and other risks.

To that end, you can use PathBuf::push_checked and Path::join_checked (and equivalents) to ensure that the paths being created do not alter pre-existing paths in unexpected ways.

use typed_path::{CheckedPathError, Path, PathBuf, UnixEncoding};

fn main() {
    let path = Path::<UnixEncoding>::new("/etc");

    // A valid path can be joined onto the existing one
    assert_eq!(path.join_checked("passwd"), Ok(PathBuf::from("/etc/passwd")));

    // An invalid path will result in an error
    assert_eq!(
        path.join_checked("/sneaky/replacement"), 
        Err(CheckedPathError::UnexpectedRoot)
    );

    let mut path = PathBuf::<UnixEncoding>::from("/etc");

    // Pushing a relative path that contains parent directory references that cannot be
    // resolved within the path is considered an error as this is considered a path
    // traversal attack!
    assert_eq!(
        path.push_checked(".."), 
        Err(CheckedPathError::PathTraversalAttack)
    );
    assert_eq!(path, PathBuf::from("/etc"));

    // Pushing an absolute path will fail with an error
    assert_eq!(
        path.push_checked("/sneaky/replacement"), 
        Err(CheckedPathError::UnexpectedRoot)
    );
    assert_eq!(path, PathBuf::from("/etc"));

    // Pushing a relative path that is safe will succeed
    assert!(path.push_checked("abc/../def").is_ok());
    assert_eq!(path, PathBuf::from("/etc/abc/../def"));
}

Converting between encodings

There may be times in which you need to convert between encodings such as when you want to load a native path and convert it into another format. In that case, you can use the with_encoding method (or specific variants like with_unix_encoding and with_windows_encoding) to convert a Path or Utf8Path into their respective PathBuf and Utf8PathBuf with an explicit encoding:

use typed_path::{Utf8Path, Utf8UnixEncoding, Utf8WindowsEncoding};

fn main() {
    // Convert from Unix to Windows
    let unix_path = Utf8Path::<Utf8UnixEncoding>::new("/tmp/foo.txt");
    let windows_path = unix_path.with_encoding::<Utf8WindowsEncoding>();
    assert_eq!(windows_path, Utf8Path::<Utf8WindowsEncoding>::new(r"\tmp\foo.txt"));
   
    // Converting from Windows to Unix will drop any prefix
    let windows_path = Utf8Path::<Utf8WindowsEncoding>::new(r"C:\tmp\foo.txt");
    let unix_path = windows_path.with_encoding::<Utf8UnixEncoding>();
    assert_eq!(unix_path, Utf8Path::<Utf8UnixEncoding>::new(r"/tmp/foo.txt"));
   
    // Converting to itself should retain everything
    let path = Utf8Path::<Utf8WindowsEncoding>::new(r"C:\tmp\foo.txt");
    assert_eq!(
        path.with_encoding::<Utf8WindowsEncoding>(),
        Utf8Path::<Utf8WindowsEncoding>::new(r"C:\tmp\foo.txt"),
    );
}

Like with pushing and joining paths using checked variants, we can also ensure that paths created from changing encodings are still valid:

use typed_path::{CheckedPathError, Utf8Path, Utf8UnixEncoding, Utf8WindowsEncoding};

fn main() {
    // Convert from Unix to Windows
    let unix_path = Utf8Path::<Utf8UnixEncoding>::new("/tmp/foo.txt");
    let windows_path = unix_path.with_encoding_checked::<Utf8WindowsEncoding>().unwrap();
    assert_eq!(windows_path, Utf8Path::<Utf8WindowsEncoding>::new(r"\tmp\foo.txt"));
   
    // Convert from Unix to Windows will fail if there are characters that are valid in Unix but not in Windows
    let unix_path = Utf8Path::<Utf8UnixEncoding>::new("/tmp/|invalid|/foo.txt");
    assert_eq!(
        unix_path.with_encoding_checked::<Utf8WindowsEncoding>(),
        Err(CheckedPathError::InvalidFilename),
    );
}

Typed Paths

In the above examples, we were using paths where the encoding (Unix or Windows) was known at compile time. There may be situations where we need runtime support to decide and switch between encodings. For that, this crate provides the TypedPath and TypedPathBuf enumerations (and their Utf8TypedPath and Utf8TypedPathBuf variations):

use typed_path::Utf8TypedPath;

// Derive the path by determining if it is Unix or Windows
let path = Utf8TypedPath::derive(r"C:\path\to\file.txt");
assert!(path.is_windows());

// Change the encoding to Unix
let path = path.with_unix_encoding();
assert_eq!(path, "/path/to/file.txt");

Normalization

Alongside implementing the standard methods associated with Path and PathBuf from the standard library, this crate also implements several additional methods including the ability to normalize a path by resolving . and .. without the need to have the path exist.

use typed_path::Utf8UnixPath;

assert_eq!(
    Utf8UnixPath::new("foo/bar//baz/./asdf/quux/..").normalize(),
    Utf8UnixPath::new("foo/bar/baz/asdf"),
);

In addition, you can leverage absolutize to convert a path to an absolute form by prepending the current working directory if the path is relative and then normalizing it (requires std feature):

use typed_path::{utils, Utf8UnixPath};

// With an absolute path, it is just normalized
// NOTE: This requires `std` feature, otherwise `absolutize` is missing!
let path = Utf8UnixPath::new("/a/b/../c/./d");
assert_eq!(path.absolutize().unwrap(), Utf8UnixPath::new("/a/c/d"));

// With a relative path, it is first joined with the current working directory
// and then normalized
// NOTE: This requires `std` feature, otherwise `utf8_current_dir` and
//       `absolutize` are missing!
let cwd = utils::utf8_current_dir().unwrap().with_unix_encoding();
let path = cwd.join(Utf8UnixPath::new("a/b/../c/./d"));
assert_eq!(path.absolutize().unwrap(), cwd.join(Utf8UnixPath::new("a/c/d")));

Current directory

Helper functions are available in the utils module (requires std feature), and one of those provides an identical experience to std::env::current_dir:

// Retrieves the current directory as a NativePath:
//
// * For Unix family, this would be Path<UnixEncoding>
// * For Windows family, this would be Path<WindowsEncoding>
//
// NOTE: This requires `std` feature, otherwise `current_dir` is missing!
let _cwd = typed_path::utils::current_dir().unwrap();

// Retrieves the current directory as a Utf8NativePath:
//
// * For Unix family, this would be Utf8Path<Utf8UnixEncoding>
// * For Windows family, this would be Utf8Path<Utf8WindowsEncoding>
//
// NOTE: This requires `std` feature, otherwise `utf8_current_dir` is missing!
let _utf8_cwd = typed_path::utils::utf8_current_dir().unwrap();

License

This project is licensed under either of

Apache License, Version 2.0, (LICENSE-APACHE or apache-license) MIT license (LICENSE-MIT or mit-license) at your option.

No runtime deps

Features