#csaf #walker #sbom #data #policy #provider #openpgp

walker-common

A common functionality for SBOM and CSAF walker

23 releases

new 0.6.0 Apr 26, 2024
0.6.0-rc.4 Apr 23, 2024
0.6.0-alpha.8 Feb 23, 2024
0.6.0-alpha.7 Jan 30, 2024
0.4.5 Sep 22, 2023

#341 in Data structures

Download history 25/week @ 2024-01-05 205/week @ 2024-01-12 143/week @ 2024-01-19 99/week @ 2024-01-26 99/week @ 2024-02-02 140/week @ 2024-02-09 52/week @ 2024-02-16 217/week @ 2024-02-23 278/week @ 2024-03-01 166/week @ 2024-03-08 107/week @ 2024-03-15 19/week @ 2024-03-22 104/week @ 2024-03-29 68/week @ 2024-04-05 175/week @ 2024-04-12 612/week @ 2024-04-19

960 downloads per month
Used in 5 crates

Apache-2.0 and maybe LGPL-2.0-or-later

71KB
1.5K SLoC

CSAF Walker

crates.io docs.rs GitHub release (latest SemVer) CI

"Walk" CSAF data from a remote server, allowing one to work with the data.

In addition, this repository also has a tool for working with SBOM data. Most of the options explained are valid for both SBOM and CSAF.

From the command line

There's a command line tool, which can be used right away.

Installation

cargo install csaf-cli
cargo install sbom-cli

You can also install this using cargo binstall:

cargo binstall csaf-cli
cargo binstall sbom-cli

Usage

You can download all documents by providing a domain of the CSAF trusted provider:

mkdir out
csaf sync -3 -v -d out/ redhat.com

It is also possible to only download files, skipping the validation step (which can be done later using an already downloaded copy):

mkdir out
csaf download -3 -v -d out/ redhat.com

[!NOTE] In cases where data is signed with a GPG v3 signature, you can use the -3 flag, which considers this still valid.

An alternative is to use the --policy-date argument, and provide a manual policy date. Also see: https://docs.sequoia-pgp.org/sequoia_openpgp/policy/struct.StandardPolicy.html.

Differential sync

By default, timestamps reported by the HTTP server will be applied to the downloaded files. When re-running, the changes.csv file will be used as a source to discover when a file was changed. If a file is already present and has a newer modification timestamp in the changes.csv file, then it will be downloaded again. Otherwise, it will be skipped.

Using the --since option, it is possible to provide a start timestamp, which will skip all changes reported before this timestamp, and force all changes after this timestamp (independent of the file local file timestamp) to be re-synced.

Using the --since-file option, it is possible to automate the "since" value, by initially loading the "since" value from a file, and storing it into a file at the end of a successful run. The timestamp stored will be the timestamp, when the application started processing.

If both --since and --since-file are provided, then the "since file" will be used first, and the "since" value will act as a fallback if the file is not present.

Sending data

Instead of storing, it is also possible to send data to a remote instance (using the Vexination or Bombastic API).

csaf send -3 redhat.com http://localhost:8083

Of course, it is also possible to use the filesystem as a source:

csaf send -3 file:out/ http://localhost:8083

As a library

Using the crate csaf-walker, this can also be used as a library:

use anyhow::Result;
use url::Url;
use csaf_walker::source::HttpSource;
use csaf_walker::walker::Walker;
use csaf_walker::retrieve::RetrievingVisitor;
use csaf_walker::validation::{ValidatedAdvisory, ValidationError, ValidationVisitor};
use walker_common::fetcher::Fetcher;

async fn walk() -> Result<()> {
    let fetcher = Fetcher::new(Default::default()).await?;
    let metadata = MetadataRetriever::new("redhat.com");
    let source = HttpSource::new(metadata, fetcher, Default::default());

    Walker::new(source.clone())
        .walk(RetrievingVisitor::new(
            source.clone(),
            ValidationVisitor::new(
                move |advisory: Result<ValidatedAdvisory, ValidationError>| async move {
                    log::info!("Found advisory: {advisory:?}");
                    Ok::<_, anyhow::Error>(())
                },
            )
        ))
        .await?;

    Ok(())
}

Dependencies

~23–41MB
~752K SLoC