3 releases

0.1.2 Aug 14, 2024
0.1.1 Aug 14, 2024
0.1.0 Aug 14, 2024

#845 in Encoding

Custom license

63KB
1K SLoC

VSF (Versatile Storage Format)

VSF is an open-standard for data storage and representation. Designed for efficiency, security, and adaptability, VSF tries to provide a complete and unified solution for storing and managing any type of data, from simple values to complex structures like images or 3D objects.

Key Features

  • Optimized for efficiency and compact size
  • Built-in security and validity
  • Transparent data exchange
  • Unified metadata framework
  • Spectral accuracy in colour and data representation
  • Proof of authenticity and chain of trust
  • Future-proof-ish? design for technological advances

Supported Data Types

VSF supports a wide range of basic constructor data types, including unsigned and signed integers, floating-point numbers, complex numbers, boolean values, Unicode text, and arrays. It also includes VSF-specific types for metadata like labels, offsets, and versions.

Usage

Here's an example of creating a boilerplate VSF structure:

use vsf::{VsfType, parse, EncodeNumber};

fn create_minimal_vsf() -> Result<Vec<u8>, std::io::Error> {
    let mut vsf = vec!["RÃ…".as_bytes().to_owned()];

    // Header
    let mut header_index = 0;
    vsf[header_index].append(&mut b"<".to_vec());
    let header_length_index = vsf.len();
    let mut header_length = 42; // Placeholder
    vsf.push(VsfType::b(header_length).flatten()?);
    header_index = vsf.len();
    vsf.push(VsfType::z(1).flatten()?); // Version
    vsf[header_index].append(&mut VsfType::y(1).flatten()?); // Backward version
    vsf[header_index].append(&mut VsfType::c(1).flatten()?); // Label definition count
    vsf[header_index].append(&mut b"(".to_vec());
    vsf[header_index].append(&mut VsfType::d("example data".to_string()).flatten()?);
    let label_offset_index = vsf.len();
    let mut label_offset = 42; // Placeholder
    vsf.push(VsfType::o(label_offset).flatten()?);
    let label_size_index = vsf.len();
    let mut label_size = 42; // Placeholder
    vsf.push(VsfType::b(label_size).flatten()?);
    header_index = vsf.len();
    vsf.push(VsfType::c(2).flatten()?); // Number of elements in example data
    vsf[header_index].append(&mut b")".to_vec());
    vsf[header_index].append(&mut b">".to_vec());
    let header_end_index = vsf.len();

    // Label set
    header_index = vsf.len();
    vsf.push(b"[".to_vec());
    vsf[header_index].append(&mut b"(".to_vec());
    vsf[header_index].append(&mut VsfType::d("example value one".to_string()).flatten()?);
    vsf[header_index].append(&mut b":".to_vec());
    vsf[header_index].append(&mut VsfType::f5(3.14159).flatten()?);
    vsf[header_index].append(&mut b")".to_vec());

    vsf[header_index].append(&mut b"(".to_vec());
    vsf[header_index].append(&mut VsfType::d("example value two".to_string()).flatten()?);
    vsf[header_index].append(&mut b":".to_vec());
    vsf[header_index].append(&mut VsfType::s7(i128::MAX).flatten()?);
    vsf[header_index].append(&mut b")".to_vec());

    vsf[header_index].append(&mut b"]".to_vec());

    let mut prev_header_length = 0;
    let mut prev_label_offset = 0;
    let mut prev_label_size = 0;

    while header_length != prev_header_length
        || label_offset != prev_label_offset
        || label_size != prev_label_size
    {
        prev_header_length = header_length;
        prev_label_offset = label_offset;
        prev_label_size = label_size;

        header_length = 0;
        for i in 0..header_end_index {
            header_length += vsf[i].len();
        }
        vsf[header_length_index] = VsfType::b(header_length * 8).flatten()?;

        label_offset = header_length;
        vsf[label_offset_index] = VsfType::o(label_offset * 8).flatten()?;

        label_size = 0;
        for i in header_end_index..vsf.len() {
            label_size += vsf[i].len();
        }
        vsf[label_size_index] = VsfType::b(label_size * 8).flatten()?;
    }

    let vsf_vector: Vec<u8> = vsf.into_iter().flatten().collect();
    Ok(vsf_vector)
}

Future Capabilities

We're actively developing VSF to handle more complex data structures! In future releases, you'll be able to:

  • Save and load images with all the spectral goodness
  • Handle delicious data types and structures
  • Implement more better constructors and destructors

Stay tuned for updates!

License

VSF is released under a custom open-source license. You're free to use, modify, and distribute VSF for ANY purpose, including commercial use. However, selling VSF itself or directly derived formats is not permitted. For full terms, see the LICENSE file in the repository.

Contributing

We welcome contributions! Please contact nick@verichrome.cc if you'd like to contribute to this project.

For more information about VSF or the TOKEN system, visit https://sunsarrow.com/vsf.

Dependencies

~1MB
~28K SLoC