#write #transcode #unicode #charset

encoding_rs_transcode

Transcode text within writers using encoding_rs

4 releases

0.8.3 Apr 17, 2023
0.8.2 Apr 6, 2023
0.8.1 Apr 5, 2023
0.8.0 Apr 5, 2023

#1557 in Text processing

MIT license

10KB
130 lines

encode_rs_transcode

Crates.io docs.rs dependency status Crates.io Rust

This library allows you to easily transcode text within writers.

The transcoding is performed by encoding_rs, this library just provides a simple builder to ease the use with external writers.

Use cases

  • Writing files in a particular format (e.g. writing a CSV file in WINDOWS_1252, using the csv crate)

Example

extern crate csv;
use std::fs::File;
use encoding_rs_transcode::{encoding_rs::WINDOWS_1252, TranscoderBuilder};

fn main() {
    // Create a file writer
    let file = File::create("test.csv").unwrap();

    // Create a transcoder that'll transcode the input to WINDOWS_1252
    let transcoder_writer = TranscoderBuilder::new()
    //  .from_encoding(UTF_8) // implied by new()
        .to_encoding(WINDOWS_1252)
        .build_writer(file);

    // Create a CSV writer
    let mut csv_writer = csv::Writer::from_writer(transcoder_writer);
    // Write to the CSV file
    csv_writer.write_record(["foo", "bar"]).unwrap();
    csv_writer.write_record(["aceio", "àcéîö"]).unwrap();

    // The CSV file will now be encoded in WINDOWS_1252, without the CSV crate ever
    // aknowledging the final encoding.
    // This can be applied to any writer implementing the `Write` trait.
}

Dependencies

~3.5MB
~119K SLoC