#charset #unicode #text-encoding #encoding

textcode

Text encoding/decoding library. Supports: UTF-8, ISO6937, ISO8859, GB2312

6 releases

0.2.2 May 2, 2022
0.2.1 Nov 3, 2020
0.1.2 Apr 24, 2020
0.1.1 Dec 23, 2019
0.1.0 Nov 18, 2019

#383 in Text processing

Download history 254/week @ 2024-07-29 313/week @ 2024-08-05 430/week @ 2024-08-12 423/week @ 2024-08-19 370/week @ 2024-08-26 292/week @ 2024-09-02 426/week @ 2024-09-09 207/week @ 2024-09-16 284/week @ 2024-09-23 300/week @ 2024-09-30 254/week @ 2024-10-07 244/week @ 2024-10-14 157/week @ 2024-10-21 214/week @ 2024-10-28 305/week @ 2024-11-04 195/week @ 2024-11-11

879 downloads per month
Used in 7 crates (4 directly)

MIT license

445KB
7.5K SLoC

textcode

docs

Intro

textcode is a library for text encoding/decoding. Supports next charsets:

  • UTF-8
  • iso-6937 - Latin superset of ISO/IEC 6937 with Euro and letters with diacritics
  • iso-8859-1 - Western European
  • iso-8859-2 - Central European
  • iso-8859-3 - South European
  • iso-8859-4 - North European
  • iso-8859-5 - Cyrillic
  • iso-8859-6 - Arabic
  • iso-8859-7 - Greek
  • iso-8859-8 - Hebrew
  • iso-8859-9 - Turkish
  • iso-8859-10 - Nordic
  • iso-8859-11 - Thai
  • iso-8859-13 - Baltic Rim
  • iso-8859-14 - Celtic
  • iso-8859-15 - Western European
  • iso-8859-16 - South-Eastern European
  • gb2312 - Simplified Chinese

Example:

use textcode::iso8859_5;

const UTF8: &str = "Привет!";
const ISO8859_5: &[u8] = &[0xbf, 0xe0, 0xd8, 0xd2, 0xd5, 0xe2, 0x21];

let mut dst: Vec<u8> = Vec::new();
iso8859_5::encode(UTF8, &mut dst);
assert_eq!(dst.as_slice(), ISO8859_5);

let mut dst = String::new();
iso8859_5::decode(ISO8859_5, &mut dst);
assert_eq!(UTF8, dst.as_str());

No runtime deps