#nlp #language-detection #language-recognition

lingua-japanese-language-model

The Japanese language model for Lingua, an accurate natural language detection library

4 stable releases

new 1.2.0 Mar 20, 2025
1.1.0 Jun 13, 2023
1.0.1 Feb 16, 2022
1.0.0 Nov 20, 2020

#2112 in Text processing

Download history 1969/week @ 2024-12-04 1763/week @ 2024-12-11 1847/week @ 2024-12-18 1419/week @ 2024-12-25 790/week @ 2025-01-01 1321/week @ 2025-01-08 1552/week @ 2025-01-15 1471/week @ 2025-01-22 1095/week @ 2025-01-29 1531/week @ 2025-02-05 1722/week @ 2025-02-12 1767/week @ 2025-02-19 1761/week @ 2025-02-26 1695/week @ 2025-03-05 2193/week @ 2025-03-12 2430/week @ 2025-03-19

8,391 downloads per month
Used in 2 crates (via lingua)

Apache-2.0

57KB

Japanese language model for Lingua

This is the language model for the Japanese language which is used by Lingua, the most accurate natural language detection library in the Rust ecosystem.

Changelog

Version 1.2.0

  • The language model has been enhanced by including unique and most common ngrams to support an absolute confidence metric which is independent of other languages.

Version 1.1.0

  • The language model files are now compressed with the Brotli algorithm which reduces the file size by 15 %, on average.

Dependencies

~91KB