#nlp #information-retrieval #stemming #language #retrieval

rust-stemmers

A rust implementation of some popular snowball stemming algorithms

6 releases (stable)

Uses old Rust 2015

1.2.0 Nov 17, 2019
1.1.0 Jan 24, 2019
1.0.2 Dec 30, 2017
1.0.1 Aug 22, 2017
0.1.0 Feb 7, 2017

#96 in Algorithms

Download history 101942/week @ 2024-08-14 98650/week @ 2024-08-21 85625/week @ 2024-08-28 99588/week @ 2024-09-04 88763/week @ 2024-09-11 89564/week @ 2024-09-18 93375/week @ 2024-09-25 94341/week @ 2024-10-02 85662/week @ 2024-10-09 82784/week @ 2024-10-16 76950/week @ 2024-10-23 69980/week @ 2024-10-30 78082/week @ 2024-11-06 81880/week @ 2024-11-13 75750/week @ 2024-11-20 54359/week @ 2024-11-27

304,408 downloads per month
Used in 246 crates (30 directly)

MIT/BSD-3-Clause

2.5MB
19K SLoC

Rust Stemmers

This crate implements some stemmer algorithms found in the snowball project which are compiled to rust using the rust-backend of the snowball compiler.

Supported Algorithms

  • Arabic
  • Danish
  • Dutch
  • English
  • French
  • German
  • Greek
  • Hungarian
  • Italian
  • Norwegian
  • Portuguese
  • Romanian
  • Russian
  • Spanish
  • Swedish
  • Tamil
  • Turkish

Usage

extern crate rust_stemmers;
use rust_stemmers::{Algorithm, Stemmer};

// Create a stemmer for the english language
let en_stemmer = Stemmer::create(Algorithm::English);

// Stemm the word "fruitlessly"
// Please be aware that all algorithms expect their input to only contain lowercase characters.
assert_eq!(en_stemmer.stem("fruitlessly"), "fruitless");

Related Projects

  • The stemmer crate provides bindings to the C Snowball implementation.

lib.rs:

This library provides rust implementations for some stemmer algorithms written in the snowball language.

All algorithms expect the input to already be lowercased.

Usage

[dependencies]
rust-stemmers = "^1.0"
extern crate rust_stemmers;

use rust_stemmers::{Algorithm, Stemmer};

fn main() {
   let en_stemmer = Stemmer::create(Algorithm::English);
   assert_eq!(en_stemmer.stem("fruitlessly"), "fruitless");
}

Dependencies