#nlp #parser #language #rules #date-time #natural #pluggable

when

'When' parses natural language date/time and produces computer friendly output structures

2 releases

0.1.4 Aug 1, 2020
0.1.3 Jun 25, 2019

#2015 in Algorithms

MIT license

105KB
2.5K SLoC

when Build Status codecov

A natural language date/time parser with pluggable rules

Inspired by https://github.com/olebedev/when

Check out how it works interactively at https://risboo6909.org/when/ or at https://tarpaha.github.io/when/

Examples

  • tonight at 11:10 pm
  • at Friday afternoon
  • the deadline is next tuesday 14:00
  • drop me a line next wednesday at 2:25 p.m
  • it could be done at 11 am past tuesday

As a demonstration, check out a simple HTTP web server which parses natural language date/time using this library.

Key features

  • No regexp in rules definition. All rules are defined using rust macros.
  • Has two modes, one with typos recognition and another one which works with exact matches only.

Usage

use chrono_tz;
use when;

fn main() {
    let parser = when::parser::Parser::new(chrono_tz::Europe::Moscow)
        .parser(Box::new(when::en))
        .max_dist(3)
        .fuzzy_parse(true);
    println!("{:?}", parser.parse("today 18p.m."));
}

Only english language is supported yet. More languages may be added in future.

How it works?

When uses Nom parsing library to parse input strings.

There is a rules folder which contains rules for various languages. Parser tries to apply all available rules for the given language one by one until the first match. Situation when several rules match the same part of the string is considered as an erroneous.

The library is also able to understand typos in words using Damerau-Levenshtein distance. Distances are defined inside the rules definitions. The longer word is the bigger distance is allowed. To disable fuzzy parsing, set the last argument to parser constructor to true, this will switch parser to exact match only mode.

Each rule has its own start and end match boundaries and a merge distance. If two matches are less than threshold away from each other then they are merged together.

For example:

Today 21:50 and tomorrow 22:00
-----------     --------------

First two terms Today and 21:5O will be merged together as the distance between them is less than or equal to 5. So the final result will be as if there were one match which captures the term Today 21:50 as the whole. The same thing will happen with the next two terms (tomorrow and 22:00), despite the fact that they match by different rules, rules results will be merged together because the distance between matches is less than or equal to 5.

Final note

This is my humble attempt to create a rust library. Although I tried to do my best, I know there are a lot of undiscovered bugs in there and my code is not at all perfect, so I will appreciate any help to make it more stable and better.

Dependencies

~3.5–5MB
~90K SLoC