#spell #lcs #log #parsing

spell

Spell is a Streaming Parser for Event Logs using an LCS (Longest Common Subsequence)

4 releases

✓ Uses Rust 2018 edition

0.1.6 Jun 3, 2019
0.1.2 Jan 20, 2019
0.1.1 Jan 4, 2019
0.1.0 Dec 17, 2018

#84 in Parser tooling

29 downloads per month

MIT/Apache

29KB
706 lines

spell-rs

Crates.io Build Status Documentation License

spell-rs is a Spell implementation in Rust.

Spell is a Streaming Parser for Event Logs using an LCS (Longest Common Subsequence).

The minimum Rust version is 1.31 due to the use crate:: syntax.

Reference

Min Du and Feifei Li. Spell: Streaming Parsing of System Event Logs. 2016 IEEE 16th International Conference on Data Mining (ICDM) pp. 859-864, Barcelona, Spain, December, 2016. DOI: 10.1109/ICDM.2016.0103. https://ieeexplore.ieee.org/document/7837916

Details

Spell ingests log lines one by one and build up a list of formatting strings that can be used to analyze the logs. For example (see presentation slides, page 19), given the two log entries:

Temperature (41C) exceeds warning threshold
Temperature (42C, 43C) exceeds warning threshold

the LCS is:

Temperature * exceeds warning threshold

which can then be used to analyze the logs.

As of cedf57a7a73b1052de937d13150c2b9d8a03237c, the Rust implementation gives the exact same results as the Java one.

Python Wrapper

Universal Python package (wheel) can be built on all platforms using:

cd python

# Compile Rust code
pip install --editable .

# Test Python package
python ./test.py

# Build a wheel
python setup.py --verbose bdist_wheel

Docker

This only requires Docker.

# Build a Docker image containing everything required
./docker/docker_build.sh

# Run the commands to build wheel inside a docker container
./docker/docker_run.sh

Other Implementations

License

This project is licensed under either of

at your option.

Dependencies

~1MB
~24K SLoC