#parser #nom

macro nom-derive

Custom derive nom parsers from struct

11 unstable releases (5 breaking)

✓ Uses Rust 2018 edition

0.6.3 Jul 2, 2020
0.6.2 Jun 30, 2020
0.5.0 Apr 9, 2020
0.4.0 Mar 6, 2019
0.1.0 Feb 23, 2019

#92 in Parser tooling

Download history 16/week @ 2020-03-22 1/week @ 2020-03-29 47/week @ 2020-04-05 62/week @ 2020-04-12 39/week @ 2020-04-19 29/week @ 2020-04-26 27/week @ 2020-05-03 50/week @ 2020-05-10 22/week @ 2020-05-17 17/week @ 2020-05-24 25/week @ 2020-05-31 69/week @ 2020-06-07 98/week @ 2020-06-14 131/week @ 2020-06-21 91/week @ 2020-06-28 94/week @ 2020-07-05

224 downloads per month
Used in ospf-parser

MIT/Apache

91KB
1.5K SLoC

nom-derive

License: MIT Apache License 2.0 docs.rs Build Status Crates.io Version

Overview

nom-derive is a custom derive attribute, to derive nom parsers automatically from the structure definition.

It is not meant to replace nom, but to provide a quick and easy way to generate parsers for structures, especially for simple structures. This crate aims at simplifying common cases. In some cases, writing the parser manually will remain more efficient.

Feedback welcome !

#[derive(Nom)]

This crate exposes a single custom-derive macro Nom which implements parse for the struct it is applied to.

The goal of this project is that:

  • derive(Nom) should be enough for you to derive nom parsers for simple structures easily, without having to write it manually
  • it allows overriding any parsing method by your own
  • it allows using generated parsing functions along with handwritten parsers and combining them without efforts
  • it remains as fast as nom

nom-derive adds declarative parsing to nom. It also allows mixing with procedural parsing easily, making writing parsers for byte-encoded formats very easy.

For example:

use nom_derive::Nom;

#[derive(Nom)]
struct S {
  a: u32,
  b: u16,
  c: u16
}

This adds a static method parse to S, with the following signature:

impl S {
    pub fn parse(i: &[u8]) -> nom::IResult(&[u8], S);
}

To parse input, just call let res = S::parse(input);.

For extensive documentation of all attributes and examples, see the Nom derive attribute documentation.

Many examples are provided, and more can be found in the project tests.

Combinators visibility

All inferred parsers will generate code with absolute type path, so there is no need to add use statements for them. However, if you use any combinator directly (or in a Parse statement, for ex.), it has to be imported as usual.

That is probably not going to change, since

  • a proc_macro cannot export items other than functions tagged with #[proc_macro_derive]
  • there are variants of combinators with the same names (complete/streaming, bits/bytes), so re-exporting them would create side-effects.

Debug tips

  • If the generated parser does not compile, add #[nom(DebugDerive)] to the structure. It will dump the generated parser to stderr.
  • If the generated parser fails at runtime, try adding #[nom(Debug)] to the structure or to fields. It wraps subparsers in dbg_dmp and will print the field name and input to stderr if the parser fails.

Changes

  • Add support for guards in Selector Patterns (#5)
  • Add limited support for Unit fields in enum (#6)
  • Make parse method public for enums too (#7)

0.6.2

  • Add ExtraArgs support for structs (top-level only)
  • Allow dynamic configuration of endianness (SetEndian attribute)
  • Add support for u128/i128 (#3)

0.6.1

  • Add Tag attribute
  • Fix type verification with Cond when using multiple attributes

0.6.0

  • Switch to nom parsing functions, do not generate macros
  • Use qualified paths, caller do not have to import nom macros
  • Move all attributes under the 'nom' namespace
  • Add many attributes (LittleEndian, BigEndian, Map, Debug, Value, Take, AlignAfter/AlignBefore, SkipAfter/SkipBefore, ErrorIf, etc.)
  • Deprecate the NomDeriveDebug derive (replaced by DebugDerive attribute)
  • Improve documentation, add many examples
  • Rewrite attribute parser, now accepting a more flexible syntax

0.5.0

  • Upgrade to nom 5.0
  • The parse method is now public
  • Upgrade dependencies (syn, quote, proc-macro2)

0.4.0

  • Add support for Enum parser generator
    • Enums require a selector to choose the variant
    • Fieldless enums (list of constants) are handled as a special case
  • Add NomDeriveDebug attribute to display generated parser on stderr during build

0.3.0

  • Move crate to rust-bakery github project
  • Add Count attribute

License

Licensed under either of

at your option.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.

Dependencies

~380–710KB
~17K SLoC