18 releases

0.2.1 Nov 15, 2024
0.1.14 Jul 9, 2024
0.1.13 Feb 9, 2024
0.1.8 Nov 15, 2023
0.1.4 Nov 6, 2022

#258 in Parser implementations

Download history 1/week @ 2024-08-12 8/week @ 2024-08-19 5/week @ 2024-08-26 14/week @ 2024-09-16 56/week @ 2024-09-23 5/week @ 2024-09-30 8/week @ 2024-10-07 13/week @ 2024-10-14 5/week @ 2024-10-21 5/week @ 2024-10-28 255/week @ 2024-11-11 33/week @ 2024-11-18 17/week @ 2024-11-25

305 downloads per month

MPL-2.0 license

69KB
1.5K SLoC

gigtag

crates.io Docs Dependencies Testing License: MPL 2.0

A lightweight, textual tagging system aimed at DJs for managing custom metadata.

Structure

A gig tag is a flat structure with the following, pre-defined fields or components:

  • Label
  • Facet (including an optional calendar date)
  • Prop(ertie)s

All components are optional with the following restrictions:

  • A valid gig tag must have a label or a facet.
  • A valid gig tag with only a facet and neither a label or props is valid, if the facet has a date suffix

Label

A label is a non-empty string that contains arbitrary text without leading/trailing whitespace.

Labels are supposed to be edited by users and are displayed verbatim in the UI.

Examples

Label Comment
Wishlist a single word
FloorFiller multiple words concatenated in PascalCase
Floor Filler multiple words separated by whitespace

Facet

The same content rules that apply to labels also apply to facets. Moreover facets must not start with a leading slash / character that would otherwise interfere with the serialization format (see below).

Facets serve a different semantic purpose than labels. They are used for categorizing, namespacing or grouping a set of labels or for defining the context of associated properties.

Facets are supposed to represent pre-defined identifiers that are neither editable nor directly displayed in the UI.

Date-like facets

A reserved suffix could be used to encode a calendar date into facets.

Facets that end with a @ character followed by 8 decimal digits are considered as date-like facets. The digits are supposed to encode an ISO 8601 calendar date without a time zone in the format yyyyMMdd.

Facets considered as date-like even if the 8 decimal digits do not encode a valid date. This less restrictive constraints have been chosen deliberately to allow using regular expressions for recognizing date-like facets.

The @ character of the date suffix must follow the preceding text without any intermediate whitespace. Thus the remaining prefix after stripping the date-like suffix remains a valid facet.

The following regular expressions could be used:

Regex Description
(^|[^\s])@\d{8}$ Recognize date-like facets
[\s]+@\d{8}$ Reject facets with a date-like suffix if preceded by whitespace

Valid examples

Facet Description
spotify a tag for encoding properties related to Spotify
@20220625 date-like facet without a prefix that denotes the calendar day 2022-06-25 in any time zone
wishlist@20220625 date-like facet with prefix wishlist that denotes the calendar day 2022-06-25 in any time zone
@00000000 date-like facet without a prefix and an invalid date
abc xyz@99999999 date-like facet with prefix abc xyz and an invalid date

Invalid examples

Facet Description
played @20220625 invalid date-like facet with a prefix containing trailing whitespace before the date-like suffix

Prop(ertie)s

Custom properties could be attached to tags, abbreviated as props.

Properties are represented as a non-empty, ordered list of name/value pairs.

Names are non-empty strings that contain arbitrary text without leading/trailing whitespace. There are no restrictions regarding the uniqueness of names, i.e. duplicate names are permitted.

Values are arbitrary strings without any restrictions. Empty values are permitted.

Applications are responsible for interpreting the names and values in their respective context. Facets could be used for defining this context.

Serialization

Single tag

Individual tags are encoded as URIs:

URI = scheme ":" ["//" authority] path ["?" query] ["#" fragment] > authority = [userinfo "@"] host [":" port]

Only the path, query, and fragment components could be present. All other components must be absent, i.e. the URI string must neither contain a scheme nor an authority component.

The following table defines the component mapping:

Tag component URI component Percent-encoded character set
label fragment fragment percent-encode set + '%'
facet path path percent-encode set + '%'
props (name/value) query query percent-encode set + '%' + '&' + '='

Tags, respective their URIs, are serialized as text and the components are percent-encoded according to RFC 2396/1738. The above table specifies which characters need to be encoded for each tag component. Property names/values are encoded separately.

Empty components are considered as absent when parsing a gig tag from an URI string.

Examples

The following examples show variations of the encoded string with empty components that are ignored when decoding the URI.

Encoded Facet Date Label Props: Names Props: Values
#MyTag
?#MyTag
MyTag
wishlist@20220625#For%20you wishlist@20220625 2022-06-25 For you
played@20220625
played@20220625?
played20220625#
played@20220625?#
played@20220625 2022-06-25
audio-features?energy=0.78&valence=0.61
audio-features?energy=0.78&valence=0.61#
audio-features energy
valence
0.78
0.61

Examples (invalid)

The following tokens do not represent valid gig tags:

Encoded Comment
https://#MyTag URL scheme/authority are present
My%20Tag Only a facet without a date, neither a label nor props
/my-facet#Label Facet starts with a /
wishlist%20@20220625#Label Date suffix in facet is prefixed by whitespace
?=val#Label Empty property name
?name=my+val#My label Special characters like + and whitespace are not percent-encoded
# Empty label is considered as absent
? Empty facet and props are considered as absent
?# Empty facet, props, and label are considered as absent

Multiple tags

Formatting

Multiple tags are formatted and stored as text by concatenating the corresponding, encoded URIs. Subsequent URIs are separated by whitespace, e.g. a single ASCII space character.

Retro-fitting

Often it is not possible to store the encoded gig tags in a reserved field. In this case gig tags could appended to any text field by separating them with arbitrary whitespace from the preceding text.

Parsing

Text is split into tokens that are separated by whitespace. Parsing starts with the last token and continues from back to front. It stops when encountering a token that could not be parsed as a valid gig tag.

Retro-fitting

The first token that could not be parsed as a valid gig tag is considered the last token of the preceding text. The preceding text including this token and the whitespace until the first valid gig tag token must be preserved as an undecoded prefix.

When re-encoding the gig tags the undecoded prefix that was captured during parsing must be prepended to the re-encoded gig tags string. This rule ensures that only whitespace characters could get lost during a decode/re-encode roundtrip, i.e. when unintentionally parsing arbitrary words from the preceding text as valid gig tags (false positives).

Storage

File metadata

The text with the encoded gig tags is appended (separated by whitespace) to the Content Group field of audio files:

  • ID3v2: GRP1 (primary/preferred) / TIT11 (traditional/fallback)
  • Vorbis: GROUPING
  • MPEG-4: ©grp

Some applications like Engine DJ do not support this file tag. In this case the encoded gig tags could be appended to the comment field, e.g. separated by a newline character.

License

Licensed under the Mozilla Public License 2.0 (MPL-2.0) (see MPL-2.0.txt or https://www.mozilla.org/MPL/2.0/).

Permissions of this copyleft license are conditioned on making available source code of licensed files and modifications of those files under the same license (or in certain cases, one of the GNU licenses). Copyright and license notices must be preserved. Contributors provide an express grant of patent rights. However, a larger work using the licensed work may be distributed under different terms and without source code for files added in the larger work.

Contribution

Any contribution intentionally submitted for inclusion in the work by you shall be licensed under the Mozilla Public License 2.0 (MPL-2.0).

It is required to add the following header with the corresponding SPDX short identifier to the top of each file:

// SPDX-License-Identifier: MPL-2.0

Dependencies

~6–8MB
~145K SLoC