HTML Selector

An HTML content extraction tool similar to CSS selectors that can precisely extract and process the required content from HTML documents through a simple and intuitive query language.

Example

use query::Query;

fn main() {
    let html = r#"
    <div class="a">
        <p>text 1</p>
        <p>text 2</p>
        <p>text 3</p>
    </div>
    <div class="b">
        <p>text 4</p>
        <p>text 5</p>
        <p>text 6</p>
    </div>
    "#;
    let q = Query::new(html);
    let result = q.query(r#"(class a > tag p:1:2 | class b > tag p:0) > text @replace," ","""#).texts();
    println!("{:?}", result); // ["text2", "text3", "text4"]
}

Basic Selectors

Text Extraction

Pipeline Operations

The pipeline operator > is used to connect multiple selectors for layer-by-layer querying:

class main > tag p > text

This query first selects elements with the class "main", then finds p tags within them, and finally extracts the text content of these p tags.

Regular Expression Matching

Using the tilde ~ allows for regular expression matching:

class ~".*ain" > tag p > text

This query selects elements with class names matching the regular expression .*ain, for example, it can match "main", "again", etc.

Index Selection

You can add an index after the selector to select elements at specific positions:

Text Processing Functions

Using the @ symbol can invoke built-in text processing functions:

Multiple functions can be chained:

class main > text @trim @replace,A,a @lowercase

Set Operations

Complex set operations can be grouped with parentheses:

(((class a ^ class c) | class b) > tag a | class main > tag a) > text @trim