webhdfs

Hadoop webhdfs client library for Rust.

Documentation

• Built on Tokio and Hyper.
• Provides both synchronous and asynchronous APIs.

See src/bin/webhdfs.rs or tests/it.rs for usage examples.

NOTE: APIs are not yet stabilized and may change towards version 1.0.

TODO list (2nd checkbox is IT coverage)

• Async read and write ([X])
• Sync read and write ([X])
• Stat and dir ([X])
• Basic filesystem mutations (concat, mkdirs, rename, delete, symlink)
• File-based configuration
• Other file and directory operations (permissions, owner, ACL, times, checksum)
• XAttr operations
• Snapshot operations
• Basic delegation token support
• Full delegation token support
• webhdfs tool
• failover support ([X])

Building and testing

cargo test --lib -- --nocapture

Integration tests

See Integration tests

Changelog

See CHANGES.md