🏁 Data structures 🏁

High performance SlidingWindow datastructures used in DeepCausality and elsewhere.

RingBuffer is a high-performance, lock-free data structure implementation inspired by the LMAX Disruptor pattern. The RingBuffer supports the following configurations:

• Single producer / single consumer
• Single producer / muliple consumer
• Multi producer / single consumer
• Multi producer / multi consumer

ArrayGrid is an abstraction over scalars, vectors, and low dimensional matrices similar to a tensor. In contrast to a tensor, an ArrayGrid is limited to low dimensions (1 to 4), only allowing a scalar, vector, or matrix type. Still, all of them are represented as a static fixed-size const generic array. Fixed-sized arrays allow for several compiler optimizations, including a cache-aligned data layout and the removal of runtime array boundary checks because all structural parameters are known upfront, providing a significant performance boost over tensors.

The sliding window implementation over-allocates to trade space (memory) for time complexity by delaying the rewind operation when hitting the end of the underlying data structure. Specifically, a sliding window of size N can hold, without any array copy, approximately C-1 elements, where C is the total capacity defined as NxM with N as the window size and M as a multiple. This crate has two implementations, one over vector and the second over a const generic array. The const generic implementation is significantly faster than the vector-based version.

🤔 Why?

1. Zero dependencies.
2. Zero cost abstraction.
3. Zero unsafe by default. Unsafe implementations are available through the unsafe feature flag.

Performance:

ArrayGrid

Set value:

More details on performance can be found in the Performance section of the ArrayGrid document.

RingBuffer: Single Producer/Consumer Performance

More details on performance can be found in the Performance section of the RingBuffer document.

Sliding Window

Single Push:

Sequential Operations:

More details on performance can be found in the Performance section of the SlidingWindow document.

🚀 Install

Just run:

cargo add dcl_data_structures

📚 Docs

• API Docs

• SlidingWindow Summary

⭐ Usage

ArrayGrid:

• Design & Details
• Benchmark
• Examples
• Test

SlidingWindow:

• Design & Details
• Benchmark
• Examples
• Test

🙏 Prior Art

The project took inspiration from:

• sliding_features
• sliding-window-aggregation
• sliding_window_alt
• sliding_windows

👨‍💻👩‍💻 Contribution

Contributions are welcomed especially related to documentation, example code, and fixes. If unsure where to start, just open an issue and ask.

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in deep_causality by you, shall be licensed under the MIT licence, without any additional terms or conditions.

📜 Licence

This project is licensed under the MIT license.

👮️ Security

For details about security, please read the security policy.

💻 Author

• Marvin Hansen.
• Github GPG key ID: 369D5A0B210D39BC
• GPG Fingerprint: 4B18 F7B2 04B9 7A72 967E 663E 369D 5A0B 210D 39BC