2 stable releases
new 47.0.1 | Apr 24, 2025 |
---|
#2243 in Database interfaces
22 downloads per month
24KB
388 lines
Instrumented Object Store
Instrumented Object Store
Adds tracing instrumentation to any Object Store implementation.
Features
- Automatically captures spans for all storage operations (get, put, list, etc.)
- Records metadata like file paths and content sizes
- Captures error details when operations fail
- Works with OpenTelemetry for distributed tracing
Getting Started
// Create your object store
let store = Arc::new(object_store::local::LocalFileSystem::new());
// Wrap it with instrumentation (prefix for span names)
let instrumented_store = instrument_object_store(store, "local_fs");
// Use directly for file operations
let result = instrumented_store.get(&Path::from("path/to/file")).await?;
// Or integrate with DataFusion
let ctx = SessionContext::new();
ctx.register_object_store(&Url::parse("file://").unwrap(), instrumented_store);
When combined with the datafusion-tracing
crate, this provides end-to-end visibility from query execution to storage operations.
Dependencies
~8–16MB
~196K SLoC