#streaming #csv #data-streaming #data #io #time-series

yanked chopper

Chopper is a streaming time series manipulation framework. Cli frontend is provided via chop crate.

30 releases

0.8.3 Jan 23, 2023
0.8.1 Jul 16, 2022
0.6.0 Mar 2, 2022
0.3.0 Dec 31, 2021
0.0.1 Dec 29, 2019

#88 in #data-streaming


Used in chop

BSD-2-Clause

380KB
10K SLoC

chopper is a streaming time series manipulation framework

Goals
  1. Primary use case - ad-hoc usage by humans.
  2. Strictly streaming - minimal memory impact.
  3. Time series focused:
    1. Input data is assumed to have time column.
    2. Time is monotonically non-decreasing within each of the inputs.
Notable design choices
  1. Generated csv output is not guaranteed to be usable as csv input except for simple data types - there is no standard for csv serialization in general and csv output is expected to be used for either debugging or final output, not intermediate results.

Dependencies

~14–22MB
~292K SLoC