#iterator #top #arrow #api #data-fusion #progress #kts

kts-analyze

Various APIs on top of the arrow and datafusion crates

1 unstable release

0.1.0 Jul 9, 2019

#52 in #data-fusion


Used in 2 crates

MIT license

14KB
294 lines

This is work in progress!

Data analysis for know-thy-shell

Some iterators and processors used by know-thy-shell.

It is unclear what is the right api to use at this time, this is just exploration work.

API

Iterators with related wrappers:

  • FlatTable provides a one level iterator on a TableProvider (instead of partitions and record batches)
  • FlatRelation provides a one level iterator on a Relation

Some simple builders in bland_builder.

A simple top K implementation in top_k.

Usage

This create is used by the kts cli.

This is work in progress!

Dependencies

~32MB
~725K SLoC