1 unstable release

new 0.1.0 Oct 20, 2024

#636 in Filesystem

Download history 109/week @ 2024-10-16

109 downloads per month

MIT license

165KB
4K SLoC

Rust 3.5K SLoC // 0.0% comments Python 573 SLoC // 0.1% comments

RAGIT

RAGIT (rag-it) is a git-like software that turns your local files into a knowledge-base. The main goal of this project is to make knowledge-bases easy to share.

It allows you to

  1. create and share knowledge-bases easily
  2. ask query on knowledge-bases

Why another RAG framework?

RAGIT is very different from the other RAG frameworks. The differences make RAGIT suitable for mid-size data files (a few 100MBs I guess), but not for very big source.

  1. It adds title and summary to every chunks. It makes AIs very easy to rerank chunks.
  2. It DOES NOT use vector DB. Not using vector DB makes it difficult to scale to million files, but instead, it's VERY easy to share your knowledge-bases with others.
  3. It calculates tf-idf score on every chunks. It must be fast enough for hundreds of thousands of chunks.

More documents

Dependencies

~25–40MB
~635K SLoC