11 unstable releases (3 breaking)
0.4.1 | Aug 6, 2024 |
---|---|
0.4.0 | Aug 3, 2024 |
0.3.2 | Aug 2, 2024 |
0.3.1 | Jul 30, 2024 |
0.1.2 | Jul 13, 2024 |
#260 in Machine learning
391 downloads per month
140KB
997 lines
valentinus
next generation vector db built with lmdb bindings
dependencies
- bincode/serde - serialize/deserialize
- lmdb-rs - database bindings
- ndarray - numpy equivalent
- ort/onnx - embeddings
getting started
git clone https://github.com/kn0sys/valentinus && cd valentinus
optional environment variables
var | usage | default |
---|---|---|
LMDB_USER |
working directory of the user for database | $USER |
LMDB_MAP_SIZE |
Sets max environment size, i.e. size in memory/disk of all data | 20% of available memory |
ONNX_PARALLEL_THREADS |
parallel execution mode for this session | 1 |
VALENTINUS_CUSTOM_DIM |
embeddings dimensions for custom models | all-mini-lm-6 -> 384 |
tests
- Note: all tests currently require the
all-Mini-LM-L6-v2_onnx
directory - Get the model.onnx and tokenizer.json from huggingface or build them
mkdir all-Mini-LM-L6-v2_onnx
cd all-Mini-LM-L6-v2_onnx && wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json
wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/onnx/model.onnx
wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/special_tokens_map.json
wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/tokenizer_config.json
wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/tokenizer.json
wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/vocab.txt
examples
see examples
reference
Dependencies
~20–46MB
~787K SLoC