#raft-consensus #gandalf #implemention #key-value-store #kvs #tracker

bin+lib gandalf-consensus

An implemention of raft to bring any database with consensus

1 stable release

1.0.0 Oct 28, 2021

#2673 in Database interfaces

29 downloads per month

GPL-3.0-or-later

105KB
2.5K SLoC

Gandolf

Gandolf is an implemention of Raft algorithm which can be used to bring consensus over any database.

Overal

This project is consisted of two module gandalf-consensus and gandalf-kvs which is the gandalf own database which can be replaced by others. The overala architecture of project is like the image below.

Each number represent a RaftMessage which is emmited in the system.

No. Name
1 VoteMsg
2 VoteResp
3 AppendMsg
4 AppendResp
5 ClientReadMsg
6 ClientWriteMsg
7 ClientResp
8 ClientError
9 SnapMsg
10 InstallSnapshot
11 InstallSnapshotResp

Gandolf-consensus

Gandol-consensus is the implemention of Raft algorithm so, it is responsible for bringing consensus to our system. It's also responsible for interacting with database and perform the command on it after the entry got commited. For connecting gandalf to your database you need to implement Parser and Tracker traits for your database, then connect gandalf to your database and point your client to gandalf instead. You can use gandalf.conf files existing in repo to launch a cluster.

Parser

Parser trait is responsible for converting client reqeust using the database protocol to somthing understandable for gandalf, so it can decide whether the request is from Read or Write kind. Then it will append the request to log and replicate it to other nodes if it's Write one or just perfrom it if it's a Read.

Tracker

Tracker trait is responsible for managing the raft log and also comunicating with database.

Gandolf-KVS

Gandolf-KVS is a redis like key-value store which is highly ispired from tokio mini-redis and is used as the currently only supported database for Gandolf-onsensus module. It uses RESP for comunicating over tcp with client and also the consesnsus module. This module is consisted of two binary file which gandalf-kvs-server which is used for starting server and, gandalf-kvs which is the client for interacting with the server.
Currently supported commands are:

Command Functionality
Set Set a value for a key
Get Retrieve a value for a key
Load Perform multiple set at one or load an snappshot
Snap Take an snappshot

The overal Architecture of kvs is like image below:

Install

To install gandalf-kvs use:

cargo install gandalf-kvs

To install gandalf use:

cargo install gandalf

Dependencies

~12–21MB
~263K SLoC