15 releases

0.1.25 Aug 10, 2024
0.1.24 Apr 10, 2024
0.1.23 Mar 28, 2024
0.1.22 Feb 23, 2024
0.1.16 Aug 31, 2023

#5 in #reputation

43 downloads per month
Used in redgold

MIT license

235KB
4.5K SLoC

Redgold

License: MIT Dev | Website | Contributing | Dev Setup | Whitepaper | Run A Node | Security Procedures

Redgold or "philosophical gold", is intended as an ideological opposite of BlackRock. It is a decentralized, open-source, peer-to-peer platform designed to act as a financial data and computation layer for the cryptocurrency ecosystem. The primary product intention is focused around ETFs & Portfolio target models, and finance, but the platform is designed to be general purpose as a decentralized data lake and SQL compute engine.

It is inspired heavily by Spark and pandas like data transformations on conventional parquet data lakes, with the key distinguishing factor being the ability to support multi-tenant compute with arbitrary secure UDFs compiled by anyone. WASM executors are used for secure remote code execution to chain together transforms operating on SQL-like data loading functions as inputs. Protobuf is used for relational algebra descriptors and for raw signature operations. Arrow is used as a cross-memory format for WASM invocations, with sqlite tables for frequent access and parquet tables for long-lived data indexes. All operations are translated to work with Kademlia distances. ACCEPT consensus protocol is the most similar to the demonstrated primary optimization technique. For a full technical description and motivation of this project please refer above to the whitepaper.

  • This project is in experimental development and is not a production release / not yet on mainnet

Dependencies

~50–66MB
~1M SLoC