4 releases

0.1.3 Jun 9, 2023
0.1.2 Jun 9, 2023
0.1.1 Jun 7, 2023
0.1.0 Jun 7, 2023

#11 in #cog

31 downloads per month

Apache-2.0

3KB

Cog[-rust]: Containers for machine learning

Cog is an open-source tool that lets you package machine learning models in a standard, production-ready container.

Cog bundles Python models into a Docker image with a simple interface for loading and running models. This project aims to match that interface for Rust models, so they can be used interchangeably (on Replicate or Dyson).

WIP

This is a work in progress. It's not ready for use yet. Check back soon!

To see the proposed DX, check the hello-world example.

  • Basic web server
  • Rust Cog interface
  • Make everything work
  • Request validation
  • Dockerfile
  • CLI?

No runtime deps