#machine-learning #grpc-api #mlops #deep-learning

jams-serve

jams-serve provides a http and gRPC API for jams-core

34 releases

0.1.33 Dec 2, 2024
0.1.32 Nov 25, 2024
0.1.30 Oct 27, 2024
0.1.20 Jun 21, 2024

#6 in #mlops


Used in jams

Apache-2.0

1MB
5K SLoC

JAMS-SERVE

This library crate is part of a wider project called J.A.M.S - Just Another Model Server. Please refer here.

jams-serve is a http and gRPC API library for jams-core.

Refer here for the OpenAPI Spec

  • /healthcheck: Endpoint for health checks

  • /api/predict: Endpoint for making predictions

  • /api/models: Endpoint for managing models

Refer here for the proto definition

  • HealthCheck
  • Predict
  • GetModels
  • AddModel
  • UpdateModel
  • DeleteModel

Stable on Linux x86_64 architecture

Dependencies

~97MB
~1.5M SLoC