Pinned

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. torchx torchx Public

   Forked from pytorch/torchx

   TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

   Python

3. sagemaker-pytorch-container sagemaker-pytorch-container Public

   Forked from aws/sagemaker-pytorch-training-toolkit

   Docker container for running PyTorch scripts to train and host PyTorch models on SageMaker

   Python

4. BentoML BentoML Public

   Forked from bentoml/BentoML

   Unified Model Serving Framework 🍱

   Python

5. DeepSpeed DeepSpeed Public

   Forked from microsoft/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python