Repository index
inference repositories
2 tracked repositories
Explore repository descriptions and the primary language: Python. Open a repository to review its recorded star growth, rank history and development activity. Coverage is limited to repositories tracked by BeWisp.
- vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Primary language: Python
- llm-d/llm-d
State of the art inference performance with modern accelerators on Kubernetes
Primary language: Python