Repository index
inference-server projects
1 indexed repository
- omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Repository index
1 indexed repository
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar