omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
- Current stars
- 21,771
- This week
- 250
- Relative growth
- 1.15%
- This month
- 3,017
- Forks
- 1,882
- Latest push
- 2026-09-15
- Commits
- Unavailable
- Latest release
- v0.6.4
- Language
- Python
- Licence
- Apache-2.0