Flagship open-source project
vLLM Semantic Router
An open routing layer for choosing the right model, tool, and execution path.
- Routes across heterogeneous model pools.
- Trades cost, latency, privacy, safety, and quality explicitly.
- Extends inference routing toward agent orchestration.