Find your focus and passion
Build and grow with the community.
MoM & Routing
Build measurable and continuously improving model pools, recipes, and multi-model routing.
wg/mom-routingFocus
- Model pools, recipes, and lifecycle
- Multi-model collaboration algorithms and strategies
- Model-pool optimization and cross-model efficiency
Router Models & Inference Runtime
Improve Router Models and provide an extensible inference runtime for the model ecosystem.
wg/router-models-inference-runtimeFocus
- Built-in model post-training and release
- Router-native model families beyond BERT
- Self-improvement, fine-tuning, and runtime contracts
Data Plane & Networking
Run a portable and reliable online request path across standalone and gateway-integrated deployments.
wg/data-plane-networkingFocus
- OpenAI-compatible standalone data plane
- Envoy ExtProc, gateways, and networking integrations
- Performance optimization, streaming, dispatch, retries, and telemetry
Enterprise & Environment
Deliver production-grade enterprise capabilities across supported environments and hardware.
wg/enterprise-environmentFocus
- Multi-tenancy, identity, API keys, quotas, and audit
- Stable, scalable APIs and reference stacks
- Multi-environment and multi-hardware support
Agentic & Context
Manage context and safely select, hand off, and compose agent backends for long-running workloads.
wg/agentic-contextFocus
- Context optimization, memory, and session state
- Agent backend selection, handoff, and composition
- Bounded multi-agent collaboration and long-session model or workflow switching
Developer Experience & Ecosystem
Make vLLM Semantic Router easy to adopt, configure, extend, deploy, tune, and operate.
wg/developer-experience-ecosystemFocus
- CLI, Dashboard, APIs, configuration, recipes, and errors
- Agent skill and ecosystem integrations for deployment, tuning, and operations
- Documentation, blogs, video tutorials, and use-case sharing
Evaluation & Quality
Provide common evaluation and quality gates across every project direction.
wg/evaluation-qualityFocus
- MoM, Router Model, agent, context, and workflow evaluation
- Model cards, benchmarks, and reproducibility
- CI, E2E, compatibility, and regression gates
Lead and Member roles
Roles make technical ownership and contribution paths visible.
- Lead
- One or more per group; a Committer or a Contributor sponsored by a Maintainer.
- Member
- A Contributor with at least one merged repository commit.
- Visibility
- Confirmed Leads and Members appear here with their avatar and name.
- Authority
- Workgroup roles are separate from Open Source Team repository and release authority.
Need a new Workgroup? Propose one only when a durable problem does not fit an existing charter.
Open a proposal