Open role
Staff AI Routing Engineer
Build dynamic model routing across task, boundary, risk, latency, quality, and cost.
Team Applied AI
Location New York, NY / Remote (US)
Type Full-time
Level Staff
Compensation Competitive salary, meaningful equity, and benefits
About the role
Build evaluation, telemetry, and decision systems that continuously improve model selection without allowing customer data to become provider training material.
What you will do
- Build policy-aware model selection and fallbacks
- Develop online and offline routing evaluations
- Model quality, latency, cost, and risk trade-offs
- Integrate frontier, specialized, and private models
- Partner with Dipp Intelligence on learning signals
What we look for
- 7+ years in ML or production platform engineering
- Experience evaluating and serving multiple language models
- Strong statistical and experimental design skills
- Production Python plus a systems language
- Understanding of privacy-preserving telemetry