Open role
Member of Technical Staff, Model Routing
Own dynamic model routing: the right model for each task, under a hard cost and policy ceiling.
Team Applied AI
Location New York, NY / Remote (US)
Type Full-time
Level Staff MTS
Compensation $250,000 – $325,000 base + meaningful equity + benefits
What we are building
Dipp AI Technologies is on a mission to close the gap between AI’s advanced reasoning capabilities and an enterprise’s ability to trust it with real work: verifiable, cost-disciplined, and in control of its own data.
We build Orcher, the agentic control plane that enforces Human-in-the-Role across seven components, and Dipp Intelligence, our Enterprise Superintelligence solution that compounds on verified execution.
Work directly with the founding team, building for customers from startups to Fortune 100 companies across industries. Help enterprises adopt frontier models, open weights and new compute providers without surrendering authority, economics or data control.
About the role
Dipp AI's strategy is decoupled orchestration — no single frontier model, but the right model for each task under governed cost, latency, and data-boundary constraints. You will own the routing layer that makes that real.
You will build task classification, capability profiles, evaluation harnesses, and the cost governor that enforces spend ceilings before inference happens rather than after the invoice arrives. Routing decisions must be explainable and reproducible, because they end up in the audit ledger alongside the action they enabled.
You will also own how new models enter the fleet: how they are evaluated, gated, shadow-tested, and promoted or rejected on evidence.
What you will do
- Build task classification and routing policy across frontier, open-weight, and private models.
- Own the evaluation harness that scores models per task class on quality, latency, and cost.
- Implement pre-inference cost governance: budgets, ceilings, degradation paths, and hard stops.
- Enforce enterprise data-boundary rules in routing so no restricted payload reaches an ineligible provider.
- Build shadow evaluation and staged promotion for new models entering the fleet.
- Instrument routing decisions so each one is explainable in the audit ledger.
What we look for
- Hands-on production experience with LLM systems beyond prototypes: serving, evaluation, and cost control.
- Strong applied ML or systems background with rigorous measurement habits.
- Experience building evaluation infrastructure that teams actually trusted.
- Fluency in Python plus a systems language for the serving path.
- Understanding of inference economics: tokens, context, caching, batching, and provider pricing behaviour.
- Skepticism about benchmarks and the discipline to construct better ones.
Experience
- 7+ years in software or ML engineering, including 2+ years shipping LLM-backed systems in production.
- Has owned a routing, serving, or evaluation platform used by other teams.
- Experience with self-hosted or private-tenant model deployment is a strong plus.
Education
- BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or a related field.
- Equivalent applied experience shipping ML systems is accepted in place of a degree.
Compensation and benefits
- Meaningful equity with a standard four-year vest.
- Full medical, dental, and vision coverage.
- 401(k) with company contribution, hardware budget, and generous compute for evaluation work.
- Support for publishing evaluation methodology and results.
How we hire
- 01Intro conversation with the founder or applied-AI lead.
- 02Deep dive on an evaluation or routing system you have built.
- 03Working session on a routing policy trade-off under a cost ceiling.
- 04Panel with control-plane and product colleagues.
- 05References and offer.