Manifold · you own the routing

Policies

Rules the router can't break: the quality bar, where data is allowed to go, which sellers are eligible and how each workload is routed. Changes apply to the next call.

Guardrails

Approval bar

A route has to clear both before it can go live.

Minimum quality parity

97%

Max p50 latency increase

20%

Parity is graded per workload on its own metric (label agreement, accepted comments, sim success…), not on a generic benchmark.

Decision model

Jev

Scores each variable-workload call 0–1 before it is sent.

Scoring overhead: 38 ms p50 · runs on-prem
Default thresholds: 0.40 low · 0.75 frontier
Retrains on: Post-review grades, nightly
Last retrain: Today 03:10 UTC · +1.2 pts
Workloads using it: 2 of 12

v2 in A/B4 overrides

Policy

Data & routing rules

PII stays on-prem or zero-retention
Prompts the shim tags as PII skip third-party sellers
US data residency
Only sellers with US regions are eligible
Use contracted capacity first
Burn down Treasury commitments before buying spot
Auto-rollback on quality dip
Revert a route if parity drops 2 pts over 1 hour
Spill over when a seller is busy
Next-cheapest qualified seller, then the original model
Store full prompt and response bodies
Off keeps hashes and templates only (30-day retention)

Eligible sellers

Who the router can buy from

Disabled sellers are skipped by every lane, including spillover.

Per workload

Route mode

The highlighted mode is the one the shim recommends for that workload's class.

Workload	Class	Mode
Support ticket triage support-bot	consistent
Fleet telemetry summaries fleet-ops	consistent
PR code review bot ci-reviewer	variable
Customer email drafts crm-assist	consistent
Incident root-cause agent oncall-agent	variable
Sim task planner sim-planner	specialty
SQL analytics copilot data-copilot	variable
Contract & invoice extraction finops-extract	consistent
Internal knowledge answers kb-answer	variable
Training-data labeling label-pipe	specialty
Perception frame captions perception-captioner	consistent
Fleet ops copilot ops-copilot	variable

Workload

Class

Mode

Support ticket triage

support-bot

consistent

Fleet telemetry summaries

fleet-ops

consistent

PR code review bot

ci-reviewer

variable

Customer email drafts

crm-assist

consistent

Incident root-cause agent

oncall-agent

variable

Sim task planner

sim-planner

specialty

SQL analytics copilot

data-copilot

variable

Contract & invoice extraction

finops-extract

consistent

Internal knowledge answers

kb-answer

variable

Training-data labeling

label-pipe

specialty

Perception frame captions

perception-captioner

consistent

Fleet ops copilot

ops-copilot

variable