Sample data. These figures are not a customer bill.Learn more
parezenparezen
Northwind AI
Scale · Sample · cloud
Home
  • Get startedSoon
  • Audits
  • Overview
Analyse
  • Spend
  • Cost per task
  • Agents
  • Model comparisonSoon
  • Budgets
  • AlertsSoon
  • Reports
  • PR cost checksSoon
  • AdvisorsSoon
  • Spend analysis
Optimise
  • RecommendationsSoon
  • Routing policiesSoon
  • Shadow testsSoon
  • CachingSoon
  • TrimmingSoon
  • BatchSoon
  • Waste detectorSoon
Gateway
  • SetupSoon
  • ProvidersSoon
  • ModelsSoon
  • API keysSoon
  • DeploymentsSoon
  • PlaygroundSoon
  • LogsSoon
Savings & billing
  • Savings history
  • Savings ledger
  • Bill match
  • Billing
  • Invoices
Settings
  • Data & privacySoon
  • OrganisationSoon
  • ProjectsSoon
  • TeamSoon
  • RolesSoon
  • SSOSoon
  • Audit logSoon
Plan: Scale · Sample ↗
DocsHelp

Sample data. Not a customer bill.

Northwind AI/Routing policies/Policy editor

Policy editor

Planned

Right-size, cascade, cache, batch, automation, YAML and history.

Support bot · ticket_resolved · version 3

Thresholds

The customer's bar. A lever that changes quality cannot cross it without a passed shadow test.

appSupport replygatewayGatewayconditionshadow test passedmodelanthropic/claude-haiku-4.5fallbackanthropic/claude-haiku-4.5fallbackanthropic/claude-sonnet-4.5provideranthropic
  1. app
    Support reply
  2. gateway
    Gateway
  3. condition
    shadow test passed
  4. model
    anthropic/claude-haiku-4.5
  5. fallback
    anthropic/claude-haiku-4.5
  6. fallback
    anthropic/claude-sonnet-4.5
  7. provider
    anthropic
Shadow testsAll tests for this routeSavingsLogs

What this policy will do

  • Support reply follows a cost-first policy.
  • A served response has to score at least 0.85 and finish inside 1,800 ms at p95.
  • Anything priced above $0.0200 a request is outside this policy.
  • Simple requests can move from anthropic/claude-sonnet-4.5 to anthropic/claude-haiku-4.5 only after a shadow test passes.
  • Cascade is off, so there is no cheap-first attempt.
  • If the chosen model fails, fallbacks run in order: anthropic/claude-haiku-4.5, anthropic/claude-sonnet-4.5.
  • Output is capped at 700 tokens, with reasoning effort low.
  • The route is synchronous, so it stays off batch prices.
  • Exact-match response cache is off for this route.
  • Semantic cache is Planned and is not applied.
  • Automation is manual. Nothing here applies on its own.

Simulated impact

12 sample requests on this route.

Baseline
$0.07
Actual
$0.02
Estimated spend
$0.02est.▲ 0.0%
Measured p95
765 ms
Escalations
0
Fallbacks
2
  • This sample has no cascade escalations. When one happens, its cost is included, not hidden.
  • Exact-match cache is off, so responses are not reused.
  • Semantic cache is Planned and is excluded.