Sample data. These figures are not a customer bill.Learn more
parezenparezen
Northwind AI
Scale · Sample · cloud
Home
  • Get startedSoon
  • Audits
  • Overview
Analyse
  • Spend
  • Cost per task
  • Agents
  • Model comparisonSoon
  • Budgets
  • AlertsSoon
  • Reports
  • PR cost checksSoon
  • AdvisorsSoon
  • Spend analysis
Optimise
  • RecommendationsSoon
  • Routing policiesSoon
  • Shadow testsSoon
  • CachingSoon
  • TrimmingSoon
  • BatchSoon
  • Waste detectorSoon
Gateway
  • SetupSoon
  • ProvidersSoon
  • ModelsSoon
  • API keysSoon
  • DeploymentsSoon
  • PlaygroundSoon
  • LogsSoon
Savings & billing
  • Savings history
  • Savings ledger
  • Bill match
  • Billing
  • Invoices
Settings
  • Data & privacySoon
  • OrganisationSoon
  • ProjectsSoon
  • TeamSoon
  • RolesSoon
  • SSOSoon
  • Audit logSoon
Plan: Scale · Sample ↗
DocsHelp

Sample data. Not a customer bill.

Northwind AI/Routing policies/Automatic optimisation

Automatic optimisation

Planned

Policy-driven auto-apply with guardrails, approvals and rollback.

Policy-driven
Automatic optimisation only applies a change the route policy already allows. Quality switches still need a passed shadow test.

Guardrail

$4,000.00$4,000.00

Auto-apply stops at 10% of the organisation soft budget.

Shadow gate

A quality change cannot auto-apply until its shadow test passes.

Rollback window

24h

A person can roll a change back inside this window. The log keeps the reason.

Routes on auto

Only these policies have automation set to auto.

  • Eval backfillAsync route. Batch routing is allowed to apply inside this policy.

Approvals queue

Open recommendations. Enable still respects the shadow gate.

  • Stop the support-reply retry storm

    Support reply

    $36.96est.open
  • Cascade ticket triage from mini to GPT-4.1

    Ticket triage · The shadow test has not passed the customer's bar.

    Blocked on the shadow test · $2.4Kest.open
  • Review Anthropic commitment headroom

    Support reply · Advice only. Never a ledger line.

    No evidence yetopen
  • Cap document extract output and require JSON

    Document extract · Run a shadow test before this switch.

    No evidence yetopen
  • Do not switch ticket triage until a shadow test passes

    Ticket triage · A shadow test is the gate. It is not itself a switch.

    Blocked on the shadow test · $8.4Kest.open
  • Consider a tuned small model for support reply

    Support reply · Fine-tune ships only behind its own passed shadow test.

    No evidence yetopen

Rollback log

  • Support reply8 Jul 2026 15:22 UTC · A. Okonkwo

    Rolled exact-match cache back off. Ignore recorded: replies are personalised.