Sample data. These figures are not a customer bill.Learn more
parezenparezen
Northwind AI
Scale · Sample · cloud
Home
  • Get startedSoon
  • Audits
  • Overview
Analyse
  • Spend
  • Cost per task
  • Agents
  • Model comparisonSoon
  • Budgets
  • AlertsSoon
  • Reports
  • PR cost checksSoon
  • AdvisorsSoon
  • Spend analysis
Optimise
  • RecommendationsSoon
  • Routing policiesSoon
  • Shadow testsSoon
  • CachingSoon
  • TrimmingSoon
  • BatchSoon
  • Waste detectorSoon
Gateway
  • SetupSoon
  • ProvidersSoon
  • ModelsSoon
  • API keysSoon
  • DeploymentsSoon
  • PlaygroundSoon
  • LogsSoon
Savings & billing
  • Savings history
  • Savings ledger
  • Bill match
  • Billing
  • Invoices
Settings
  • Data & privacySoon
  • OrganisationSoon
  • ProjectsSoon
  • TeamSoon
  • RolesSoon
  • SSOSoon
  • Audit logSoon
Plan: Scale · Sample ↗
DocsHelp

Sample data. Not a customer bill.

Northwind AI/Shadow tests/Shadow test

Shadow test

Planned

Score distribution, cost delta and failing examples if logging is on.

Runninggoogle/gemini-2.5-flash vs anthropic/claude-sonnet-4.5Support reply
Score
—
Bar 0.85 · 5% sample
Estimated cost delta
—
Candidate $0.00 · baseline $0.00
Latency delta
—
680 ms vs 680 ms p50

Score distribution

Samples relative to the customer's threshold.

The test is still collecting scores.

Failing examples

Only the tail under the bar. Prompts stay hidden unless content logging is on.

Content logging is off
Prompts and completions for this project are not stored. Turn logging on for the project if you need to read failing examples.