Sample data. These figures are not a customer bill.Learn more
parezenparezen
Devbox Agents
Team · Sample · cloud
Home
  • Get startedSoon
  • Audits
  • Overview
Analyse
  • Spend
  • Cost per taskLock
  • Agents
  • Model comparisonSoon
  • Budgets
  • AlertsSoon
  • Reports
  • PR cost checksSoon
  • AdvisorsSoon
  • Spend analysis
Optimise
  • RecommendationsSoon
  • Routing policiesSoon
  • Shadow testsSoon
  • CachingSoon
  • TrimmingSoon
  • BatchSoon
  • Waste detectorSoon
Gateway
  • SetupSoon
  • ProvidersSoon
  • ModelsSoon
  • API keysSoon
  • DeploymentsSoon
  • PlaygroundSoon
  • LogsSoon
Savings & billing
  • Savings history
  • Savings ledger
  • Bill match
  • Billing
  • Invoices
Settings
  • Data & privacySoon
  • OrganisationSoon
  • ProjectsSoon
  • TeamSoon
  • RolesSoon
  • SSOSoon
  • Audit logSoon
Plan: Team · Sample ↗
DocsHelp

Sample data. Not a customer bill.

Devbox Agents/Shadow tests/Shadow test

Shadow test

Planned

Score distribution, cost delta and failing examples if logging is on.

Included with Scale

Shadow test is plan-gated in this sample. The preview stays visible.

Compare plans
Passopenai/gpt-4.1-mini vs openai/gpt-4.1Code review agent
View recommendation
Score
0.89
Bar 0.84 · 12% sample
Estimated cost delta
▼ -80.0%
Candidate $0.01 · baseline $0.03
Latency delta
▲ 0.0%
680 ms vs 680 ms p50

Score distribution

Samples relative to the customer's threshold.

Green bars clear the 0.84 bar. Amber bars do not.

Failing examples

Only the tail under the bar. Prompts stay hidden unless content logging is on.

Content logging is off
Prompts and completions for this project are not stored. Turn logging on for the project if you need to read failing examples.