Sample data. These figures are not a customer bill.Learn more
parezenparezen
Orbital Health
Enterprise · Sample · self hosted connected
Home
  • Get startedSoon
  • Audits
  • Overview
Analyse
  • Spend
  • Cost per task
  • Agents
  • Model comparisonSoon
  • Budgets
  • AlertsSoon
  • Reports
  • PR cost checksSoon
  • AdvisorsSoon
  • Spend analysis
Optimise
  • RecommendationsSoon
  • Routing policiesSoon
  • Shadow testsSoon
  • CachingSoon
  • TrimmingSoon
  • BatchSoon
  • Waste detectorSoon
Gateway
  • SetupSoon
  • ProvidersSoon
  • ModelsSoon
  • API keysSoon
  • DeploymentsSoon
  • PlaygroundSoon
  • LogsSoon
Savings & billing
  • Savings history
  • Savings ledger
  • Bill match
  • Billing
  • Invoices
Settings
  • Data & privacySoon
  • OrganisationSoon
  • ProjectsSoon
  • TeamSoon
  • RolesSoon
  • SSOSoon
  • Audit logSoon
Plan: Enterprise · Sample ↗
DocsHelp

Sample data. Not a customer bill.

Orbital Health/Shadow tests/Shadow test

Shadow test

Planned

Score distribution, cost delta and failing examples if logging is on.

Passopenai/gpt-4.1-mini vs openai/gpt-4.1Auth summary
View recommendation
Score
0.94
Bar 0.90 · 6% sample
Estimated cost delta
▼ -72.7%
Candidate $0.01 · baseline $0.04
Latency delta
▲ 0.0%
680 ms vs 680 ms p50

Score distribution

Samples relative to the customer's threshold.

Green bars clear the 0.90 bar. Amber bars do not.

Failing examples

Only the tail under the bar. Prompts stay hidden unless content logging is on.

Content logging is off
Prompts and completions for this project are not stored. Turn logging on for the project if you need to read failing examples.