Sample data. These figures are not a customer bill.Learn more
parezenparezen
Orbital Health
Enterprise · Sample · self hosted connected
Home
  • Get startedSoon
  • Audits
  • Overview
Analyse
  • Spend
  • Cost per task
  • Agents
  • Model comparisonSoon
  • Budgets
  • AlertsSoon
  • Reports
  • PR cost checksSoon
  • AdvisorsSoon
  • Spend analysis
Optimise
  • RecommendationsSoon
  • Routing policiesSoon
  • Shadow testsSoon
  • CachingSoon
  • TrimmingSoon
  • BatchSoon
  • Waste detectorSoon
Gateway
  • SetupSoon
  • ProvidersSoon
  • ModelsSoon
  • API keysSoon
  • DeploymentsSoon
  • PlaygroundSoon
  • LogsSoon
Savings & billing
  • Savings history
  • Savings ledger
  • Bill match
  • Billing
  • Invoices
Settings
  • Data & privacySoon
  • OrganisationSoon
  • ProjectsSoon
  • TeamSoon
  • RolesSoon
  • SSOSoon
  • Audit logSoon
Plan: Enterprise · Sample ↗
DocsHelp

Sample data. Not a customer bill.

Orbital Health/Caching

Caching

Planned

Provider cache hit rate and exact-match cache per route.

Hit rate
0.0%
0 of 24 sample requests
Cached input tokens
0
Tokens the provider priced as cached
Routes to reorder
2
Stable prefix is not in front yet

Prompt reorder

No behaviour change. Move the stable system prompt ahead of the user turn so the provider can discount it.

Note draft

Move the stable system prompt ahead of the user turn so the provider can cache it.

8,173 input tokens
Open cache policy
Auth summary

Move the stable system prompt ahead of the user turn so the provider can cache it.

7,955 input tokens
Open cache policy