Route Lab

LLM fallback cost calculator

Try the fallback before you pay.

Compare bounded supplier sequences using quality assumptions, worst-case cost and latency constraints.

Use my own records

Local processing · No account · No wallet connection

What would you like to check?

Choose a fictional scenario to run it immediately, then change the assumptions.

Explore the calculations and common mistakes

Make it your own

Edit the form or import the example-shaped JSON. Input reference

Edit the inputs

Inputs stay in this tab and clear on reload. No automatic upload or wallet access. Maximum 128 KiB.

Report text for manual copy

From your records to a reviewable result

  1. Estimate each candidate from the same task cohort and include every attempt cost.
  2. Set an exact worst-case budget, latency bound and quality target.
  3. Review assumptions, export the plan, then validate in your own shadow workload.
Read the method and example

Where this tool fits

A transparent preflight calculation for a complete fallback sequence, with a hard worst-case budget and explicit failure assumptions.

Scope: Offline planning only. No live requests, model judge, payment, dynamic bandit or production routing.

质量与预算采购路由:可直接使用表单,也可导入 JSON。先运行虚构示例理解结果,再切换到自己的材料。输入仅在当前页面处理。查看中文说明

Compare with established tools

Existing gateways execute production traffic and have operational depth. This planner adds an inspectable scenario calculation, but has no gateway integration or calibrated success estimates.

Official product descriptions reviewed 19 September 2026. These are alternatives, not partners or endorsements.

  • OpenRouter

    Provider routing includes price, throughput, latency, fallback and data-policy controls.

  • LiteLLM

    Gateway routing, cooldowns, retries, load balancing and fallback strategies.

What does Route Lab do?

Route Lab compares short supplier sequences using entered cost, success and latency assumptions. It checks the worst-case total against your budget before sorting feasible options by expected cost. It is an offline planning tool; no model or payment is called.

By the AGI Scorecard team. Method and sources reviewed . Read the method.

Questions before you start

Should an agent budget use expected cost or worst-case cost?

Use worst-case cost for a hard spending limit. Expected cost is useful for comparison but may hide an expensive fallback. Success estimates also depend on how failures correlate across providers.

Is Route Lab free, and do I need a wallet?

All current functions are free beta. No account, wallet connection, subscription or model API key is needed. Offline planning only. No live requests, model judge, payment, dynamic bandit or production routing.

Can I use my own records and keep them private?

Yes. Enter records, import JSON or paste CSV into record groups. Inputs and comparison snapshots stay in this browser tab. Share-example links contain only a public scenario name. Review downloaded reports before sharing your records.