Skip to content
PayingForAI Test Lab By OverpayingForAI
MENU

Workload · v1.0.0

Pricing Intelligence Research

Given frozen pricing sources for three AI providers and a fixed monthly workload volume, calculate the true monthly cost of every plan, select the cheapest plan, and compute the landed cost per accepted result — with every claim cited to a frozen source.

Workload volume

Requests / month
50,000
Avg tokens in/out
800 / 400
Human review
5 min × $75/hr
Accepted outcomes
10 per run

Frozen sources

SHA-256

196516c063af3603b3a6935312c17dac111597dd12ef7b8d977a91fad13899b6

SHA-256

151b508ad9deb5f3d26a6a000a45521704c9173846bbf63fb1cf15490b7e9eb2

SHA-256

d43121acac45ea4798a83c92f364e7eb09e4b98d7e4a8ffef746211815cb30c5

Acceptance criteria

Minimum score
85/100
Mandatory rules
0
Tolerance
$
Validation
deterministic, no LLM judge

Deterministic rules

  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]
  • [object Object]

Currently fought by: The Flagship Fight. Future fights can reuse this workload without new code.

See results