The counterintuitive row
Searches cost more than models do.
Look again at the middle row. The mid-tier model is cheaper per token than the top tier
and it cost more than twice as much, because it spent its entire search allowance and read
four times as many tokens. Every search result is pulled into the input context and
billed per token, so reading dominates the bill, not answering. The number of
searches is the lever; the model is second.
This has a pleasant consequence. The cheap configuration is also the faithful one, because
a person asking an engine a question gets a quick answer rather than a research run. If a
vendor’s measurement costs twenty times ours, it is not more accurate — it is
measuring a different thing.