Precomputing Live demo: Traces How to run it

Answers ready before you ask

A day of coding-agent calls, each piece kept once and every call metered, in your browser

Loading SQLite

Loading SQLite, the Engine and the day's runs.

0
model calls kept
0 B
the calls as sent
0 B
the same calls in the file
$0.00
spent today, at example prices
0
secrets masked before storage
0
calls reported twice, refused

Every call as sent, and what the file keeps

An agent sends the whole conversation again with every call, so a run's 40th call repeats its first 39. The store keeps each message and the tool list once, under the SHA-256 of its bytes, and each call as the list of its pieces.

Spend by repository, against the day's budget

Read from repo_budget, the policy's quota view. A gateway in front of the agents reads it before letting a run's next call through.

What happened

Newest first.

    Where the input comes from

    Each call's input split by source, from the precomputes source_tokens_day and source_cost_day: the system prompt, the tool list, the task, the agent's own earlier messages, or the output of a tool.

    Each row shows cost, then input tokens. Replies are what the model wrote. Cost counts cached input at a tenth of the fresh price, so a source that repeats in every call costs less than its tokens suggest.

    Runs, the costliest first

    From the precomputes run_calls, run_input, run_cached, run_output and run_cost.

    Run and repositoryCallsCostInputCachedOutput

    Tokens. Cached is the input the provider served from its prompt cache: all of the run's previous call, when that call was sent less than five minutes before.

    Rebuild a call from the file

    Pick a finished run and one of its calls. The page reads the call back with the trace_requests view, SQL alone, and compares it with the request as the agent sent it, which it builds on its own from the day's runs.

    The policy

    Two exact streams meter the calls: one event for each call, and one for each source of its input. The store's own tables sit beside them in the same file and go in with the same checkpoints.

    
      

    Ask the file

    The store and the meter are one plain SQLite file. Pick a question or write your own, then press Run (or Ctrl+Enter, ⌘+Enter on a Mac). It reads while the day is paused or finished.