Skip to content

llm-echo 0.5 Adds Tool Calls, System Prompts and Reasoning to Simulated Token Counts

1 reports 1 reporting sources 3 hours agoNew

Understand the event

AI overview

Simon Willison updated the llm-echo debugging plugin in version 0.5 so its simulated token usage counts now account for tool calls, system prompts, and reasoning tokens. The plugin provides a “model” that repeats prompts back without involving an LLM. In the example command, `uvx --with llm-echo llm -m echo 'hi there' -o thinking 1 --usage`, the plugin reports 2 input tokens and 24 output tokens. These are simulated counts, not usage from an actual LLM.

Generated by AI from reports · Updated 2 hours ago

Report timeline

Follow the reports to explore different sides of the event.

10/19
  1. llm-echo 0.5 Updates Simulated Token Usage Counts

    Simon Willison’s llm-echo 0.5 debug plugin updates its simulated token usage counts to account for tool calls, system prompts, and reasoning tokens. The plugin provides a “model” that repeats back prompts without involving an LLM. In the example, `uvx --with llm-echo llm -m echo 'hi there' -o thinking 1 --usage` reports 2 input and 24 output tokens.

Tomorrow at 08:00, a briefing like this arrives in your inbox.

The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.

Keep reading

Latest daily · Issue 26VAST open-sources EdenLive world model with over 24FPS generation at 720P

Trending now

  1. 1DeepSeek Releases V4.1-Flash-1017, Now Available on Ollama Cloud With US Hosting
  2. 2Anthropic Pledges 5% of Its Shares to New Public Benefit Fund
  3. 3Meta Removes Business Terms Language That Raised Website Scraping and AI Training Concerns
  4. 4Anthropic Says Claude Reconstructed Five NIST Elliptic-Curve Seeds Using a Timestamp-Initialized Generator