llm-echo 0.5 更新模拟 token 用量统计

llm-echo 0.5

AI 导读

Simon Willison 更新 llm-echo 0.5 调试插件，改进模拟 token 用量统计，使其计入工具调用、系统提示词和推理 token。该插件提供不调用 LLM、只重复输入提示词的“模型”；示例显示输入用量为 2 个 token、输出用量为 24 个 token。

正文 · 原文

I'm working towards a new LLM release, and testing PRs caused me to revisit the llm-echo debug plugin. This plugin provides a "model" which doesn't involve an LLM at all - it just repeats back the prompts that have been fed to it. The new release now updates the simulated token usage counts to take tool calls, system prompts, and reasoning tokens into account.

Example usage:

uvx --with llm-echo llm -m echo 'hi there' -o thinking 1 --usage

Outputs:

First I consider the prompt, then I decide what to say.
{
  "prompt": "hi there",
  "system": "",
  "attachments": [],
  "stream": true,
  "previous": []
}
Token usage: 2 input, 24 output

来源：Simon Willison · simonwillison.net