跳到正文
The Decoder· Matthias Bastian·· 4 小时前AI 评分55

Anthropic 推出 Message Threads 公测,长对话首 token 延迟降低 35%

Anthropic's Message Threads cut time to first token by 35 percent for long conversations

AI 导读

Anthropic 在 Claude 平台以公测形式推出 Message Threads,API 请求不再重发全部对话历史,只传输上次消息后的增量内容。

正文 · 原文

Anthropic released Message Threads as a public beta on its Claude platform. Until now, every API request had to resend the entire conversation history. Message Threads only transmits what's changed since the last message, cutting time to first token by about 35 percent for requests between 500,000 and one million tokens, according to Anthropic.

Coding agents, computer-use agents, and workflows processing lots of documents or images benefit the most, the company says. The thread stays encrypted in memory between requests and expires after five minutes of inactivity. Token usage doesn't change since Claude still reads the full conversation history. The feature works on the Claude platform and through AWS, Microsoft Foundry, and Google Cloud. Details are in the documentation.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源: The Decoder · the-decoder.com