[RFC] 088 - Claude Thinking 集成 #6521

arvinxx · 2025-02-25T18:10:02Z

arvinxx
Feb 25, 2025
Maintainer

背景

集成 Claude 3.7 Sonnet 模型 Extended Thinking 能力：https://www.anthropic.com/news/claude-3-7-sonnet

设计思路

Thinking 集成

由于 Claude 3.7 具有 DeepSeek 类模型不具备的特殊字段，因此设计还略有不同。

Claude 对于推理的态度是一个可控的思路，提供了专门的 thinking 字段用于开启这个功能，同时提供了 budget_tokens 用于控制思考深度，比起 OpenAI 和 DeepSeek 都对开发者更友好：

const params = {
  thinking: {
    type: "enabled",
    budget_tokens: 4096
  }
};

正常来说只要开启这个配置后，Claude 就具有了 Thinking 能力，然后只需要解析 claude 返回的 thinking 块，走 LobeChat 现有的标准 SSE 协议即可正常展示 thinking 块，这也是 PR #6515 中做的工作。

Thinking + Tool Use

但事实上当我测试了同时开启 Thinking + Search 插件时，事情就变得没有那么简单了。默认 Thinking + 联网插件时，直接使用就会遇到一个报错：

{
  "error": {
    "type": "error",
    "error": {
      "type": "invalid_request_error",
      "message": "messages.1.content.0.type: Expected `thinking` or `redacted_thinking`, but found `text`. When `thinking` is enabled, a final `assistant` message must start with a thinking block (preceeding the lastmost set of `tool_use` and `tool_result` blocks). We recommend you include thinking blocks from previous turns. To avoid this requirement, disable `thinking`. Please consult our documentation at https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking (request id: 2025022709391110067949266409883)"
    }
  }
}

报错提到的问题点是，assistant 如果需要使用 tool calling，那么必须在 assistants 中包含 thinking 或者 redacted_thinking 块。

即构造出来的数据结构必须得是这样：

[
  { "content": "告诉我杭州和北京的天气，先回答我好的", "role": "user" },
  {
    "content": [
      {
        "thinking": "经过一番思考....",
        "signature": "WaUjzkypQ2mUEVM36O2TxuC06KN8xyfbJwyem2dw3URve/op91XWHOEBLLqIOMfFG/UvLEczmEsUjavL....",
        "type": "thinking"
      },
      {
        "text": "好的,我会为您查询杭州和北京的天气信息。我现在就开始查询这两个城市的当前天气情况。",
        "type": "text"
      },
      {
        "id": "toolu_018PNQkH8ChbjoJz4QBiFVod",
        "input": { "city": "杭州" },
        "name": "realtime-weather____fetchCurrentWeather",
        "type": "tool_use"
      },
      {
        "id": "toolu_018VQTQ6fwAEC3eppuEfMxPp",
        "input": { "city": "北京" },
        "name": "realtime-weather____fetchCurrentWeather",
        "type": "tool_use"
      }
    ],
    "role": "assistant"
  },
  {
    "content": [
      {
        "content": [
          {
            "text": "[{\"city\":\"杭州市\",\"adcode\":\"330100\",\"province\":\"浙江\",\"reporttime\":\"2024-06-24 17:02:14\",\"cas....",
            "type": "text"
          }
        ],
        "tool_use_id": "toolu_018PNQkH8ChbjoJz4QBiFVod",
        "type": "tool_result"
      },
      {
        "content": [
          {
            "text": "[{\"city\":\"北京市\",\"adcode\":\"110000\",\"province\":\"北京\"....",
            "type": "text"
          }
        ],
        "tool_use_id": "toolu_018VQTQ6fwAEC3eppuEfMxPp",
        "type": "tool_result"
      }
    ],
    "role": "user"
  }
]

这里非常值得说的就是 signature 字段，我在下面贴了中间和 Claude 3.7 讨论的要点，它提到了为什么需要 signature ，以及为什么 thinking 是 tools calling 中必须的东西。从这一点来看，Claude 的确是一家非常重视 LLM 安全性的公司，并且在工程实践上给出了非常好的指引，Respect。

当然，加了这个 thinking 块的确大大提升了接入 claude thinking 的复杂度，但是从完成以后来看是非常值得的一件事情。

进展

Step 1：完成 Thinking 配置能力集成与实现 ✨ feat: support claude sonnet 3.7 thinking #6515
Step 2: 针对 Thinking 场景完成相关 edge case 修正
- 🐛 fix: fix claude 3.7 sonnet thinking with tool use #6528
- 🐛 fix: fix anthropic tools issue #6566

arvinxx · 2025-02-25T18:10:25Z

arvinxx
Feb 25, 2025
Maintainer Author

litellm 示例数据：

{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505568,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"我","ignature_delta":null}],"reasoning_content":"我","content":"","role":"assistant"}}],"thinking_blocks":[{"type":"thinking","thinking":"我","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"需要找94的所有质","signature_delta":null}],"reasoning_content":"需要找出394的所有质","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"需要找出394的所有质","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"因数。\n质因数是","signature_delta":null}],"reasoning_content":"因数。\n\n质因数是","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"因数。\n\n质因数是","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"指能整数的质","signature_delta":null}],"reasoning_content":"指能整除该数的质","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"指能整除该数的质","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"数。我检查394能","signature_delta":null}],"reasoning_content":"数。我先来检查394能","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"数。我先来检查394能","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"被哪些","signature_delta":null}],"reasoning_content":"被哪些小质","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"被哪些小质","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"数整除,"signature_delta":null}],"reasoning_content":"数整除。","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"数整除。","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"\n\n先尝试2：\n394 ","signature_delta":null}],"reasoning_content":"\n\n先尝试2：\n394 ","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"\n\n先尝试2：\n394 ","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"÷ 2 = 197","signature_delta":null}],"reasoning_content":"÷ 2 = 197","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"÷ 2 = 197","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"\n197是质数吗？我","signature_delta":null}],"reasoning_content":"\n197是质数吗？我","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"\n197是质数吗？我","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"来检查n197不","signature_delta":null}],"reasoning_content":"来检查：\n197不","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"来检查：\n197不","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"能被2\n197不能被3","signature_delta":null}],"reasoning_content":"能被2整除\n197不能被3","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"能被2整除\n197不能被3","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"整除\97不能被5","signature_delta":null}],"reasoning_content":"整除\n197不能被5","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"整除\n197不能被5","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505569,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"整除\97不能被7整除","signature_delta":null}],"reasoning_content":"整除\n197不能被7整除","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"整除\n197不能被7整除","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505570,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"\n197不能被11整除\n197","signature_delta":null}],"reasoning_content":"\n197不能被11整除\n197","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"\n197不能被11整除\n197","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505570,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"不能被整除","signature_delta":null}],"reasoning_content":"不能被13整除","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"不能被13整除","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505570,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"\n\n要确定197是不是质数，我","signature_delta":null}],"reasoning_content":"\n\n要确定197是不是质数，我","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"\n\n要确定197是不是质数，我","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505570,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"需要检是否能","signature_delta":null}],"reasoning_content":"需要检查它是否能","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"需要检查它是否能","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505570,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"被不超197的质数整除。√","signature_delta":null}],"reasoning_content":"被不超过√197的质数整除。√","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"被不超过√197的质数整除。√","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505570,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"197 ≈ ","signature_delta":null}],"reasoning_content":"197 ≈ ","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"197 ≈ ","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505570,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"14，所我已经检查了","signature_delta":null}],"reasoning_content":"14，所以我已经检查了","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"14，所以我已经检查了","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505570,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"所有需质数，","signature_delta":null}],"reasoning_content":"所有需要的质数，","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"所有需要的质数，","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"197没更小的因","signature_delta":null}],"reasoning_content":"197没有更小的因","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"197没有更小的因","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"数，所97是质数。","signature_delta":null}],"reasoning_content":"数，所以197是质数。","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"数，所以197是质数。","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"\n\n因此，394的质因数是2和","signature_delta":null}],"reasoning_content":"\n\n因此，394的质因数是2和","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"\n\n因此，394的质因数是2和","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"197。n394 = 2 ","signature_delta":null}],"reasoning_content":"197。\n394 = 2 ","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"197。\n394 = 2 ","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"thinking_blocks":[{"type":"thinking","thinking":"× 197","signature_delta":null}],"reasoning_content":"× 197","content":""}}],"thinking_blocks":[{"type":"thinking","thinking":"× 197","signature_delta":null}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"","tool_calls":[{"function":{"arguments":"{}"},"type":"function","index":-1}]}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"要找出394的质因数，我需要将"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"394分解为质数的乘积"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505571,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"。\n\n我先用最"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"小的质数2"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"尝试除394：\n394 "}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"÷ 2 = 197"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"\n\n现在我需要判"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"断197是否为质数。\n-"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":" 197不能被2整除"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"\n- 197不能被3整除"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"\n- 对于更"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"大的质数，我"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505572,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"只需检查到"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"√197 ≈ 14"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"\n- 5, 7, "}}]}
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"11, 13都不能整除197"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"\n\n因此197是质数。\n\n所"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"以394的质因数只有两"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"个：2和197"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"\n\n答案：394 = 2"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":" × 197，质因数是"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"2和197。"}}]},
{"id":"chatcmpl-1c04a1f1-d58c-4008-abd7-84f043a222af","created":1740505573,"model":"claude-3-7-sonnet-latest","object":"chat.completion.chunk","choices":[{"finish_reason":"stop","index":0,"delta":{}}]}

0 replies

arvinxx · 2025-02-27T02:43:59Z

arvinxx
Feb 27, 2025
Maintainer Author

遗留问题：在持续搜索后，达到历史记录限制带来的报错。

arvinxx
Feb 27, 2025
Maintainer Author

开启思考后，需要关闭历史记录限制，否则会报错：

{
  "body": {
    "error": {
      "status": 400,
      "headers": {
        "connection": "keep-alive",
        "content-length": "579",
        "content-type": "application/json; charset=utf-8",
        "date": "Thu, 27 Feb 2025 08:47:58 GMT",
        "x-aihubmix-request-id": "2025022708475795031093801986038"
      },
      "error": {
        "error": {
          "type": "invalid_request_error",
          "message": "messages.1.content.0.type: Expected `thinking` or `redacted_thinking`, but found `text`. When `thinking` is enabled, a final `assistant` message must start with a thinking block (preceeding the lastmost set of `tool_use` and `tool_result` blocks). We recommend you include thinking blocks from previous turns. To avoid this requirement, disable `thinking`. Please consult our documentation at https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking (request id: 2025022708475795031093801986038)"
        },
        "type": "error"
      }
    },
    "endpoint": "https://ai****ix.com/",
    "provider": "anthropic"
  },
  "errorType": "ProviderBizError"
}

从这个角度来考虑，感觉深度思考不能默认开启，需要手动触发，并提示用户开启深度思考后会自动取消历史记录条数限制

0 replies

arvinxx · 2025-02-27T09:54:32Z

arvinxx
Feb 27, 2025
Maintainer Author

redacted_thinking的作用与必要性

User:

https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking 根据这个页面的内容帮我解释下 redacted_thinking 的作用？是否一定需要包含进去

Assistant:

让我查看这个页面的具体内容。

Assistant:

根据文档内容，我来解释 redacted_thinking 的作用和使用要点：

redacted_thinking 是 Claude 在使用扩展思考(extended thinking)功能时的一个特殊机制：

产生原因：

当 Claude 的内部推理过程被安全系统标记时，系统会对部分或全部 thinking 块进行加密
加密后的内容会以 redacted_thinking 块的形式返回

作用机制：

redacted_thinking 块包含加密的内容，对人类来说是不可读的
当这些块被传回 API 时会被自动解密，使 Claude 能够在不丢失上下文的情况下继续响应

是否必须包含：

在多轮对话中，如果你使用了工具调用(tool use)功能，则必须将 thinking 和 redacted_thinking 块都完整地传回 API
如果没有使用工具调用，你可以:
- 选择省略之前轮次的 thinking 块
- 或者让 API 自动帮你清除这些块

生产环境建议：

需要意识到 redacted_thinking 块包含加密内容，不可人为解读
可以向用户提供简单解释："出于安全原因，Claude 的部分内部推理已被自动加密。这不会影响响应质量。"
如果要向用户展示 thinking 块，可以过滤掉 redacted 块，只保留正常的 thinking 块
建议对 redacted thinking 实现适当的错误处理，确保不会影响 UI 展示

重要注意事项：

当需要传回 thinking/redacted_thinking 块时，必须完整、不经修改地传回
不能重新排列或修改这些块的顺序
这些块对于维持模型的推理流程和对话完整性很重要

总结：redacted_thinking 是一个安全机制，只有在使用工具调用(tool use)功能时才必须包含。在其他情况下，可以选择性地处理或忽略这些块。这个机制既保证了 Claude 的安全性，又不影响其推理能力的连续性。

User:

为什么 tools 调用必须要包含 thinking 呢？

Assistant:

根据文档内容，我来详细解释为什么在工具调用(tools)时必须包含 thinking 块：

核心原因在于工具调用的特殊执行流程和思维连续性：

工具调用的执行流程：

1. 用户发送初始消息
2. Assistant 响应，包含 thinking 块和工具请求
3. 用户发送带有工具结果的消息
4. Assistant 响应(这一步不会包含新的 thinking 块)
5. 如果需要更多工具调用，重复步骤 3-4 直到对话完成

思维连续性的需求：

当 Claude 调用工具时，它实际上是暂停了当前响应的构建，等待外部信息
当工具结果返回时，Claude 需要继续构建之前的响应
thinking 块记录了导致工具请求的步骤推理过程
包含原始 thinking 确保 Claude 可以从上次停止的地方继续其推理

上下文维护：

虽然工具结果在 API 结构中显示为用户消息
但它们实际上是一个连续推理流程的一部分
保留 thinking 块可以在多个 API 调用之间维持这种概念流程

举个例子来说明：

用户: "帮我分析这个 CSV 文件的数据"

Claude (thinking): 
1. 需要先读取 CSV 文件
2. 分析数据分布
3. 生成统计摘要

Claude: "我需要使用 read_csv 工具来读取文件"
[调用 read_csv 工具]

用户: [返回 CSV 数据]

Claude: [继续基于之前的 thinking 进行分析]
"根据数据显示..."

如果不保留 thinking 块：

Claude 就会丢失之前的分析计划和上下文
每次工具调用返回后都需要重新思考和规划
可能导致分析不连贯或重复工作

所以 thinking 块在工具调用场景下是必须的，它：

维护了推理的连续性
保证了工具调用前后的上下文完整性
提高了多步骤任务的执行效率
避免了重复思考和计划

这就像人类解决问题时的思维过程 - 当我们需要查找资料时，我们会记住之前的思考过程，等获取到资料后继续之前的思路。thinking 块就扮演了这个"记忆"的角色。

User:

所以一旦这里用户修改了 thinking content，就有可能导致问题？所以才需要 signature 吗？

Assistant:

是的，你理解得很准确！这就是为什么 Anthropic 在 thinking 块中引入了 signature 机制。让我详细解释一下：

Signature 的作用：

thinking 块包含一个 signature 字段
这个字段包含一个加密令牌(cryptographic token)
用于验证 thinking 块确实是由 Claude 生成的
当 thinking 块被传回 API 时会进行验证

为什么需要这种验证机制：

保护推理的完整性：确保 thinking 内容没有被人为修改
维护安全标准：防止用户注入可能绕过安全限制的内容
确保状态一致性：尽管 API 是无状态的，但需要保证推理过程的连续性

可能出现的问题场景：
如果用户修改了 thinking content：

原始 thinking：
1. 分析数据格式
2. 检查数值范围
3. 调用数据处理工具

用户修改后：
1. 分析数据格式
2. 执行任意代码 <-- 恶意修改
3. 调用数据处理工具

这种修改可能：

破坏 Claude 的推理连续性
引入安全风险
导致工具调用的上下文错误
使模型行为变得不可预测

Signature 在流式响应中的处理：

- 在流式响应中，signature 通过特殊的事件添加
- 通过 signature_delta 在 content_block_delta 事件中传递
- 在 content_block_stop 事件之前完成添加

最佳实践建议：

永远不要尝试修改 thinking 块的内容
完整保留并传回原始的 thinking 块
如果需要展示给用户，可以选择性地过滤或隐藏某些内容，但传回 API 时必须保持原样
实现适当的错误处理，以应对 signature 验证失败的情况

技术实现建议：

interface ThinkingBlock {
  content: string;
  signature: string;
  type: 'thinking' | 'redacted_thinking';
}

// 正确的处理方式
function handleThinkingBlock(block: ThinkingBlock) {
  // 存储完整的原始块
  saveOriginalBlock(block);
  
  // 展示时可以过滤
  if (block.type === 'thinking') {
    displayThinkingContent(block.content);
  }
  
  // API 调用时使用完整原始块
  return block;
}

所以 signature 机制是一个重要的安全和完整性保证：

确保了推理过程的可信度
防止了潜在的安全漏洞
保证了工具调用场景下的上下文完整性
维护了模型响应的可预测性

这就像是给 thinking 块加了一个防篡改封条，确保从 Claude 输出到再次输入的过程中，思维过程保持原样，不会被人为修改或破坏。

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[RFC] 088 - Claude Thinking 集成 #6521

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 4 comments

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

[RFC] 088 - Claude Thinking 集成 #6521

arvinxx Feb 25, 2025 Maintainer

背景

设计思路

Thinking 集成

Thinking + Tool Use

进展

Replies: 4 comments

arvinxx Feb 25, 2025 Maintainer Author

arvinxx Feb 27, 2025 Maintainer Author

arvinxx Feb 27, 2025 Maintainer Author

arvinxx Feb 27, 2025 Maintainer Author

redacted_thinking的作用与必要性

User:

Assistant:

Assistant:

User:

Assistant:

User:

Assistant:

arvinxx
Feb 25, 2025
Maintainer

arvinxx
Feb 25, 2025
Maintainer Author

arvinxx
Feb 27, 2025
Maintainer Author

arvinxx
Feb 27, 2025
Maintainer Author

arvinxx
Feb 27, 2025
Maintainer Author