override the temperature in thinking mode (not supported)

aubin-tchoi · aubin-tchoi · commit 54866db8b2e1 · 2025-03-18T15:48:02.000+01:00
diff --git a/core/src/providers/anthropic.rs b/core/src/providers/anthropic.rs
@@ -930,6 +930,9 @@ impl AnthropicLLM {
                 "type": thinking_type,
                 "budget_tokens": thinking_budget_tokens,
             });
+            // We can't pass a temperature different than 1.0 in thinking mode: https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking#important-considerations-when-using-extended-thinking
+            // TODO(2025-03-18 aubin): we should surface this sooner
+            body["temperature"] = 1.0f32.into();
         }
 
         let url = self.messages_uri()?.to_string();

Original file line number	Diff line number	Diff line change
`@@ -930,6 +930,9 @@ impl AnthropicLLM {`
`930`	`930`	`"type": thinking_type,`
`931`	`931`	`"budget_tokens": thinking_budget_tokens,`
`932`	`932`	`});`
	`933`	`+ // We can't pass a temperature different than 1.0 in thinking mode: https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking#important-considerations-when-using-extended-thinking`
	`934`	`+ // TODO(2025-03-18 aubin): we should surface this sooner`
	`935`	`+ body["temperature"] = 1.0f32.into();`
`933`	`936`	`}`
`934`	`937`
`935`	`938`	`let url = self.messages_uri()?.to_string();`