Use Groq mixtral-8x7b-32768 in functions/tools OpenAI like agent #19927
Replies: 4 comments 4 replies
-
Hey @A-Giordano, great to see you tackling new challenges! Hope you've been well since our last interaction. Thank you for providing the detailed context and the code snippet. It seems like you've done a thorough job of setting In the LangChain framework, the However, the error message you're seeing suggests that the Groq model you're using, Here are a few suggestions to troubleshoot this issue:
If after reviewing and adjusting these areas based on the specific capabilities and requirements of the I hope this helps! If you have any further questions or if there's anything else I can assist you with, please let me know. Sources
|
Beta Was this translation helpful? Give feedback.
-
Please see https://console.groq.com/docs/openai. The Groq API doesn't appear to support tool calling. Edit: Groq released tool calling support on 2024-04-09 |
Beta Was this translation helpful? Give feedback.
-
They just released tool calling support today: https://console.groq.com/docs/tool-use |
Beta Was this translation helpful? Give feedback.
-
Well how do we make a tools agent with groq in langchain now that the tools support is introduced? Because the groq tools usage is simpler, but some use cases require langchain... |
Beta Was this translation helpful? Give feedback.
-
Checked other resources
Commit to Help
Example Code
Description
Hello everybody,
I'm new here so forgive me if I made any mistake in the post.
I would like to try the
mixtral-8x7b-32768
model provided by Groq in a function/tool agent, since it seems to support functions calling.I tried 2 different way of implementing it:
using the provided
ChatGroq
classusing
ChatOpenAI
class settingopenai_api_base="https://api.groq.com/openai/v1"
but both gave me the same error:
BadRequestError: Error code: 400 - {'error': {'message': 'Tool and function calls do not currently support streaming', 'type': 'invalid_request_error'}}
Now, is there a way to use the function/tool agent in a complete non streaming mode?
I tried to set
streaming=False
everywhere i could but it doesn't seem to fix it.If anyone has any suggestion it would be much appreciated.
Thanks
System Info
langchain==0.1.14
langchain-community==0.0.31
langchain-core==0.1.38
langchain-groq==0.0.1
langchain-openai==0.1.1
langchain-text-splitters==0.0.1
openai==1.14.3
groq==0.4.2
Beta Was this translation helpful? Give feedback.
All reactions