请问如何使用聚合接口，也就是使用第三方提供的代理接口。

[crosswk]

目前我测试OpenAI可以使用代理接口，例如修改配置文件"openai_api_base": "https://aihubmix.com/v1" 即可。

但是使用Claude似乎无法修改代理url。我看这个聚合API是依据OpenAI写的，所以我在ChuanhuChatGPT/modules/presets.py文件修改模型名称

ONLINE_MODELS = [
"claude-3",

MODEL_METADATA = {
"claude-3": {
"model_name": "claude-3-sonnet-20240229",
"token_limit": 200000,

修改ChuanhuChatGPT/modules/models，将Claude3修改为使用OpenAi模型
elif "claude-3" in model_name_lower:
model_type = ModelType.OpenAI
#elif "claude" in model_name_lower:
# model_type = ModelType.Claude

问题是，在前端聊天时，无法正常获取对话内容。后端有报错。

2024-04-24 11:56:18,050 [INFO] [base_model.py:613] 用户的输入为：print test
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': '', 'role': 'assistant'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {'prompt_tokens': 9, 'completion_tokens': 1, 'total_tokens': 10}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': 'I'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' don'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': "'t"}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' actually'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' have'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' the'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' capability'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' to'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' print'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' text'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': '.'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' I'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': "'m"}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' Claude'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ','}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' an'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' AI'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' assistant'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' created'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' by'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' Anthrop'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': 'ic'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' to'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' be'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' helpful'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ','}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' harm'}}], 'created': 1713930980, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': 'less'}}], 'created': 1713930981, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ','}}], 'created': 1713930981, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' and'}}], 'created': 1713930981, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': ' honest'}}], 'created': 1713930981, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}
ERROR: {'id': 'chatcmpl-fd5a7ea4-4f72-42eb-9a4f-71b086635fcb', 'choices': [{'index': 0, 'delta': {'content': '.'}}], 'created': 1713930981, 'model': 'claude-3-sonnet@20240229', 'object': 'chat.completion.chunk', 'usage': {}}

[Keldos-Li]

不同的模型返回的格式不同，因此并不通用。第三方OpenAI的代理会返回和OpenAI一致的格式，因此可以。

如果其他模型需要其他代理地址，会需要进一步修改代码……

[GaiZhenbiao]

正在做更进一步的自定义功能

[crosswk]

感谢回复。

因为我看了这个聚合API的文档，感觉是可行的。

下面是这个聚合API的描述：（https://aihubmix.com/about）
“本站以OpenAI模型调用接口为标准，聚合了多个非OpenAI模型，包括但不限于谷歌的gemini-pro、Claude3等模型。调用非OpenAI模型和调用openAI模型一样，只需要修改对应模型名字即可。”

所以我理解他的其他模型，返回的格式和OpenAI是一样的，应该是能用的。

按照他他的教程，我在Lobe-chat测试确实可以。在川虎测试，后台已经看到输出的回复流了，但是就是前端看不到，卡在最后一步了，实在搞不定了，所以问问看看 :)