【feature】llm添加openai风格服务端支持(自定义代理地址和模型名称) #294
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
llm添加openai风格服务端支持(自定义代理地址和模型名称)
使用mindsearch的时候,发现无法使用自定义代理地址、模型名称的openai风格服务端。
GPTAPI有进行模型校验等原因,秉承只add的原则。基于GPTAPI扩展GPTStyleAPI:
支持openai风格:
已测试通过:
使用方法:
设置api_base、 model_name、key(如果服务端不需要,可忽略)
具体参见tests/test_llms/test_gptstyleapi.py