Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问我该如何获得opt模型相关的weight文件？ #223

Open
a1bc2def6g opened this issue Sep 23, 2024 · 2 comments
Open

请问我该如何获得opt模型相关的weight文件？ #223

a1bc2def6g opened this issue Sep 23, 2024 · 2 comments
Labels
question Further information is requested

Comments

@a1bc2def6g
Copy link

你好！我在项目中只找到了llama相关模型的文件，请问如果我想要使用powerinfer进行opt模型的推理加速，应该从哪里获取相关权重文件呢？
@a1bc2def6g a1bc2def6g added the question Further information is requested label Sep 23, 2024
@eljrte
Copy link

eljrte commented Nov 23, 2024

同问。请问您有解决吗？怎么用llama.cpp或者powerinfer去运行OPT模型

@wuooo339
Copy link

同问，readme没给出OPT的predictor？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@eljrte @a1bc2def6g @wuooo339