New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: Add CPU based LLM support #370

Open

linonetwo opened this issue May 2, 2023 · 8 comments

Assignees

Contributor

linonetwo commented May 2, 2023 •

edited

Description 描述

https://github.com/ItsPi3141/alpaca-electron

https://github.com/Atome-FE/llama-node

https://github.com/gmpetrov/databerry

Additional Context 额外上下文

No response

linonetwo self-assigned this

Contributor Author

linonetwo commented Jun 6, 2023 •

edited

https://github.com/ohmplatform/FreedomGPT/blob/main/src/index.ts it uses https://github.com/ohmplatform/FreedomGPT/blob/main/src/model/windows/main.exe prebuild binary

Contributor Author

linonetwo commented Jun 6, 2023

参考 https://github.com/hwchase17/langchainjs/blob/main/langchain/src/vectorstores/memory.ts 实现 vector 存储，而不一定用 sqlite-vss

Contributor Author

linonetwo commented Jun 6, 2023

参考 https://github.com/josStorer/RWKV-Runner

Contributor Author

linonetwo commented Jun 7, 2023

用 https://github.com/xenova/transformers.js 创建 embedding

Contributor Author

linonetwo commented Jun 18, 2023

onnx.js https://github.com/xenova/transformers.js can load onnx, so don't need python

linonetwo mentioned this issue

Feat/llm worker #440

Merged

linonetwo closed this as completed

Contributor Author

linonetwo commented Sep 28, 2023

嵌入 https://github.com/QwenLM/qwen.cpp 以便支持中文

Contributor Author

linonetwo commented May 11, 2024

参考 https://github.com/reorproject/reor ，接入基于 transformer.js 的向量搜索

linonetwo reopened this

Contributor Author

linonetwo commented May 28, 2024

https://www.npmjs.com/package/vectordb lancedb/lancedb#865

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment