Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
-
Updated
Mar 13, 2024 - Rust
#
localllama
Here are 8 public repositories matching this topic...
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
natural-language-processing
compression
text-generation
transformer
llama
quantization
mistral
model-compression
efficient-inference
efficient-model
large-language-models
llm
small-models
localllm
localllama
-
Updated
Apr 19, 2024 - Python
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
docker
kubernetes
ai
inference
nvidia
openai
llama
gpt
gemma
mistral
fine-tuning
finetuning
buildkit
large-language-models
llm
chatgpt
open-source-llm
llama2
localllama
mixtral
-
Updated
May 6, 2024 - Go
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
android
nlp
macos
linux
dart
ios
native-apps
gemini
flutter
indiedev
on-device
ipados
on-device-ai
pubdev
llamacpp
gen-ai
genai
mistral-7b
localllama
gemini-nano
-
Updated
Apr 27, 2024 - Dart
Social and customizable AI writing assistant! ✍️
-
Updated
Apr 15, 2024 - TypeScript
Run gguf LLM models in Latest Version TextGen-webui
-
Updated
Apr 28, 2024 - Jupyter Notebook
Summarize emails received by Thunderbird mail client extension via locally run LLM. Early development.
-
Updated
Feb 9, 2024 - Python
An experimental local web search engine assistant frontend and CLI for ollama and llama.cpp with a focus on being extremely lightweight and easy to run. The goal is to provide something along the lines of a minimalist Perplexity.
-
Updated
Apr 26, 2024 - Python
Improve this page
Add a description, image, and links to the localllama topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the localllama topic, visit your repo's landing page and select "manage topics."