BentoML

All

103 repositories

BentoML
Public
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai
Python
•
Apache License 2.0
•797•7.2k•153•12•Updated Dec 25, 2024Dec 25, 2024
comfy-pack
Public
A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.
ai-art comfyui genai comfyui-manager comfyui-workflow comfyui-nodes comfyui-api
Python
•
Apache License 2.0
•9•65•0•0•Updated Dec 24, 2024Dec 24, 2024
BentoBLIP
Public
how to build an image captioning application on top of a BLIP model with BentoML
Python
•2•3•0•2•Updated Dec 24, 2024Dec 24, 2024
OpenLLM
Public
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving
Python
•
Apache License 2.0
•654•10k•19•0•Updated Dec 24, 2024Dec 24, 2024
BentoSGLang
Public
Python
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024
yatai-image-builder
Public
🐳 Build OCI images for Bentos in k8s
docker docker-image container container-image kubernetes k8s
Go
•10•15•4•7•Updated Dec 23, 2024Dec 23, 2024
BentoCLIP
Public
building a CLIP application using BentoML
Python
•2•8•0•2•Updated Dec 23, 2024Dec 23, 2024
BentoSentenceTransformers
Public
how to build a sentence embedding application using BentoML
Python
•2•6•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoWhisperX
Public
Python
•5•11•0•8•Updated Dec 23, 2024Dec 23, 2024
BentoXTTS
Public
how to build an text-to-speech application using BentoML
Python
•2•5•1•3•Updated Dec 23, 2024Dec 23, 2024
BentoFunctionCalling
Public
Python
•1•5•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoTGI
Public
Python
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoMLCLLM
Public
Python
•1•2•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoLMDeploy
Public
Self-host LLMs with LMDeploy and BentoML
Python
•2•17•1•0•Updated Dec 23, 2024Dec 23, 2024
BentoTRTLLM
Public
Python
•1•9•2•0•Updated Dec 23, 2024Dec 23, 2024
BentoDiffusion
Public
BentoDiffusion: A collection of diffusion models served with BentoML
kubernetes ai lora model-serving fine-tuning diffusion-models stable-diffusion
Python
•
Apache License 2.0
•25•342•9•1•Updated Dec 23, 2024Dec 23, 2024
BentoVLLM
Public
Self-host LLMs with vLLM and BentoML
Python
•12•79•4•2•Updated Dec 23, 2024Dec 23, 2024
BentoMoirai
Public
Python
•0•2•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoColPali
Public
Python
•0•10•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoResnet
Public
Python
•1•3•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoYolo
Public
BentoML service of YOLO v8
Python
•
Apache License 2.0
•1•6•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoMoshi
Public
Python
•
Apache License 2.0
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoBark
Public
Python
•0•4•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoXTTSStreaming
Public
xtts with streaming endpoint
Python
•0•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoChatTTS
Public
Python
•1•23•0•0•Updated Dec 23, 2024Dec 23, 2024
llm-router
Public
Multi-LLM Routing API Endpoint with BentoML
Python
•1•4•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoVoiceAgent
Public
Build Phone Calling Voice Agent fully powered by open source models.
voice-agent ai-phone-calling-guide ai-voice-assistant ai-phone
Python
•1•9•0•0•Updated Dec 23, 2024Dec 23, 2024
rag-tutorials
Public
a series of tutorials implementing rag service with BentoML and LlamaIndex
Python
•5•30•2•0•Updated Dec 23, 2024Dec 23, 2024
BentoShield
Public
Python
•0•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoCrewAI
Public
Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs
Python
•1•4•0•1•Updated Dec 23, 2024Dec 23, 2024