LLM inference in C/C++

Easy to use open source fast database for search | Good alternative to Elasticsearch now | Drop-in replacement for E in the ELK soon

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/READ…

A duckDB extension implementing a full service AI/ML enginer

The Airport extension for DuckDB, enables the use of Arrow Flight with DuckDB

An open sourced implementation of Bw-Tree in SQL Server Hekaton

KV cache store for distributed LLM inference

A Datacenter Scale Distributed Inference Serving Framework

Distributed data engine for Python/SQL designed for the cloud, powered by Rust

PRQL as a DuckDB extension

AI-powered Autonomous Data System

Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

Large-scale CLIP image search

Porting original DiskANN project to MAC and adding Python bindings

Pure Rust Port of DiskANN

An Approximate Nearest Neighbors library in Rust, based on random projections and LMDB and optimized for memory usage 💥

A complement to pgvector for high performance, cost efficient vector search on large workloads.

Exploration of Vector database Index for fast approximate nearest neighbour search.

View parquet files online

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

A lightweight data processing framework built on DuckDB and 3FS.

A build project for ONNX Runtime

Onnxruntime Builder

open source tooling for AI search and understanding

DeepEP: an efficient expert-parallel communication library

🛠 A lite C++ toolkit that contains 100+ Awesome AI models (Stable-Diffusion, FaceFusion, YOLO series, Face/Object Detection, Seg, Matting, etc), support MNN, ORT and TensorRT. 🎉🎉

Fast ML inference & training for ONNX models in Rust

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation