Efficient Triton Kernels for LLM Training
-
Updated
Dec 23, 2024 - Python
#
triton
Here are 144 public repositories matching this topic...
Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
-
Updated
Feb 16, 2024 - Jupyter Notebook
A service for autodiscovery and configuration of applications running in containers
-
Updated
Sep 20, 2023 - Go
Playing with the Tigress software protection. Break some of its protections and solve their reverse engineering challenges. Automatic deobfuscation using symbolic execution, taint analysis and LLVM.
llvm reverse-engineering symbolic-execution deobfuscation triton taint-analysis tigress tigress-protections solution-tigress-challenge
-
Updated
Nov 21, 2023 - LLVM
Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.
-
Updated
Dec 24, 2024 - Cuda
🚀🚀🚀A collection of some wesome public projects about Large Language Model(LLM), Visual Language Model(VLM), AI Generated Content(AIGC), the related Datasets and Applications.
computer-vision cuda openai yolo triton awesome-list llama gpt datasets vlm sora hugging-face aigc large-language-models llm stable-diffusion chatgpt langchain chatglm llama3
-
Updated
Dec 22, 2024
A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
-
Updated
Oct 25, 2024 - Python
FlagGems is an operator library for large language models implemented in Triton Language.
-
Updated
Dec 24, 2024 - Python
Automatic ROPChain Generation
reverse-engineering symbolic-execution triton pwn ctf rop rop-exploitation rop-gadgets binary-exploitation rop-chain exploit-development exploitdev
-
Updated
Feb 21, 2020 - Python
SymGDB - symbolic execution plugin for gdb
-
Updated
May 15, 2018 - Python
LLVM based static binary analysis framework
analysis binary x86-64 llvm static-analysis deobfuscation triton x86 instruction-semantics program-analysis lifter llvm-ir
-
Updated
Oct 7, 2024 - C++
A performance library for machine learning applications.
-
Updated
Oct 12, 2023 - Python
🔥🔥🔥 A collection of some awesome public CUDA, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, MLIR and High Performance Computing (HPC) projects.
awesome hpc gpu parallel-computing cuda pytorch cublas yolo triton blas llama cutlass cudnn gemm tensorrt blis mlir llm tensorrt-llm
-
Updated
Dec 22, 2024
ClearML - Model-Serving Orchestration and Repository Solution
kubernetes devops machine-learning ai deep-learning triton tensorflow-serving model-serving serving mlops serving-pytorch-models triton-inference-server clearml serving-ml
-
Updated
Dec 16, 2024 - Python
(WIP)The deployment framework aims to provide a simple, lightweight, fast integrated, pipelined deployment framework for algorithm service that ensures reliability, high concurrency and scalability of services.
-
Updated
Jul 21, 2021 - Python
NVIDIA-accelerated, deep learned model support for image space object detection
machine-learning deep-learning gpu inference ros nvidia triton object-detection jetson ros2 tensorrt ros2-humble
-
Updated
Dec 11, 2024 - C++
Improve this page
Add a description, image, and links to the triton topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the triton topic, visit your repo's landing page and select "manage topics."