rocm

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Open Machine Learning Compiler Framework

NumPy & SciPy for GPU

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A nearly-live implementation of OpenAI's Whisper.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Stable Diffusion web UI

A deep learning package for many-body potential energy representation and molecular dynamics

Large-scale LLM inference engine

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3

Self-host the powerful Chatterbox TTS model. This server offers a user-friendly Web UI, flexible API endpoints (incl. OpenAI compatible), predefined voices, voice cloning, and large audiobook-scale text processing. Runs accelerated on NVIDIA (CUDA), AMD (ROCm), and CPU.

stdgpu: Efficient STL-like Data Structures on the GPU

The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU performance.

UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms

RDNA-native LLM inference engine in Rust.

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.