ml-rust

Machine learning infrastructure in Rust, from tensors to inference servers. The stack needs no Python runtime.

Projects

Project	What it does
blazr	Inference server for LLMs, speech, and embeddings. OpenAI and Anthropic compatible API. Runs on CPU, CUDA, and WebGPU. C API for apps.
oxidizr	LLM training for Mamba, MLA, MoE, and hybrid models.
voxr	Audio and speech on boostr: decoding, TTS, ASR, and VAD.
vidr	Video: codecs, hardware decode and encode, filters, and models on the GPU, as a library.
containr	Media containers for vidr and voxr: MP4/MOV and Matroska/WebM, read and write.
rav1r	AV1 encoder derived from rav1e, for vidr. Output stays bit-exact with upstream.
compressr	Model conversion and quantization between SafeTensors and GGUF.
boostr	ML framework on numr: attention, MoE, Mamba, quantization, model loaders.
numr	Tensors, linear algebra, and FFT on CPU, CUDA, and WebGPU.
solvr	Scientific computing on numr: optimization, ODE and PDE solvers, statistics.
splintr	BPE, WordPiece, and SentencePiece tokenizers. Python bindings.
regexr	Regex engine with lookarounds and JIT, built for tokenization.
nexar	Distributed runtime with QUIC transport and collectives.
treeboost	Gradient boosted decision trees for large tabular data.
fluxbench	Benchmarking with crash isolation and bootstrap statistics.
venus	Reactive notebooks for Rust, stored as plain `.rs` files.
axp	Open protocol that gives AI agents a sandbox to run code and tools.
cargo-reclaim	Background companion to `cargo clean` for large Rust projects.
ml-rust.github.io	Find the right Rust library or app for your machine learning job, by real downloads and activity.

How they fit

numr
├── solvr
└── boostr
    ├── blazr      inference
    ├── oxidizr    training
    ├── voxr       speech
    ├── vidr       video
    └── compressr  conversion

splintr, regexr    tokenization, used by boostr and blazr
containr           media containers, for vidr and voxr
rav1r              AV1 encoder, for vidr

Start

cargo install blazr --locked
blazr pull Qwen/Qwen2.5-0.5B
blazr list
blazr serve --model <name>

See the blazr README for models, formats, and the API.

Pinned Loading

numr

Public

A high-performance numerical computing library for Rust with GPU acceleration, inspired by Numpy

Rust 61 1

boostr

Public

ML primitives for you to build your own AI/ML framework. Built on numr.

Rust 20 2

splintr

Public

A high-performance tokenizer (BPE, WordPiece, SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.

Rust 63 6

regexr

Public

Regex engine specialized in tokenization and LLM text processing

Rust 28 1

venus

Public

Reactive notebook environment for Rust that uses standard .rs files. Features process isolation, hot reloading, and instant compilation via Cranelift.

Rust 50 4

treeboost

Public

High-performance Gradient Boosted Decision Tree engine for large-scale tabular data

Rust 9 3

GeezerVison

ml-rust

Projects

How they fit

Start

Pinned Loading

Repositories

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

People

Top languages

Uh oh!

Most used topics

Uh oh!