A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology

linux libraries nvidia gpu-memory kernel-mode-driver gpudirect-rdma

• Updated Sep 15, 2026
• C

Thin, unified, C++-flavored wrappers for the CUDA APIs

gpu modern-cpp cuda gpgpu api-wrapper gpu-memory gpu-computing cuda-driver-api cuda-toolkit cuda-device cuda-runtime-api cuda-driver gpgpu-computing cuda-api-wrappers cuda-programming

• Updated Nov 9, 2026
• C++

Training neural networks in TensorFlow 2.0 with 5x less memory

python distributed-systems deep-learning compiler memory tensorflow gpu-memory tensorflow2

• Updated Feb 21, 2022
• Python

A Toolkit for Training, Tracking, Saving Models and Syncing Results

toolkit logger pytorch gpu-memory tensorboard

• Updated Mar 12, 2020
• Python

A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.

gpu-memory memory-management gpu-profiler cuda-programming gpu-memory-profiler

• Updated May 30, 2026
• Python

Windows utility focused on out of memory recovery, vram error, and local AI crash for local AI workflows.

windows gpu-memory recovery troubleshooting stability oom out-of-memory vram llm 2026 local-ai pc-ai

• Updated Oct 19, 2026
• CSS

Windows utility focused on vram optimization, llm memory usage, and gpu memory budget for local AI workflows.

windows performance amd optimization nvidia gpu-memory vram 2026 local-llm llm-tools local-ai pc-ai

• Updated Oct 19, 2026
• CSS

cuda gpu-memory gpu-acceleration cuda-kernels compression-schemes compression-algorithm compression-implementations

• Updated May 8, 2017
• C++

OpenCV & Spout C++ library. Shared GPU memory and processing at reach.

opencv library gpu spout gpu-memory opencv-cpp

• Updated May 1, 2020
• C++

Rust embedded things running on the seL4 microkernel for the Raspberry Pi 3

rust gpu graphics gpu-memory rpi3 aarch64 dma raspberry-pi-3 sel4 rust-embedded embedded-hal fel4 sel4-microkernel cargo-fel4

• Updated Dec 8, 2018
• Rust

A tiny, useful command-line tool to show each user gpu usage, pid under each gpu, provide more details than nvidia-smi/gpustat

gpu gpu-memory command-line-tool nvidia-smi monitoring-tool nvidia-gpu

• Updated Sep 21, 2019
• Shell

Python library for memory-constrained activation checkpoint optimization, recomputation scheduling, and GPU training performance analysis.

machine-learning deep-learning pytorch gpu-memory model-training gradient-checkpointing

• Updated Oct 25, 2026
• TypeScript

A simple tool to find out GPU VRAM requirements for running LLMs

gpu gpu-memory vram llm

• Updated Mar 23, 2026
• HTML

A CLI to plan, order and run multiple local AI services on NVIDIA GPUs, and catch memory problems before anything starts.

python docker cli gpu self-hosted orchestration nvidia gpu-memory nvidia-smi model-serving vram llm vllm llm-inference local-ai

• Updated Nov 4, 2026
• Python

A prefix-cache advisor for LLM serving infrastructure that recommends KV-cache capacity and eviction policies from your request traces/logs.

python gpu-memory inference-optimization kv-cache llm cache-eviction prefix-caching

• Updated Aug 7, 2026
• Python

Demonstration of generating mini-batches in Tensorlfow from GPU memory.

tensorflow gpu-memory mini-batch

• Updated Apr 20, 2017
• Python

Accurate VRAM calculator for Local LLMs (Llama 4, DeepSeek V3, Qwen 2.5). Calculates GGUF quantization, GQA context overhead, and offloading limits

gpu-memory llama llm-inference gguf deepseek llm-vram-calculator gpu-calculator local-llm-gguf

• Updated Nov 27, 2025
• HTML

V-native Vulkan memory allocator with budget-aware placement, block suballocation, upload rings and diagnostics.

gpu graphics vulkan gpu-memory memory-management v observability fragmentation allocators vlang memory-budget suballocator staging-buffer

• Updated Nov 11, 2026
• V

monitor gpu-memory nvidia-gpu gpu-usage

• Updated Jun 24, 2022
• C++

LLM GPU Toolkit: estimate VRAM, training/inference GPU needs, multi-GPU allocation, and quantization impact. 大模型 GPU 显存与算力估算。by jammyfu / PaintingCoder

python gpu inference gpu-memory quantization vram llm llm-training llm-inference vram-calculator

• Updated Nov 12, 2026
• TypeScript