GeezerVison is showing developer.nvidia.com — cuSPARSE

cuSPARSE

GPU library APIs for sparse computation.
cuSPARSE host APIs provide GPU accelerated basic linear algebra routines, and cuSPARSELt host APIs provide structured sparsity support that leverages sparse tensor cores for GEMM. Sparsity is widely applicable in machine learning, AI, computational fluid dynamics, seismic exploration and computational sciences.

cuSPARSE Host API

Download Documentation

The cuSPARSE APIs provides GPU-accelerated basic linear algebra subroutines for sparse matrix computations for unstructured sparsity. cuSPARSE is widely used by engineers and scientists working on applications in machine learning, AI, computational fluid dynamics, seismic exploration, and computational sciences.

cuSPARSE is included in both the NVIDIA HPC SDK and the CUDA Toolkit.

cuSPARSELt Host API

Download Documentation

cuSPARSELt APIs offer 2:4 structured sparsity support via Sparse Tensor Core in Ampere and later architectures for GEneral Matrix Multiplications (GEMMs). cuSPARSELt APIs provide options for pruning and compression of sparse matrices, Activation functions, bias vectors, and output scaling for AI and deep learning use cases.

cuSPARSE Performance

The cuSPARSE library is highly optimized for performance on NVIDIA GPUs, with SpMM performance 30-150X faster than CPU-only alternatives.

cuSPARSE Key Features

Support for dense, COO, CSR, CSC, and Blocked CSR sparse matrix formats
Full suite of sparse routines covering sparse vector x dense vector operations, sparse matrix x dense vector operations, and sparse matrix x dense matrix operations.
Routines for sparse matrix x sparse matrix addition and multiplication
Generic high-performance APIs for sparse-dense vector multiplication (SpVV), sparse matrix-dense vector multiplication (SpMV), and sparse matrix-dense matrix multiplication (SpMM)
ILU0 and IC0 preconditioners

Resources

Documentation:

Samples:

Forums

Feedback