RF-DETR C++ inference engine for object detection and instance segmentation with ONNX Runtime, TensorRT, Executorch and LiteRT support

object-detection tensorrt instance-segmentation litert onnxruntime cpp-inference executorch human-pose-keypoints rf-detr skeleton-keypoints

• Updated Nov 8, 2026
• C++

Tutorial that shows how to train a PyTorch model in Python and run it in C++

opencv deep-learning cpp cnn pytorch mnist image-classification digit-recognition model-deployment libtorch torchscript cpp-inference python-to-cpp

• Updated Jul 25, 2025
• Python

Real-time SAM2 segmentation on edge devices - 40x faster C++ inference with ONNX Runtime for iOS/Android deployment

computer-vision tensorrt embedded-ai edge-ai edge-deployment onnx-runtime cpp-inference zero-shot-segmentation ios-deployment sam2 arm-optimization lightweight-ai on-device-inference edgetam real-time-segmentation npu-acceleration mobile-segmentation picosam android-edge prompt-segmentation

• Updated Nov 14, 2025
• C++

Fruit classification tensorflow

cpp tensorflow optimization classification fruits sagemaker sagemaker-deployment tflite-conversion cpp-inference

• Updated Mar 4, 2021
• Jupyter Notebook

A lightweight CPU inference runtime implemented in C++20.

cpp inference transformer attention inference-engine cpp20 kv-cache cpp-inference qwen2 qwen2-5 cpp-infrastructure

• Updated Nov 9, 2026
• C++

MiniMind-Next: 全栈轻量级中文大模型实验平台 — 统一全阶段训练/对齐流水线、零依赖原生 C++ 推理引擎与中英双语文档

nlp reinforcement-learning deep-learning cpp pytorch transformer chinese-nlp lora ppo sft dpo cpp-inference llm grpo minimind

• Updated Aug 26, 2026
• Python