vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

raspberry-pi arduino esp8266 machine-learning deep-learning microcontrollers raspberrypi esp32 stm32 odroid arm64 stm32f4 sparkfun-products edge-devices onnx tinyml inference-framework nxp-cortex arduino-nano-33-ble-sense

• Updated Jul 22, 2025
• C++

深度学习系统笔记，包含深度学习数学基础知识、神经网络基础部件详解、深度学习炼丹策略、模型压缩算法详解。

python machine-learning deep-learning cpp cnn pytorch convolutional-neural-networks loss-functions activation-functions inference-framework

• Updated Aug 31, 2026
• Python

Running Microsoft's BitNet via Electron, React & Astro

electron benchmarking ai reactjs 1-bit bitnet perplexity inference-framework astrojs large-language-models llm 1-bit-quantization

• Updated Sep 26, 2025
• JavaScript

Qingnang Smart Diagnosis is an end-to-end AI healthcare framework with field-proven application capabilities, designed to provide efficient and intelligent solutions for the medical industry.

nlp medical inference-framework llm medical-ai-project deepseek

• Updated Jul 21, 2026
• Shell

使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和 https://github.com/zjhellofss/kuiperdatawhale 中的深度学习推理框架。

rust deep-neural-networks deep-learning inference-framework kuiperdatawhale kuiperinfer

• Updated Apr 9, 2024
• Rust

A lightweight, config-driven framework for unified vision-language model inference across local and cloud backends, built on LiteLLM and Transformers.

transformers gemini openai vlm huggingface inference-framework llm anthropic vision-language-model vllm ollama litellm multimodal-ai mlx-vlm multimodal-inference

• Updated Oct 5, 2026
• Python

This is the Framework used for developing ArmNN backend. It can compiled without error under armnn_21_05

inference-framework

• Updated Oct 21, 2021
• C++

DeepInfer: High-performance, large-scale inference framework for DeepSeek models

inference ascend inference-framework llm deepseek

• Updated Oct 23, 2026
• Python

DeepInfer 推理框架的 Iluvatar BI-V150 / CoreX 第三后端移植 — port of the DeepInfer inference framework as a third accelerator backend (DEEPINFER_ACCELERATOR=iluvatar)

gpgpu corex inference-framework deepseek iluvatar deepinfer bi-v150

• Updated Oct 30, 2026
• Python

cross-platform inference-framework llm-inference ollama local-deployment

• Updated Jul 10, 2025

A constructive framework that systematically integrates causal structures across domains, enabling adaptive reasoning, predictive modeling, and cross-contextual understanding in AI and data systems. 構成的因果統合理論は、因果構造を領域横断的に統合し、AIやデータシステムにおける適応的推論・予測モデリング・文脈横断的理解を可能にする枠組みです。

inference-framework causal-modeling ai-integration knowledge-systems constructive-theory adaptive-reasoning

• Updated Jun 23, 2025

deepinfer: high-performance, large-scale keyword engineering for deepseek models. nano, mini, awesome, everything, anything. implementation: todo.

awesome ai everything inference nano awesome-list anything parody mini inference-engine inference-framework readme-only large-language-models llm deepseek deepinfer

• Updated Oct 20, 2026

machine-learning inference-framework llama-cpp llm-inference

• Updated Jul 21, 2025