Machine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai

machine-learning deep-learning robotics artificial-intelligence textbook courseware computer-systems ai-agents edge-machine-learning machine-learning-systems mlsys tinyml embodied-ai cloud-ml embedded-ml agentic-ai mobile-ml physical-ai

• Updated Nov 12, 2026
• Python

Sub-50mb agentic, voice and vision intelligence for consumer devices.

cactus edge-ai on-device-ai tinyml llm foundation-model function-calling tool-calling

• Updated Nov 12, 2026
• Python

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

raspberry-pi machine-learning webassembly wasm llama whisper mistral onnx tinyml stable-diffusion yolov8

• Updated Jun 18, 2026
• C++

[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

acceleration nas automl edge-ai efficient-model tinyml

• Updated Dec 14, 2023
• Python

Z80-μLM is a 2-bit quantized language model small enough to run on an 8-bit Z80 processor. Train conversational models in Python, export them as CP/M .COM binaries, and chat with your vintage computer.

nlp machine-learning retro chatbot z80 code-golf retrocomputing quantization language-model cpm tinyml

• Updated Apr 29, 2026
• Python

A lightweight header-only library for using Keras (TensorFlow) models in C++.

python c-plus-plus machine-learning library deep-learning cpp tensorflow cpp14 keras prediction c-plus-plus-14 header-only convolutional-neural-networks keras-models edge-computing tinyml

• Updated Nov 5, 2026
• C++

The Fastest Deep Reinforcement Learning Library

reinforcement-learning deep-learning cpp robotics continuous-control mujoco tinyml tinyrl

• Updated Nov 9, 2026
• C++

This is a list of interesting papers and projects about TinyML.

machine-learning computer-vision embedded-systems neural-architecture-search tinyml wake-word

• Updated Dec 8, 2025

[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory

c microcontroller deep-learning cpp pytorch codegenerator quantization edge-computing neural-architecture-search tinyml

• Updated Nov 27, 2024
• C

Machine Learning inference engine for Microcontrollers and Embedded devices

python c classifier machine-learning microcontroller random-forest tensorflow scikit-learn sklearn keras inference embedded-systems neural-networks tinyml

• Updated Nov 10, 2026
• Python

[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning

deep-learning pytorch neural-architecture-search tinyml microncontroller

• Updated Mar 29, 2024
• Python

vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

raspberry-pi arduino esp8266 machine-learning deep-learning microcontrollers raspberrypi esp32 stm32 odroid arm64 stm32f4 sparkfun-products edge-devices onnx tinyml inference-framework nxp-cortex arduino-nano-33-ble-sense

• Updated Jul 22, 2025
• C++

Seeed SenseCraft Model Assistant is an open-source project focused on embedded AI. 🔥🔥🔥

raspberry-pi arduino deep-learning esp32 pytorch image-classification object-detection jetson ncnn onnx tflite tinyml yolov5 openmmlab

• Updated Sep 4, 2026
• Python

Zant simplifies the deployment and optimization of neural networks on microprocessors

opensource embedded ai zig deeplearning mcu tinyml edgeai

• Updated Jul 18, 2026
• Zig

Instructions, source code, and misc. resources needed for building a Tiny ML-powered artificial nose.

iot ai seeedstudio tinyml edge-impulse wioterminal

• Updated Jul 5, 2024
• C

Neural Networks with low bit weights on low end 32 bit microcontrollers such as the CH32V003 RISC-V Microcontroller and others

quantization tinyml ch32v003 ch32v003fun

• Updated Sep 13, 2026
• C

Notes on Machine Learning on edge for embedded/sensor/IoT uses

machine-learning microcontroller embedded-systems sensor-data sensor-network tinyml

• Updated Sep 24, 2026
• Jupyter Notebook

Code for MobiCom paper 'TinyML-CAM: 80 FPS Image Recognition in 1 Kb RAM'

c-plus-plus computer-vision embedded-systems arduino-library image-recognition iot-device embedded-c edge-computing edge-analytics esp32-cam tinyml edgeimpulse

• Updated Oct 18, 2022
• Jupyter Notebook

Whistle speech-to-text running fully on an ESP32-S3: hold a button, say a colour in one of 7 languages, the LED does it. No network.

esp32 speech-recognition speech-to-text whistle edge-ai inmp441 tinyml esp32-s3

• Updated Oct 21, 2026
• C

In this repository you will find TinyML course syllabi, assignments/labs, code walkthroughs, links to student projects, and lecture videos (where applicable).

education course tensorflow ml edx-course stem colab-notebook embedded-machine-learning tinyml tensorflow-lite-micro tinyml-edx

• Updated Nov 25, 2025