GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — Build software better, together

#

inference-api

Star

Here are 157 public repositories matching this topic...

Language: All
Filter by language
All 157 Python 87 Go 11 Jupyter Notebook 9 JavaScript 8 TypeScript 7 Rust 4 C++ 3 C# 2 Dart 2 Java 2
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
inference

roboflow / inference

Star 2.5k

Turn any computer or edge device into a command center for your computer vision projects.

python docker machine-learning computer-vision deployment inference classification object-detection vit agents inference-server jetson tensorrt instance-segmentation onnx inference-api yolov5 yolov8 yolo11 yolov12
  • Updated Nov 12, 2026
  • Python

qualcomm / ai-hub-models

Star 1.3k

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

machine-learning inference pytorch machinelearning deeplearning demos inference-engine onnx tensorflow-lite qnn inference-api
  • Updated Nov 12, 2026
  • Python
truss

basetenlabs / truss

Star 1.2k

The simplest way to serve AI/ML models in production

open-source machine-learning packaging artificial-intelligence falcon easy-to-use whisper inference-server model-serving inference-api stable-diffusion wizardlm
  • Updated Nov 12, 2026
  • Python

qualcomm / ai-hub-apps

Star 480

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

machine-learning inference pytorch machinelearning deeplearning demos inference-engine onnx tensorflow-lite qnn inference-api
  • Updated Nov 12, 2026
  • Python

inference-gateway / inference-gateway

Sponsor
Star 212

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

api kubernetes golang performance opensource proxy mcp gateway proxy-server self-hosted tracing agnostic openai gateway-api opentelemetry inference-api opensource-projects llm anthropic deepseek-v4-pro
  • Updated Nov 11, 2026
  • Go

Michael-OvO / Yolov7-Flask

Star 199

A Beautiful Flask Web API for Yolov7 (and custom) models

python flask pytorch object-detection flask-web pretrained-weights model-deployment torchhub inference-api yolov7
  • Updated Sep 20, 2022
  • Python
deep-learning-training-gui

mustafamerttunali / deep-learning-training-gui

Star 150

Train and predict your model on pre-trained deep learning models through the GUI (web app). No more many parameters, no more data preprocessing.

python api flask gui computer-vision deep-learning tensorflow image-classification tensorboard tensorflow-training mobilenetv2 inference-api tensorflow-predict
  • Updated Mar 24, 2024
  • Python

pszemraj / textsum

Star 134

CLI & Python API to easily summarize text-based files with transformers

pipeline text transformers inference transformer summarization summary batch-processing inference-api text-to-text-transformer
  • Updated Nov 7, 2025
  • Python

YoannDev90 / awesome-free-ai-api

Sponsor
Star 131

A list of 75 APIs providing AI models, free of charge, no credit card needed. Regular updates.

free awesome-list free-api inference-api ai-models ai-providers
  • Updated Nov 11, 2026
  • Python

BMW-InnovationLab / BMW-Classification-Training-GUI

Star 71

This repository allows you to get started with training a State-of-the-art Deep Learning model with little to no configuration needed! You provide your labeled dataset and you can start the training right away. You can even test your model with our built-in Inference REST API. Training classification models with GluonCV has never been so easy.

training computer-vision deep-learning classification gluoncv inference-api
  • Updated May 11, 2022
  • Python

intelligencedev / eternal

Star 70

Eternal is an experimental platform for machine learning models and workflows.

go ai ml inference-api htmx gpt-4 stable-diffusion llamacpp comfyui claude-ai gemini-pro
  • Updated Mar 9, 2025
  • Go

hupe1980 / go-huggingface

Star 58

🤗 Hugging Face Inference Client written in Go

golang huggingface inference-api
  • Updated Jan 7, 2024
  • Go

BMW-InnovationLab / BMW-Classification-Inference-GPU-CPU

Star 47

This is a repository for an image classification inference API using the Gluoncv framework. The inference REST API works on CPU/GPU. It's supported on Windows and Linux Operating systems. Models trained using our Gluoncv Classification training repository can be deployed in this API. Several models can be loaded and used at the same time.

computer-vision deep-learning inference classification gluoncv inference-api
  • Updated May 4, 2022
  • Python

TommyLemon / CVAuto

Star 44

👁 零代码零标注 CV AI 自动化测试工具 🚀 免除大量人工画框和打标签等,直接零代码快速自动化测试 CV 计算机视觉 AI 人工智能图像识别算法:行人检测、动植物分类、人脸识别、OCR 车牌识别、旋转校正、舞蹈姿态、抠图分割 等,还可一键 下载测试报告、导出训练和测试数据集

ocr ai computer-vision detection cv test-automation yolo classification segmentation face-recognition rotation cv2 inference-server pose-estimation apijson inference-api ultralytics ai-testing yolo11 ultralytics-yolo
  • Updated Oct 7, 2026
  • JavaScript

RightNow-AI / TIDE

Sponsor
Star 34

Dynamic per-token early exit for LLM inference. Skip layers tokens don't need

optimization inference transformer inference-engine early-exit inference-api llm
  • Updated Sep 18, 2026
  • Python

Prismadic / magnet

Star 33

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

distributed-systems distributed-computing nats embeddings gemini nats-streaming mistral mlx nats-messaging claude fine-tuning sentence-splitting huggingface milvus inference-api apple-silicon tokenizers langchain llm-training finetuning-llms
  • Updated Oct 19, 2024
  • Python

stephanj / Llama3JavaChatCompletionService

Star 28

Llama3.java Inference engine with OpenAI Chat Completion REST API/

java inference-api openai-api llama3
  • Updated Feb 3, 2025
  • Java

CoreyLeath-code / Facial-Emotion-Recognition-System

Star 27

PyTorch/FastAPI facial-expression classification research scaffold with reproducible evaluation contracts, CI/security automation, versioned releases, and explicit TBD model-quality metrics.

testing documentation monitoring computer-vision deployment logging ci-cd deeplearning data-preparation governance augmentation containerization modular-architecture inference-api
  • Updated Nov 11, 2026
  • Python

TimMikeladze / huggingface

Sponsor
Star 27

Typescript wrapper for the Hugging Face Inference API.

typescript inference huggingface inference-api hugging-face
  • Updated Mar 2, 2023
  • TypeScript

OBA-Research / VAAS

Star 27

VAAS is an inference-first, research-driven library for image integrity analysis. It integrates Vision Transformer Attention Mechanisms with patch-level self-consistency analysis to enable fine-grained localization and detection of visual inconsistencies across diverse image analysis tasks.

visualization research computer-vision deep-learning pytorch segmentation image-forensics hybrid-model anomaly-detection attention-mechanisms explainable-ai huggingface inference-api vision-transformers
  • Updated Mar 30, 2026
  • Python

Add this topic to your repo

To associate your repository with the inference-api topic, visit your repo's landing page and select "manage topics."

Learn more

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.