Distribute and run LLMs with a single file.
-
Updated
Nov 9, 2026 - C++
GeezerVisonThe World Wide Web, restored to 800 pixels of glory. |
| Home|About|Gaming cabinet|Archives|How it works|Starter sites |
GeezerVison is showing github.com — Build software better, together
#
llama-cppHere are 5,578 public repositories matching this topic...Language: All
Filter by language
Sort: Most stars
Sort options
Distribute and run LLMs with a single file.
cross-platform speech-to-text local-inference llama-cpp local-llm local-ai gguf open-source-ai single-file-executable
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
multilingual pytorch audio-analysis speech-recognition speech-to-text cantonese transcription asr emotion-detection cross-lingual language-identification speech-emotion-recognition voice-ai llama-cpp funasr sensevoice audio-event-detection multilingual-asr speech-understanding whisper-alternative
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
machine-learning transformers inference pytorch artificial-intelligence glm whisper gemma mlx kimi openai-api llm diffusers llamacpp llama-cpp vllm qwen sglang kimi-k3 glm-5-3
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
docker text-to-speech amd self-hosted nvidia speech-to-text workflow-automation ai-agents rag n8n llm llama-cpp comfyui local-ai open-webui strix-halo
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
windows macos linux swift embeddings semantic-search file-search tauri on-device multimodal menubar-app local-first llama-cpp embeddinggemma
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
nodejs cli typescript mcp tui openai agents browser-automation local-first playwright ai-agent llm llama-cpp local-llm gguf gbnf local-ai-agent openclaw hermes-agent
Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.
macos mlx on-device-ai ai-privacy apple-silicon anthropic llama-cpp local-llm local-ai qwen offline-ai private-ai claude-code claude-code-alternative claude-code-local claude-rate-limit qwen4 claude-code-usage-limit claude-code-offline qwen-4
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
android macos ios react-native mcp privacy-first edge-ai ondevice mobile-ai whisper-cpp vision-language-model llama-cpp local-ai offline-llm gguf stable-diffusion-android offline-ai whisper-android tool-calling ondevice-ai
Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.
python raspberry-pi machine-learning ai computer-vision deep-learning camera cctv face-recognition home-assistant video-surveillance object-detection security-camera vlm home-security ai-camera llm llama-cpp local-ai ai-nvr
LLM speculative inference server for heterogeneous hardware & consumer GPUs
spark kernel cuda cuda-kernels rocm heterogeneous-computing luce poolside rtx3090 llama-cpp local-ai qwen speculative-decoding strix-halo dflash megakernel speculative-prefill pflash r9700
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
android facebook chatbot openai llama mistral claude chatgpt anthropic llama-cpp ollama gguf mobile-artificial-intelligence deepseek
A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
python self-hosted agents llm llama-cpp function-calling ollama llamafile agentic-workflow agentic-ai tool-calling
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
nodejs cmake ai metal json-schema gpu vulkan grammar cuda self-hosted bindings llama embedding cmake-js prebuilt-binaries llm llama-cpp catai function-calling gguf
The agent that monitors anything for you. Open-source, running completely locally.
agent privacy agents ai-agents agent-framework ai-agent llama-cpp local-llm ollama transformers-js agentic-ai screen-monitoring
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
decision-making inference calibration classification agents reasoning mlx llm llama-cpp vllm gguf open-weights
Add this topic to your repoTo associate your repository with the llama-cpp topic, visit your repo's landing page and select "manage topics." |
| You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. |