a self-hosted webui for 30+ generative ai

flux bark webui gradio whisper insightface huggingface kandinsky real-esrgan gfpgan stable-diffusion diffusers generative-ai controlnet audiocraft animatediff llama-cpp-python ip-adapter photomaker stable-diffusion-3-5

• Updated Nov 11, 2026
• Python

Setup and run a local LLM and Chatbot using consumer grade hardware.

chatbot artificial-intelligence openai rag large-language-models llm vllm retrieval-augmented-generation llama-cpp-python

• Updated Oct 25, 2026
• JavaScript

Gradio based tool to run opensource LLM models directly from Huggingface

python streaming opensource cpu chatbot cuda openai gradio huggingface model-conversion websockets-chat llm safetensors langchain llamacpp llm-inference ollama llama-cpp-python gguf

• Updated Jun 27, 2024
• Python

Pre-built wheels for llama-cpp-python across platforms and CUDA versions

windows machine-learning cuda ada prebuilt wheels ampere blackwell rtx3080 rtx3070 rtx3090 rtx3060 llm ada-architecture llama-cpp-python gguf python313 blackwell-gpu blackwell-architecture cuda13

• Updated Apr 18, 2026

Information on optimizing python libraries specifically for oobabooga to take advantage of Apple Silicon and Accelerate Framework.

macos journal numpy pytorch blas oobabooga llama-cpp-python

• Updated Feb 12, 2025
• Python

An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intelligent assistant for modern professionals.

docker cassandra docker-compose python3 gradio llama2 llama-cpp-python

• Updated Aug 1, 2024
• Python

Best Open-Source Math Olympiad Problem Generator 2026

python education ai math pyqt5 desktop-application sqlite3 trainer epsilon ome plotly-express mathematical-olympiads llama-cpp-python epsilon-ome-trainer

• Updated Nov 12, 2026
• HTML

Olympiad Problem Generator 2026: Create Infinite Spanish Math Olympiad-Style Challenges

python education ai math pyqt5 desktop-application sqlite3 trainer epsilon ome plotly-express mathematical-olympiads llama-cpp-python epsilon-ome-trainer

• Updated Nov 12, 2026
• HTML

GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).

machine-learning vulkan python-wrapper fastai amd-gpu intel-gpu llama-cpp gpu-inference llm-inference localllm local-ai open-source-llm llama-cpp-python gguf legacy-gpus

• Updated Oct 14, 2025
• Python

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

chatbot spacy ner llama-cpp langchain-python chromadb chainlit llama2 llama-cpp-python gguf

• Updated Oct 7, 2024
• Python

Notolog Markdown Editor

markdown text-to-speech qt markdown-editor python3 onnx on-device-ai ai-assistant pyside6 python-qt local-inference llama-cpp local-llm qwen llama-cpp-python gguf local-llms phi-4 privacy-first-ai nemo-speech

• Updated Nov 3, 2026
• Python

Local-first voice memory assistant — capture speech, transcribe live, and ask a private RAG chatbot grounded in what you've actually said. No cloud required.

open-source privacy accessibility voice speech-to-text whisper voice-assistant rag on-device-ai voice-assistants voice-assistant-ai llama-cpp local-llm llama-cpp-python voice-assistant-free rag-chatbot hearing-assistance

• Updated Sep 17, 2026
• Python

This repository is a CUA (computer use agent) system that, using the Qwen3-VL model on Ubuntu computers, aims to perform tasks on your behalf using the keyboard and mouse in a local Sandbox environment in GGUF format, based on the commands you provide.

linux agent docker ubuntu docker-container sandbox operating-system desktop-automation sandbox-playground agents locally tigervnc llamacpp llama-cpp-python llama-cpp-agent computer-use computer-use-agent qwen3-vl

• Updated Mar 3, 2026
• Python

Tool for test diferents large language models without code.

api-rest chat-application flask-api inference-api large-language-models llm local-inference llamacpp llm-inference llama2 llama-cpp-python llama2-7b mixtral-8x7b

• Updated Oct 18, 2025
• Python

Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and Gradio.

text-generation artificial-intelligence data-analysis feedback-loop windows-compatible ethical-ai large-language-models prompt-engineering llama-cpp local-ai llama-cpp-python open-source-ai prompt-chaining model-chaining gguf-models ai-interface democratizing-ai samantha-ai model-iteraction ai-experimentation

• Updated Oct 11, 2025
• Python

UnOfficial Gradio Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

python agent chatbot prompt coding code-generation llama agent-based-modeling gradio mistral gradio-interface llm llama-cpp llm-agent code-llms llama-cpp-python code-action mistral-7b mixtral code-act

• Updated Sep 30, 2024
• Jupyter Notebook

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

database inference python3 llama model-database hugginface llm llama2 llama-cpp-python

• Updated Jan 13, 2024
• Python

Multimodal prompt generator nodes for ComfyUI, designed to generate prompts for QwenImageEdit and Wan2.2. Supports local LLM / local GGUF models (Qwen2.5-VL, Qwen3-VL, Qwen3.5, Qwen3.6 and Qwen3.8) and Qwen API for image and video prompt generation and enhancement.

wan prompt-generator llm-tools qwen llama-cpp-python gguf comfyui-nodes comfy-ui vision-language-models comfyui-custom-node qwen-image-edit qwen3-vl comfyui-custom-nodes

• Updated Aug 22, 2026
• Python

A financial chatbot powered by an LLM and retrieval-augmented generation.

finance chatbot web-scraping finchat large-language-models llm llama-cpp llm-inference retrieval-augmented-generation llama-cpp-python

• Updated Oct 2, 2023
• Jupyter Notebook

Simple chat interface for local AI using llama-cpp-python and llama-cpp-agent

gui llm-inference llama-cpp-python llama-cpp-agent

• Updated Jul 27, 2024
• Python