🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

audio python nlp machine-learning natural-language-processing deep-learning pytorch transformer speech-recognition glm pretrained-models hacktoberfest gemma vlm pytorch-transformers model-hub llm qwen deepseek

• Updated Nov 12, 2026
• Python

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

agent mcp vision vlm tars multimodal cowork computer-use mcp-server gui-agent browser-use gui-operator ui-tars agent-tars

• Updated Oct 9, 2026
• TypeScript

SGLang is a high-performance serving framework for large language models and multimodal models.

reinforcement-learning cuda inference transformer moe attention llama glm minimax wan diffusion vlm blackwell llm qwen deepseek gpt-oss qwen-image

• Updated Nov 12, 2026
• Python

https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

search agent ai memory vision vlm searchengine multimodal rag

• Updated Nov 11, 2026
• Python

Production ready toolkit to run AI locally

android kotlin swift ios react-native web cpp inference edge flutter websdk vlm multimodal diffusion-models on-device-ai voice-ai llm llamacpp ollama apple-intelligence

• Updated Nov 10, 2026
• C++

A collection of tutorials on state-of-the-art computer vision models and techniques. Explore everything from foundational architectures like ResNet to cutting-edge models like RF-DETR, YOLO11, SAM 3, and Qwen3-VL.

machine-learning tutorial deep-neural-networks computer-vision deep-learning pytorch image-classification object-detection image-segmentation vlm google-colab zero-shot-detection yolov5 zero-shot-classification yolov8 open-vocabulary-detection open-vocabulary-segmentation automatic-labeling-system qwen paligemma

• Updated Sep 22, 2026
• Jupyter Notebook

Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!

machine-learning data-mining awesome awesome-list outlier-detection unsupervised-learning fraud-detection time-series-analysis vlm anomaly-detection fraud outlier outlier-ensembles graph-neural-networks large-language-models llm vlms

• Updated Mar 2, 2026
• Python

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

reinforcement-learning inference pytorch llama lora gemma vlm synthetic-data fine-tuning sft dpo llm llms qwen llm-evaluation llm-as-a-judge agentic-ai tool-calling grpo gpt-oss

• Updated Nov 11, 2026
• Python

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

go sdk hexagon snapdragon qualcomm vlm on-device-ai llm local-ai llama3 qwen3 gpt-oss granite4 qwen3vl gemma4

• Updated Nov 12, 2026
• Go

The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.

vlm ernie llm erniekit ernie-45 ernie-45-vl

• Updated Jul 24, 2026
• Python

Reverse-engineer any video, shot by shot: filmed, AI-generated or coded, and how to remake it. Breakdowns in the open VIDEO.md format. 逆向一切视频，逐个镜头看是拍的、AI 生成的还是代码做的，再告诉你怎么复刻；拆解结果按 VIDEO.md 格式输出。

ffmpeg reverse-engineering subtitles video-editing codex vlm video-analysis short-video video-generation shot-detection remotion prompt-engineering ai-video aigc-detection agent-skills claude-code video-breakdown videomd

• Updated Nov 12, 2026
• Python

Solve Visual Understanding with Reinforced VLMs

reinforcement-learning vlm multimodal llm qwen deepseek-r1 grpo r1-zero vlm-r1 multimodal-r1

• Updated Jul 7, 2026
• Python

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

flask demo ui mcp openai easy gpt embedding vlm multimodal rag sentence-transformers huggingface-transformers llm vllm qwen deepseek

• Updated Nov 12, 2026
• Python

🌟100+ 原创 LLM / RL 原理图📚，《大模型算法》作者巨献！💥（100+ LLM/RL Algorithm Maps ）

machine-learning natural-language-processing algorithm reinforcement-learning ai deep-learning transformers nlp-machine-learning vlm llm

• Updated Sep 10, 2026
• Python

StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture, StarVector processes both visual and textual inputs to produce high-quality SVG code with remarkable precision.

svg vlm llm multimodal-large-language-models

• Updated Nov 7, 2025
• Python

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

benchmark evaluation agi video-understanding vlm multimodal large-language-models vision-language-model llm-evaluation audio-evaluation multimodal-evaluation

• Updated Nov 11, 2026
• Python

[CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.

prompt image-editing text-to-image image-to-image vlm prompt-engineering hunyuan prompt-enhancer hunyuan-image

• Updated Aug 18, 2026
• Python

An open-source document parsing model with SOTA accuracy and speed, using an RSI loop during post-training.

agent ocr rsi vlm oxr llm-tools vlm-ocr

• Updated Nov 6, 2026
• Python

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

performance evaluation vlm rag llm

• Updated Nov 12, 2026
• Python

The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention

vlm large-language-models llm llms vision-language-model minimax-text-01 minimax-vl-01

• Updated Jul 7, 2025
• Python