GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — Build software better, together

#

multi-modality

Star

Here are 106 public repositories matching this topic...

Language: All
Filter by language
All 106 Python 80 Jupyter Notebook 12 C++ 3 JavaScript 1 MATLAB 1 TeX 1 TypeScript 1
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

haotian-liu / LLaVA

Star 25.1k

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

chatbot llama multimodal multi-modality gpt-4 foundation-models visual-language-learning chatgpt instruction-tuning vision-language-model llava llama2 llama-2
  • Updated Aug 12, 2024
  • Python

BradyFU / Awesome-Multimodal-Large-Language-Models

Star 18.1k

✨✨Latest Advances on Multimodal Large Language Models

multi-modality instruction-following in-context-learning large-language-models chain-of-thought instruction-tuning visual-instruction-tuning large-vision-language-model multimodal-instruction-tuning large-vision-language-models multimodal-large-language-models multimodal-in-context-learning multimodal-chain-of-thought
  • Updated Oct 29, 2026
clip-as-service

jina-ai / clip-as-service

Star 12.8k

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

deep-learning pytorch openai bert sentence2vec onnx cross-modality multi-modality image2vec sentence-encoding bert-as-service cross-modal-retrieval neural-search clip-model clip-as-service
  • Updated Jan 23, 2024
  • Python

OpenMOSS / MOSS-TTS-Nano

Star 4.7k

A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation

multilingual text-to-speech realtime tts speech-synthesis english chinese streaming-audio onnx voice-cloning multi-modality cpu-inference voice-clone audio-tokenizer
  • Updated Sep 6, 2026
  • Python

lucidrains / deep-daze

Star 4.3k

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

deep-learning transformers artificial-intelligence siren text-to-image multi-modality implicit-neural-representation
  • Updated Mar 13, 2022
  • Python
Otter

EvolvingLMMs-Lab / Otter

Star 3.4k

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

machine-learning deep-learning multi-modality artificial-inteligence embodied-ai gpt-4 foundation-models large-scale-models visual-language-learning chatgpt instruction-tuning
  • Updated Mar 5, 2024
  • Python

InternLM / InternLM-XComposer

Star 2.9k

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

foundation gpt language-model multimodal multi-modality vision-transformer gpt-4 visual-language-learning llm chatgpt instruction-tuning large-language-model supervised-finetuning mllm vision-language-model large-vision-language-model
  • Updated May 26, 2025
  • Python

DLR-RM / 3DObjectTracking

Star 1.1k

Algorithms and Publications on 3D Object Tracking

tracking real-time computer-vision paper object-tracking rgbd pose-estimation ijcv multi-modality articulated tpami multi-body accv2020 cvpr2022 iros2023
  • Updated Aug 25, 2025
  • C++

OpenBMB / VisRAG

Star 990

Parsing-free RAG supported by VLMs

retrieval multi-modal document-retrieval rag multi-modality document-understanding vision-language-model retrieval-augmented-generation
  • Updated Nov 2, 2026
  • Python

NVlabs / Long-RL

Star 730

Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)

reinforcement-learning multi-modality long-sequence large-language-models sequence-parallelism efficient-ai
  • Updated Sep 24, 2025
  • Python

LSXI7 / MINIMA

Star 691

[CVPR 2025] MINIMA: Modality Invariant Image Matching

image-matching multi-modality cvpr2025
  • Updated Oct 9, 2025
  • Python

OpenGVLab / Multi-Modality-Arena

Star 566

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

chat chatbot vqa gradio multi-modality large-language-models llms chatgpt vision-language-model
  • Updated Apr 21, 2024
  • Python

kyegomez / Gemini

Sponsor
Star 467

The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google

machine-learning ai ml artificial-intelligence gemini multi-modality gpt4 multimodla
  • Updated Oct 13, 2026
  • Python

JIA-Lab-research / VisionZip

Star 464

Official repository for VisionZip (CVPR 2025)

efficiency multi-modality vision-language-model vlms
  • Updated Jul 21, 2025
  • Python

researchmm / MM-Diffusion

Star 455

[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

video-generation multi-modality diffusion-models content-creation audio-generation
  • Updated Jun 5, 2024
  • Python

ziqihuangg / Collaborative-Diffusion

Star 444

[CVPR 2023] Collaborative Diffusion

image-editing image-generation face-generation multi-modality face-editing diffusion-models aigc stable-diffusion latent-diffusion-models gen-ai
  • Updated Oct 7, 2025
  • Python

xiaoachen98 / Open-LLaVA-NeXT

Star 438

An open-source implementation for training LLaVA-NeXT.

chatbot llama multimodal multi-modality gpt-4 visual-language-learning chatgpt vision-language-model llava large-multimodal-models llama3 gpt4o llava-next
  • Updated Oct 23, 2024
  • Python

yuanze-lin / Olympus

Star 427

[CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"

chatbot pytorch deeplearning multimodal multi-modality foundation-models llms chatgpt instruction-tuning vision-language-model llava mllms
  • Updated Aug 5, 2026
  • Python

kyegomez / Sophia

Sponsor
Star 384

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

deep-learning neural-network optimizer artificial-intelligence multi-modality chatgpt
  • Updated Jun 4, 2024
  • Python

RLHF-V / RLHF-V

Star 311

[CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback

chatbot llama multimodal multi-modality gpt-4 visual-language-learning rlhf-v
  • Updated Sep 11, 2024
  • Python

Add this topic to your repo

To associate your repository with the multi-modality topic, visit your repo's landing page and select "manage topics."

Learn more

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.