GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — Build software better, together

#

multi-modal-learning

Star

Here are 161 public repositories matching this topic...

Language: All
Filter by language
All 161 Python 109 Jupyter Notebook 36 HTML 2 JavaScript 2 C++ 1 PHP 1 TypeScript 1
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

mlfoundations / open_clip

Star 14.3k

An open source implementation of CLIP.

computer-vision deep-learning pytorch pretrained-models language-model contrastive-loss multi-modal-learning zero-shot-classification
  • Updated Nov 10, 2026
  • Python

OFA-Sys / Chinese-CLIP

Star 6k

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

nlp computer-vision deep-learning transformers pytorch chinese pretrained-models multi-modal clip coreml-models contrastive-loss vision-language multi-modal-learning image-text-retrieval vision-and-language-pre-training
  • Updated Mar 31, 2026
  • Jupyter Notebook

lyuchenyang / Macaw-LLM

Star 1.6k

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

machine-learning natural-language-processing deep-learning neural-networks language-model multi-modal-learning
  • Updated Jan 1, 2025
  • Python

NVlabs / prismer

Star 1.3k

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

vqa image-captioning language-model multi-task-learning vision-and-language multi-modal-learning vision-language-model
  • Updated Jan 17, 2024
  • Python

lucidrains / x-clip

Star 726

A concise but complete implementation of CLIP with various experimental improvements from recent papers

deep-learning artificial-intelligence zero-shot-learning multi-modal-learning contrastive-learning
  • Updated Nov 3, 2026
  • Python

InternRobotics / EmbodiedScan

Star 679

[CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

computer-vision robotics 3d-vision multi-modal-learning
  • Updated Jun 13, 2025
  • Python

jokieleung / awesome-visual-question-answering

Star 674

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

vqa awesome-list multi-modal multi-modal-learning attention-networks
  • Updated Jul 6, 2023

zjukg / KG-MM-Survey

Star 508

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

information-extraction survey knowledge-graph awsome image-classification image-generation surveys entity-linking knowledge-graph-embeddings visual-question-answering entity-alignment paper-list awsome-list cross-modal-retrieval multi-modal-learning multi-modal-fusion large-language-models multi-modal-knowledge-graph
  • Updated Mar 2, 2026

DmitryRyumin / CVPR-2023-24-Papers

Star 453

CVPR 2023-2024 Papers: Dive into advanced research presented at the leading computer vision conference. Keep up to date with the latest developments in computer vision and deep learning. Code included. ⭐ support visual intelligence development!

computer-vision deep-learning biometrics segmentation face-recognition pattern-recognition datasets autonomous-driving cvpr action-recognition gesture-recognition medical-image-processing shape-analysis image-synthesis self-supervised-learning scene-analysis multi-modal-learning video-synthesis cvpr2023 cvpr2024
  • Updated Jul 15, 2024
  • Python

zhengli97 / PromptKD

Star 348

[CVPR 2024] Official PyTorch Code for "PromptKD: Unsupervised Prompt Distillation for Vision-Language Models"

clip knowledge-distillation multi-modal-learning prompt-learning vision-language-model cvpr2024
  • Updated Dec 14, 2025
  • Python

Ysz2022 / NeRCo

Star 265

[ICCV 2023] Implicit Neural Representation for Cooperative Low-light Image Enhancement

iccv low-light-image multi-modal-learning low-light-image-enhancement neural-representation iccv2023
  • Updated Mar 18, 2024
  • Python

moabarar / nemar

Star 192

[CVPR2020] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation

deep-learning cnn pytorch multi-modal image-registration affine-transformation stn image-to-image-translation multimodal deformable-transformation multi-modal-learning cvpr2020 registartion multimodal-image-registration
  • Updated Aug 2, 2020
  • Python

huggingface / chug

Star 162

Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.

computer-vision pdf-document datasets distributed-training dataloading document-understanding multi-modal-learning webdataset
  • Updated Apr 3, 2024
  • Python

qizekun / ReCon

Star 158

[ICML 2023] Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining

representation-learning 3d-point-clouds self-supervised-learning multi-modal-learning
  • Updated Jul 21, 2024
  • Python

wjun0830 / CGDETR

Star 156

Official pytorch repository for CG-DETR "Correlation-guided Query-Dependency Calibration in Video Representation Learning for Temporal Grounding"

computer-vision video-summarization pytorch video-understanding video-grounding multi-modal-learning detr moment-retrieval highlight-detection detection-transformer temporal-grounding text-video-retrieval
  • Updated Aug 21, 2024
  • Python

ExplainableML / flair

Star 150

[CVPR 2025] FLAIR: VLM with Fine-grained Language-informed Image Representations

clip multi-modal-learning contrastive-learning vision-language-model
  • Updated Mar 12, 2026
  • Python

kkakkkka / ETRIS

Star 150

[ICCV-2023] The code of Bridging Vision and Language Encoders: Parameter-Efficient Tuning for Referring Image Segmentation

deep-neural-networks deep-learning machine-learning-algorithms segmentation referring-image-segmentation multi-modal-learning multi-modal-fusion
  • Updated Oct 10, 2026
  • Python

shikras / d-cube

Star 138

A detection/segmentation dataset with labels characterized by intricate and flexible expressions. "Described Object Detection: Liberating Object Detection with Flexible Expressions" (NeurIPS 2023).

dataset object-detection vision-language multi-modal-learning referring-expression-comprehension open-vocabulary-detection
  • Updated Mar 20, 2024
  • Python

GuanRunwei / Achelous

Star 138

The official repository of Achelous and Achelous++

object-detection object-tracking semantic-segmentation multi-task-learning point-cloud-segmentation multi-modal-learning multi-modal-fusion panoptic-perception 4d-mmwave-radar
  • Updated Jul 8, 2024
  • Python

zhengli97 / ATPrompt

Star 135

Official PyTorch Code for Anchor Token Guided Prompt Learning Methods: [ICCV 2025] ATPrompt and [Arxiv 2511.21188] AnchorOPT

image-classification multi-modal-learning zero-shot-classification prompt-learning
  • Updated Jan 28, 2026
  • Python

Add this topic to your repo

To associate your repository with the multi-modal-learning topic, visit your repo's landing page and select "manage topics."

Learn more

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.