Janus-Series: Unified Multimodal Understanding and Generation Models
-
Updated
Feb 1, 2025 - Python
#
vision-language-pretraining
Here are 40 public repositories matching this topic...
LAVIS - A One-stop Library for Language-Vision Intelligence
deep-learning salesforce image-captioning deep-learning-library vision-framework vision-and-language multimodal-deep-learning multimodal-datasets vision-language-transformer vision-language-pretraining visual-question-anwsering
-
Updated
Nov 18, 2024 - Jupyter Notebook
DeepSeek-VL: Towards Real-World Vision-Language Understanding
-
Updated
Apr 24, 2024 - Python
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
llama large-language-models video-language-pretraining vision-language-pretraining cross-modal-pretraining blip2 minigpt4 multi-modal-chatgpt
-
Updated
Jun 4, 2024 - Python
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
chatbot llama clip mulit-modal vision-language vicuna gpt-4 vision-language-pretraining llava video-chatboat video-conversation
-
Updated
Aug 5, 2025 - Python
Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
-
Updated
Sep 19, 2022 - Python
[TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
vision-language-pretraining audio-language-pretraining audiovisual-language-pretraining multimodal-representation-learning
-
Updated
Dec 25, 2024 - Python
Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
chatbot clip image-encoder video-encoder multimodal dual-encoder vision-language vicuna gpt4 vision-language-pretraining llava video-conversation video-chatbot llama3 gpt4o phi-3-mini
-
Updated
Aug 5, 2025 - Python
[CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》
-
Updated
Jun 7, 2023 - Python
[MedIA'25] FLAIR: A Foundation LAnguage-Image model of the Retina for fundus image understanding.
-
Updated
Jun 20, 2025 - Python
Recognize Any Regions
open-world object-detection zero-shot instance-segmentation auto-labeling vision-language-pretraining open-vocabulary vision-language-model multimodal-representation-learning vision-foundation-model vision-language-foundation-model
-
Updated
Dec 18, 2024 - Python
✨✨Official implementation of BridgeVLA
-
Updated
Jun 30, 2025 - Python
Official repository for "CLIP model is an Efficient Continual Learner".
-
Updated
Dec 13, 2022 - Python
PyTorch implementation of ICML 2023 paper "SegCLIP: Patch Aggregation with Learnable Centers for Open-Vocabulary Semantic Segmentation"
transfer-learning semantic-segmentation contrastive-learning zero-shot-semantic-segmentation vision-language-pretraining open-vocabulary open-vocabulary-semantic-segmentation
-
Updated
Jun 28, 2023 - Python
Multi-Aspect Vision Language Pretraining - CVPR2024
zero-shot-classification vision-language-pretraining vision-language-model zero-shot-segmentation medical-vision-and-language-pretraining
-
Updated
Aug 20, 2024 - Python
This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl.acm.org/doi/abs/10.1145/3617833 .
cross-modal multimodal-deep-learning multimodal-datasets transformer-models multimodal-pre-trained-model vision-language-pretraining multimodal-applications multimodal-pretext
-
Updated
Jun 16, 2025
Uni-CoT: Towards Unified Chain-of-Thought Reasoning Across Text and Vision
computer-vision deep-learning artificial-intelligence cot multimodal unified-model any-to-any llm vision-language-pretraining chain-of-thought chain-of-thought-reasoning uni-cot unicot
-
Updated
Aug 4, 2025 - Python
Set-level Guidance Attack: Boosting Adversarial Transferability of Vision-Language Pre-training Models. [ICCV 2023 Oral]
-
Updated
Sep 6, 2023 - Python
📍 Official pytorch implementation of paper "ProtoCLIP: Prototypical Contrastive Language Image Pretraining" (IEEE TNNLS)
-
Updated
Nov 8, 2023 - Python
[ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
-
Updated
Dec 25, 2024 - Python
Improve this page
Add a description, image, and links to the vision-language-pretraining topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the vision-language-pretraining topic, visit your repo's landing page and select "manage topics."