#

multimodal-datasets

Here are 22 public repositories matching this topic...

salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

deep-learning salesforce image-captioning deep-learning-library vision-framework vision-and-language multimodal-deep-learning multimodal-datasets vision-language-transformer vision-language-pretraining visual-question-anwsering

Updated Nov 18, 2024
Jupyter Notebook

remyxai / VQASynth

Compose multimodal datasets 🎹

dataset-generation spatial-reasoning synthetic-dataset-generation multimodal-deep-learning multimodal-datasets scene-reconstruction

Updated Jul 25, 2025
Python

drmuskangarg / Multimodal-datasets

This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and Frontiers". As a part of this release we share the information about recent multimodal datasets which are available for research purposes. We found that although 100+ multimodal language resources are available…

multimodal-datasets

Updated Jan 10, 2022

AnkurDeria / MFT

Pytorch implementation of Multimodal Fusion Transformer for Remote Sensing Image Classification.

deep-learning remote-sensing hyperspectral-image-classification multimodal-deep-learning multimodal-datasets transformer-models hsi-classification

Updated Dec 23, 2023
Jupyter Notebook

wisdomikezogwo / quilt1m

[NeurIPS 2023 Oral] Quilt-1M: One Million Image-Text Pairs for Histopathology.

vlm medical-dataset multimodal-datasets histopathology clip-model

Updated Jan 18, 2024
Python

yuanxiaosc / Multimodal-short-video-dataset-and-baseline-classification-model

500,000 multimodal short video data and baseline models. 50万条多模态短视频数据集和基线模型（TensorFlow2.0）。

tensorflow-models classification-model multimodal-datasets video-dataset

Updated Jul 23, 2019
Jupyter Notebook

marslanm / Multimodality-Representation-Learning

This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl.acm.org/doi/abs/10.1145/3617833 .

cross-modal multimodal-deep-learning multimodal-datasets transformer-models multimodal-pre-trained-model vision-language-pretraining multimodal-applications multimodal-pretext

Updated Jun 16, 2025

roboflow / rf100-vl

Code from the paper "Roboflow100-VL: A Multi-Domain Object Detection Benchmark for Vision-Language Models"

computer-vision object-detection rf100 multimodal-datasets object-detection-benchmarks

Updated Jun 2, 2025
Python

piresramon / gpt-4-enem

Code and data to evaluate LLMs on the ENEM, the main standardized Brazilian university admission exams.

artificial-intelligence multimodal-datasets llms llm-inference

Updated Dec 6, 2024
Python

Yuco-Z / Awesome-Multi-Modal-Dialog

[Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics

dialogue awesome-list multimodal-learning multimodal multimodal-deep-learning multimodal-datasets paperlist dialogue-system multimodal-dialogue

Updated Jan 22, 2025

JunweiLiang / FVTA_MemexQA

Real-world photo sequence question answering system (MemexQA). CVPR'18 and TPAMI'19

visual-question-answering vision-and-language multimodal-deep-learning multimodal-datasets multimodal-representation memex-question-answering memexqa-dataset

Updated Jul 1, 2019
Python

ddw2AIGROUP2CQUPT / Large-Scale-Multimodal-Face-Datasets

Millions-Level Face/Human-Scene Image-Text Datasets

multimodal-datasets face-datasets human-datasets

Updated Jun 9, 2025

OlehOnyshchak / pyWikiMM

Collects a multimodal dataset of Wikipedia articles and their images

Updated Mar 25, 2023
Python

deepmancer / vlm-toolbox

Vision-Language Models Toolbox: Your all-in-one solution for multimodal research and experimentation

deep-learning transformers pytorch deep-learning-library clip multi-granularity-dataset vision-framework multimodal-learning vision-and-language multimodal-deep-learning multimodal-datasets hierarchical-classification zero-shot-classification vision-language-transformer prompt-tuning soft-prompt-tuning

Updated Feb 16, 2025
Jupyter Notebook

lujiaying / MUG-Bench

Data and code of the Findings of EMNLP'23 paper MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fields

multimodal-learning multimodal-datasets

Updated Dec 18, 2023
Python

pspdada / SENTINEL

[ICCV 2025] Official repository of "Mitigating Object Hallucinations via Sentence-Level Early Intervention".

image-captioning multimodal-datasets multimodal-large-language-models preference-alignment iccv2025

Updated Jul 30, 2025
Python

NUSTM / EMDRC

Towards Explainable Multimodal Depression Recognition for Clinical Interviews

dataset datasets depression mental-health affective-computing multimodal-datasets depression-analysis depression-detection

Updated Jan 28, 2025

gcunhase / AnnotatedMV-PreProcessing

Pre-Processing of Annotated Music Video Corpora (COGNIMUSE and DEAP)

multimodal-datasets cognimuse

Updated Mar 1, 2021
Python

OlehOnyshchak / WikiImageRecommendation

Image Recommendation for Wikipedia Articles

image wikipedia text wikipedia-api data-collection recommender-systems wikipedia-scraper multimodal-learning multimodal-deep-learning multimodal-datasets

Updated May 22, 2021
Jupyter Notebook

GeorgeTouros / video-soundtrack-evaluation

Create a large, well-managed and clean data-set for the task of music composition for video soundtracks.

video deep-learning music-composition soundtrack dataset-generation multimodal-deep-learning multimodal-datasets

Updated Jul 6, 2023
Jupyter Notebook

Improve this page

Add a description, image, and links to the multimodal-datasets topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multimodal-datasets topic, visit your repo's landing page and select "manage topics."

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.

Alternative Proxies:

Alternative Proxy