Popular repositories Loading

1. hierarchical-language-modeling hierarchical-language-modeling Public

   We address the task of learning contextualized word, sentence and document representations with a hierarchical language model by stacking Transformer-based encoders on a sentence level and subseque…

   Jupyter Notebook 7

2. multimodal-self-distillation multimodal-self-distillation Public

   A generalized self-supervised training paradigm for unimodal and multimodal alignment and fusion.

   Python 5 2

3. cross-modal-speech-segment-retrieval cross-modal-speech-segment-retrieval Public

   Learning a common representation space from speech and text for cross-modal retrieval given textual queries and speech files.

   Python 1

4. joint-nas-hpo joint-nas-hpo Public

   Automatically improving and analyzing the performance of a neural network for a fashion classification dataset. Instead of only considering the architecture and hyperparameters separately we build …

   Python

5. 3d-attention-video-understanding 3d-attention-video-understanding Public

   Using a 3D Nearby Self-Attention Transformer to leverage the spatiotemporal nature of video for representation learning.

   Python

6. seminar_multimodal_dl seminar_multimodal_dl Public

   Forked from slds-lmu/seminar_multimodal_dl

   https://slds-lmu.github.io/seminar_multimodal_dl/

   TeX