Multimodal

OmniMAE: Single Model Masked Pretraining on Images and Videos
Single self-supervised representation for images and videos.
Rohit Girdhar, Alaaeldin El-Nouby, Mannat Singh, Kalyan Vasudev Alwala, Armand Joulin, Ishan Misra
PDF Cite Video Code
OmniMAE: Single Model Masked Pretraining on Images and Videos
Omnivore: A Single Model for Many Visual Modalities
A single model for images, video and single-view 3D.
Rohit Girdhar, Mannat Singh, Nikhila Ravi, Laurens van der Maaten, Armand Joulin, Ishan Misra
PDF Cite Code
Omnivore: A Single Model for Many Visual Modalities
Ego4D: Around the World in 3,000 Hours of Egocentric Video
The largest egocentric video dataset.
Kristen Grauman, Andrew Westbury, Rohit Girdhar, et al
PDF Cite Video Code
Ego4D: Around the World in 3,000 Hours of Egocentric Video