Multimodal

Omnivore: A Single Model for Many Visual Modalities
A single model for images, video and single-view 3D.
Rohit Girdhar, Mannat Singh, Nikhila Ravi, Laurens van der Maaten, Armand Joulin, Ishan Misra
PDF Cite Code
Omnivore: A Single Model for Many Visual Modalities
Ego4D: Around the World in 3,000 Hours of Egocentric Video
The largest egocentric video dataset.
Kristen Grauman, Andrew Westbury, Rohit Girdhar, et al
PDF Cite Video Code
Ego4D: Around the World in 3,000 Hours of Egocentric Video