View-Dependent Video Textures for 360° Video

30-sec Video Preview

Abstract

A major concern for filmmakers creating 360° video is ensuring that the viewer does not miss important narrative elements because they are looking in the wrong direction. This paper introduces gated clips which do not play the video past a gate time until a filmmaker-defined viewer gaze condition is met, such as looking at a specific region of interest (ROI). Until the condition is met, we seamlessly loop video playback using view-dependent video textures, a new variant of standard video textures that adapt the looping behavior to the portion of the scene that is within the viewer’s field of view. We use our desktop GUI to edit live action and computer animated 360° videos. In a user study with casual viewers, participants prefer our looping videos over the standard versions and are able to successfully see all of the looping videos’ ROIs without fear of missing important narrative content.

Paper

PDF (49 MB) | Low-res PDF (15 MB)

Supplemental Material

Results Zip (306 MB) | Gate Examples Metadata (72 MB)

Full Video

Bibtex


          @inproceedings{Liu:2019,
            author = {Sean J. Liu and Maneesh Agrawala and Stephen DiVerdi and Aaron Hertzmann},
            title = {View-Dependent Video Textures for 360${}^\circ$ Video},
            booktitle = {Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology},
            series = {UIST '19},
            year = {2019},
            isbn = {978-1-4503-6816-2/19/10},
            location = {New Orleans, LA, USA},
            url = {http://dx.doi.org/10.1145/3332165.3347887},
            doi = {10.1145/3332165.3347887},
            publisher = {ACM},
            keywords = {view-dependent video texture, 360${}^\circ$ video, virtual reality, cinematography, gaze guidance},
          }