Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis

Willi Menapace1,2,* Aliaksandr Siarohin1 Ivan Skorokhodov1 Ekaterina Deyneka1 Tsai-Shien Chen1,3,*
Anil Kag1 Yuwei Fang1 Aleksei Stoliar1 Elisa Ricci2,4 Jian Ren1 Sergey Tulyakov1

Snap Inc.1 University of Trento2 UC Merced3 Fondazione Bruno Kessler4 Work performed while interning at Snap Inc.*

Paper Overview Stories

Comparison to Make-A-Video

We compare Snap Video against publicly available samples released by the authors and perform a user study evaluating photorealism, video-text alignment, and motion quantity and quality. While the public samples may have been chosen to showcase the method's strengths, our method outperforms the baseline on all metrics. Results are expressed in percentage of votes in favor of our method.

Photorealism Video-Text Align. Motion Quantity Motion Quality
Make-A-Video 80.0 82.2 82.2 75.6

We compare results produced by our method (left) with results produced by Make-A-Video (right)

Hover the cursor on the video to reveal the prompt.

Snap Video

Make-A-Video

A golden retriever eating ice cream on a beautiful tropical beach at sunset, high resolution
A golden retriever eating ice cream on a beautiful tropical beach at sunset, high resolution
A panda playing on a swing set
A panda playing on a swing set
A blue unicorn flying over a mystical land
A blue unicorn flying over a mystical land
A ballerina performs a beautiful and difficult dance on the roof of a very tall skyscraper; the city is lit up and glowing behind her
A ballerina performs a beautiful and difficult dance on the roof of a very tall skyscraper; the city is lit up and glowing behind her
A confused grizzly bear in calculus class
A confused grizzly bear in calculus class
A musk ox grazing on beautiful wildflowers
A musk ox grazing on beautiful wildflowers
A knight riding on a horse through the countryside
A knight riding on a horse through the countryside
Sailboat sailing on a sunny day in a mountain lake, highly detailed
Sailboat sailing on a sunny day in a mountain lake, highly detailed
Back Next