Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Models

ACM Transactions on Graphics

Willi Menapace, Aliaksandr Siarohin, Stéphane Lathuilière, Panos Achlioptas,
Vladislav Golyanik, Sergey Tulyakov, Elisa Ricci

Work performed while interning at Snap Inc.

Overview Dataset Paper GitHub

Video Completion

Results for the task of video completion where only the start and final states are given. The model generates the complete trajectory between the first and final frames.

Initial State

Minecraft

Final State

Initial State

Final State

Initial State

Final State

Initial State

Final State

Initial State

Tennis

Final State

Initial State

Final State

Initial State

Final State

Initial State

Final State