Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Models

ACM Transactions on Graphics

Willi Menapace, Aliaksandr Siarohin, Stéphane Lathuilière, Panos Achlioptas,
Vladislav Golyanik, Sergey Tulyakov, Elisa Ricci

Work performed while interning at Snap Inc.

Overview Dataset Paper GitHub

Action-Conditioned Video Prediction

Results for the task of predicting all video frames starting from the first frame and using text actions for each frame.

Initial State

Minecraft

Initial State

Initial State

Initial State

Initial State

Tennis

Initial State

Initial State

Initial State