Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Models

ACM Transactions on Graphics

Willi Menapace☨, Aliaksandr Siarohin, Stéphane Lathuilière, Panos Achlioptas,
Vladislav Golyanik, Sergey Tulyakov, Elisa Ricci

☨ Work performed while interning at Snap Inc.

Overview Dataset
Action-Conditioned Video Prediction Video Completion Unconditional Generation Random Conditioning Baselines Ablation
Camera Manipulation Style Manipulation Baselines Ablation
Paper GitHub

Unconditional Generation

Results for the task of unconditionally generating sequences. No states or action conditioning is given to the model and the complete trajectory is generated.

Minecraft

Tennis