Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Models

ACM Transactions on Graphics

Willi Menapace☨, Aliaksandr Siarohin, Stéphane Lathuilière, Panos Achlioptas,
Vladislav Golyanik, Sergey Tulyakov, Elisa Ricci

☨ Work performed while interning at Snap Inc.

Overview Dataset
Action-Conditioned Video Prediction Video Completion Unconditional Generation Random Conditioning Baselines Ablation
Camera Manipulation Style Manipulation Baselines Ablation
Paper GitHub

Random Conditioning

Results for the task of generating sequences given a randomly selected 5% portion of the ground truth actions and state properties.

Minecraft

Tennis