What control signal does GameNGen condition on, and what resolution, context and speed does the paper state?
GameNGen's ICLR version (arXiv v2) says the action set is 'key presses' of DOOM and that each action is embedded into a single token; the paper text never lists the individual actions (no hit for mouse, keyboard or discrete in the whole PDF text), so the exact action set is not stated. Stated numbers: 320x240 frames padded to 320x256, context of 64 frames plus 64 actions (a little over 3 seconds), 20 fps with four DDIM steps on a TPU-v5 (50 fps with distillation), trained on RL-agent play where each agent action is held for 4 frames. Table 2 shows PSNR rising from 20.94 at one history frame to 22.36 at 64.
GameNGen's ICLR version (arXiv v2) says the action set is 'key presses' of DOOM and that each action is embedded into a single token; the paper text never lists the individual actions (no hit for mouse, keyboard or discrete in the whole PDF text), so the exact action set is not stated. Stated numbers: 320x240 frames padded to 320x256, context of 64 frames plus 64 actions (a little over 3 seconds), 20 fps with four DDIM steps on a TPU-v5 (50 fps with distillation), trained on RL-agent play where each agent action is held for 4 frames. Table 2 shows PSNR rising from 20.94 at one history frame to 22.36 at 64.
Curator qualifications: All excerpts located; GameNGen control, resolution, context and speed.
Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/abs/2408.14837v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://gamengen.github.io/",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [sourced_fact] GameNGen's ICLR version (arXiv v2) says the action set is 'key presses' of DOOM and that each action is embedded into a single token; the paper text never lists the individual actions (no hit for mouse, keyboard or discrete in the whole PDF text), so the exact action set is not stated. Stated numbers: 320x240 frames padded to 320x256, context of 64 frames plus 64 actions (a little over 3 seconds), 20 fps with four DDIM steps on a TPU-v5 (50 fps with distillation), trained on RL-agent play where each agent action is held for 4 frames. Table 2 shows PSNR rising from 20.94 at one history frame to 22.36 at 64. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/abs/2408.14837v2
- cites → https://gamengen.github.io/