If I have one video (or one image) of an object and no rig, which video-to-4D generation systems can produce an animated 3D object, what do they output, and what do they cost to run?
Corrected 2026-10-23 - see C3-B588-09; the original statements below are kept for history and are superseded where the correction says so. Four released video-to-4D lines were read at pinned versions. Consistent4D (monocular stationary-camera video, SDS from Zero123-XL into a cascade dynamic NeRF; at least 24 GB VRAM, hours on a V100) and DreamGaussian4D (image or video to 4D Gaussians in minutes on an 80 GB A100, with an obj mesh-sequence export) are optimisation-based. SV4D and SV4D 2.0 instead generate a multi-view video image matrix with a video diffusion model and then fit a dynamic NeRF to it (15-25 minutes; up to 30 GB on an H100 for SV4D 2.0). All are object-centric; SV4D 2.0 states it is limited to object-centric videos and cannot handle strong perspective distortion. Outputs are generated, not captured: the authors' own quality statements are 'not as high as photo-realistic 4D methods' (DG4D) and failures on abrupt motion (Consistent4D). Weights and rights are in candidate...
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/html/2311.02848v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/yanqinJiang/Consistent4D",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2312.17142v3",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/jiawei-ren/dreamgaussian4d",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2407.17470v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2503.16396v3",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/Stability-AI/generative-models",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [sourced_fact] Four released video-to-4D lines were read at pinned versions. Consistent4D (monocular stationary-camera video, SDS from Zero123-XL into a cascade dynamic NeRF; at least 24 GB VRAM, hours on a V100) and DreamGaussian4D (image or video to 4D Gaussians in minutes on an 80 GB A100, with an obj mesh-sequence export) are optimisation-based. SV4D and SV4D 2.0 instead generate a multi-view video image matrix with a video diffusion model and then fit a dynamic NeRF to it (15-25 minutes; up to 30 GB on an H100 for SV4D 2.0). All are object-centric; SV4D 2.0 states it is limited to object-centric videos and cannot handle strong perspective distortion. Outputs are generated, not captured: the authors' own quality statements are 'not as high as photo-realistic 4D methods' (DG4D) and failures on abrupt motion (Consistent4D). Weights and rights are in candidate 06. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/html/2311.02848v1
- cites → https://arxiv.org/html/2312.17142v3
- cites → https://arxiv.org/html/2407.17470v2
- cites → https://arxiv.org/html/2503.16396v3
- cites → https://github.com/jiawei-ren/dreamgaussian4d
- cites → https://github.com/stability-ai/generative-models
- cites → https://github.com/yanqinjiang/consistent4d