Which metrics, baselines and benchmark protocols do the 4D generation papers use, and which reported numbers can be compared across papers without being misled?
Partially verified: the curator re-read none of the cited sources; S1, S3, S8, S13, S11, S5, S6, S15, S16 rest on the producer's pinned reading. The papers use different metric families and protocols: CLIP R-Precision plus human votes (MAV3D), CLIP Score plus pairwise user study (4D-fy), LPIPS/CLIP/FVD on a seven-object synthetic benchmark (Consistent4D, DreamGaussian4D, L4GM, SV4D), CLIP-F/CLIP-O and image metrics on a 20-case held-out set (Diffusion4D), and view/frame FVD variants plus FV4D (SV4D family). Cross-paper tables carry copied or inconsistent rows: the DreamGaussian4D row in L4GM and SV4D tables (0.16/0.87) equals the Consistent4D row and differs from DreamGaussian4D own Table 3 (0.12/0.92); Consistent4D FVD is 1133.44 in two papers and 1133.93 in a third; L4GM calls the benchmark eight animations while Consistent4D and its uid file list seven. User-study percentages point in opposite directions in MAV3D and 4D-fy. The one independent-protocol re-run found (SV4D 2.0 on i...
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/html/2301.11280v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2311.17984v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2405.16645v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2311.02848v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2312.17142v3",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2406.10324v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/nv-tlabs/L4GM-official",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2407.17470v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2503.16396v3",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [sourced_fact] The papers use different metric families and protocols: CLIP R-Precision plus human votes (MAV3D), CLIP Score plus pairwise user study (4D-fy), LPIPS/CLIP/FVD on a seven-object synthetic benchmark (Consistent4D, DreamGaussian4D, L4GM, SV4D), CLIP-F/CLIP-O and image metrics on a 20-case held-out set (Diffusion4D), and view/frame FVD variants plus FV4D (SV4D family). Cross-paper tables carry copied or inconsistent rows: the DreamGaussian4D row in L4GM and SV4D tables (0.16/0.87) equals the Consistent4D row and differs from DreamGaussian4D own Table 3 (0.12/0.92); Consistent4D FVD is 1133.44 in two papers and 1133.93 in a third; L4GM calls the benchmark eight animations while Consistent4D and its uid file list seven. User-study percentages point in opposite directions in MAV3D and 4D-fy. The one independent-protocol re-run found (SV4D 2.0 on its own ObjaverseDy validation set) places L4GM close to Consistent4D, which is not the large lead L4GM reports on the Consistent4D benchmark. No source supplies a production-fitness test. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/html/2301.11280v1
- cites → https://arxiv.org/html/2311.02848v1
- cites → https://arxiv.org/html/2311.17984v2
- cites → https://arxiv.org/html/2312.17142v3
- cites → https://arxiv.org/html/2405.16645v1
- cites → https://arxiv.org/html/2406.10324v1
- cites → https://arxiv.org/html/2407.17470v2
- cites → https://arxiv.org/html/2503.16396v3
- cites → https://github.com/nv-tlabs/l4gm-official