MMAudio (video-to-audio synthesis, CVPR 2025)
Source: https://github.com/hkchengrex/mmaudio
Structured fields
{
"archived": false,
"checked_at": "2026-10-17T00:00:00.000Z",
"usefulness": "Generates synchronized audio (Foley, ambience) for video or text using multimodal joint training; about 6 GB GPU memory in 16-bit; default 8-second clips. MIT code, CC-BY-NC checkpoints.",
"source_type": "repository",
"availability": "available",
"source_owner": "Ho Kei Cheng et al.",
"next_check_at": "2026-10-31T00:00:00.000Z",
"hardware_notes": "~6 GB GPU memory (16-bit) per README.",
"known_limitations": [
"8 s default duration; non-commercial weights."
],
"upstream_updated_at": "2026-02-23T06:09:19.000Z"
}Evidence claims
- [upstream_claim] README: inference takes around 6GB GPU memory in 16-bit mode; default output and training duration is 8 seconds and large deviations may reduce quality. · locator: README, requirements and notes source
- [sourced_fact] README: trained on several datasets including AudioSet, Freesound (LAION-audio-630k), VGGSound and others. · locator: README, training data note source
- [sourced_fact] README License: code MIT; checkpoints released on Hugging Face under CC-BY-NC 4.0. · locator: README, License source
- [upstream_claim] Research review verdict at export: reviewed (as of 2026-10-17). Recorded by the research pipeline, not a hub review outcome; evidence.review stays unreviewed until an independent reviewer records one.
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| code | MIT | permitted | permitted | permitted | unknown | MIT per README. |
| model_weights | CC-BY-NC-4.0 | restricted | restricted | restricted | unknown | README: checkpoints CC-BY-NC 4.0 (non-commercial); training datasets include web-sourced audio with varying rights. |