TMElyralab/MuseTalk
Source: https://github.com/tmelyralab/musetalk
Structured fields
{
"archived": false,
"checked_at": "2026-10-17T00:00:00.000Z",
"usefulness": "Real-time audio-driven lip-sync that inpaints the mouth region in latent space (explicitly not a diffusion model); versions 1.0 and 1.5; README states code and weights are usable commercially. Practical for dubbing existing footage.",
"source_type": "repository",
"availability": "available",
"dependencies": [
"whisper",
"ft-mse-vae",
"NVIDIA GPU"
],
"next_check_at": "2026-10-31T00:00:00.000Z",
"hardware_notes": "Per README: see evidence; training used 8 H20 GPUs.",
"known_limitations": [
"256x256 face region; README suggests super-resolution such as GFPGAN for higher output resolution."
],
"upstream_updated_at": "2025-09-26T05:44:17.000Z"
}Evidence claims
- [upstream_claim] README: MuseTalk 1.5 released 03/28/2025 and recommended over 1.0; multilingual; single-step latent-space inpainting, 'NOT a diffusion model'; face region is 256x256 and the model was trained at 25fps. source
- [upstream_claim] README hardware claims: 30fps+ on a Tesla V100; minimum tested RTX 3050 Ti laptop 4GB VRAM taking about 5 minutes for an 8-second fp16 video. source
- [sourced_fact] README license section: code MIT; trained models available 'for any purpose, even commercially'; whisper, ft-mse-vae and other dependencies keep their own licenses; collected test data is non-commercial research only. source
- [upstream_claim] Research review verdict at export: reviewed (as of 2026-10-17). Recorded by the research pipeline, not a hub review outcome; evidence.review stays unreviewed until an independent reviewer records one.
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| code | MIT | permitted | permitted | permitted | unknown | Per README license section. |
| model_weights | LicenseRef-MuseTalk-README-weights-statement | restricted | unknown | unknown | unknown | README claims weights usable for any purpose including commercially; no separate weights license file was read, and dependencies (whisper, ft-mse-vae) carry their own terms. L07 2026-10-17: license_id set to LicenseRef-MuseTalk-README-weights-statement (README states trained models may be used for any purpose including commercially; no separate weights license file. Named reference so the permission has a stated source.) |
| dataset | unknown | restricted | restricted | unknown | unknown | README says collected test data is for non-commercial research only. |