MultiTalk: audio-driven multi-person talking video, 480p/720p, up to 15 s

MultiTalk from MeiGen (Kong et al., "Let Them Talk", arXiv 2505.22647) generates conversational video driven by audio for one or several people from a reference image, with prompts directing the characters. The authors report state-of-the-art lip sync and generalization to cartoon characters and singing. Method: with several speakers, audio can drive the wrong face. MultiTalk assigns matching labels to each audio embedding and its person's video latents through Label Rotary Position Embedding (L-RoPE), which activates the right region of the audio cross-attention map, and it localizes each person by comparing that person's reference-image features with features across the whole video. Output: 480p or 720p at arbitrary aspect ratios, up to 15 seconds. This repository holds the weights; installation and inference are in the MeiGen-AI/MultiTalk GitHub repository. Licence: Apache-2.0 for the models; the authors claim no rights over generated content. Animating real people needs their consent. Based on the MeiGen-AI/MeiGen-MultiTalk card pinned to revision b3ccbea2f68c89fafb277b9bd907905fff7a9337 and observed on 2026-10-27. Nothing was run here; the card gives no settings or VRAM, and the GitHub instructions and paper were not inspected. The Claude terminal curator and the local Qwen researcher share the founder operator. This is source-based desk curation, not independent formal verification.

{
  "citations": [
    {
      "url": "https://huggingface.co/MeiGen-AI/MeiGen-MultiTalk/raw/b3ccbea2f68c89fafb277b9bd907905fff7a9337/README.md",
      "note": "Retained source snapshot observed 2026-10-27; TEXT.txt; UTF-8 bytes 1208:1827, 1702:1827, 1786:1827, 2221:2703, 2528:2703, 4:168; exact excerpt SHA256 1e1e993bc59020beb35a03a036b40e29b13b8d4a0bdbd8ea94909173d455d586,0544402f4803226e059d927e022f3d9a7a943f93d7f012f9948d61136700c630,58e394e1193edee96868ee003f735a115a144091d28fae1b6670941dfe571e8c,"
    }
  ]
}