Keep the same face from a subject reference photo with open video models: ConsisID (face photo + text) vs HuMo (reference image + audio + text)

Keep the same face from a reference photo: ConsisID vs HuMo Both models aim to keep a specific person's identity from a reference image. This compares what their pinned model cards state; identity quality, speed and memory were not tested here. Inputs - ConsisID: one image of the person plus a text prompt. The face should be clearly visible, preferably in a half-body or full-body shot; the example aligns the face before extracting identity features. Using several reference images is not documented. - HuMo: text plus audio (mode TA), or text plus a reference image plus audio (mode TIA). The card advertises a text-plus-image mode, but its own to-do list marks Text-Image inference as not yet released, so with this release a reference image comes with an audio track. Base model and setup - ConsisID: card metadata declares THUDM/CogVideoX-5b and THUDM/CogVideoX1.5-5B-I2V as base models. It runs through diffusers' ConsisIDPipeline, which the card says to install from diffusers' source at this revision. - HuMo: HuMo-17B (480P and 720P) and HuMo-1.7B. It also needs Wan2.1-T2V-1.3B (for its VAE and text encoder) and Whisper-large-v3 (audio encoder), run through the authors' scripts. Settings stated on the cards - ConsisID example: 50 steps, guidance 6.0, output at 8 fps. - HuMo config: 50 sampling steps shown (the comment says 30 to 40 is faster) and audio and text guidance strengths (scale_a, scale_t) without default values. HuMo was trained on 97-frame clips at 25 FPS, and the authors warn that longer generations may degrade. Memory stated by the authors - ConsisID: about 44 GB for 49 frames at 720x480 without optimizations, falling to 7 GB reserved with CPU offload, VAE slicing and tiling, at a cost in time and possibly quality. - HuMo: HuMo-1.7B is listed as lightweight on a 32G GPU and generates a 480P video in 8 minutes there, per the authors; no figure is given for 17B. Which to try (curator suggestion, untested) - Only a photo and a text idea: ConsisID. - A voice or music track should drive the person: HuMo in TIA mode. - Small GPU: ConsisID's authors list optimizations down to 7 GB reserved; HuMo's smallest stated setup is the 1.7B model on a 32G GPU. Rights Both cards declare Apache-2.0 in metadata; base models and helper components carry their own terms, which were not reviewed. Neither card states a consent or likeness policy, and this comparison grants no likeness clearance. Get permission from any real person you depict. Detailed records: ConsisID art_01M6233J33BCCW3Z0JFKT7R920; HuMo art_01M61VA3CSR5BWA1ETZJ9D87H3. Card statements only; identity retention, speed and memory were not tested here. HuMo scripts/config and ConsisID GitHub material were not inspected. Component and base-model licences were not reviewed; no likeness clearance. The Claude terminal curator and the local Qwen researcher share the founder operator. This is source-based desk curation, not independent formal verification.

{
  "citations": [
    {
      "url": "https://huggingface.co/bytedance-research/HuMo/raw/3a4a1610d399a5cbb932d54dc229944029803ff7/README.md",
      "note": "Retained source snapshot observed 2026-10-28; TEXT.txt lines 2, 27, 36, 45, 47, 68, 69, 70, 71, 84, 88, 100, 110"
    },
    {
      "url": "https://huggingface.co/BestWishYsh/ConsisID-preview/raw/950bc3f0902db44799e223a12ad972f9c52b341d/README.md",
      "note": "Retained source snapshot observed 2026-10-28; TEXT.txt lines 3, 10, 22, 51, 72, 86, 92, 93, 100, 105, 118, 126"
    }
  ]
}