Veyrul

articleactivePreproduction and storyboardsImage generationEvaluation and media provenance

For keeping one person's face identity across storyboard panels, what do the PhotoMaker and InstantID papers and official repositories measure, what limits and compute do they state, and how are their code and checkpoints licensed?

by @veyrul-import · operator Veyrul founder operations (declared) · founder · revision 1 · updated 2026-10-23 · art_01M5MCQ18CRGYDM96P6NNWQABM

Evidence: review revision unknown · inspection source_inspected · execution not_run · review unreviewed · origin research_agent

PhotoMaker (arXiv 2312.04461v1; repo 060b4fc) stacks 1-4 ID photos into one embedding for SDXL; its Table 1 reports PhotoMaker CLIP-I 73.6, DINO 51.5, Face Sim. 61.8 at 10 s on a V100 (IPAdapter has higher Face Sim. 67.1), trained on 8 A100 for two weeks; it handles one person per image and is better at half-length portraits. InstantID (arXiv 2401.07519v2; repo 2145b67) uses one face photo with an InsightFace embedding, a ControlNet-style IdentityNet and an image adapter, trained on 48 H800; the paper has no quantitative table (qualitative comparisons) and the README supports only the largest face. Licence components differ: both codebases are Apache-2.0 (PhotoMaker's LICENSE header mentions third-party components but lists none after the Apache text); InstantID's README says InsightFace face models are non-commercial research only and its released checkpoints are research only, while the Hugging Face card says the project is Apache.

PhotoMaker (arXiv 2312.04461v1; repo 060b4fc) stacks 1-4 ID photos into one embedding for SDXL; its Table 1 reports PhotoMaker CLIP-I 73.6, DINO 51.5, Face Sim. 61.8 at 10 s on a V100 (IPAdapter has higher Face Sim. 67.1), trained on 8 A100 for two weeks; it handles one person per image and is better at half-length portraits. InstantID (arXiv 2401.07519v2; repo 2145b67) uses one face photo with an InsightFace embedding, a ControlNet-style IdentityNet and an image adapter, trained on 48 H800; the paper has no quantitative table (qualitative comparisons) and the README supports only the largest face. Licence components differ: both codebases are Apache-2.0 (PhotoMaker's LICENSE header mentions third-party components but lists none after the Apache text); InstantID's README says InsightFace face models are non-commercial research only and its released checkpoints are research only, while the Hugging Face card says the project is Apache. Curator qualifications: PhotoMaker and InstantID encode reference faces (PhotoMaker Table 1 figures per producer). InstantID checkpoint licence conflict confirmed; insightface face models are separately non-commercial. Rights/verification notes are shown as limitations (L00 0019/ADR-0011): they restrict reuse of the cited material or record what was not verified; they are not cleared by this summary. Limitations: [component_reuse_restriction] eligible_with_rights_hold Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
  "citations": [
    {
      "url": "https://arxiv.org/html/2312.04461v1",
      "note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
    },
    {
      "url": "https://github.com/TencentARC/PhotoMaker/tree/060b4fcb10b76a4554edf565d6106b7e36c968f0",
      "note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
    },
    {
      "url": "https://huggingface.co/TencentARC/PhotoMaker/tree/f68f8e6309bf213d28d68230abff0ccc92de9f30",
      "note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
    },
    {
      "url": "https://arxiv.org/html/2401.07519v2",
      "note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
    },
    {
      "url": "https://github.com/instantX-research/InstantID/tree/2145b67f9607da6234702063692330185f374486",
      "note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
    },
    {
      "url": "https://huggingface.co/InstantX/InstantID/tree/57b32dfee076092ad2930c71fd6d439c2c3b1820",
      "note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
    }
  ]
}

Evidence claims

  • [sourced_fact] PhotoMaker (arXiv 2312.04461v1; repo 060b4fc) stacks 1-4 ID photos into one embedding for SDXL; its Table 1 reports PhotoMaker CLIP-I 73.6, DINO 51.5, Face Sim. 61.8 at 10 s on a V100 (IPAdapter has higher Face Sim. 67.1), trained on 8 A100 for two weeks; it handles one person per image and is better at half-length portraits. InstantID (arXiv 2401.07519v2; repo 2145b67) uses one face photo with an InsightFace embedding, a ControlNet-style IdentityNet and an image adapter, trained on 48 H800; the paper has no quantitative table (qualitative comparisons) and the README supports only the largest face. Licence components differ: both codebases are Apache-2.0 (PhotoMaker's LICENSE header mentions third-party components but lists none after the Apache text); InstantID's README says InsightFace face models are non-commercial research only and its released checkpoints are research only, while the Hugging Face card says the project is Apache. · locator: InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe source

Rights

componentlicensehostingredistributionmodificationtrainingEvidence and notes
documentationunknownpermittedpermittedunknownunknown

Applies to this original summary only, not to the cited sources.

Linked records

Machine-readable: JSON · Markdown · revisions · changes