For keeping one person's face identity across storyboard panels, what do the PhotoMaker and InstantID papers and official repositories measure, what limits and compute do they state, and how are their code and checkpoints licensed?
PhotoMaker (arXiv 2312.04461v1; repo 060b4fc) stacks 1-4 ID photos into one embedding for SDXL; its Table 1 reports PhotoMaker CLIP-I 73.6, DINO 51.5, Face Sim. 61.8 at 10 s on a V100 (IPAdapter has higher Face Sim. 67.1), trained on 8 A100 for two weeks; it handles one person per image and is better at half-length portraits. InstantID (arXiv 2401.07519v2; repo 2145b67) uses one face photo with an InsightFace embedding, a ControlNet-style IdentityNet and an image adapter, trained on 48 H800; the paper has no quantitative table (qualitative comparisons) and the README supports only the largest face. Licence components differ: both codebases are Apache-2.0 (PhotoMaker's LICENSE header mentions third-party components but lists none after the Apache text); InstantID's README says InsightFace face models are non-commercial research only and its released checkpoints are research only, while the Hugging Face card says the project is Apache.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/html/2312.04461v1",
"note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
},
{
"url": "https://github.com/TencentARC/PhotoMaker/tree/060b4fcb10b76a4554edf565d6106b7e36c968f0",
"note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
},
{
"url": "https://huggingface.co/TencentARC/PhotoMaker/tree/f68f8e6309bf213d28d68230abff0ccc92de9f30",
"note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
},
{
"url": "https://arxiv.org/html/2401.07519v2",
"note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
},
{
"url": "https://github.com/instantX-research/InstantID/tree/2145b67f9607da6234702063692330185f374486",
"note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
},
{
"url": "https://huggingface.co/InstantX/InstantID/tree/57b32dfee076092ad2930c71fd6d439c2c3b1820",
"note": "InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe"
}
]
}Evidence claims
- [sourced_fact] PhotoMaker (arXiv 2312.04461v1; repo 060b4fc) stacks 1-4 ID photos into one embedding for SDXL; its Table 1 reports PhotoMaker CLIP-I 73.6, DINO 51.5, Face Sim. 61.8 at 10 s on a V100 (IPAdapter has higher Face Sim. 67.1), trained on 8 A100 for two weeks; it handles one person per image and is better at half-length portraits. InstantID (arXiv 2401.07519v2; repo 2145b67) uses one face photo with an InsightFace embedding, a ControlNet-style IdentityNet and an image adapter, trained on 48 H800; the paper has no quantitative table (qualitative comparisons) and the README supports only the largest face. Licence components differ: both codebases are Apache-2.0 (PhotoMaker's LICENSE header mentions third-party components but lists none after the Apache text); InstantID's README says InsightFace face models are non-commercial research only and its released checkpoints are research only, while the Hugging Face card says the project is Apache. · locator: InstantID GitHub README at 2145b67f L262; Hugging Face InstantX/InstantID card at 57b32dfe source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/html/2312.04461v1
- cites → https://arxiv.org/html/2401.07519v2
- cites → https://github.com/TencentARC/PhotoMaker/tree/060b4fcb10b76a4554edf565d6106b7e36c968f0
- cites → https://github.com/instantX-research/InstantID/tree/2145b67f9607da6234702063692330185f374486
- cites → https://huggingface.co/InstantX/InstantID/tree/57b32dfee076092ad2930c71fd6d439c2c3b1820
- cites → https://huggingface.co/TencentARC/PhotoMaker/tree/f68f8e6309bf213d28d68230abff0ccc92de9f30