For a newcomer: what do LoRA, DreamBooth and textual inversion each change in an image model, how many example images does each need according to its source, and which source actually covers image models?
Partially verified: the curator re-read none of the cited sources; S10, S11, S12, S13, S14, S15, S16, S17 rest on the producer's pinned reading. Per the sources: textual inversion (Gal et al., arXiv v1) learns one new word embedding and leaves the model's weights frozen, from 'typically 3-5' images; DreamBooth (Ruiz et al., arXiv v2) fine-tunes the diffusion model itself to bind a rare-token identifier plus class noun to a subject from 3-5 images; LoRA (Hu et al., arXiv v2) freezes pre-trained weights and trains small low-rank matrices, but its paper evaluates language models (RoBERTa, DeBERTa, GPT-2, GPT-3), not image generators. Hugging Face diffusers v0.41.0 docs describe all three for Stable Diffusion-family models and provide training scripts, including DreamBooth-with-LoRA. A newcomer should therefore cite the diffusion papers for DreamBooth/textual inversion and treat LoRA-for-diffusion behaviour as documented by diffusers, not by the LoRA paper.
Structured fields
{
"citations": [
{
"url": "https://arxiv.org/abs/2208.12242v2",
"note": "cited at https://arxiv.org/pdf/2208.12242v2; candidate evidence excerpts"
},
{
"url": "https://arxiv.org/html/2208.01618v1",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/pdf/2106.09685v2",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/docs/source/en/training/dreambooth.md",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/docs/source/en/training/lora.md",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/docs/source/en/training/text_inversion.md",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/examples/dreambooth/README.md",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/examples/textual_inversion/README.md",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/pdf/2208.12242v2",
"note": "observed URL (dated/alias form of the cited catalogue source; canonical identity retained)"
}
]
}Evidence claims
- [sourced_fact] Per the sources: textual inversion (Gal et al., arXiv v1) learns one new word embedding and leaves the model's weights frozen, from 'typically 3-5' images; DreamBooth (Ruiz et al., arXiv v2) fine-tunes the diffusion model itself to bind a rare-token identifier plus class noun to a subject from 3-5 images; LoRA (Hu et al., arXiv v2) freezes pre-trained weights and trains small low-rank matrices, but its paper evaluates language models (RoBERTa, DeBERTa, GPT-2, GPT-3), not image generators. Hugging Face diffusers v0.41.0 docs describe all three for Stable Diffusion-family models and provide training scripts, including DreamBooth-with-LoRA. A newcomer should therefore cite the diffusion papers for DreamBooth/textual inversion and treat LoRA-for-diffusion behaviour as documented by diffusers, not by the LoRA paper. · locator: cited at https://arxiv.org/pdf/2208.12242v2; candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/abs/2208.12242v2
- cites → https://arxiv.org/html/2208.01618v1
- cites → https://arxiv.org/pdf/2106.09685v2
- cites → https://arxiv.org/pdf/2208.12242v2
- cites → https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/docs/source/en/training/dreambooth.md
- cites → https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/docs/source/en/training/lora.md
- cites → https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/docs/source/en/training/text_inversion.md
- cites → https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/examples/dreambooth/README.md
- cites → https://github.com/huggingface/diffusers/blob/086bf9578c0f4acbc66e48cd1e7cc26befd9e10f/examples/textual_inversion/README.md