How do you build a consistent multi-character cast with LoRAs (dataset, captions, training steps) for image and video models, per a July 2026 local workflow?
Creator-reported: statements attributed to the creator(s) come from discovery's reading of auto-caption transcript excerpts; the curator checked the video metadata (title, date, length) and any cited documentation pages, not the spoken claims. Nothing was tested; promotional or sponsored framing applies where stated. Mickmumpitz (2026-07-17) gives five LoRA rules: (1) a made-up trigger word absorbs everything not captioned; (2) vary what should generalize (include wide shots, lighting, poses, clothing), or the character only exists as trained (e.g. close-ups); (3) decide what stays fixed versus editable; (4) captions decide editability: captioned clothes stay changeable but must then be re-prompted; (5) captions are reverse prompts, so match the target model's prompt style (long natural language for Krea 2; structured JSON with bounding boxes for Ideogram 4). Pipeline: an edit-model "character creator" generates a varied synthetic dataset from one or two images (add close-ups of det...
Structured fields
{
"citations": [
{
"url": "https://www.youtube.com/watch?v=ghFYDG0DF1w",
"note": "0:00-3:00; 0:00-3:00; 15:10; 15:10-18:15; 24:18; cardData.license_name; cardData.license_name"
},
{
"url": "https://huggingface.co/api/models/ideogram-ai/ideogram-4-fp8",
"note": "0:00-3:00; 0:00-3:00; 15:10; 15:10-18:15; 24:18; cardData.license_name; cardData.license_name"
},
{
"url": "https://huggingface.co/api/models/Comfy-Org/Krea-2",
"note": "0:00-3:00; 0:00-3:00; 15:10; 15:10-18:15; 24:18; cardData.license_name; cardData.license_name"
}
]
}Evidence claims
- [sourced_fact] Mickmumpitz (2026-07-17) gives five LoRA rules: (1) a made-up trigger word absorbs everything not captioned; (2) vary what should generalize (include wide shots, lighting, poses, clothing), or the character only exists as trained (e.g. close-ups); (3) decide what stays fixed versus editable; (4) captions decide editability: captioned clothes stay changeable but must then be re-prompted; (5) captions are reverse prompts, so match the target model's prompt style (long natural language for Krea 2; structured JSON with bounding boxes for Ideogram 4). Pipeline: an edit-model "character creator" generates a varied synthetic dataset from one or two images (add close-ups of details that drift, such as necklaces; optional face detailer for small faces), an LLM tagger writes captions (trigger words per character; describe position and interaction), and AI Toolkit trains (RunPod RTX Pro 6000 about 80 minutes for 3,000 steps; best checkpoints around 1,250-2,500 steps, last is not best; rank 64 for three characters). For multi-character LoRAs, include generated images of the characters together so the model learns they are separate entities. Ideogram 4 LoRAs use JSON captions with bounding boxes (rotated-box format that LLMs wrongly "correct"); Wan 2.1 LoRAs trained on images (sample frames = 1) also work on Wan 2.2. Licences verified on Hugging Face cards: Ideogram 4 weights non-commercial (gated); Krea 2 under a Krea-2 community licence. · locator: 0:00-3:00; 0:00-3:00; 15:10; 15:10-18:15; 24:18; cardData.license_name; cardData.license_name source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |