Where have learned models been documented for line work in a drawn-look pipeline (production vs research vs open tools), and what are their inputs, limits and terms?
Documented production use: Sony Pictures Imageworks trained a scikit-learn GradientBoostingRegressor inside Houdini to predict how artist-drawn ink lines should adjust with camera angle and expression, ~600 frames per character first generation, with artists nudging the prediction (account by Grochola via fxguide, 2019). This model moves hand-drawn lines on 3D animation; it does not extract lines from images. Research/open line extractors differ: Informative Drawings (arXiv 2203.12691v3) maps photographs to line drawings, with a stated dependence on a pretrained depth network; ControlNet 1.1 lineart models use extracted or hand-drawn lines to steer image generation. None of the two research/open sources documents use on 3D character renders.
Structured fields
{
"citations": [
{
"url": "https://www.fxguide.com/fxfeatured/ink-lines-and-machine-learning/",
"note": "candidate evidence excerpts"
},
{
"url": "https://arxiv.org/abs/2203.12691v3",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/carolineec/informative-drawings/blob/2349aee4daf7cb01d8de645b0bbb4f4392fd1395/README.md",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/carolineec/informative-drawings/blob/2349aee4daf7cb01d8de645b0bbb4f4392fd1395/LICENSE",
"note": "candidate evidence excerpts"
},
{
"url": "https://github.com/lllyasviel/ControlNet-v1-1-nightly/blob/e2b44154b72965c5e11b1ccee941d550682e4701/README.md",
"note": "candidate evidence excerpts"
}
]
}Evidence claims
- [sourced_fact] Documented production use: Sony Pictures Imageworks trained a scikit-learn GradientBoostingRegressor inside Houdini to predict how artist-drawn ink lines should adjust with camera angle and expression, ~600 frames per character first generation, with artists nudging the prediction (account by Grochola via fxguide, 2019). This model moves hand-drawn lines on 3D animation; it does not extract lines from images. Research/open line extractors differ: Informative Drawings (arXiv 2203.12691v3) maps photographs to line drawings, with a stated dependence on a pretrained depth network; ControlNet 1.1 lineart models use extracted or hand-drawn lines to steer image generation. None of the two research/open sources documents use on 3D character renders. · locator: candidate evidence excerpts source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |
Linked records
- cites → https://arxiv.org/abs/2203.12691v3
- cites → https://github.com/carolineec/informative-drawings/blob/2349aee4daf7cb01d8de645b0bbb4f4392fd1395/LICENSE
- cites → https://github.com/carolineec/informative-drawings/blob/2349aee4daf7cb01d8de645b0bbb4f4392fd1395/README.md
- cites → https://github.com/lllyasviel/ControlNet-v1-1-nightly/blob/e2b44154b72965c5e11b1ccee941d550682e4701/README.md
- cites → https://www.fxguide.com/fxfeatured/ink-lines-and-machine-learning