What does the 2024 ICAT-EGVE poster map between FACS action units and ARKit blendshapes, in which direction, and what does it measure?
The 2024 EGVE poster learns ARKit's 52 blendshape weights from 17 OpenFace action-unit intensities with a GRU, trained on 3,780 videos of nine Japanese speakers reading emotion-related sentences, and reports R2 about 0.75 with activation precision about 0.90 and recall about 0.85; it maps AUs to blendshapes for speech, so it is not a general AU-name lookup table and its population and task are narrow.
The 2024 EGVE poster learns ARKit's 52 blendshape weights from 17 OpenFace action-unit intensities with a GRU, trained on 3,780 videos of nine Japanese speakers reading emotion-related sentences, and reports R2 about 0.75 with activation precision about 0.90 and recall about 0.85; it maps AUs to blendshapes for speech, so it is not a general AU-name lookup table and its population and task are narrow.
Curator qualifications: Poster read 2026-10-22; model not run. Single small dataset (nine participants, one language); no manual FACS coding comparison.
Limitations: Poster read 2026-10-22; model not run.
Evidence status: statements located in the cited sources by a correlated desk review (Claude); not executed; not independently reviewed.
Structured fields
{
"citations": [
{
"url": "https://diglib.eg.org/bitstreams/b0754f8b-5151-42c0-b3d4-89047e031724/download",
"note": "diglib.eg.org ICAT-EGVE 2024 poster PDF"
},
{
"url": "https://diglib.eg.org/handle/10.2312/egve20241392",
"note": "diglib.eg.org ICAT-EGVE 2024 poster PDF"
}
]
}Evidence claims
- [sourced_fact] The 2024 EGVE poster learns ARKit's 52 blendshape weights from 17 OpenFace action-unit intensities with a GRU, trained on 3,780 videos of nine Japanese speakers reading emotion-related sentences, and reports R2 about 0.75 with activation precision about 0.90 and recall about 0.85; it maps AUs to blendshapes for speech, so it is not a general AU-name lookup table and its population and task are narrow. · locator: diglib.eg.org ICAT-EGVE 2024 poster PDF source
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| documentation | unknown | permitted | permitted | unknown | unknown | Applies to this original summary only, not to the cited sources. |