Neural Facial Deformation Transfer

dc.contributor.authorChandran, Prashanthen_US
dc.contributor.authorCiccone, Loïcen_US
dc.contributor.authorZoss, Gasparden_US
dc.contributor.authorBradley, Dereken_US
dc.contributor.editorCeylan, Duyguen_US
dc.contributor.editorLi, Tzu-Maoen_US
dc.date.accessioned2025-05-09T09:35:26Z
dc.date.available2025-05-09T09:35:26Z
dc.date.issued2025
dc.description.abstractWe address the practical problem of generating facial blendshapes and reference animations for a new 3D character in production environments where blendshape expressions and reference animations are readily available on a pre-defined template character. We propose Neural Facial Deformation Transfer (NFDT); a data-driven approach to transfer facial expressions from such a template character to new target characters given only the target's neutral shape. To accomplish this, we first present a simple data generation strategy to automatically create a large training dataset consisting of pairs of template and target character shapes in the same expression. We then leverage this dataset through a decoder-only transformer that transfers facial expressions from the template character to a target character in high fidelity. Through quantitative evaluations and a user study, we demonstrate that NFDT surpasses the previous state-of-the-art in facial expression transfer. NFDT provides good results across varying mesh topologies, generalizes to humanoid creatures, and can save time and cost in facial animation workflows.en_US
dc.description.sectionheadersShort Paper 2
dc.description.seriesinformationEurographics 2025 - Short Papers
dc.identifier.doi10.2312/egs.20251036
dc.identifier.isbn978-3-03868-268-4
dc.identifier.issn1017-4656
dc.identifier.pages4 pages
dc.identifier.urihttps://doi.org/10.2312/egs.20251036
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/egs20251036
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Shape modeling; Animation
dc.subjectComputing methodologies → Shape modeling
dc.subjectAnimation
dc.titleNeural Facial Deformation Transferen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
egs20251036.pdf
Size:
74.62 MB
Format:
Adobe Portable Document Format