StyleMM: Stylized 3D Morphable Face Model via Text Driven Aligned Image Translation

Simple item page
dc.contributor.authorLee, Seungmien_US
dc.contributor.authorYun, Kwanen_US
dc.contributor.authorNoh, Junyongen_US
dc.contributor.editorChristie, Marcen_US
dc.contributor.editorPietroni, Nicoen_US
dc.contributor.editorWang, Yu-Shuenen_US
dc.date.accessioned2025-10-07T05:01:39Z
dc.date.available2025-10-07T05:01:39Z
dc.date.issued2025
dc.description.abstractWe introduce StyleMM, a novel framework that can construct a stylized 3D Morphable Model (3DMM) based on user-defined text descriptions specifying a target style. Building upon a pre-trained mesh deformation network and a texture generator for original 3DMM-based realistic human faces, our approach fine-tunes these models using stylized facial images generated via text-guided image-to-image (i2i) translation with a diffusion model, which serve as stylization targets for the rendered mesh. To prevent undesired changes in identity, facial alignment, or expressions during i2i translation, we introduce a stylization method that explicitly preserves the facial attributes of the source image. By maintaining these critical attributes during image stylization, the proposed approach ensures consistent 3D style transfer across the 3DMM parameter space through imagebased training. Once trained, StyleMM enables feed-forward generation of stylized face meshes with explicit control over shape, expression, and texture parameters, producing meshes with consistent vertex connectivity and animatability. Quantitative and qualitative evaluations demonstrate that our approach outperforms state-of-the-art methods in terms of identity-level facial diversity and stylization capability. The code and videos are available at kwanyun.github.io/stylemm_page.en_US
dc.description.number7
dc.description.sectionheadersStylization
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume44
dc.identifier.doi10.1111/cgf.70234
dc.identifier.issn1467-8659
dc.identifier.pages15 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.70234
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf70234
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.rightsCC BY-NC Attribution-NonCommercial 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by-nc/4.0/
dc.subjectCCS Concepts: Computing methodologies → Computer graphics; Computer vision representations Categories and Subject Descriptors (according to ACM CCS): I.3.6 [Computer Graphics]: Methodology and Techniques
dc.subjectComputing methodologies → Computer graphics
dc.subjectComputer vision representations
dc.subjectI.3.6 [Computer Graphics]
dc.subjectMethodology and Techniques
dc.titleStyleMM: Stylized 3D Morphable Face Model via Text Driven Aligned Image Translationen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
cgf70234.pdf
Size:
60.04 MB
Format:
Adobe Portable Document Format
Download
Collections
44-Issue 7