Show simple item record

dc.contributor.authorZell, Eduarden_US
dc.contributor.authorMcDonnell, Rachelen_US
dc.contributor.editorChaine, Raphaëlleen_US
dc.contributor.editorKim, Min H.en_US
dc.date.accessioned2022-04-22T06:27:11Z
dc.date.available2022-04-22T06:27:11Z
dc.date.issued2022
dc.identifier.issn1467-8659
dc.identifier.urihttps://doi.org/10.1111/cgf.14463
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14463
dc.description.abstractAn abundance of older, as well as recent work exists at the intersection of computer vision and computer graphics on accurate estimation of dynamic facial landmarks with applications in facial animation, emotion recognition, and beyond. However, only a few publications exist that optimize the actual layout of facial landmarks to ensure an optimal trade-off between compact layouts and detailed capturing. At the same time, we observe that applications like social games prefer simplicity and performance over detail to reduce the computational budget especially on mobile devices. Other common attributes of such applications are predefined low-dimensional models to animate and a large, diverse user-base. In contrast to existing methods that focus on creating person-specific facial landmarks, we suggest to derive application-specific facial landmarks. We formulate our optimization method on the widely adopted blendshape model. First, a score is defined suitable to compute a characteristic landmark for each blendshape. In a following step, we optimize a global function, which mimics merging of similar landmarks to one. The optimization is solved in less than a second using integer linear programming and guarantees a globally optimal solution to an NP-hard problem. Our application-specific approach is faster and fundamentally different to previous, actor-specific methods. Resulting layouts are more similar to empirical layouts. Compared to empirical landmarks, our layouts require only a fraction of landmarks to achieve the same numerical error when reconstructing the animation from landmarks. The method is compared against previous work and tested on various blendshape models, representing a wide spectrum of applications.en_US
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.titleCompact Facial Landmark Layouts for Performance Captureen_US
dc.description.seriesinformationComputer Graphics Forum
dc.description.sectionheadersAnimation and Motion Capture
dc.description.volume41
dc.description.number2
dc.identifier.doi10.1111/cgf.14463
dc.identifier.pages121-133
dc.identifier.pages13 pages


Files in this item

Thumbnail
Thumbnail

This item appears in the following Collection(s)

Show simple item record