Generating 3D Faces using Multi-column Graph Convolutional Networks
View/ Open
Date
2019Author
Li, Kun
Liu, Jingying
Lai, Yu-Kun
Yang, Jingyu
Metadata
Show full item recordAbstract
In this work, we introduce multi-column graph convolutional networks (MGCNs), a deep generative model for 3D mesh surfaces that effectively learns a non-linear facial representation. We perform spectral decomposition of meshes and apply convolutions directly in the frequency domain. Our network architecture involves multiple columns of graph convolutional networks (GCNs), namely large GCN (L-GCN), medium GCN (M-GCN) and small GCN (S-GCN), with different filter sizes to extract features at different scales. L-GCN is more useful to extract large-scale features, whereas S-GCN is effective for extracting subtle and fine-grained features, and M-GCN captures information in between. Therefore, to obtain a high-quality representation, we propose a selective fusion method that adaptively integrates these three kinds of information. Spatially non-local relationships are also exploited through a self-attention mechanism to further improve the representation ability in the latent vector space. Through extensive experiments, we demonstrate the superiority of our end-to-end framework in improving the accuracy of 3D face reconstruction. Moreover, with the help of variational inference, our model has excellent generating ability.
BibTeX
@article {10.1111:cgf.13830,
journal = {Computer Graphics Forum},
title = {{Generating 3D Faces using Multi-column Graph Convolutional Networks}},
author = {Li, Kun and Liu, Jingying and Lai, Yu-Kun and Yang, Jingyu},
year = {2019},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.13830}
}
journal = {Computer Graphics Forum},
title = {{Generating 3D Faces using Multi-column Graph Convolutional Networks}},
author = {Li, Kun and Liu, Jingying and Lai, Yu-Kun and Yang, Jingyu},
year = {2019},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.13830}
}