A Practical Approach to Physically-Based Reproduction of Diffusive Cosmetics

Abstract

In this paper, we introduce so-called the bSX method as a new way to utilize the Kubelka-Munk (K-M) model. Assuming the material is completely diffusive, the K-M model gives the reflectance and transmittance of the material from the observation of the material applied on a backing, where the observation includes the thickness of the material application. By rearranging the original K-M equation, we propose that the reflectance and transmittance can be calculated without knowing the thickness. This is a practically useful contribution. Based on the above finding, we develop the bSX method which can (1) capture the material specific parameters from the two photos - taken before and after the material application, and (2) reproduce its effect on a novel backing. We experimented the proposed method in various cases related to virtual cosmetic try-on, which include (1) capture from a single color backing, (2) capture from human skin backing, (3) reproduction of varying thickness effect, (4) reproduction of multi-layer cosmetic application effect, (5) applying the proposed method to makeup transfer. Compared to previous image-based makeup transfer methods, the bSX method reproduces the feel of the cosmetics more accurately.