Bonn Appearance Benchmark

Abstract

There is a general shortage of standardized comparisons in the field of appearance modeling. We therefore introduce a benchmark for assessing the quality of reflectance models on a dataset of high quality material measurements obtained with a commercial appearance scanner. The dataset currently consists of 56 fabric materials which are measured as radiometrically calibrated HDR images together with a precise surface geometry. We pose a public challenge to attract further participation and spark new research. Participants evaluate their models on provided directional light and view sampling to recreate the appearance of a set of unseen images per material. The results are automatically evaluated under various image metrics and ranked in a public leaderboard. Our benchmark provides standardized testing and thus enables fair comparisons between related works. We also release baseline SVBRDF material fits.