Towards Scientific Benchmarks: On Increasing the Credibility of Benchmarks

dc.contributor.author	Gundersen, Odd Erik	en_US
dc.contributor.editor	I. Pratikakis and M. Spagnuolo and T. Theoharis and L. Van Gool and R. Veltkamp	en_US
dc.date.accessioned	2015-04-27T11:03:37Z
dc.date.available	2015-04-27T11:03:37Z
dc.date.issued	2015	en_US
dc.identifier.uri	http://dx.doi.org/10.2312/3dor.20151059	en_US
dc.description.abstract	Problem: Increasing the credibility of results from scientific benchmarks. Goal: Specify what exactly is required in order for a benchmark to be scientific. Contribution: (i) Specification of what it entails for a benchmark to be scientific, (ii) a metric for measuring the replicability of an experiment, (iii) a metric for measuring the replicability of a set of experiments, and (iv) Analysis of the replicability of SHREC 2015. Result: Replicability of SHREC 2015 can be increased by open sourcing the methods compared and improving documentation.	en_US
dc.publisher	The Eurographics Association	en_US
dc.subject	I.5.2 [Pattern Recognition]	en_US
dc.subject	Design Methodology	en_US
dc.title	Towards Scientific Benchmarks: On Increasing the Credibility of Benchmarks	en_US
dc.description.seriesinformation	Eurographics Workshop on 3D Object Retrieval	en_US
dc.description.sectionheaders	Posters	en_US
dc.identifier.doi	10.2312/3dor.20151059	en_US
dc.identifier.pages	83-86	en_US