Evaluation Test for 3D Computer Graphics Content Production Capability based on Simulation Methodology

Abstract

Through 15 years experience with the Certification Test of Computer Graphics by the Computer Graphic Arts Society, we have felt importance of a new style of test, namely simulation test (ST). The goal of ST is to evaluate the examinees knowledge and skills using simulation methodology. We conducted an experimental test session of ST in November 2005. In this experimental session, we also conducted a Paper and Pencil Test (PPT) for comparison. An assignment is shown to 75 testees by a storyboard. The testees read the storyboard, then, create answer work using ST software which we developed for this session. The testees would select and deploy characters, props, lights, and cameras, all of which has prepared to set parameters for the position, degree, focal length and etc. according to the timeline. The evaluation was conducted to check whether the testees' answer work is matched to the correct answer work. We analyzed results of both ST and PPT. We especially focused on the score difference and progress difference due to the level of proficiency of our testees operating ST software, and the correlation between their learning experiences and score, and on correlation between ST and PPT scores. From the results, we confirmed that the correlation between the scores of both ST and PPT was observed among all the testees, and that the scores of ST show the possibility of evaluating accumulation of skills of the testees to be able to brush up creativity for moving image content production with 3D computer graphics.