FORHHSS-TEA, Support to the Individual Work System for People With Autism Spectrum Disorder Using Virtual and Augmented Reality

Abstract

The Individual Work System (IWS) is an essential element from the TEACCH program, designed by The University of North Carolina (USA), one of the most used all over the world for work with persons with Autism Spectrum Disorder (ASD). The FORHHSS-TEA project uses spatial augmented reality and virtual reality technologies, following the IWS, to help persons with ASD to develop areas where they usually have problems. In the VR version, the end-users wear virtual reality glasses and 3D scanners to detect their hands in order to interact with a virtual setting. In the AR version, participants interact with a real scenario that is augmented with projection lights in order to improve independent completion of tasks. Thus, many technologies are involved to evaluate the process: eye tracking, biosignals, and emotion recognition through facial analysis and IP cameras. By using these technologies, the concentration level and the state of the person with ASD are evaluated. In the platform, there are also pressure sensors to process the user interaction with the platform elements. The platform has been evaluated with 4 persons with ASD during 5 weeks. In this paper, it is presented the design of the platform, the session description and the results of the evaluation.