Symbolic Event Visualization for Analyzing User Input and Behavior of Augmented Reality Sessions

Abstract

Interacting with augmented reality (AR) systems involves different domains and is more complex than interacting with traditional user interfaces. To analyze AR interactions, we suggest an event visualization approach that discerns different event layers on a timeline. It is based on symbolic event representations of typical user actions, such as physical movement or interaction with scene objects. Although focusing on the Microsoft HoloLens 2, the approach can generalize to similar environments and provide a basis for developing a more comprehensive visual analytics and annotation solution for AR usage sessions.