Intelligent Control for Haptic Displays

Abstract

Usually, a mouse is used for input activities only, whereas output from the computer is sent via the monitor and one or two loudspeakers. But why not use the mouse for output, too? For instance, if it would be possible to predict the next interaction object the user wants to click on, a mouse with a mechanical brake could stop the cursor movement at the desired position. This kind of aid is especially attractive for small targets like resize handles of windows or small buttons.In this paper, we present an approach for the integration of haptic feedback in everyday graphical user interfaces. We use a specialized mouse which, is able to apply simple haptic information, to the user s hand and index finger. A multi-agent system has been designed which observes the user in order to predict the next interaction object and launch haptic feedback, thus supporting positioning actions with the mouse. Although primarily designed in order to provide intelligent haptic feedback, the system can be combined with other output modalities as well, due to its modular and flexible architecture.