Multimodal Interfaces: an Introduction to ENACTIVE systems

Abstract

Enactive Interfaces are related to a fundamental "interaction" concept which is not exploited by most of the existing human-computer interface technologies. The traditional interaction with the information mediated by a computer is mostly based on symbolic or iconic knowledge, and not on enactive knowledge. While in the symbolic way of learning knowledge is stored as words, mathematical symbols or other symbol systems, in the iconic stage knowledge is stored in the form of visual images, such as diagrams and illustrations that can accompany verbal information. On the other hand, enactive knowledge is a form of knowledge based on the active use of the hand for apprehension tasks. Enactive knowledge is not simply multisensory mediated knowledge, but knowledge stored in the form of motor responses and acquired by the act of "doing". A typical example of enactive knowledge is constituted by the competence required by tasks such as typing, driving a car, dancing, playing a musical instrument, modelling objects from clay, which would be difficult to describe in an iconic or symbolic form. This type of knowledge transmission can be considered the most direct, in the sense that it is natural and intuitive, since it is based on the experience and on the perceptual responses to motor acts.