Gesture and Emotional Design in Multimodal Human- Computer Interaction using Semiotic Analysis.
The design of gesture-based interactive systems, where an emotional response may be potentially evoked, is a substantial and enduring challenge for designers of interactive systems. The discussion to follow looks at the use of semiotics to analyse expressive gesture generation in theatre, yoga, and multimodal human-computer interaction to establish design foundations, these being interpretable, ephemeral, and programmable elements. A description of an interactive gestural film game To be or not to be is included as an appendix showing the application of the elements.
emotion, gesture, metaphor, metonymy, ennounciation