User interaction with virtual agents generally takes place in virtual environments in which there is clear separation between the virtual actors and the user, due to the fact that in most cases, the user is in some way external to the virtual world. In Mixed-Reality Interactive Storytelling, the user’s video image is captured in real time and inserted into a virtual world populated by autonomous synthetic actors with which the user interacts. The user in turn watches the composite world projected on a large screen, following a ”magic mirror” metaphor. This context leads to re-investigating the techniques by which the user interacts with virtual actors, as well as exploring specific research problems. In this paper, we discuss some specificities of user interaction with virtual actors in Mixed Reality Interactive Storytelling. After a brief introduction to our system’s architecture and the example scenario supporting our experiments, we describe various techniques supporting multi-modal interaction with virtual actors.
|Name||Lecture notes in computer science|
|Conference||Intelligent Virtual Agents: 4th International Workshop|
|Abbreviated title||IVA 2003|
|Period||15/09/03 → 17/09/03|