Interacting with Virtual Agents in Mixed Reality Interactive Storytelling

Marc Cavazza, Olivier Martin, Fred Charles, Steven J. Mead, Xavier Marichal

Research output: Chapter in Book/Report/Conference proceedingChapter


User interaction with virtual agents generally takes place in virtual environments in which there is clear separation between the virtual actors and the user, due to the fact that in most cases, the user is in some way external to the virtual world. In Mixed-Reality Interactive Storytelling, the user’s video image is captured in real time and inserted into a virtual world populated by autonomous synthetic actors with which the user interacts. The user in turn watches the composite world projected on a large screen, following a ”magic mirror” metaphor. This context leads to re-investigating the techniques by which the user interacts with virtual actors, as well as exploring specific research problems. In this paper, we discuss some specificities of user interaction with virtual actors in Mixed Reality Interactive Storytelling. After a brief introduction to our system’s architecture and the example scenario supporting our experiments, we describe various techniques supporting multi-modal interaction with virtual actors.
Original languageEnglish
Title of host publicationIntelligent virtual agents
EditorsThomas Rist, Ruth Aylett, Daniel Ballin, Jeff Rickel
Place of PublicationBerlin
Publication statusPublished - 2003
EventIntelligent Virtual Agents: 4th International Workshop - Kloster Irsee, Germany
Duration: 15 Sept 200317 Sept 2003

Publication series

NameLecture notes in computer science
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


ConferenceIntelligent Virtual Agents: 4th International Workshop
Abbreviated titleIVA 2003
CityKloster Irsee


Dive into the research topics of 'Interacting with Virtual Agents in Mixed Reality Interactive Storytelling'. Together they form a unique fingerprint.

Cite this