Evaluating multimodal affective fusion using physiological signals

Stephen W. Gilroy, Marc O. Cavazza, Valentin Vervondel

Research output: Contribution to conferencePaperpeer-review

267 Downloads (Pure)


In this paper we present an evaluation of an affective multimodal fusion approach utilizing dimensional representations of emotion. The evaluation uses physiological signals as a reference measure of users’ emotional states. Surface electromyography (EMG) and galvanic skin response (GSR) signals are known to be correlated with specific dimensions of emotion (Pleasure and Arousal) and are compared here to real time continuous values of these dimensions obtained from affective multimodal fusion. The results (both qualitative and quantitative) suggest that the particular multimodal fusion approach described is consistent with physiological indicators of emotion, constituting a first positive evaluation of the approach.
Original languageEnglish
Publication statusPublished - 2011
Event16th International Conference on Intelligent User Interfaces - Palo Alto, United States
Duration: 13 Feb 201116 Feb 2011
Conference number: 16


Conference16th International Conference on Intelligent User Interfaces
Abbreviated titleIUI '11
Country/TerritoryUnited States
CityPalo Alto


Dive into the research topics of 'Evaluating multimodal affective fusion using physiological signals'. Together they form a unique fingerprint.

Cite this