Evaluating multimodal affective fusion using physiological signals

Stephen W. Gilroy, Marc O. Cavazza, Valentin Vervondel

Research output: Contribution to conferencePaperResearchpeer-review

21 Downloads (Pure)

Abstract

In this paper we present an evaluation of an affective multimodal fusion approach utilizing dimensional representations of emotion. The evaluation uses physiological signals as a reference measure of users’ emotional states. Surface electromyography (EMG) and galvanic skin response (GSR) signals are known to be correlated with specific dimensions of emotion (Pleasure and Arousal) and are compared here to real time continuous values of these dimensions obtained from affective multimodal fusion. The results (both qualitative and quantitative) suggest that the particular multimodal fusion approach described is consistent with physiological indicators of emotion, constituting a first positive evaluation of the approach.
Original languageEnglish
Pages53-62
DOIs
Publication statusPublished - 2011
Event16th International Conference on Intelligent User Interfaces - Palo Alto, United States
Duration: 13 Feb 201116 Feb 2011
Conference number: 16

Conference

Conference16th International Conference on Intelligent User Interfaces
Abbreviated titleIUI '11
CountryUnited States
CityPalo Alto
Period13/02/1116/02/11

Fingerprint

Fusion reactions
Electromyography
Skin

Cite this

Gilroy, S. W., Cavazza, M. O., & Vervondel, V. (2011). Evaluating multimodal affective fusion using physiological signals. 53-62. Paper presented at 16th International Conference on Intelligent User Interfaces, Palo Alto, United States. https://doi.org/10.1145/1943403.1943413
Gilroy, Stephen W. ; Cavazza, Marc O. ; Vervondel, Valentin. / Evaluating multimodal affective fusion using physiological signals. Paper presented at 16th International Conference on Intelligent User Interfaces, Palo Alto, United States.
@conference{15dcaa4e8f504a4c8955ffc585c57015,
title = "Evaluating multimodal affective fusion using physiological signals",
abstract = "In this paper we present an evaluation of an affective multimodal fusion approach utilizing dimensional representations of emotion. The evaluation uses physiological signals as a reference measure of users’ emotional states. Surface electromyography (EMG) and galvanic skin response (GSR) signals are known to be correlated with specific dimensions of emotion (Pleasure and Arousal) and are compared here to real time continuous values of these dimensions obtained from affective multimodal fusion. The results (both qualitative and quantitative) suggest that the particular multimodal fusion approach described is consistent with physiological indicators of emotion, constituting a first positive evaluation of the approach.",
author = "Gilroy, {Stephen W.} and Cavazza, {Marc O.} and Valentin Vervondel",
year = "2011",
doi = "10.1145/1943403.1943413",
language = "English",
pages = "53--62",
note = "16th International Conference on Intelligent User Interfaces, IUI '11 ; Conference date: 13-02-2011 Through 16-02-2011",

}

Gilroy, SW, Cavazza, MO & Vervondel, V 2011, 'Evaluating multimodal affective fusion using physiological signals' Paper presented at 16th International Conference on Intelligent User Interfaces, Palo Alto, United States, 13/02/11 - 16/02/11, pp. 53-62. https://doi.org/10.1145/1943403.1943413

Evaluating multimodal affective fusion using physiological signals. / Gilroy, Stephen W.; Cavazza, Marc O.; Vervondel, Valentin.

2011. 53-62 Paper presented at 16th International Conference on Intelligent User Interfaces, Palo Alto, United States.

Research output: Contribution to conferencePaperResearchpeer-review

TY - CONF

T1 - Evaluating multimodal affective fusion using physiological signals

AU - Gilroy, Stephen W.

AU - Cavazza, Marc O.

AU - Vervondel, Valentin

PY - 2011

Y1 - 2011

N2 - In this paper we present an evaluation of an affective multimodal fusion approach utilizing dimensional representations of emotion. The evaluation uses physiological signals as a reference measure of users’ emotional states. Surface electromyography (EMG) and galvanic skin response (GSR) signals are known to be correlated with specific dimensions of emotion (Pleasure and Arousal) and are compared here to real time continuous values of these dimensions obtained from affective multimodal fusion. The results (both qualitative and quantitative) suggest that the particular multimodal fusion approach described is consistent with physiological indicators of emotion, constituting a first positive evaluation of the approach.

AB - In this paper we present an evaluation of an affective multimodal fusion approach utilizing dimensional representations of emotion. The evaluation uses physiological signals as a reference measure of users’ emotional states. Surface electromyography (EMG) and galvanic skin response (GSR) signals are known to be correlated with specific dimensions of emotion (Pleasure and Arousal) and are compared here to real time continuous values of these dimensions obtained from affective multimodal fusion. The results (both qualitative and quantitative) suggest that the particular multimodal fusion approach described is consistent with physiological indicators of emotion, constituting a first positive evaluation of the approach.

U2 - 10.1145/1943403.1943413

DO - 10.1145/1943403.1943413

M3 - Paper

SP - 53

EP - 62

ER -

Gilroy SW, Cavazza MO, Vervondel V. Evaluating multimodal affective fusion using physiological signals. 2011. Paper presented at 16th International Conference on Intelligent User Interfaces, Palo Alto, United States. https://doi.org/10.1145/1943403.1943413