Affect sensing in an affective interactive e-theatre for autistic children

Li Zhang

Research output: Chapter in Book/Report/Conference proceedingChapterResearch

16 Downloads (Pure)

Abstract

In this paper we describe an interactive emotional
social virtual framework for autistic young people age 11 –
14 to learn verbal and non-verbal emotional expression in
role-play situations. In order to provide an interactive
learning environment with some degree of automatic
metaphorical understanding from open-ended text input,
new developments on affect detection for the processing of
several metaphorical languages have been presented. The
emotional gesture and facial animation have been created
for users’ avatars and activated by affective states detected
from users’ text input. Emotion appraisal and affect
detection functions have been embodied in an intelligent
conversational agent, who interacts with human users for
drama improvisation. We have also conducted user testing
with 24 autistic children to evaluate the overall framework.
The work has the potential to improve autistic young
people’s ability in language learning and their social
connection with other people. It contributes to the
conference themes on natural language processing,
interactive affective social interfaces and user studies of
intelligent interfaces.
Original languageEnglish
Title of host publicationProceedings of the 6th international conference on natural language processing and knowledge engineering, NLP-KE 2010
PublisherIEEE Computer Society
Pages1-8
ISBN (Print)9781424468966
DOIs
Publication statusPublished - 2010
Event2010 International Conference on Natural Language Processing and Knowledge Engineering (NLP-KE) - Beijing, China
Duration: 21 Aug 201023 Aug 2010

Conference

Conference2010 International Conference on Natural Language Processing and Knowledge Engineering (NLP-KE)
Period21/08/1023/08/10

Fingerprint

Theaters
Intelligent agents
Processing
Animation
Testing

Cite this

Zhang, L. (2010). Affect sensing in an affective interactive e-theatre for autistic children. In Proceedings of the 6th international conference on natural language processing and knowledge engineering, NLP-KE 2010 (pp. 1-8). IEEE Computer Society. https://doi.org/10.1109/NLPKE.2010.5587813
Zhang, Li. / Affect sensing in an affective interactive e-theatre for autistic children. Proceedings of the 6th international conference on natural language processing and knowledge engineering, NLP-KE 2010. IEEE Computer Society, 2010. pp. 1-8
@inbook{7129f0bfa0264326bc2b7fffb20a414e,
title = "Affect sensing in an affective interactive e-theatre for autistic children",
abstract = "In this paper we describe an interactive emotional social virtual framework for autistic young people age 11 – 14 to learn verbal and non-verbal emotional expression in role-play situations. In order to provide an interactive learning environment with some degree of automatic metaphorical understanding from open-ended text input, new developments on affect detection for the processing of several metaphorical languages have been presented. The emotional gesture and facial animation have been created for users’ avatars and activated by affective states detected from users’ text input. Emotion appraisal and affect detection functions have been embodied in an intelligent conversational agent, who interacts with human users for drama improvisation. We have also conducted user testing with 24 autistic children to evaluate the overall framework. The work has the potential to improve autistic young people’s ability in language learning and their social connection with other people. It contributes to the conference themes on natural language processing, interactive affective social interfaces and user studies of intelligent interfaces.",
author = "Li Zhang",
year = "2010",
doi = "10.1109/NLPKE.2010.5587813",
language = "English",
isbn = "9781424468966",
pages = "1--8",
booktitle = "Proceedings of the 6th international conference on natural language processing and knowledge engineering, NLP-KE 2010",
publisher = "IEEE Computer Society",
address = "United States",

}

Zhang, L 2010, Affect sensing in an affective interactive e-theatre for autistic children. in Proceedings of the 6th international conference on natural language processing and knowledge engineering, NLP-KE 2010. IEEE Computer Society, pp. 1-8, 2010 International Conference on Natural Language Processing and Knowledge Engineering (NLP-KE), 21/08/10. https://doi.org/10.1109/NLPKE.2010.5587813

Affect sensing in an affective interactive e-theatre for autistic children. / Zhang, Li.

Proceedings of the 6th international conference on natural language processing and knowledge engineering, NLP-KE 2010. IEEE Computer Society, 2010. p. 1-8.

Research output: Chapter in Book/Report/Conference proceedingChapterResearch

TY - CHAP

T1 - Affect sensing in an affective interactive e-theatre for autistic children

AU - Zhang, Li

PY - 2010

Y1 - 2010

N2 - In this paper we describe an interactive emotional social virtual framework for autistic young people age 11 – 14 to learn verbal and non-verbal emotional expression in role-play situations. In order to provide an interactive learning environment with some degree of automatic metaphorical understanding from open-ended text input, new developments on affect detection for the processing of several metaphorical languages have been presented. The emotional gesture and facial animation have been created for users’ avatars and activated by affective states detected from users’ text input. Emotion appraisal and affect detection functions have been embodied in an intelligent conversational agent, who interacts with human users for drama improvisation. We have also conducted user testing with 24 autistic children to evaluate the overall framework. The work has the potential to improve autistic young people’s ability in language learning and their social connection with other people. It contributes to the conference themes on natural language processing, interactive affective social interfaces and user studies of intelligent interfaces.

AB - In this paper we describe an interactive emotional social virtual framework for autistic young people age 11 – 14 to learn verbal and non-verbal emotional expression in role-play situations. In order to provide an interactive learning environment with some degree of automatic metaphorical understanding from open-ended text input, new developments on affect detection for the processing of several metaphorical languages have been presented. The emotional gesture and facial animation have been created for users’ avatars and activated by affective states detected from users’ text input. Emotion appraisal and affect detection functions have been embodied in an intelligent conversational agent, who interacts with human users for drama improvisation. We have also conducted user testing with 24 autistic children to evaluate the overall framework. The work has the potential to improve autistic young people’s ability in language learning and their social connection with other people. It contributes to the conference themes on natural language processing, interactive affective social interfaces and user studies of intelligent interfaces.

U2 - 10.1109/NLPKE.2010.5587813

DO - 10.1109/NLPKE.2010.5587813

M3 - Chapter

SN - 9781424468966

SP - 1

EP - 8

BT - Proceedings of the 6th international conference on natural language processing and knowledge engineering, NLP-KE 2010

PB - IEEE Computer Society

ER -

Zhang L. Affect sensing in an affective interactive e-theatre for autistic children. In Proceedings of the 6th international conference on natural language processing and knowledge engineering, NLP-KE 2010. IEEE Computer Society. 2010. p. 1-8 https://doi.org/10.1109/NLPKE.2010.5587813