Comparing Virtual Reality with Computer Monitors as Rating Environments for Affective Dimensions in Social Interactions

Gary McKeown, Christine Spencer, Alex Patterson, Thomas Creaney, Damien Dupre

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Virtual Reality technologies present exciting oppor- tunities for increasing the understanding of affect and emotion- related phenomena. However, they remain understudied both from the principles of data gathering and for their prospec- tive use as annotation tools. A 2x2 mixed design experiment assessed the influence of presentation of emotion related so- cial interactions in virtual reality and using more traditional database techniques. Participants rated the interactions along four emotion-related dimensions (empathy, rapport, trust and tone), for conversational “floor” dominance and how they made the raters “feel” on a valence dimension. Forty-three participants watched clips of a recorded conversation. Sig- nificant differences were found between the rapport, trust, emotional tone, floor dominance and subjective feeling ratings when comparing emotional valence of the materials; however, there was no effect of presentation medium for any measure– presenting in virtual reality made no difference to a raters annotations when compared to more traditional computer monitor style ratings. Implications for using virtual reality for database creation and annotation are discussed and the value is assessed given the current state of these technologies. We conclude that this does not diminish the need for research in Virtual Reality in Affective Computing but call for caution in the interpretation of results.
Original languageEnglish
Title of host publication2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII)
Publisher IEEE
Pages464-469
Number of pages6
ISBN (Electronic)978-1-5386-0563-9
DOIs
Publication statusPublished - 01 Feb 2018
Event2017 International Conference on Affective Computing and Intelligent Interaction - San Antonio, United States
Duration: 23 Oct 201726 Oct 2017
http://acii2017.org/

Publication series

NameInternational Conference on Affective Computing and Intelligent Interaction (ACII)
ISSN (Print)2156-8103
ISSN (Electronic)2156-8111

Conference

Conference2017 International Conference on Affective Computing and Intelligent Interaction
Abbreviated titleACII 2017
CountryUnited States
CitySan Antonio
Period23/10/201726/10/2017
Internet address

Fingerprint

Computer monitors
Virtual reality
Experiments

Cite this

McKeown, G., Spencer, C., Patterson, A., Creaney, T., & Dupre, D. (2018). Comparing Virtual Reality with Computer Monitors as Rating Environments for Affective Dimensions in Social Interactions. In 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 464-469). (International Conference on Affective Computing and Intelligent Interaction (ACII)). IEEE . https://doi.org/10.1109/ACII.2017.8273640
McKeown, Gary ; Spencer, Christine ; Patterson, Alex ; Creaney, Thomas ; Dupre, Damien. / Comparing Virtual Reality with Computer Monitors as Rating Environments for Affective Dimensions in Social Interactions. 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE , 2018. pp. 464-469 (International Conference on Affective Computing and Intelligent Interaction (ACII)).
@inproceedings{4ae383d494b1438eb8c8faae5f7da04e,
title = "Comparing Virtual Reality with Computer Monitors as Rating Environments for Affective Dimensions in Social Interactions",
abstract = "Virtual Reality technologies present exciting oppor- tunities for increasing the understanding of affect and emotion- related phenomena. However, they remain understudied both from the principles of data gathering and for their prospec- tive use as annotation tools. A 2x2 mixed design experiment assessed the influence of presentation of emotion related so- cial interactions in virtual reality and using more traditional database techniques. Participants rated the interactions along four emotion-related dimensions (empathy, rapport, trust and tone), for conversational “floor” dominance and how they made the raters “feel” on a valence dimension. Forty-three participants watched clips of a recorded conversation. Sig- nificant differences were found between the rapport, trust, emotional tone, floor dominance and subjective feeling ratings when comparing emotional valence of the materials; however, there was no effect of presentation medium for any measure– presenting in virtual reality made no difference to a raters annotations when compared to more traditional computer monitor style ratings. Implications for using virtual reality for database creation and annotation are discussed and the value is assessed given the current state of these technologies. We conclude that this does not diminish the need for research in Virtual Reality in Affective Computing but call for caution in the interpretation of results.",
author = "Gary McKeown and Christine Spencer and Alex Patterson and Thomas Creaney and Damien Dupre",
year = "2018",
month = "2",
day = "1",
doi = "10.1109/ACII.2017.8273640",
language = "English",
series = "International Conference on Affective Computing and Intelligent Interaction (ACII)",
publisher = "IEEE",
pages = "464--469",
booktitle = "2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII)",

}

McKeown, G, Spencer, C, Patterson, A, Creaney, T & Dupre, D 2018, Comparing Virtual Reality with Computer Monitors as Rating Environments for Affective Dimensions in Social Interactions. in 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII). International Conference on Affective Computing and Intelligent Interaction (ACII), IEEE , pp. 464-469, 2017 International Conference on Affective Computing and Intelligent Interaction, San Antonio, United States, 23/10/2017. https://doi.org/10.1109/ACII.2017.8273640

Comparing Virtual Reality with Computer Monitors as Rating Environments for Affective Dimensions in Social Interactions. / McKeown, Gary; Spencer, Christine; Patterson, Alex; Creaney, Thomas; Dupre, Damien.

2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE , 2018. p. 464-469 (International Conference on Affective Computing and Intelligent Interaction (ACII)).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Comparing Virtual Reality with Computer Monitors as Rating Environments for Affective Dimensions in Social Interactions

AU - McKeown, Gary

AU - Spencer, Christine

AU - Patterson, Alex

AU - Creaney, Thomas

AU - Dupre, Damien

PY - 2018/2/1

Y1 - 2018/2/1

N2 - Virtual Reality technologies present exciting oppor- tunities for increasing the understanding of affect and emotion- related phenomena. However, they remain understudied both from the principles of data gathering and for their prospec- tive use as annotation tools. A 2x2 mixed design experiment assessed the influence of presentation of emotion related so- cial interactions in virtual reality and using more traditional database techniques. Participants rated the interactions along four emotion-related dimensions (empathy, rapport, trust and tone), for conversational “floor” dominance and how they made the raters “feel” on a valence dimension. Forty-three participants watched clips of a recorded conversation. Sig- nificant differences were found between the rapport, trust, emotional tone, floor dominance and subjective feeling ratings when comparing emotional valence of the materials; however, there was no effect of presentation medium for any measure– presenting in virtual reality made no difference to a raters annotations when compared to more traditional computer monitor style ratings. Implications for using virtual reality for database creation and annotation are discussed and the value is assessed given the current state of these technologies. We conclude that this does not diminish the need for research in Virtual Reality in Affective Computing but call for caution in the interpretation of results.

AB - Virtual Reality technologies present exciting oppor- tunities for increasing the understanding of affect and emotion- related phenomena. However, they remain understudied both from the principles of data gathering and for their prospec- tive use as annotation tools. A 2x2 mixed design experiment assessed the influence of presentation of emotion related so- cial interactions in virtual reality and using more traditional database techniques. Participants rated the interactions along four emotion-related dimensions (empathy, rapport, trust and tone), for conversational “floor” dominance and how they made the raters “feel” on a valence dimension. Forty-three participants watched clips of a recorded conversation. Sig- nificant differences were found between the rapport, trust, emotional tone, floor dominance and subjective feeling ratings when comparing emotional valence of the materials; however, there was no effect of presentation medium for any measure– presenting in virtual reality made no difference to a raters annotations when compared to more traditional computer monitor style ratings. Implications for using virtual reality for database creation and annotation are discussed and the value is assessed given the current state of these technologies. We conclude that this does not diminish the need for research in Virtual Reality in Affective Computing but call for caution in the interpretation of results.

U2 - 10.1109/ACII.2017.8273640

DO - 10.1109/ACII.2017.8273640

M3 - Conference contribution

T3 - International Conference on Affective Computing and Intelligent Interaction (ACII)

SP - 464

EP - 469

BT - 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII)

PB - IEEE

ER -

McKeown G, Spencer C, Patterson A, Creaney T, Dupre D. Comparing Virtual Reality with Computer Monitors as Rating Environments for Affective Dimensions in Social Interactions. In 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII). IEEE . 2018. p. 464-469. (International Conference on Affective Computing and Intelligent Interaction (ACII)). https://doi.org/10.1109/ACII.2017.8273640