Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions

Damien Dupré , Nicole Andelic, Gawain Morrison, Gary McKeown

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)
234 Downloads (Pure)

Abstract

Automatic facial expression recognition systems can provide information about our emotions and how they change over time. However, based on different statistical methods the results of automatic systems have not yet been compared. In the current paper we evaluate the emotion detection between three different commercial systems (i.e.Affectiva, Kairos and Microsoft) when detecting dynamic and spontaneous facial expressions. Even if the study was performed on a limited sample of videos, the results show significant differences between the systems for the same video and per system across comparable facial expressions. Finally, we reflect on the implications according the generalization of the results provided by automatic emotion detection.
Original languageEnglish
Title of host publication2018 IEEE International Conference on Pervasive Computing and Communications: Proceedings
Publisher IEEE
Pages627-632
Number of pages6
ISBN (Electronic)978-1-5386-3227-7
ISBN (Print)978-1-5386-3228-4
DOIs
Publication statusEarly online date - 08 Oct 2018
Event16th IEEE International Conference on Pervasive Computing and Communications - Athens, Greece
Duration: 19 Mar 201823 Mar 2018

Conference

Conference16th IEEE International Conference on Pervasive Computing and Communications
Abbreviated titlePerCom 2018
CountryGreece
CityAthens
Period19/03/201823/03/2018

Fingerprint

Statistical methods

Cite this

Dupré , D., Andelic, N., Morrison, G., & McKeown, G. (2018). Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. In 2018 IEEE International Conference on Pervasive Computing and Communications: Proceedings (pp. 627-632). IEEE . https://doi.org/10.1109/PERCOMW.2018.8480127
Dupré , Damien ; Andelic, Nicole ; Morrison, Gawain ; McKeown, Gary. / Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. 2018 IEEE International Conference on Pervasive Computing and Communications: Proceedings. IEEE , 2018. pp. 627-632
@inproceedings{c741f201bea9425a96dbffcd88c58d02,
title = "Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions",
abstract = "Automatic facial expression recognition systems can provide information about our emotions and how they change over time. However, based on different statistical methods the results of automatic systems have not yet been compared. In the current paper we evaluate the emotion detection between three different commercial systems (i.e.Affectiva, Kairos and Microsoft) when detecting dynamic and spontaneous facial expressions. Even if the study was performed on a limited sample of videos, the results show significant differences between the systems for the same video and per system across comparable facial expressions. Finally, we reflect on the implications according the generalization of the results provided by automatic emotion detection.",
author = "Damien Dupr{\'e} and Nicole Andelic and Gawain Morrison and Gary McKeown",
year = "2018",
month = "10",
day = "8",
doi = "10.1109/PERCOMW.2018.8480127",
language = "English",
isbn = "978-1-5386-3228-4",
pages = "627--632",
booktitle = "2018 IEEE International Conference on Pervasive Computing and Communications: Proceedings",
publisher = "IEEE",

}

Dupré , D, Andelic, N, Morrison, G & McKeown, G 2018, Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. in 2018 IEEE International Conference on Pervasive Computing and Communications: Proceedings. IEEE , pp. 627-632, 16th IEEE International Conference on Pervasive Computing and Communications, Athens, Greece, 19/03/2018. https://doi.org/10.1109/PERCOMW.2018.8480127

Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. / Dupré , Damien; Andelic, Nicole; Morrison, Gawain; McKeown, Gary.

2018 IEEE International Conference on Pervasive Computing and Communications: Proceedings. IEEE , 2018. p. 627-632.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions

AU - Dupré , Damien

AU - Andelic, Nicole

AU - Morrison, Gawain

AU - McKeown, Gary

PY - 2018/10/8

Y1 - 2018/10/8

N2 - Automatic facial expression recognition systems can provide information about our emotions and how they change over time. However, based on different statistical methods the results of automatic systems have not yet been compared. In the current paper we evaluate the emotion detection between three different commercial systems (i.e.Affectiva, Kairos and Microsoft) when detecting dynamic and spontaneous facial expressions. Even if the study was performed on a limited sample of videos, the results show significant differences between the systems for the same video and per system across comparable facial expressions. Finally, we reflect on the implications according the generalization of the results provided by automatic emotion detection.

AB - Automatic facial expression recognition systems can provide information about our emotions and how they change over time. However, based on different statistical methods the results of automatic systems have not yet been compared. In the current paper we evaluate the emotion detection between three different commercial systems (i.e.Affectiva, Kairos and Microsoft) when detecting dynamic and spontaneous facial expressions. Even if the study was performed on a limited sample of videos, the results show significant differences between the systems for the same video and per system across comparable facial expressions. Finally, we reflect on the implications according the generalization of the results provided by automatic emotion detection.

U2 - 10.1109/PERCOMW.2018.8480127

DO - 10.1109/PERCOMW.2018.8480127

M3 - Conference contribution

SN - 978-1-5386-3228-4

SP - 627

EP - 632

BT - 2018 IEEE International Conference on Pervasive Computing and Communications: Proceedings

PB - IEEE

ER -

Dupré D, Andelic N, Morrison G, McKeown G. Accuracy of three commercial automatic emotion recognition systems across different individuals and their facial expressions. In 2018 IEEE International Conference on Pervasive Computing and Communications: Proceedings. IEEE . 2018. p. 627-632 https://doi.org/10.1109/PERCOMW.2018.8480127