An Event Driven Fusion Approach for Enjoyment Recognition in Real-time

Florian Lingenfelser, Johannes Wagner, Elisabeth Andre, Gary McKeown, Will Curran

Research output: Chapter in Book/Report/Conference proceedingConference contribution

18 Citations (Scopus)
321 Downloads (Pure)

Abstract

Social signals and interpretation of carried information is of high importance in Human Computer Interaction. Often used for affect recognition, the cues within these signals are displayed in various modalities. Fusion of multi-modal signals is a natural and interesting way to improve automatic classification of emotions transported in social signals. Throughout most present studies, uni-modal affect recognition as well as multi-modal fusion, decisions are forced for fixed annotation segments across all modalities. In this paper, we investigate the less prevalent approach of event driven fusion, which indirectly accumulates asynchronous events in all modalities for final predictions. We present a fusion approach, handling short-timed events in a vector space, which is of special interest for real-time applications. We compare results of segmentation based uni-modal classification and fusion schemes to the event driven fusion approach. The evaluation is carried out via detection of enjoyment-episodes within the audiovisual Belfast Story-Telling Corpus.
Original languageEnglish
Title of host publicationMM '14 Proceedings of the 22nd ACM International Conference on Multimedia
PublisherAssociation for Computing Machinery
Pages377-386
Number of pages10
ISBN (Print)9781450330633
DOIs
Publication statusPublished - 03 Nov 2014
Event2014 ACM Conference on Multimedia, MM 2014 - Orlando, United States
Duration: 03 Nov 201407 Nov 2014

Conference

Conference2014 ACM Conference on Multimedia, MM 2014
CountryUnited States
CityOrlando
Period03/11/201407/11/2014

Keywords

  • Affect recognition
  • Event-driven fusion
  • Multi-modal fusion
  • Social signal processing

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Media Technology
  • Software

Fingerprint Dive into the research topics of 'An Event Driven Fusion Approach for Enjoyment Recognition in Real-time'. Together they form a unique fingerprint.

  • Cite this

    Lingenfelser, F., Wagner, J., Andre, E., McKeown, G., & Curran, W. (2014). An Event Driven Fusion Approach for Enjoyment Recognition in Real-time. In MM '14 Proceedings of the 22nd ACM International Conference on Multimedia (pp. 377-386). Association for Computing Machinery. https://doi.org/10.1145/2647868.2654924