Common-sense reasoning for human action recognition

J. Martínez del Rincón, Maria J. Santofimia, Jean-Christophe Nebel

Research output: Contribution to journalArticle

12 Citations (Scopus)
308 Downloads (Pure)

Abstract

This paper presents a novel method that leverages reasoning capabilities in a computer vision system dedicated to human action recognition. The proposed methodology is decomposed into two stages. First, a machine learning based algorithm - known as bag of words - gives a first estimate of action classification from video sequences, by performing an image feature analysis. Those results are afterward passed to a common-sense reasoning system, which analyses, selects and corrects the initial estimation yielded by the machine learning algorithm. This second stage resorts to the knowledge implicit in the rationality that motivates human behaviour. Experiments are performed in realistic conditions, where poor recognition rates by the machine learning techniques are significantly improved by the second stage in which common-sense knowledge and reasoning capabilities have been leveraged. This demonstrates the value of integrating common-sense capabilities into a computer vision pipeline.
Original languageEnglish
Pages (from-to)1849-1860
Number of pages12
JournalPattern Recognition Letters
Volume34
Issue number15
Early online date21 Nov 2012
DOIs
Publication statusPublished - 01 Nov 2013

Bibliographical note

Copyright 2012 Elsevier B.V., All rights reserved.

Fingerprint Dive into the research topics of 'Common-sense reasoning for human action recognition'. Together they form a unique fingerprint.

  • Projects

    R1118ECI: Centre for Secure Information Technologies (CSIT)

    McCanny, J. V., Cowan, C., Crookes, D., Fusco, V., Linton, D., Liu, W., Miller, P., O'Neill, M., Scanlon, W. & Sezer, S.

    01/08/200930/06/2014

    Project: Research

    Cite this