Food places classification in egocentric images using Siamese neural networks

Md Mostafa Kamal Sarker*, Syeda Furruka Banu, Hatem A. Rashwan, Mohamed Abdel-Nasser, Vivek Kumar Singh, Sylvie Chambon, Petia Radeva, Domenec Puig

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Wearable cameras are become more popular in recent years for capturing the unscripted moments of the first-person that help to analyze the users lifestyle. In this work, we aim to recognize the places related to food in egocentric images during a day to identify the daily food patterns of the first-person. Thus, this system can assist to improve their eating behavior to protect users against food-related diseases. In this paper, we use Siamese Neural Networks to learn the similarity between images from corresponding inputs for one-shot food places classification. We tested our proposed method with'MiniEgoFoodPlaces' with 15 food related places. The proposed Siamese Neural Networks model with MobileNet achieved an overall classification accuracy of 76.74% and 77.53% on the validation and test sets of the “MiniEgoFoodPlaces” dataset, respectively outperforming with the base models, such as ResNet50, InceptionV3, and InceptionResNetV2.

Original languageEnglish
Title of host publicationArtificial Intelligence Research and Development - Proceedings of the 22nd International Conference of the Catalan Association for Artificial Intelligence, CCIA 2019
EditorsJordi Sabater-Mir, Vicenc Torra, Isabel Aguilo, Manuel Gonzalez-Hidalgo
PublisherIOS Press
Pages145-151
Number of pages7
ISBN (Electronic)9781643680149
DOIs
Publication statusPublished - 2019
Externally publishedYes
Event22nd International Conference of the Catalan Association for Artificial Intelligence, CCIA 2019 - Mallorca, Spain
Duration: 23 Oct 201925 Oct 2019

Publication series

NameFrontiers in Artificial Intelligence and Applications
Volume319
ISSN (Print)0922-6389

Conference

Conference22nd International Conference of the Catalan Association for Artificial Intelligence, CCIA 2019
CountrySpain
CityMallorca
Period23/10/201925/10/2019

Keywords

  • Egocentric vision
  • Food pattern classification
  • One-shot learning
  • Scene classification
  • Siamese neural networks

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Food places classification in egocentric images using Siamese neural networks'. Together they form a unique fingerprint.

Cite this