Towards a real-world brain-computer interface for image retrieval

Ben McCartney, Jesus Martinez-del-Rincon, Barry Devereux, Brian Murphy

Research output: Other contribution

Abstract

Brain decoding - the process of inferring a person's momentary cognitive state from their brain activity - has enormous potential in the field of human-computer interaction. In this study we propose a zero-shot EEG-to-image brain decoding approach which makes use of state-of-the-art EEG preprocessing and feature selection methods, and which maps EEG activity to biologically inspired computer vision and linguistic models. We apply this approach to solve the problem of identifying viewed images from recorded brain activity in a reliable and scalable way. We demonstrate competitive decoding accuracies across two EEG datasets, using a zero-shot learning framework more applicable to real-world image retrieval than traditional classification techniques.
Original languageEnglish
TypeOnline preprint
Media of outputbioRxiv preprint server
DOIs
Publication statusSubmitted - Jan 2019

Publication series

NamebioRxiv
PublisherCold Spring Harbor Laboratory Press

Fingerprint

Dive into the research topics of 'Towards a real-world brain-computer interface for image retrieval'. Together they form a unique fingerprint.

Cite this