Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search

Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on sp...

ver descrição completa

Detalhes bibliográficos
Autores: Kamienkowski, Juan Esteban, Varatharajah, Alexander, Sigman, Mariano, Ison, Matias Julian
Formato: artículo
Estado:Versión publicada
Fecha de publicación:2018
País:Argentina
Recursos:Consejo Nacional de Investigaciones Científicas y Técnicas
Repositorio:CONICET Digital (CONICET)
Idioma:inglés
OAI Identifier:oai:ri.conicet.gov.ar:11336/104345
Acesso em linha:http://hdl.handle.net/11336/104345
Access Level:acceso abierto
Palavra-chave:VISUAL SEARCH
EEG
EYE MOVEMENTS
ATTENTION
NATURAL SCENES
OSCILLATIONS
https://purl.org/becyt/ford/1.7
https://purl.org/becyt/ford/1
Descrição
Resumo:Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on specific recognition algorithms) and a decision making step to determine the position of the next searched location based on existent evidence. Recent developments in our ability to co-register brain scalp potentials (EEG) during free eye movements has allowed investigating brain responses related to fixations (fixation-Related Potentials; fERPs), including the identification of sensory and cognitive local EEG components linked to individual fixations. However, the way in which the mental program guiding the search unfolds has not yet been investigated. We performed an EEG and eye tracking co-registration experiment in which participants searched for a target face in natural images of crowds. Here we show how unitary steps of the program are encoded by specific local target detection signatures and how the positioning of each unitary operation within the global search program can be pinpointed by changes in the EEG signal amplitude as well as the signal power in different frequency bands. By simultaneously studying brain signatures of unitary operations and those occurring during the sequence of fixations, our study sheds light into how local and global properties are combined in implementing visual routines in natural tasks.