Towards brain passage retrieval : an investigation of EEG query representations

Tools

McGuire, Niall and Moshfeghi, Yashar (2024) Towards brain passage retrieval : an investigation of EEG query representations. Other. arXiv, Ithaca, NY. (https://doi.org/10.48550/arXiv.2412.06695)

[thumbnail of Mcguire-Moshfeghi-arXiv-2025-Towards-brain-passage-retrieval-an-investigation-of-EEG-query-representations]
Preview
 Text. Filename: Mcguire-Moshfeghi-arXiv-2025-Towards-brain-passage-retrieval-an-investigation-of-EEG-query-representations.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (2MB)| Preview

Abstract

Information Retrieval (IR) systems primarily rely on users' ability to translate their internal information needs into (text) queries. However, this translation process is often uncertain and cognitively demanding, leading to queries that incompletely or inaccurately represent users' true needs. This challenge is particularly acute for users with ill-defined information needs or physical impairments that limit traditional text input, where the gap between cognitive intent and query expression becomes even more pronounced. Recent neuroscientific studies have explored Brain-Machine Interfaces (BMIs) as a potential solution, aiming to bridge the gap between users' cognitive semantics and their search intentions. However, current approaches attempting to decode explicit text queries from brain signals have shown limited effectiveness in learning robust brain-to-text representations, often failing to capture the nuanced semantic information present in brain patterns. To address these limitations, we propose BPR (Brain Passage Retrieval), a novel framework that eliminates the need for intermediate query translation by enabling direct retrieval of relevant passages from users' brain signals. Our approach leverages dense retrieval architectures to map EEG signals and text passages into a shared semantic space. Through comprehensive experiments on the ZuCo dataset, we demonstrate that BPR achieves up to 8.81% improvement in precision@5 over existing EEG-to-text baselines, while maintaining effectiveness across 30 participants. Our ablation studies reveal the critical role of hard negative sampling and specialised brain encoders in achieving robust cross-modal alignment. These results establish the viability of direct brain-to-passage retrieval and provide a foundation for developing more natural interfaces between users' cognitive states and IR systems.

ORCID iDs

McGuire, Niall ORCID logoORCID: https://orcid.org/0009-0005-9738-047X and Moshfeghi, Yashar ORCID logoORCID: https://orcid.org/0000-0003-4186-1088;
CORE (COnnecting REpositories)