Predicting perceptual speed from search behaviour

Tools

Foulds, Olivia and Suglia, Alessandro and Azzopardi, Leif and Halvey, Martin; (2020) Predicting perceptual speed from search behaviour. In: SIGIR 2020 - Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, CHN, 1989–1992. ISBN 9781450380164 (https://doi.org/10.1145/3397271.3401210)

[thumbnail of Foulds-etal-ACM-SIGIR-2020-Predicting-perceptual-speed-from-search]
Preview
 Text. Filename: Foulds_etal_ACM_SIGIR_2020_Predicting_perceptual_speed_from_search.pdf
Accepted Author Manuscript
Download (475kB)| Preview

Abstract

Perceptual Speed (PS) is a cognitive ability that is known to affect multiple factors in Information Retrieval (IR) such as a user's search performance and subjective experience. However PS tests are difficult to administer which limits the design of user-adaptive systems that can automatically infer PS to appropriately accommodate low PS users. Consequently, this paper evaluated whether PS can be automatically classified from search behaviour using several machine learning models trained on features extracted from TREC Common Core search task logs. Our results are encouraging: given a user's interactions from one query, a Decision Tree was able to predict a user's PS as low or high with 86\% accuracy. Additionally, we identified different behavioural components for specific PS tests, implying that each PS test measures different aspects of a person's cognitive ability. These findings motivate further work for how best to design search systems that can adapt to individual differences.

ORCID iDs

Foulds, Olivia, Suglia, Alessandro, Azzopardi, Leif and Halvey, Martin ORCID logoORCID: https://orcid.org/0000-0001-6387-8679;
CORE (COnnecting REpositories)