Are we there yet? Estimating training time for recommendation systems

Paun, Iulia and Moshfeghi, Yashar and Ntarmos, Nikos; (2021) Are we there yet? Estimating training time for recommendation systems. In: Proceedings of the 1st Workshop on Machine Learning and Systems, EuroMLSys 2021. Proceedings of the 1st Workshop on Machine Learning and Systems, EuroMLSys 2021 . ACM, New York, pp. 39-47. ISBN 9781450382984 (https://doi.org/10.1145/3437984.3458832)

[thumbnail of Paun-etal-EuroMLSys-2021-Are-we-there-yet-Estimating-training-time-for-recommendation]
Preview
 Text. Filename: Paun_etal_EuroMLSys_2021_Are_we_there_yet_Estimating_training_time_for_recommendation.pdf
Accepted Author Manuscript
Download (844kB)| Preview

Abstract

Recommendation systems (RS) are a key component of modern commercial platforms, with Collaborative Filtering (CF) based RSs being the centrepiece. Relevant research has long focused on measuring and improving the effectiveness of such CF systems, but alas their efficiency – especially with regards to their time- and resource-consuming training phase – has received little to no attention. This work is a first step in the direction of addressing this gap. To do so, we first perform a methodical study of the computational complexity of the training phase for a number of highly popular CF-based RSs, including approaches based on matrix factorisation, k-nearest neighbours, co-clustering, and slope one schemes. Based on this, we then build a simple yet effective predictor that, given a small sample of a dataset, is able to predict training times over the complete dataset. Our systematic experimental evaluation shows that our approach outperforms state-of-the-art regression schemes by a considerable margin.

ORCID iDs

Paun, Iulia, Moshfeghi, Yashar ORCID logoORCID: https://orcid.org/0000-0003-4186-1088 and Ntarmos, Nikos;
CORE (COnnecting REpositories)