Measuring digitalization at scale using web scraped data

Tools

Ashouri, Sajad and Hajikhani, Arash and Suominen, Arho and Pukelis, Lukas and Cunningham, Scott W. (2024) Measuring digitalization at scale using web scraped data. Technological Forecasting and Social Change, 207. 123618. ISSN 0040-1625 (https://doi.org/10.1016/j.techfore.2024.123618)

[thumbnail of Ashouri-etal-TFSC-2024-Measuring-digitization-at-scale-using-web-scraped]
Preview
 Text. Filename: Ashouri-etal-TFSC-2024-Measuring-digitization-at-scale-using-web-scraped.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (2MB)| Preview

Abstract

Measuring digitalization has been a central topic in academic discourse. While evaluating firms' efforts in increasing digitalization is crucial, quantifying it at scale, presents considerable challenges. This paper uses website information as a source of data to operationalize a measure of digitalization. Drawing on a sample of 60,942 firms, our approach proposes two distinct measures of digitalization: one at the product level and the other at the general organizational level. We substantiate these measures using a blend of qualitative and quantitative methods. The study validates the content of websites as a relevant source of innovation indicator data and verifies the indicators using multiple experiments. The developed digitalization indicators offer future research an empirical measure of digitalization that can be run at scale, across industries and regions through time.

ORCID iDs

Ashouri, Sajad, Hajikhani, Arash, Suominen, Arho, Pukelis, Lukas and Cunningham, Scott W. ORCID logoORCID: https://orcid.org/0000-0001-7140-916X;
CORE (COnnecting REpositories)