Picture of smart phone in human hand

World leading smartphone and mobile technology research at Strathclyde...

The Strathprints institutional repository is a digital archive of University of Strathclyde's Open Access research outputs. Strathprints provides access to thousands of Open Access research papers by University of Strathclyde researchers, including by Strathclyde researchers from the Department of Computer & Information Sciences involved in researching exciting new applications for mobile and smartphone technology. But the transformative application of mobile technologies is also the focus of research within disciplines as diverse as Electronic & Electrical Engineering, Marketing, Human Resource Management and Biomedical Enginering, among others.

Explore Strathclyde's Open Access research on smartphone technology now...

Classifying suspicious content using frequency analysis

Gellineau, Obika and Weir, George R. S. (2011) Classifying suspicious content using frequency analysis. In: Corpora and Language Technologies in Teaching, Learning and Research. University of Strathclyde Publishing. ISBN 9780947649821

[img]
Preview
Text (Gellineau-Weir-2011-Classifying-suspicious-content-using-frequency)
Gellineau_Weir_2011_Classifying_suspicious_content_using_frequency.pdf - Accepted Author Manuscript

Download (92kB) | Preview

Abstract

This paper details an experiment to explore the use of chi by degrees of freedom (CBDF) and Log-Likelihood statistical similarity measures with single word and bigram frequencies as a means of discriminating subject content in order to classify samples of chat texts as dangerous, suspicious or innocent. The control for these comparisons was a set of manually ranked sample texts that were rated, in terms of eleven subject categories (five considered dangerous and six considered harmless). Results from this manual rating of chat text samples were then compared with the ranked lists generated using CBDF and Log-Likelihood measures, for both word and bigram frequency. This was achieved by combining currently available textual analysis tools with a newly implemented software application. Our results show that the CBDF method using word frequencies gave discrimination closest to the human rated samples.