Positing the problem : enhancing classification of extremist web content through textual analysis

Weir, George and Frank, Richard and Cartwright, Barry and dos Santos, Emanuel; Cartwright, Barry and Weir, George and Lau, Laurie Yiu-Chung, eds. (2016) Positing the problem : enhancing classification of extremist web content through textual analysis. In: 2016 IEEE International Conference on Cybercrime and Computer Forensic (ICCCF). IEEE, CAN. ISBN 9781509060962 (https://doi.org/10.1109/ICCCF.2016.7740431)

[thumbnail of Weir-etal-ICCCF-2016-Positing-the-problem-enhancing-classification-of-extremist-web]
Text. Filename: Weir_etal_ICCCF_2016_Positing_the_problem_enhancing_classification_of_extremist_web.pdf
Accepted Author Manuscript

Download (233kB)| Preview


Webpages with terrorist and extremist content are key factors in the recruitment and radicalization of disaffected young adults who may then engage in terrorist activities at home or fight alongside terrorist groups abroad. This paper reports on advances in techniques for classifying data collected by the Terrorism and Extremism Network Extractor (TENE) web-crawler, a custom-written program that browses the World Wide Web, collecting vast amounts of data, retrieving the pages it visits, analyzing them, and recursively following the links out of those pages. The textual content is subjected to enhanced classification through software analysis, using the Posit textual analysis toolset, generating a detailed frequency analysis of the syntax, including multi-word units and associated part-of-speech components. Results are then deployed in a knowledge extraction process using knowledge extraction algorithms, e.g., from the WEKA system. Indications are that the use of the data enrichment through application of Posit analysis affords a greater degree of match between automatic and manual classification than previously attained. Furthermore, the incorporation and deployment of these technologies promises to provide public safety officials with techniques that can help to detect terrorist webpages, gauge the intensity of their content, discriminate between webpages that do or do not require a concerted response, and take appropriate action where warranted.