Enhancing procedure quality : advanced language tools for identifying ambiguity and high-potential violation triggers

Johnson, Karl and Morais, Caroline and Patelli, Edoardo (2025) Enhancing procedure quality : advanced language tools for identifying ambiguity and high-potential violation triggers. Reliability Engineering and System Safety, 264 (Pt. A). 111308. ISSN 0951-8320 (https://doi.org/10.1016/j.ress.2025.111308)

[thumbnail of Johnson-etal-RESS-2025-advanced-language-tools-for-identifying-ambiguity-and-high-potential-violation]
Preview
Text. Filename: Johnson-etal-RESS-2025-advanced-language-tools-for-identifying-ambiguity-and-high-potential-violation.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo

Download (2MB)| Preview

Abstract

In high-risk industrial environments, the clarity and accuracy of Standard Operating Procedures (SOPs) are critical for ensuring safety and regulatory compliance. The presence of ambiguities in SOPs can lead to misunderstandings, errors, and increased risks. While violations of procedural directives can significantly contribute to catastrophic outcomes. This study introduces the development of sophisticated tools utilizing both rule-based and machine learning methodologies in Natural Language Processing (NLP) specifically designed to detect ambiguities and identify high-risk steps prone to non-malevolent violation in procedural documentation. By addressing these linguistic and procedural discrepancies, we aim to enhance the clarity and applicability of SOPs, ultimately improving adherence and reducing risks in complex operational settings. The tools leverages a blend of linguistic rules to systematically identify and categorize ambiguities, and machine learning techniques with historical data to identify procedural directives with high-risk potential when violated. This enhances the precision and practical application of SOPs in sectors such as nuclear, oil and gas, and chemical processing. Initial tests demonstrate the tools’ effectiveness and promising applicability. This approach not only aids in refining SOPs but also contributes to the broader objective of enhancing operational safety and efficiency. The research underscores the importance of integrating advanced NLP techniques with traditional safety management practices to address the inherent challenges of procedural documentation in complex industrial settings.

ORCID iDs

Johnson, Karl, Morais, Caroline and Patelli, Edoardo ORCID logoORCID: https://orcid.org/0000-0002-5007-7247;