Predictive validity and interrater reliability of the FACE-CARAS toolkit in a CAMHS setting

Evans, Stephen A. and Young, David and Tiffin, Paul A. (2019) Predictive validity and interrater reliability of the FACE-CARAS toolkit in a CAMHS setting. Criminal Behaviour and Mental Health, 29 (1). pp. 47-56. ISSN 1471-2857 (https://doi.org/10.1002/cbm.2104)

[thumbnail of Evans-etal-CBMH-2019-Predictive-validity-and-interrater-reliability-of-the-FACE-CARAS-toolkit-in-a-CAMHS-setting]
Preview
 Text. Filename: Evans_etal_CBMH_2019_Predictive_validity_and_interrater_reliability_of_the_FACE_CARAS_toolkit_in_a_CAMHS_setting.pdf
Accepted Author Manuscript
Download (356kB)| Preview

Abstract

Background: The FACE-CARAS (Functional Analysis in Care Environments-Child and Adolescent Risk-Assessment Suite) toolkit has been developed to support practitioners in Child and Adolescent Mental Health Services (CAMHS) in performing a structured risk assessment. It covers a number of risk domains including violence, suicide, self-harm, experienced abuse, and exploitation. Interrater and internal reliability has already been established but not predictive validity. Aims/Hypothesis: Our aim was to establish the predictive validity of the FACE-CARAS in a CAMHS population. Methods: Records from 123 young people with FACE-CARAS ratings completed by clinicians were examined in a retrospective file review to extract data on a relevant list of adverse outcomes at three and at 6 months following the assessment. Although this was not a prospective longitudinal study, researchers were blind to the clinicians' ratings, allowing valid testing of predictive power. Cases were drawn from across generic and specialist CAMHS teams in approximately equal proportions. Data were analysed using receiver operator characteristic statistics. Results: Areas under the curve values in five of the seven risk areas approached or were greater than 0.8 indicated that the FACE-CARAS profile score was a good potential predictor of risks of self-harm, suicidal behaviours, serious self-neglect, abuse or exploitation by others, and violence to others at both 3 and 6 months. It was weakly "predictive" of accidental self-harm and no better than chance at signalling physical ill health. Conclusions: Findings support the use of the "profile summary" section of the tool as likely to generate clinically useful risk predictions. We were concerned that clinical use of the scale did not conform to research standards and often left subscales incompletely rated; however, the fact that the tool nonetheless proved a good predictor of most key adversities under scrutiny may add weight to its value in clinical practice. Further work with the FACE-CARAS subscales is recommended.

  • Item type:Article
    ID code:66901
    Dates:
    Date
    Event
    1 February 2019
    Published
    3 January 2019
    Published Online
    4 December 2018
    Accepted
    24 August 2018
    Submitted
    Notes:This is the peer reviewed version of the following article: Evans, S. A., Young, D., & Tiffin, P. A. (2019). Predictive validity and interrater reliability of the FACE-CARAS toolkit in a CAMHS setting. Criminal Behaviour and Mental Health, 29(1), 47-56., which has been published in final form at https://doi.org/10.1002/cbm.2104. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions.
    Subjects:Science > Mathematics
    Medicine > Pediatrics > Child Health. Child health services
    Department:Faculty of Science > Mathematics and Statistics
    Depositing user: Pure Administrator
    Date deposited:12 Feb 2019 11:45
    Last modified:11 Apr 2024 01:37
    URI:https://strathprints.strath.ac.uk/id/eprint/66901
CORE (COnnecting REpositories)