Measuring fidelity of brief cognitive behavior therapy for insomnia: Development, reliability and validity
- PMID: 39693769
- DOI: 10.1016/j.evalprogplan.2024.102531
Measuring fidelity of brief cognitive behavior therapy for insomnia: Development, reliability and validity
Abstract
Purpose: Measuring fidelity is critical in program evaluations to assess how implementation influences outcomes. Implementer fidelity is comprised of adherence to the treatment content and competence of treatment delivery. Cognitive behavioral therapy for insomnia (CBT-I) is well-established and empirically supported with variants such as brief CBTi (bCBTi) showing promise in reducing both insomnia and depression. The impact of therapist fidelity on treatment outcomes is unknown in part because reliable measures have not been available. We developed measures of therapist fidelity for bCBT-i and assessed the impact of fidelity in the context of a pilot study with veterans in primary care.
Methods/results: Audio recordings from 23 participants (78 % male) were coded. Therapist adherence measures were created for each session along with a single measure of therapist competence. Inter-rater reliability was established and predictive validity was determined. For total adherence, inter-rater reliability was excellent across sessions (ICC =.73 -.80). The competence measure showed good reliability across all sessions (ICC =.57) and was internally consistent (Cronbach's alpha =.75). There was only 10 % of shared variance between adherence and competence. All of the fidelity measures demonstrated associations with outcomes in the predicted direction; therapist adherence was significantly associated with decreased depression.
Keywords: CBT-I; Measurement; Observational coding; Therapist fidelity; Veterans.
Copyright © 2024 Elsevier Ltd. All rights reserved.
Similar articles
-
Initial Session Effects of Brief Cognitive Behavioral Therapy for Insomnia: A Secondary Analysis of A Small Randomized Pilot Trial.Behav Sleep Med. 2021 Nov-Dec;19(6):769-782. doi: 10.1080/15402002.2020.1862847. Epub 2021 Jan 7. Behav Sleep Med. 2021. PMID: 33410336 Clinical Trial.
-
Treatment agreement, adherence, and outcome in cognitive behavioral treatments for insomnia.J Consult Clin Psychol. 2018 Mar;86(3):294-299. doi: 10.1037/ccp0000269. Epub 2017 Dec 21. J Consult Clin Psychol. 2018. PMID: 29265834 Free PMC article. Clinical Trial.
-
Brief cognitive behavioral therapy for insomnia delivered to depressed veterans receiving primary care services: A pilot study.J Affect Disord. 2017 Aug 1;217:105-111. doi: 10.1016/j.jad.2017.04.003. Epub 2017 Apr 6. J Affect Disord. 2017. PMID: 28395207
-
Delivering Cognitive Behavioral Therapy for Insomnia in the Real World: Considerations and Controversies.Sleep Med Clin. 2019 Jun;14(2):275-281. doi: 10.1016/j.jsmc.2019.01.008. Epub 2019 Mar 29. Sleep Med Clin. 2019. PMID: 31029193 Review.
-
Piloting cognitive-behavioral therapy for insomnia integrated with prolonged exposure.Psychol Trauma. 2019 Jan;11(1):107-113. doi: 10.1037/tra0000402. Epub 2018 Sep 13. Psychol Trauma. 2019. PMID: 30211598 Free PMC article. Review.
Cited by
-
Fidelity, not adaptation, is essential for implementation.Front Health Serv. 2025 Apr 25;5:1575179. doi: 10.3389/frhs.2025.1575179. eCollection 2025. Front Health Serv. 2025. PMID: 40353253 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Medical