Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Apr:109:102531.
doi: 10.1016/j.evalprogplan.2024.102531. Epub 2024 Dec 8.

Measuring fidelity of brief cognitive behavior therapy for insomnia: Development, reliability and validity

Affiliations

Measuring fidelity of brief cognitive behavior therapy for insomnia: Development, reliability and validity

Wendi F Cross et al. Eval Program Plann. 2025 Apr.

Abstract

Purpose: Measuring fidelity is critical in program evaluations to assess how implementation influences outcomes. Implementer fidelity is comprised of adherence to the treatment content and competence of treatment delivery. Cognitive behavioral therapy for insomnia (CBT-I) is well-established and empirically supported with variants such as brief CBTi (bCBTi) showing promise in reducing both insomnia and depression. The impact of therapist fidelity on treatment outcomes is unknown in part because reliable measures have not been available. We developed measures of therapist fidelity for bCBT-i and assessed the impact of fidelity in the context of a pilot study with veterans in primary care.

Methods/results: Audio recordings from 23 participants (78 % male) were coded. Therapist adherence measures were created for each session along with a single measure of therapist competence. Inter-rater reliability was established and predictive validity was determined. For total adherence, inter-rater reliability was excellent across sessions (ICC =.73 -.80). The competence measure showed good reliability across all sessions (ICC =.57) and was internally consistent (Cronbach's alpha =.75). There was only 10 % of shared variance between adherence and competence. All of the fidelity measures demonstrated associations with outcomes in the predicted direction; therapist adherence was significantly associated with decreased depression.

Keywords: CBT-I; Measurement; Observational coding; Therapist fidelity; Veterans.

PubMed Disclaimer

Similar articles

Cited by

LinkOut - more resources