Effectiveness and Efficiency of Observationally Assessing Fidelity to a Family-Centered Child Intervention: A Quasi-Experimental Study

Details

• Alternative Title:
  J Clin Child Adolesc Psychol
• Personal Author:
  Smith, Justin D. ; Rudo-Stern, Jenna ; Dishion, Thomas J. ; Stormshak, Elizabeth A. ; Montag, Samantha ; Brown, Kimbree ; Ramos, Karina ; Shaw, Daniel S. ; Wilson, Melvin N.
• Description:
  Objective.
  
  Assessment of fidelity that is effective, efficient, and differentiates from usual practices is critical for effectively implementing evidence-based programs for families. This quasi-experiemntal study sought to determine whether observational ratings of fidelity to the Family Check-Up (FCU) could differentiate between levels of clinician training in the model, and from services as usual, and whether rating segments of sessions could be equivalent to rating complete sessions.
  
  Method.
  
  Coders rated 75 videotaped sessions—complete and 20-minute segments—for fidelity, using a valid and reliable rating system across three groups: (1) highly trained in FCU with universal, routine monitoring; (2) minimally trained in FCU with optional, variable monitoring; and (3) services as usual with no training in the FCU. We hypothesized that certain dimensions of fidelity would differ by training, while others would not.
  
  Results.
  
  The results indicated that, as expected, one dimension of fidelity to the FCU, Conceptually accurate to the FCU, was reliably different between the groups (χ2 = 44.63, p<0.001). The differences observed were in the expected direction, showing higher scores for therapists with more training. The rating magnitude of session segments largely did not differ from those of complete session ratings; however, reliabilities were low for the segments.
  
  Conclusions.
  
  Although observational ratings were shown to be sensitive to the degree of training in the FCU on a unique and theoretically critical dimension, observational coding of complete sessions is resource-intensive and limits scalability. Additional work is needed to reduce the burden of assessing fidelity to family-centered programs.
  
  
• Subjects:
  Article Competent Adherence Effectiveness And Efficiency Of Observationally Assessing Fidelity To A Family-Centered Child Intervention: A Quasi-Experimental Study Family Check–Up Fidelity Implementation Observational Coding
• Source:
  J Clin Child Adolesc Psychol. 48(1):16-28
• Pubmed ID:
  30702355
• Pubmed Central ID:
  PMC6450082
• Document Type:
  Journal Article
• Funding:
  R01 CE001389/CE/NCIPC CDC HHS/United States ; T32 MH020012/MH/NIMH NIH HHS/United States ; R25 MH080916/MH/NIMH NIH HHS/United States ; R01 DA016110/DA/NIDA NIH HHS/United States ; L40 TR001029/TR/NCATS NIH HHS/United States ; P30 DA027828/DA/NIDA NIH HHS/United States
• Volume:
  48
• Issue:
  1
• Collection(s):
  CDC Public Access
• Main Document Checksum:
  urn:sha256:d228e013b43be9e339473ec2810514e9cd273a1f25f0117d29a123b84495166c
• Download URL:
  https://stacks.cdc.gov/view/cdc/77258/cdc_77258_DS1.pdf
• File Type:
  [PDF - 369.19 KB ]