Redesigning Implementation Measurement for Monitoring and Quality Improvement in Community Delivery Settings

Details

• Alternative Title:
  J Prim Prev
• Personal Author:
  Berkel, Cady ; Gallo, Carlos G. ; Sandler, Irwin N. ; Mauricio, Anne M. ; Smith, Justin D. ; Brown, C. Hendricks
• Description:
  The field of prevention has established the potential to promote child adjustment across a wide array of outcomes. However, when evidence-based prevention programs have been delivered at scale in community settings, declines in implementation and outcomes have resulted. Maintaining high quality implementation is a critical challenge for the field. We describe steps towards the development of a practical system to monitor and support the high-quality implementation of evidence-based prevention programs in community settings. Research on the implementation of an evidence-based parenting program for divorcing families called the "New Beginnings Program" serves as an illustration of the promise of such a system. As a first step, we describe a multidimensional theoretical model of implementation that links aspects of program delivery with improvements in participant outcomes. We then describe research on the measurement of each of these implementation dimensions and test their relations to intended program outcomes. As a third step, we develop approaches to the assessment of these implementation constructs that are feasible to use in community settings and to establish their reliability and validity. We focus on the application of machine learning algorithms and web-based data collection systems to assess implementation and provide support for high quality delivery and positive outcomes. Examples are presented to demonstrate that valid and reliable measures can be collected using these methods. Finally, we envision how these measures can be used to develop an unobtrusive system to monitor implementation and provide feedback and support in real time to maintain high quality implementation and program outcomes.
• Subjects:
  Adolescent Adult Child Curriculum Data Collection Divorce Evidence-Based Practice Female Humans Implementation Science Machine Learning Male Models, Theoretical Parent-Child Relations Program Evaluation Quality Improvement

  More +
• Keywords:
  Evidence-based Programs Implementation Measurement Parenting Pragmatic Measures Technology
• Source:
  J Prim Prev. 40(1):111-127
• Pubmed ID:
  30656517
• Pubmed Central ID:
  PMC6404547
• Document Type:
  Journal Article
• Funding:
  R01 DA033991/DA/NIDA NIH HHSUnited States/ ; R01 DA026874/DA/NIDA NIH HHSUnited States/ ; P30 DA027828/DA/NIDA NIH HHSUnited States/ ; U18 DP006255/DP/NCCDPHP CDC HHSUnited States/
• Volume:
  40
• Issue:
  1
• Collection(s):
  CDC Public Access
• Main Document Checksum:
  urn:sha256:88f5d5b39b1862d959439b2707202ec2f1d1c097bcfa79759c941b0d24fa2fad
• Download URL:
  https://stacks.cdc.gov/view/cdc/76381/cdc_76381_DS1.pdf
• File Type:
  [PDF - 1.49 MB ]