<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article"><?properties open_access?><front><journal-meta><journal-id journal-id-type="nlm-ta">Implement Sci</journal-id><journal-id journal-id-type="iso-abbrev">Implement Sci</journal-id><journal-title-group><journal-title>Implementation Science : IS</journal-title></journal-title-group><issn pub-type="epub">1748-5908</issn><publisher><publisher-name>BioMed Central</publisher-name><publisher-loc>London</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">29100551</article-id><article-id pub-id-type="pmc">5670723</article-id><article-id pub-id-type="publisher-id">657</article-id><article-id pub-id-type="doi">10.1186/s13012-017-0657-x</article-id><article-categories><subj-group subj-group-type="heading"><subject>Debate</subject></subj-group></article-categories><title-group><article-title>Beyond &#x0201c;implementation strategies&#x0201d;: classifying the full range of strategies used in implementation science and practice</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">http://orcid.org/0000-0003-3130-8297</contrib-id><name><surname>Leeman</surname><given-names>Jennifer</given-names></name><address><email>jleeman@email.unc.edu</email></address><xref ref-type="aff" rid="Aff1">1</xref></contrib><contrib contrib-type="author"><name><surname>Birken</surname><given-names>Sarah A.</given-names></name><address><email>birken@unc.edu</email></address><xref ref-type="aff" rid="Aff2">2</xref></contrib><contrib contrib-type="author"><name><surname>Powell</surname><given-names>Byron J.</given-names></name><address><email>bjpowell@unc.edu</email></address><xref ref-type="aff" rid="Aff2">2</xref></contrib><contrib contrib-type="author"><name><surname>Rohweder</surname><given-names>Catherine</given-names></name><address><email>rohweder@email.unc.edu</email></address><xref ref-type="aff" rid="Aff3">3</xref></contrib><contrib contrib-type="author"><name><surname>Shea</surname><given-names>Christopher M.</given-names></name><address><email>Chris_Shea@unc.edu</email></address><xref ref-type="aff" rid="Aff2">2</xref></contrib><aff id="Aff1"><label>1</label><institution-wrap><institution-id institution-id-type="ISNI">0000000122483208</institution-id><institution-id institution-id-type="GRID">grid.10698.36</institution-id><institution>School of Nursing, </institution><institution>University of North Carolina at Chapel Hill, </institution></institution-wrap>CB #7460, Chapel Hill, NC 27599 USA </aff><aff id="Aff2"><label>2</label><institution-wrap><institution-id institution-id-type="ISNI">0000000122483208</institution-id><institution-id institution-id-type="GRID">grid.10698.36</institution-id><institution>Department of Health Policy and Management, Gillings School of Global Public Health, </institution><institution>University of North Carolina at Chapel Hill, </institution></institution-wrap>Chapel Hill, NC 27599 USA </aff><aff id="Aff3"><label>3</label><institution-wrap><institution-id institution-id-type="ISNI">0000000122483208</institution-id><institution-id institution-id-type="GRID">grid.10698.36</institution-id><institution>Center for Health Promotion and Disease Prevention, </institution><institution>University of North Carolina at Chapel Hill, </institution></institution-wrap>Chapel Hill, NC 27599 USA </aff></contrib-group><pub-date pub-type="epub"><day>3</day><month>11</month><year>2017</year></pub-date><pub-date pub-type="pmc-release"><day>3</day><month>11</month><year>2017</year></pub-date><pub-date pub-type="collection"><year>2017</year></pub-date><volume>12</volume><elocation-id>125</elocation-id><history><date date-type="received"><day>13</day><month>6</month><year>2017</year></date><date date-type="accepted"><day>18</day><month>10</month><year>2017</year></date></history><permissions><copyright-statement>&#x000a9; The Author(s). 2017</copyright-statement><license license-type="OpenAccess"><license-p>
<bold>Open Access</bold>This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">http://creativecommons.org/publicdomain/zero/1.0/</ext-link>) applies to the data made available in this article, unless otherwise stated.</license-p></license></permissions><abstract id="Abs1"><sec><title>Background</title><p id="Par1">Strategies are central to the National Institutes of Health&#x02019;s definition of implementation research as &#x0201c;the study of strategies to integrate evidence-based interventions into specific settings.&#x0201d; Multiple scholars have proposed lists of the strategies used in implementation research and practice, which they increasingly are classifying under the single term &#x0201c;implementation strategies.&#x0201d; We contend that classifying all strategies under a single term leads to confusion, impedes synthesis across studies, and limits advancement of the full range of strategies of importance to implementation. To address this concern, we offer a system for classifying implementation strategies that builds on Proctor and colleagues&#x02019; (2013) reporting guidelines, which recommend that authors not only name and define their implementation strategies but also specify who enacted the strategy (i.e., the actor) and the level and determinants that were targeted (i.e., the action targets).</p></sec><sec><title>Main body</title><p id="Par2">We build on Wandersman and colleagues&#x02019; Interactive Systems Framework to distinguish strategies based on whether they are enacted by actors functioning as part of a Delivery, Support, or Synthesis and Translation System. We build on Damschroder and colleague&#x02019;s Consolidated Framework for Implementation Research to distinguish the levels that strategies target (intervention, inner setting, outer setting, individual, and process). We then draw on numerous resources to identify determinants, which are conceptualized as modifiable factors that prevent or enable the adoption and implementation of evidence-based interventions. Identifying actors and targets resulted in five conceptually distinct classes of implementation strategies: dissemination, implementation process, integration, capacity-building, and scale-up. In our descriptions of each class, we identify the level of the Interactive System Framework at which the strategy is enacted (actors), level and determinants targeted (action targets), and outcomes used to assess strategy effectiveness. We illustrate how each class would apply to efforts to improve colorectal cancer screening rates in Federally Qualified Health Centers.</p></sec><sec><title>Conclusions</title><p id="Par3">Structuring strategies into classes will aid reporting of implementation research findings, alignment of strategies with relevant theories, synthesis of findings across studies, and identification of potential gaps in current strategy listings. Organizing strategies into classes also will assist users in locating the strategies that best match their needs.</p></sec></abstract><kwd-group xml:lang="en"><title>Keywords</title><kwd>Implementation strategies</kwd><kwd>Dissemination</kwd><kwd>Scale-up</kwd><kwd>Interactive Systems Framework</kwd><kwd>Capacity-building</kwd></kwd-group><funding-group><award-group><funding-source><institution-wrap><institution-id institution-id-type="FundRef">http://dx.doi.org/10.13039/100000002</institution-id><institution>National Institutes of Health</institution></institution-wrap></funding-source><award-id>UL 1TR001111</award-id></award-group><award-group><funding-source><institution-wrap><institution-id institution-id-type="FundRef">http://dx.doi.org/10.13039/100000030</institution-id><institution>Centers for Disease Control and Prevention</institution></institution-wrap></funding-source><award-id>U48 DP005017-SIP</award-id><principal-award-recipient><name><surname>Leeman</surname><given-names>Jennifer</given-names></name></principal-award-recipient></award-group></funding-group><custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name><meta-value>&#x000a9; The Author(s) 2017</meta-value></custom-meta></custom-meta-group></article-meta></front><body><sec id="Sec1"><title>Background</title><p id="Par10">Strategies are central to the National Institutes of Health&#x02019;s (NIH&#x02019;s) definition of implementation research as &#x0201c;the study of strategies to integrate evidence-based interventions into specific settings&#x0201d; [<xref ref-type="bibr" rid="CR1">1</xref>]. Multiple papers have been written proposing frameworks and lists to describe the strategies used in implementation research and practice [<xref ref-type="bibr" rid="CR2">2</xref>, <xref ref-type="bibr" rid="CR3">3</xref>]. In a recent review, Lokker et al. [<xref ref-type="bibr" rid="CR4">4</xref>] identified 23 models, frameworks, and taxonomies for classifying the type of strategies used &#x0201c;to promote and integrate evidence into practice in healthcare.&#x0201d; These strategies increasingly are being classified under the single term &#x0201c;implementation strategies&#x0201d; [<xref ref-type="bibr" rid="CR2">2</xref>]. We contend that classifying all strategies under a single term may constrain efforts to synthesize findings across tests of strategy effectiveness and limit advancement of the full range of strategies of importance to implementation science and practice.</p><p id="Par11">The ability to synthesize findings across studies is essential to building the evidence base for what, how, and when implementation strategies work to improve which implementation outcomes. Despite the valuable work that has been done to name and define strategies, efforts to synthesize findings across studies continue to be challenging [<xref ref-type="bibr" rid="CR4">4</xref>]. Names and definitions do not adequately differentiate who enacted the strategies or for what purpose, resulting in findings that are not &#x0201c;readily comparable&#x0201d; or amendable to the synthesis needed to build the evidence base for their use [<xref ref-type="bibr" rid="CR5">5</xref>].</p><p id="Par12">We illustrate the problem with an example from our research. Two authors (JL, CR) are collaborating on a study testing &#x0201c;implementation strategies&#x0201d; that practice facilitators (e.g., coaches) provide to primary care clinic staff to build the staffs&#x02019; capacity to use &#x0201c;implementation strategies&#x0201d; to integrate cancer screening evidence-based interventions (EBIs) into their practice setting. The broad use of the term &#x0201c;implementation strategy&#x0201d; creates confusion for our team because it does not distinguish what the practice facilitators are doing to support implementation from what primary care staffs are doing to integrate EBIs into routine practice. We contend that these distinctions are important when selecting and reporting strategies for use in research and practice because the evidence base and, to a large extent, the underlying theory, differ for strategies used to support implementation (e.g., [<xref ref-type="bibr" rid="CR6">6</xref>, <xref ref-type="bibr" rid="CR7">7</xref>]) as compared to strategies used to integrate screening EBIs into practice (e.g., [<xref ref-type="bibr" rid="CR8">8</xref>, <xref ref-type="bibr" rid="CR9">9</xref>]).</p><p id="Par13">The use of the single term &#x0201c;implementation strategy&#x0201d; also increases the risk that some of the strategies essential to implementation science will be overlooked. Those using the term &#x0201c;implementation strategy&#x0201d; tend to define it in relation to the implementation of a specific intervention or guideline. Powell et al. [<xref ref-type="bibr" rid="CR2">2</xref>], for example, define &#x0201c;implementation strategies&#x0201d; as &#x0201c;methods or techniques used to enhance the adoption, implementation, and sustainability of a clinical program or practice.&#x0201d; Similarly, Mazza et al. [<xref ref-type="bibr" rid="CR3">3</xref>] define an &#x0201c;implementation strategy&#x0201d; as a &#x0201c;purposeful procedure to achieve clinical practice compliance with a guideline recommendation.&#x0201d; These definitions suggest that implementation begins with a predefined &#x0201c;program or practice&#x0201d; or &#x0201c;guideline&#x0201d; and have the potential to perpetuate the field&#x02019;s historic focus on a &#x0201c;push&#x0201d; model of implementation that begins with the identification of a specific evidence-based intervention (EBI) that is then &#x0201c;pushed&#x0201d; into practice [<xref ref-type="bibr" rid="CR10">10</xref>]. Many scholars have called for more research that applies a &#x0201c;pull&#x0201d; model, with the goal of building practice-level capacity to select, adapt, and implement the EBIs they need to address locally identified needs [<xref ref-type="bibr" rid="CR10">10</xref>, <xref ref-type="bibr" rid="CR11">11</xref>]. We contend that to achieve this goal, implementation science needs to invest more in strategies that build practice-level capacity to prioritize areas in need of improvement and to select (i.e., pull) from the menus of available EBIs. The creation, promotion, and distribution of these EBI menus require dissemination strategies&#x02014;yet another set of strategies of importance to implementation.</p><p id="Par14">To address these challenges (among others), Proctor et al. [<xref ref-type="bibr" rid="CR5">5</xref>] recommended that authors not only name and define their implementation strategies but also describe how they operationalized the strategy in their study. Specifically, they recommended specifying who enacted the strategy (i.e., the actor), the level and determinants that were targeted (action targets), and the intended implementation outcomes. Clearly delineating how strategies are operationalized is critical to reporting findings in ways that are amenable to synthesis. Using a more consistent approach to operationalizing strategies also has potential to foreground the full range of strategies used in implementation science.</p><p id="Par15">Building on the recommendations of Proctor et al. [<xref ref-type="bibr" rid="CR5">5</xref>], we propose a system for classifying implementation strategies based on the strategies&#x02019; actor and action targets. (Table&#x000a0;<xref rid="Tab1" ref-type="table">1</xref> provides an overview of definitions for these and other terms used in this paper.) Structuring strategies into classes will aid in aligning strategies with relevant theories (i.e., those that pertain to related determinants), synthesizing findings across studies, and identifying potential gaps in current strategy listings. Organizing strategies into classes also will assist users in locating the strategies that best match their needs. We are not suggesting a new taxonomy but rather a system for classifying implementation strategies.<table-wrap id="Tab1"><label>Table 1</label><caption><p>Key terms and their definitions</p></caption><table frame="hsides" rules="groups"><tbody><tr><td>Evidence-based intervention (EBI)</td><td>&#x0201c;Programs, practices, principles, procedures, products, pills, and policies&#x0201d; that have been found to be effective at improving health behaviors, health outcomes, or health-related environments [<xref ref-type="bibr" rid="CR21">21</xref>]</td></tr><tr><td>Actor</td><td>Who enacts the strategy [<xref ref-type="bibr" rid="CR5">5</xref>]</td></tr><tr><td>&#x02003;Delivery system actors</td><td>Individuals, teams, and systems that adopt and integrate EBIs into practice [<xref ref-type="bibr" rid="CR12">12</xref>]</td></tr><tr><td>&#x02003;Support system actors</td><td>Individuals, teams, and systems that build delivery systems&#x02019; general and EBI-specific capacity to adopt and integrate EBIs [<xref ref-type="bibr" rid="CR12">12</xref>]</td></tr><tr><td>&#x02003;Synthesis and translation systems</td><td>Organizations that identify, translate, and disseminate EBIs [<xref ref-type="bibr" rid="CR12">12</xref>]</td></tr><tr><td>Implementation strategies (action)</td><td>&#x0201c;Methods or techniques used to enhance the adoption, implementation, and sustainability&#x0201d; of EBIs [<xref ref-type="bibr" rid="CR2">2</xref>]</td></tr><tr><td>Action target</td><td>What the strategy intends to change [<xref ref-type="bibr" rid="CR5">5</xref>]</td></tr><tr><td>&#x02003;Levels</td><td>The level the strategy targets (intervention, individuals, inner setting, outer setting, processes) [<xref ref-type="bibr" rid="CR18">18</xref>]</td></tr><tr><td>&#x02003;Determinants</td><td>The modifiable factors the strategy intends to change to overcome barriers and activate facilitators of EBI adoption and implementation [<xref ref-type="bibr" rid="CR15">15</xref>]</td></tr></tbody></table></table-wrap>
</p><sec id="Sec2"><title>Classifying strategies according to who enacts them (the actor)</title><p id="Par16">To differentiate categories of actors, we drew on the three systems described in the Interactive Systems Framework (ISF) for dissemination and implementation [<xref ref-type="bibr" rid="CR12">12</xref>]. <italic>Delivery system</italic> actors include the individuals and teams who adopt and integrate EBIs into their practice settings. They include those working in public health departments, hospitals, clinics, and community-based coalitions and organizations, among others. <italic>Support system</italic> actors promote and support EBI adoption and implementation with a focus on building delivery systems&#x02019; &#x0201c;general capacity&#x0201d; to adopt and implement EBIs as well as their &#x0201c;EBI-specific capacity,&#x0201d; in other words, their capacity to adopt and implement specific EBIs [<xref ref-type="bibr" rid="CR12">12</xref>]. Support system actors often are external to the setting where implementation will occur and in the USA include, for example, Area Health Education Centers [<xref ref-type="bibr" rid="CR13">13</xref>] or State Health Departments [<xref ref-type="bibr" rid="CR14">14</xref>], both of which employ staff to provide technical assistance (i.e., quality improvement coaches or practice facilitators) to those working in delivery system to promote and support EBI adoption and integration. Support system actors also may function within delivery systems, particularly larger systems that employ quality improvement coaches and other staff who then provide support to the staff who are adopting and integrating EBIs into practice. <italic>Synthesis and translation system</italic> actors identify, translate, and disseminate EBIs and include, for example, the US Preventive Services Taskforce, the Cochrane Collaboration, and a host of other organizations that synthesize, translate, and disseminate EBIs in print and electronic formats.</p></sec><sec id="Sec3"><title>Classifying strategies by linking them to action targets</title><p id="Par17">Action targets include both the determinant and the level that an implementation strategy targets. The determinants targeted may include any modifiable factor that prevents or enables EBI adoption and implementation [<xref ref-type="bibr" rid="CR15">15</xref>]. Several recently published frameworks contend that the determinants&#x02019; strategy targets are central to defining both interventions and implementation strategies. In their framework for knowledge translation interventions, Colquhoun et al. [<xref ref-type="bibr" rid="CR16">16</xref>] identified &#x0201c;what they aim to change&#x0201d; as one of four defining components. (The other three components are the strategy or technique, causal mechanism, and mode of delivery). In creating a taxonomy of behavior change interventions, Kok et al. [<xref ref-type="bibr" rid="CR17">17</xref>] also argued for linking behavior change methods to a modifiable determinant of behavior change. Strategies may target determinants at multiple levels including the EBI (e.g., its complexity), inner setting (characteristics of the setting into which the EBI is implemented, e.g., leadership engagement), outer setting (characteristics of the wider socio-political context, e.g., public policy), individuals (characteristics of those intended to adopt and implement the EBI; e.g., motivation, ability), and process (the presence and nature of activities involved in EBI adoption and implementation, e.g., planning, evaluating) [<xref ref-type="bibr" rid="CR18">18</xref>]. Numerous taxonomies and lists are available that detail determinants derived from reviews of the literature and theory and often organized by level (e.g., [<xref ref-type="bibr" rid="CR15">15</xref>, <xref ref-type="bibr" rid="CR19">19</xref>, <xref ref-type="bibr" rid="CR20">20</xref>]).</p></sec></sec><sec id="Sec4"><title>Classifying implementation strategies</title><p id="Par18">As further described below, identifying actors and action targets resulted in five conceptually distinct classes of strategies: dissemination, implementation process, integration, capacity-building, and scale-up (See Fig.&#x000a0;<xref rid="Fig1" ref-type="fig">1</xref> and Table&#x000a0;<xref rid="Tab1" ref-type="table">1</xref>). In our descriptions of each class, we identify the ISF system actors that enacted the strategy (actors), levels and determinants targeted (action targets), and outcomes used to assess strategy effectiveness. We illustrate how each class would apply to strategies to improve colorectal cancer (CRC) screening rates in Federally Qualified Health Centers (FQHCs). Because EBI adoption and implementation is the central goal of implementation science and practice, we begin with our definition of EBIs.<fig id="Fig1"><label>Fig. 1</label><caption><p>Classes of implementation strategies organized within the Interactive System Framework [<xref ref-type="bibr" rid="CR12">12</xref>]. The bi-directional arrows represent the importance of communication across levels</p></caption><graphic xlink:href="13012_2017_657_Fig1_HTML" id="MO1"/></fig>
</p><p id="Par19">
<italic>Evidence-based interventions</italic> (EBIs) include any action or set of actions that delivery systems enact to improve health behaviors, health outcomes, or health-related environments (e.g., built and communication environments that support healthy behaviors). EBIs target factors that directly contribute to health as compared to implementation strategies, which target factors that contribute to EBI adoption, implementation, scale-up, or sustainment. Interventions include what Brown et al. [<xref ref-type="bibr" rid="CR21">21</xref>] refer to as programs, practices, principles, procedures, products, pills, and policies (the seven Ps). Interventions are evidence-based to the extent that they are supported by research that has established a causal relationship between the intervention and a specified improvement in individual- or population-level health behaviors, health outcomes, or health-related environments.</p><p id="Par20">For colorectal cancer screening, EBIs would include age- and risk-appropriate colorectal cancer screening using either FIT, iFOBT, or colonoscopy, followed by diagnostic screening and treatment as indicated [<xref ref-type="bibr" rid="CR22">22</xref>].</p><sec id="Sec5"><title>Five classes of implementation strategies</title><sec id="FPar1"><title>Dissemination strategies</title><p id="Par21"> include any action or set of actions that target public health and healthcare decision-makers&#x02019;, clinicians&#x02019;, and other staffs&#x02019; awareness, knowledge, attitudes, and intention to adopt an EBI. Within this classification system, communication strategies that directly target patients or a population with the goal of changing their health-related beliefs, knowledge, or behaviors would be classified as EBIs rather than as dissemination strategies. Dissemination strategies are the primary strategies that synthesis and translation systems use but also are used by actors in both support and delivery systems.</p><p id="Par22">The NIH defines dissemination research as the study of the &#x0201c;targeted distribution of information and intervention materials to a specific public health or clinical practice audience&#x0201d; [<xref ref-type="bibr" rid="CR23">23</xref>]. Consistent with this definition, dissemination begins with the identification of an intended public health or healthcare audience or audiences (sometimes referred to as audience segmentation) [<xref ref-type="bibr" rid="CR24">24</xref>]. Identifying audience(s) often is followed by formative research to customize dissemination strategies to fit audience needs and preferences. Dissemination involves two broad categories of strategies: (1) developing messages and materials and (2) distributing EBIs, messages, and materials for a specific audience or audiences.</p></sec><sec id="FPar2"><title>Developing messages and materials</title><p id="Par23">Message development strategies involve framing information about an EBI to persuade the intended decision-making audience to adopt it [<xref ref-type="bibr" rid="CR25">25</xref>]. Material development strategies include packaging EBI materials into a format that the intended audience can interpret and use [<xref ref-type="bibr" rid="CR26">26</xref>]. The National Cancer Institute&#x02019;s &#x0201c;Research Tested Interventions Program,&#x0201d; for example, packages EBIs into a standardized template that includes information on the EBI&#x02019;s intended population and setting, targeted outcomes, and evidence base and also provides intervention materials and implementation guidance (See <ext-link ext-link-type="uri" xlink:href="https://rtips.cancer.gov/rtips/index.do">https://rtips.cancer.gov/rtips/index.do</ext-link>).</p></sec><sec id="FPar3"><title>Distribution of EBIs, messages, and materials</title><p id="Par24">Distribution strategies focus on ensuring that EBIs, messages, and materials reach intended audiences through a range of distribution channels, including mailings, websites, publications, webinar or in-person presentations, interpersonal connections, and mass media among others. To be most effective, distribution should engage the channels that intended audiences already trust and access for EBI-related information [<xref ref-type="bibr" rid="CR26">26</xref>, <xref ref-type="bibr" rid="CR27">27</xref>]. Diffusion of Innovations Theory identifies interpersonal connections as particularly important to promoting the spread of new innovations [<xref ref-type="bibr" rid="CR28">28</xref>].</p><p id="Par25">Outcomes used to assess the effectiveness of dissemination strategies include the extent to which EBIs, messages, and materials reach the intended audience(s) and affect their EBI awareness, knowledge, attitude, and intention to adopt. Relevant measures include, for example, Pankratz et al.&#x02019;s [<xref ref-type="bibr" rid="CR29">29</xref>] measure of healthcare providers&#x02019; perceptions of an intervention.</p><p id="Par26">Dissemination strategies to promote colorectal screening might include formative work to identify who within an FQHC makes the decision to adopt new practices. Findings from formative research with these decision-makers would then be applied to customize messages about the value of CRC screening together with materials about CRC screening EBIs. Messages and materials would then be distributed through channels known to have broad reach to the identified decision-makers such as Primary Care Association conferences, newsletters, or continuing education opportunities.</p></sec><sec id="FPar4"><title>Implementation process strategies</title><p id="Par27">are enacted by those working within delivery systems and pertain to processes or activities that implementation or quality improvement teams perform to plan, select, and integrate an EBI into practice. Processes often are categorized within stages, for example, the stages of exploration, adoption/preparation, implementation, and sustainment [<xref ref-type="bibr" rid="CR30">30</xref>]. As the name implies, implementation process strategies target the &#x0201c;process&#x0201d; level of the Consolidated Framework for Implementation Research (CFIR) and focus on how well teams execute activities required to select, adapt, and integrate an EBI. Implementation process strategies may begin prior to the selection of an EBI and typically are EBI-agnostic. In other words, the same process strategies that would apply to a clinic-based obesity prevention initiative also would apply to a clinic-based vaccination initiative. Numerous authors have proposed planning stages and recommended the processes required to complete those stages such as assessing the context, engaging key stakeholders, prioritizing goals and objectives, selecting and adapting an EBI to fit the context, evaluating processes and outcomes, and sustaining EBI integration over time [<xref ref-type="bibr" rid="CR31">31</xref>&#x02013;<xref ref-type="bibr" rid="CR33">33</xref>]. Measures of implementation process strategies focus on the extent to which activities or processes within each stage were completed in a high quality and timely manner [<xref ref-type="bibr" rid="CR34">34</xref>&#x02013;<xref ref-type="bibr" rid="CR36">36</xref>].</p><p id="Par28">For CRC screening, implementation process strategies might include FQHC staff (1) prioritizing CRC screening rates as an area in need of improvement; (2) identifying one or more sub-populations of patients with low screening rates; (3) assessing potential determinants of those low rates; (4) selecting EBIs that best fit the identified determinants of low screening rates; (5) selecting integration strategies that target determinants of how well those EBIs will integrate into the FQHC setting; (6) adapting EBIs, integration strategies, and contexts to fit; (7) executing the selected EBIs and integration strategies; and (8) monitoring implementation and intervention effectiveness and making indicated improvements. Of note, the FQHC staff might transfer the process strategies they learned in the CRC screening implementation initiative for use in a future effort to implement another type of EBI.</p></sec><sec id="FPar6"><title>Integration strategies</title><p id="Par29">are delivered by actors within delivery systems and include any action or set of actions that target factors contributing to or impeding the optimal integration of a specific EBI into practice. Whereas implementation processes are relatively EBI-agnostic and include activities prior to selection of a specific EBI, integration strategies are applied to integrate a specific EBI into practice. Integration strategies primarily target determinants at the level of individuals (e.g., motivation, self-efficacy) and inner settings (e.g., leadership engagement, communication) [<xref ref-type="bibr" rid="CR18">18</xref>]. Strategies include, for example, reminder systems, new care teams, revisions to medical record systems, or new equipment [<xref ref-type="bibr" rid="CR3">3</xref>]. Evaluations of integration strategy effectiveness ideally would focus on changes in the targeted determinants and also their effects on implementation outcomes. For example, an evaluation of a new care team might assess effects on interdisciplinary coordination&#x02014;the targeted determinant&#x02014;in addition to their impact on implementation outcomes (e.g., fidelity, penetration, feasibility) [<xref ref-type="bibr" rid="CR37">37</xref>].</p><p id="Par30">For CRC screening, integration strategies might include reminder systems that target primary care providers&#x02019; awareness of when their patients are due for screening, monitoring those patients&#x02019; subsequent screening rates, and providing feedback to primary care providers on those rates.</p></sec><sec id="FPar7"><title>Capacity-building strategies</title><p id="Par31">are delivered by support systems and target individuals&#x02019; general capacity (motivation, self-efficacy) to execute implementation process strategies (described above). Capacity-building strategies include training, technical assistance, tools, and opportunities for peer networking, among others [<xref ref-type="bibr" rid="CR6">6</xref>]. The Institute for Healthcare Improvement, for example, provides strategies to build delivery-system capacity to execute the implementation process strategies that comprise their Model for Improvement [<xref ref-type="bibr" rid="CR38">38</xref>]. Jacobs et al. [<xref ref-type="bibr" rid="CR39">39</xref>] provide strategies to build public health delivery system capacity to execute the implementation process strategies described in their planning framework. The outcomes of capacity building strategies focus on individual and collective self-efficacy and motivation to execute implementation process strategies and on their actual completion (extent, quality, timeliness) of those implementation process strategies [<xref ref-type="bibr" rid="CR6">6</xref>, <xref ref-type="bibr" rid="CR35">35</xref>, <xref ref-type="bibr" rid="CR36">36</xref>].</p><p id="Par32">For FQHCs, capacity building strategies might involve a support system actor inviting FQHC improvement staff to participate in the Institute for Healthcare Improvement&#x02019;s online school&#x02019;s sessions and then providing them with in-person quality improvement coaching sessions as they progress through each implementation process.</p></sec><sec id="FPar8"><title>Scale-up strategies</title><p id="Par33">are enacted by support system actors with the goal of getting multiple settings to implement a specific EBI. Scale-up strategies target determinants at the level of individuals, inner settings, and outer settings. At the individual level, they target motivation, capability, and opportunity [<xref ref-type="bibr" rid="CR40">40</xref>]. At the inner setting level, they target leadership engagement, resources, and infrastructure among others. At the level of the outer setting, scale-up strategies may target public policy; human and material resources; and cross-setting learning, collaboration, and competition [<xref ref-type="bibr" rid="CR41">41</xref>]. Examples of scale-up strategies include train-the-trainer initiatives, infrastructure development (supply chains, data systems), quality improvement collaboratives, benchmarking, policy advocacy, and recognition systems [<xref ref-type="bibr" rid="CR42">42</xref>, <xref ref-type="bibr" rid="CR43">43</xref>]. The outcomes of scale-up strategies focus on individual or setting-level changes such as increased motivation or capacity to implement or actual implementation of a specific EBI across multiple settings.</p><p id="Par34">To take CRC screening EBIs to scale, an intermediary organization might employ a staged approach and initially partner with a few FQHCs to develop the combination of EBIs, dissemination strategies, implementation planning strategies, and integration strategies they intend to take to scale (i.e., the change package) [<xref ref-type="bibr" rid="CR43">43</xref>]. They would then motivate FQHCs&#x02019; leadership to adopt the change package and educate staff on how to use it. The intermediary organization might then employ technical assistance and benchmarking to support and sustain FQHCs&#x02019; efforts to execute the change package. They may also create a quality improvement collaborative or use other strategies to facilitate peer networking, support, and learning across FQHCs [<xref ref-type="bibr" rid="CR44">44</xref>].</p></sec></sec></sec><sec id="Sec11"><title>Conclusions</title><p id="Par35">Existing taxonomies provide both names and definitions for their lists of implementation strategies. Building on Proctor et al.&#x02019;s [<xref ref-type="bibr" rid="CR5">5</xref>] reporting guidelines, the proposed classification system adds greater conceptual clarity to these definitions by classifying strategies according to who enacts them (actor) and the levels and determinants they target (action targets). These distinctions will aid communication among those engaged in both implementation science and practice, who will now be able to identify their need for or use of implementation strategies as aligning with one (or more) of the five classes. Placing strategies into five broad classes will also assist those who are seeking implementation strategies, whether for research or practice. Accordingly, Table&#x000a0;<xref rid="Tab2" ref-type="table">2</xref> provides references for lists of strategies that are applicable to each class. Finally, the classifications will assist systematic reviewers in aggregating findings across implementation strategies by providing an additional scheme for identifying studies with comparable findings.<table-wrap id="Tab2"><label>Table 2</label><caption><p>Five classifications for implementation strategies</p></caption><table frame="hsides" rules="groups"><thead><tr><th>Classification</th><th>Category of actor [<xref ref-type="bibr" rid="CR10">10</xref>]</th><th>Action target (determinants and levels)</th><th>Example strategies</th><th>Outcomes used to assess effectiveness</th><th>Example strategy lists/descriptions</th></tr></thead><tbody><tr><td>Dissemination strategies</td><td>All 3 ISF systems</td><td>Awareness, attitude, knowledge, and intention to adopt a specific EBI<break/>Targets levels of intervention and individual</td><td>&#x02022; Develop EBI messaging, packaging, and pricing customized to audience<break/>&#x02022; Distribute customized EBI messages and packages through channels with optimal reach</td><td>Distribution reach to target audience<break/>EBI awareness, knowledge, attitude, and intention to adopt</td><td>Dearing &#x00026; Kreuter (2010) [<xref ref-type="bibr" rid="CR26">26</xref>]<break/>Kreuter &#x00026; Bernhartdt (2009) [<xref ref-type="bibr" rid="CR27">27</xref>]</td></tr><tr><td>Implementation process strategies</td><td>Delivery system</td><td>How well teams execute activities required to select, adapt, and integrate EBIs generally<break/>Targets level of process</td><td>&#x02022; Engage stakeholders<break/>&#x02022; Assess context (need, capacity)<break/>&#x02022; Establish goals and objectives<break/>&#x02022; Select EBI and implementation strategies that fit<break/>&#x02022; Adapt EBI, strategies, and context<break/>&#x02022; Evaluate processes and outcomes</td><td>Extent, quality, and timeliness of the completion of activities related to specific implementation process strategies</td><td>Aarons et al. (2011) [<xref ref-type="bibr" rid="CR30">30</xref>]<break/>Chinman et al. (2004) [<xref ref-type="bibr" rid="CR32">32</xref>]<break/>Institute for Healthcare Improvement [<xref ref-type="bibr" rid="CR38">38</xref>]<break/>Meyers et al. (2012) [<xref ref-type="bibr" rid="CR33">33</xref>]</td></tr><tr><td>Integration strategies</td><td>Delivery system</td><td>Factors that facilitate or impede optimal integration of a specific EBI into a specific setting<break/>Targets levels of individual and inner setting</td><td>For a specific EBI:<break/>&#x02022; Institute reminder systems<break/>&#x02022; Revise professional roles<break/>&#x02022; Provide supervision<break/>&#x02022; Modify medical record systems<break/>&#x02022; Implement tools for quality monitoring</td><td>Individuals&#x02019; motivation, capability, and opportunity to implement an EBI<break/>Team coordination/ communication<break/>Fidelity, feasibility, acceptability</td><td>Fixsen et al. (2009) [<xref ref-type="bibr" rid="CR48">48</xref>]<break/>Mazza et al. (2013) [<xref ref-type="bibr" rid="CR3">3</xref>]<break/>Powell et al. (2015) [<xref ref-type="bibr" rid="CR2">2</xref>]</td></tr><tr><td>Capacity-building strategies</td><td>Support system</td><td>Motivation and capability to engage in implementation process strategies<break/>(in general, not related to a specific EBI)<break/>Targets levels of individual and processes</td><td>Across multiple settings:<break/>&#x02022; Training to build general capacity<break/>&#x02022; Technical assistance and facilitation for implementation processes<break/>&#x02022; Tools to support implementation processes</td><td>Individual and collective self-efficacy and motivation to engage in implementation process strategies<break/>Team completion of implementation process strategies</td><td>Leeman et al. (2015) [<xref ref-type="bibr" rid="CR6">6</xref>]<break/>Jacobs et al. (2014) [<xref ref-type="bibr" rid="CR39">39</xref>]<break/>Wandersman et al. (2012) [<xref ref-type="bibr" rid="CR49">49</xref>]</td></tr><tr><td>Scale-up strategies</td><td>Support system</td><td>Motivation and capacity to integrate a specific EBI into practice<break/>Targets level of individual, inner setting, and outer setting</td><td>Across multiple settings:<break/>&#x02022; Training to build EBI-specific capacity<break/>&#x02022; Technical assistance and facilitation (EBI specific)<break/>&#x02022; Implementation toolkits<break/>&#x02022; Quality improvement collaboratives<break/>&#x02022; Benchmarking<break/>&#x02022; Recognition systems<break/>&#x02022; Infrastructure development<break/>&#x02022; Changes to fee for service lists/formularies</td><td>Motivation and capacity to implement, and actual implementation of an EBI across multiple settings</td><td>Barker et al. (2016) [<xref ref-type="bibr" rid="CR43">43</xref>]<break/>Milat et al. (2016) [<xref ref-type="bibr" rid="CR42">42</xref>]</td></tr></tbody></table><table-wrap-foot><p>
<italic>ISF</italic> Interactive Systems Framework, <italic>EBI</italic> evidence-based intervention</p></table-wrap-foot></table-wrap>
</p><p id="Par36">Consistent with the intent of Proctor et al.&#x02019;s guidelines, this classification system&#x02019;s focus on targets of action (levels and determinants) has potential to aid in selecting and strategically combining multiple strategies [<xref ref-type="bibr" rid="CR45">45</xref>, <xref ref-type="bibr" rid="CR46">46</xref>]. For example, by applying intervention mapping methods, implementation strategies could be selected to match determinants across the CFIR levels of the individual, inner setting, and outer setting [<xref ref-type="bibr" rid="CR47">47</xref>]. By identifying the targeted determinants and measuring strategies&#x02019; effects on those determinants, implementation researchers can begin to disentangle the contributions of discrete strategies when multiple strategies are used in combination. They also could advance understanding of the mechanisms through which implementation strategies influence EBI adoption, implementation, scale-up, and sustainment by facilitating the alignment of strategies to theories that explain how they work [<xref ref-type="bibr" rid="CR46">46</xref>].</p><p id="Par37">This classification is intended to be broadly applicable to EBIs that target changes in individuals, populations, environments, and policy. Although our illustration applied the classification to a clinical EBIs, we easily could have illustrated their applicability to implementation strategies related to policy EBIs (e.g., to regulate tobacco marketing) or to environmental EBIs (e.g., to increase access to healthy foods and beverages).</p><p id="Par38">The next steps for developing this framework might include mapping it to existing taxonomies, such as those developed by Powell et al. [<xref ref-type="bibr" rid="CR3">3</xref>] and Mazza et al. [<xref ref-type="bibr" rid="CR4">4</xref>]. Subsequently, a review of the literature and/or Delphi approach might be applied to generate lists of strategies for classes that may be underrepresented in existing taxonomies (e.g., scale-up strategies or dissemination strategies). Further work might also explore the need for additional classes. For example, are different strategies used to de-escalate or to sustain an EBI within a specific setting beyond those that would be listed as integration strategies? Additionally, there may be a need to identify and refine taxonomies of outcomes (like those identified by Proctor et al. [<xref ref-type="bibr" rid="CR37">37</xref>]) that are relevant for each of these classes (e.g., dissemination, scale-up, etc.).</p><p id="Par39">This proposed classification system reflects the ongoing efforts of implementation scientists to develop clearer and more meaningful ways of communicating about the strategies that are crucial to moving EBIs into real-world practice. Structuring strategies into classes has potential to add and facilitate clearer reporting of implementation research findings, alignment of strategies with relevant theories, synthesis of findings across studies, and identification of potential gaps in current strategy listings. Organizing strategies into classes also will assist users in locating the strategies that best match their needs.</p></sec></body><back><glossary><title>Abbreviations</title><def-list><def-item><term>CRC</term><def><p id="Par4">Colorectal cancer</p></def></def-item><def-item><term>EBI</term><def><p id="Par5">Evidence-based intervention</p></def></def-item><def-item><term>FQHC</term><def><p id="Par6">Federally Qualified Health Center</p></def></def-item><def-item><term>IHI</term><def><p id="Par7">Institute for Healthcare Improvement</p></def></def-item><def-item><term>ISF</term><def><p id="Par8">Interactive Systems Framework</p></def></def-item><def-item><term>NIH</term><def><p id="Par9">National Institutes of Health</p></def></def-item></def-list></glossary><ack><title>Acknowledgements</title><p>Appreciation is expressed to Jennifer Scott who also read and edited a near final version of the manuscript.</p><sec id="FPar9"><title>Funding</title><p id="Par40">The project described was supported by the National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, through Grant Award Number UL1TR001111. Dr. Leeman&#x02019;s and Dr. Rohweder&#x02019;s time also was supported by the Centers for Disease Control and Prevention (CDC) through Cooperative Agreement Number U48 DP005017-SIP to the Center for Health Promotion and Disease Prevention at the University of North Carolina at Chapel Hill. Dr. Birken was also supported by KL2TR001109 and Dr. Powell by K01MH113806. The content is solely the responsibility of the authors and does not necessarily represent the official views of the CDC or NIH.</p></sec><sec id="FPar10"><title>Availability of data and materials</title><p id="Par41">Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.</p></sec></ack><notes notes-type="author-contribution"><title>Authors&#x02019; contributions</title><p>JL took the lead in conceptualizing and writing the manuscript. SB, BP, CR, and CS provided ongoing feedback during team meetings, critiqued successive drafts, and provided substantive input into the conceptualization of the manuscript. All authors read and approved the final manuscript.</p></notes><notes notes-type="COI-statement"><sec id="FPar11"><title>Ethics approval and consent to participate</title><p id="Par42">Not applicable.</p></sec><sec id="FPar12"><title>Consent for publication</title><p id="Par43">Not applicable.</p></sec><sec id="FPar13"><title>Competing interests</title><p id="Par44">The authors declare that they have no competing interests.</p></sec><sec id="FPar14"><title>Publisher&#x02019;s Note</title><p id="Par45">Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.</p></sec></notes><ref-list id="Bib1"><title>References</title><ref id="CR1"><label>1.</label><mixed-citation publication-type="other">National Cancer Institute, National Institutes of Health. Implementation science: about IS. 2015. <ext-link ext-link-type="uri" xlink:href="https://cancercontrol.cancer.gov/IS/html">https://cancercontrol.cancer.gov/IS/html</ext-link>. Accessed 6 June 2017.</mixed-citation></ref><ref id="CR2"><label>2.</label><mixed-citation publication-type="other">Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project Implement Sci. 2015;10:21.</mixed-citation></ref><ref id="CR3"><label>3.</label><mixed-citation publication-type="other">Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, et al. Refining a taxonomy for guideline implementation: results of an exercise in abstract classification. Implement Sci. 2013; 8:32.</mixed-citation></ref><ref id="CR4"><label>4.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lokker</surname><given-names>C</given-names></name><name><surname>McKibbon</surname><given-names>KA</given-names></name><name><surname>Colquhoun</surname><given-names>H</given-names></name><name><surname>Hempel</surname><given-names>S</given-names></name></person-group><article-title>A scoping review of classification schemes of interventions to promote and integrate evidence into practice in healthcare</article-title><source>Implement Sci</source><year>2015</year><volume>10</volume><issue>1</issue><fpage>220</fpage><pub-id pub-id-type="doi">10.1186/s13012-015-0220-6</pub-id></element-citation></ref><ref id="CR5"><label>5.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Proctor</surname><given-names>EK</given-names></name><name><surname>Powell</surname><given-names>BJ</given-names></name><name><surname>McMillen</surname><given-names>JC</given-names></name></person-group><article-title>Implementation strategies: recommendations for specifying and reporting</article-title><source>Implement Sci</source><year>2013</year><volume>8</volume><fpage>139</fpage><pub-id pub-id-type="doi">10.1186/1748-5908-8-139</pub-id><pub-id pub-id-type="pmid">24289295</pub-id></element-citation></ref><ref id="CR6"><label>6.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Leeman</surname><given-names>J</given-names></name><name><surname>Calancie</surname><given-names>L</given-names></name><name><surname>Hartman</surname><given-names>M</given-names></name><name><surname>Escoffery</surname><given-names>C</given-names></name><name><surname>Hermann</surname><given-names>A</given-names></name><name><surname>Tague</surname><given-names>L</given-names></name><etal/></person-group><article-title>What strategies are used to build practitioners&#x02019; capacity to implement community-based interventions and are they effective?: a systematic review</article-title><source>Implement Sci</source><year>2015</year><volume>10</volume><fpage>80</fpage><pub-id pub-id-type="doi">10.1186/s13012-015-0272-7</pub-id><pub-id pub-id-type="pmid">26018220</pub-id></element-citation></ref><ref id="CR7"><label>7.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Leeman</surname><given-names>J</given-names></name><name><surname>Calancie</surname><given-names>L</given-names></name><name><surname>Kegler</surname><given-names>M</given-names></name><name><surname>Escoffery</surname><given-names>C</given-names></name><name><surname>Hermman</surname><given-names>A</given-names></name><name><surname>Thatcher</surname><given-names>E</given-names></name><name><surname>Hartman</surname><given-names>M</given-names></name><name><surname>Fernandez</surname><given-names>M</given-names></name></person-group><article-title>Developing theory to guide the design of strategies to build practitioners&#x02019; capacity to adopt and implement evidence-based interventions</article-title><source>Health Educ Behav</source><year>2017</year><volume>44</volume><fpage>59</fpage><lpage>69</lpage><pub-id pub-id-type="doi">10.1177/1090198115610572</pub-id><pub-id pub-id-type="pmid">26500080</pub-id></element-citation></ref><ref id="CR8"><label>8.</label><mixed-citation publication-type="other">Baron RC, Melillo S, Rimer BK, Coates RJ, Kerner J, Habarta N, et al. Intervention to increase recommendation and delivery of screening for breast, cervical, and colorectal cancers by healthcare providers a systematic review of provider reminders. Am J Prev Med. 38(1):110&#x02013;7. S0749-3797(09)00635-7</mixed-citation></ref><ref id="CR9"><label>9.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Steinmo</surname><given-names>S</given-names></name><name><surname>Fuller</surname><given-names>C</given-names></name><name><surname>Stone</surname><given-names>SP</given-names></name><name><surname>Michie</surname><given-names>S</given-names></name></person-group><article-title>Characterising an implementation intervention in terms of behaviour change techniques and theory: the &#x02018;Sepsis Six&#x02019; clinical care bundle</article-title><source>Implement Sci</source><year>2015</year><volume>10</volume><fpage>111</fpage><pub-id pub-id-type="doi">10.1186/s13012-015-0300-7</pub-id><pub-id pub-id-type="pmid">26253306</pub-id></element-citation></ref><ref id="CR10"><label>10.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wilson</surname><given-names>MG</given-names></name><name><surname>Lavis</surname><given-names>JN</given-names></name><name><surname>Travers</surname><given-names>R</given-names></name><name><surname>Rourke</surname><given-names>SB</given-names></name></person-group><article-title>Community-based knowledge transfer and exchange: helping community-based organizations link research to action</article-title><source>Implement Sci</source><year>2010</year><volume>5</volume><fpage>33</fpage><pub-id pub-id-type="doi">10.1186/1748-5908-5-33</pub-id><pub-id pub-id-type="pmid">20423486</pub-id></element-citation></ref><ref id="CR11"><label>11.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Flaspohler</surname><given-names>P</given-names></name><name><surname>Duffy</surname><given-names>J</given-names></name><name><surname>Wandersman</surname><given-names>A</given-names></name><name><surname>Stillman</surname><given-names>L</given-names></name><name><surname>Maras</surname><given-names>MA</given-names></name></person-group><article-title>Unpacking prevention capacity: an intersection of research-to-practice models and community-centered models</article-title><source>Am J Community Psychol</source><year>2008</year><volume>41</volume><issue>3&#x02013;4</issue><fpage>182</fpage><lpage>196</lpage><pub-id pub-id-type="doi">10.1007/s10464-008-9162-3</pub-id><pub-id pub-id-type="pmid">18307028</pub-id></element-citation></ref><ref id="CR12"><label>12.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wandersman</surname><given-names>A</given-names></name><name><surname>Duffy</surname><given-names>J</given-names></name><name><surname>Flaspohler</surname><given-names>P</given-names></name><name><surname>Noonan</surname><given-names>R</given-names></name><name><surname>Lubell</surname><given-names>K</given-names></name><name><surname>Stillman</surname><given-names>L</given-names></name><etal/></person-group><article-title>Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation</article-title><source>Am J Community Psychol</source><year>2008</year><volume>41</volume><issue>3&#x02013;4</issue><fpage>171</fpage><lpage>181</lpage><pub-id pub-id-type="doi">10.1007/s10464-008-9174-z</pub-id><pub-id pub-id-type="pmid">18302018</pub-id></element-citation></ref><ref id="CR13"><label>13.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Newton</surname><given-names>WP</given-names></name><name><surname>Lefebvre</surname><given-names>A</given-names></name><name><surname>Donahue</surname><given-names>KE</given-names></name><name><surname>Bacon</surname><given-names>T</given-names></name><name><surname>Dobson</surname><given-names>A</given-names></name></person-group><article-title>Infrastructure for large-scale quality-improvement projects: early lessons from North Carolina improving performance in practice</article-title><source>J Contin Educ Heal Prof</source><year>2010</year><volume>30</volume><issue>2</issue><fpage>106</fpage><lpage>113</lpage><pub-id pub-id-type="doi">10.1002/chp.20066</pub-id></element-citation></ref><ref id="CR14"><label>14.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hefelfinger</surname><given-names>J</given-names></name><name><surname>Patty</surname><given-names>A</given-names></name><name><surname>Ussery</surname><given-names>A</given-names></name><name><surname>Young</surname><given-names>W</given-names></name></person-group><article-title>Technical assistance from state health departments for communities engaged in policy, systems, and environmental change: the ACHIEVE program</article-title><source>Prev Chronic Dis</source><year>2013</year><volume>10</volume><fpage>E175</fpage><pub-id pub-id-type="doi">10.5888/pcd10.130093</pub-id><pub-id pub-id-type="pmid">24157078</pub-id></element-citation></ref><ref id="CR15"><label>15.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Flottorp</surname><given-names>SA</given-names></name><name><surname>Oxman</surname><given-names>AD</given-names></name><name><surname>Krause</surname><given-names>J</given-names></name><name><surname>Musila</surname><given-names>NR</given-names></name><name><surname>Wensing</surname><given-names>M</given-names></name><name><surname>Godycki-Cwirko</surname><given-names>M</given-names></name><etal/></person-group><article-title>A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice</article-title><source>Implement Sci</source><year>2013</year><volume>8</volume><fpage>35</fpage><pub-id pub-id-type="doi">10.1186/1748-5908-8-35</pub-id><pub-id pub-id-type="pmid">23522377</pub-id></element-citation></ref><ref id="CR16"><label>16.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Colquhoun</surname><given-names>H</given-names></name><name><surname>Leeman</surname><given-names>J</given-names></name><name><surname>Michie</surname><given-names>S</given-names></name><name><surname>Lokker</surname><given-names>C</given-names></name><name><surname>Bragge</surname><given-names>P</given-names></name><name><surname>Hempel</surname><given-names>S</given-names></name><etal/></person-group><article-title>Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies</article-title><source>Implement Sci</source><year>2014</year><volume>9</volume><fpage>51</fpage><pub-id pub-id-type="pmid">24885553</pub-id></element-citation></ref><ref id="CR17"><label>17.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kok</surname><given-names>G</given-names></name><name><surname>Gottlieb</surname><given-names>NH</given-names></name><name><surname>Peters</surname><given-names>GJ</given-names></name><name><surname>Mullen</surname><given-names>PD</given-names></name><name><surname>Parcel</surname><given-names>G</given-names></name><name><surname>Ruiter</surname><given-names>RAC</given-names></name><etal/></person-group><article-title>A taxonomy of behavior change methods: an intervention mapping approach</article-title><source>Health Psychol Rev</source><year>2016</year><volume>10</volume><fpage>297</fpage><lpage>312</lpage><pub-id pub-id-type="doi">10.1080/17437199.2015.1077155</pub-id><pub-id pub-id-type="pmid">26262912</pub-id></element-citation></ref><ref id="CR18"><label>18.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Damschroder</surname><given-names>LJ</given-names></name><name><surname>Aron</surname><given-names>DC</given-names></name><name><surname>Keith</surname><given-names>RE</given-names></name><name><surname>Kirsh</surname><given-names>SR</given-names></name><name><surname>Alexander</surname><given-names>JA</given-names></name><name><surname>Lowery</surname><given-names>JC</given-names></name></person-group><article-title>Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science</article-title><source>Implement Sci</source><year>2009</year><volume>4</volume><fpage>50</fpage><pub-id pub-id-type="doi">10.1186/1748-5908-4-50</pub-id><pub-id pub-id-type="pmid">19664226</pub-id></element-citation></ref><ref id="CR19"><label>19.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Michie</surname><given-names>S</given-names></name><name><surname>Johnston</surname><given-names>M</given-names></name><name><surname>Abraham</surname><given-names>C</given-names></name><name><surname>Lawton</surname><given-names>R</given-names></name><name><surname>Parker</surname><given-names>D</given-names></name><name><surname>Walker</surname><given-names>A</given-names></name></person-group><article-title>Making psychological theory useful for implementing evidence based practice: a consensus approach</article-title><source>Qual Saf Health Care</source><year>2005</year><volume>14</volume><fpage>26</fpage><lpage>33</lpage><pub-id pub-id-type="doi">10.1136/qshc.2004.011155</pub-id><pub-id pub-id-type="pmid">15692000</pub-id></element-citation></ref><ref id="CR20"><label>20.</label><mixed-citation publication-type="other">Bartholomew Elderedge LK, Markham CM, Ruiter RAC, Fernandez ME, Kok G, Parcel GS. Planning health promotion programs: an intervention mapping approach. San Francisco: Jossey-Bass; 2016.</mixed-citation></ref><ref id="CR21"><label>21.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname><given-names>CH</given-names></name><name><surname>Curran</surname><given-names>G</given-names></name><name><surname>Palinkas</surname><given-names>LA</given-names></name><name><surname>Aarons</surname><given-names>GA</given-names></name><name><surname>Wells</surname><given-names>KB</given-names></name><name><surname>Jones</surname><given-names>L</given-names></name><etal/></person-group><article-title>An overview of research and evaluation designs for dissemination and implementation</article-title><source>Annu Rev Public Health</source><year>2017</year><volume>38</volume><fpage>1</fpage><lpage>22</lpage><pub-id pub-id-type="doi">10.1146/annurev-publhealth-031816-044215</pub-id><pub-id pub-id-type="pmid">28384085</pub-id></element-citation></ref><ref id="CR22"><label>22.</label><mixed-citation publication-type="other">US Preventive Services Task Force. Colorectal cancer: screening. <ext-link ext-link-type="uri" xlink:href="https://www.uspreventiveservicestaskforce.org/Page/Document/UpdateSummaryFinal/colorectal-cancer-screening2">https://www.uspreventiveservicestaskforce.org/Page/Document/UpdateSummaryFinal/colorectal-cancer-screening2</ext-link>. Retrieved June 6, 2017.</mixed-citation></ref><ref id="CR23"><label>23.</label><mixed-citation publication-type="other">Department of Health and Human Services, National Institutes of Health. Dissemination and implementation research in health. PAR-16-238. 2016. Retrieved June 6, 2017.</mixed-citation></ref><ref id="CR24"><label>24.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Storey</surname><given-names>JD</given-names></name><name><surname>Saffitz</surname><given-names>GB</given-names></name><name><surname>Rimon</surname><given-names>JG</given-names></name></person-group><person-group person-group-type="editor"><name><surname>Glanz</surname><given-names>K</given-names></name><name><surname>Rimer</surname><given-names>BK</given-names></name><name><surname>Viswanathan</surname><given-names>K</given-names></name></person-group><article-title>Social marketing</article-title><source>Health behavior and health education</source><year>2008</year><publisher-loc>San Francisco</publisher-loc><publisher-name>Wiley</publisher-name><fpage>435</fpage><lpage>464</lpage></element-citation></ref><ref id="CR25"><label>25.</label><mixed-citation publication-type="other">McCormack L, Sheridan S, Lewis M, Boudewyns V, Melvin CL, Kisteler C, et al. Communication and dissemination strategies to facilitate the use of health-related evidence. Evid Report/Technology Assess 2013. <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/books/NBK179104">https://www.ncbi.nlm.nih.gov/books/NBK179104</ext-link>. Retrieved June 8, 2017.</mixed-citation></ref><ref id="CR26"><label>26.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dearing</surname><given-names>JW</given-names></name><name><surname>Kreuter</surname><given-names>MW</given-names></name></person-group><article-title>Designing for diffusion: how can we increase uptake of cancer communication innovations?</article-title><source>Patient Educ Couns</source><year>2010</year><volume>81</volume><issue>Suppl</issue><fpage>S100</fpage><lpage>S110</lpage><pub-id pub-id-type="doi">10.1016/j.pec.2010.10.013</pub-id><pub-id pub-id-type="pmid">21067884</pub-id></element-citation></ref><ref id="CR27"><label>27.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kreuter</surname><given-names>MW</given-names></name><name><surname>Bernhardt</surname><given-names>JM</given-names></name></person-group><article-title>Reframing the dissemination challenge: a marketing and distribution perspective</article-title><source>Am J Public Health</source><year>2009</year><volume>99</volume><issue>12</issue><fpage>2123</fpage><lpage>2127</lpage><pub-id pub-id-type="doi">10.2105/AJPH.2008.155218</pub-id><pub-id pub-id-type="pmid">19833993</pub-id></element-citation></ref><ref id="CR28"><label>28.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Rogers</surname><given-names>EM</given-names></name></person-group><source>Diffusion of innovations</source><year>2003</year><publisher-loc>New York</publisher-loc><publisher-name>Free Press</publisher-name></element-citation></ref><ref id="CR29"><label>29.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pankratz</surname><given-names>M</given-names></name><name><surname>Hallfors</surname><given-names>D</given-names></name><name><surname>Cho</surname><given-names>H</given-names></name></person-group><article-title>Measuring perceptions of innovation adoption: the diffusion of a federal drug prevention policy</article-title><source>Health Educ Res</source><year>2002</year><volume>17</volume><issue>3</issue><fpage>315</fpage><lpage>326</lpage><pub-id pub-id-type="doi">10.1093/her/17.3.315</pub-id><pub-id pub-id-type="pmid">12120847</pub-id></element-citation></ref><ref id="CR30"><label>30.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Aarons</surname><given-names>GA</given-names></name><name><surname>Hurlburt</surname><given-names>M</given-names></name><name><surname>Horwitz</surname><given-names>SM</given-names></name></person-group><article-title>Advancing a conceptual model of evidence-based practice implementation in public service sectors</article-title><source>Admin Pol Ment Health</source><year>2011</year><volume>38</volume><issue>1</issue><fpage>4</fpage><lpage>23</lpage><pub-id pub-id-type="doi">10.1007/s10488-010-0327-7</pub-id></element-citation></ref><ref id="CR31"><label>31.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Graham</surname><given-names>I</given-names></name><name><surname>Logan</surname><given-names>J</given-names></name><name><surname>Harrison</surname><given-names>M</given-names></name><name><surname>Straus</surname><given-names>S</given-names></name><name><surname>Tetroe</surname><given-names>J</given-names></name><name><surname>Caswell</surname><given-names>W</given-names></name><etal/></person-group><article-title>Lost in knowledge translation: time for a map?</article-title><source>J Contin Educ Heal Prof</source><year>2006</year><volume>26</volume><fpage>13</fpage><lpage>24</lpage><pub-id pub-id-type="doi">10.1002/chp.47</pub-id></element-citation></ref><ref id="CR32"><label>32.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chinman</surname><given-names>M</given-names></name><name><surname>Early</surname><given-names>D</given-names></name><name><surname>Ebener</surname><given-names>P</given-names></name><name><surname>Hunter</surname><given-names>S</given-names></name><name><surname>Imm</surname><given-names>P</given-names></name><name><surname>Jenkins</surname><given-names>P</given-names></name><etal/></person-group><article-title>Getting to outcomes: a community-based participatory approach to preventive interventions</article-title><source>J Interprof Care</source><year>2004</year><volume>18</volume><issue>4</issue><fpage>441</fpage><lpage>443</lpage><pub-id pub-id-type="doi">10.1080/13561820400011727</pub-id><pub-id pub-id-type="pmid">15801559</pub-id></element-citation></ref><ref id="CR33"><label>33.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meyers</surname><given-names>DC</given-names></name><name><surname>Durlak</surname><given-names>JA</given-names></name><name><surname>Wandersman</surname><given-names>A</given-names></name></person-group><article-title>The quality implementation framework: a synthesis of critical steps in the implementation process</article-title><source>Am J Community Psychol</source><year>2012</year><volume>50</volume><issue>3&#x02013;4</issue><fpage>462</fpage><lpage>480</lpage><pub-id pub-id-type="doi">10.1007/s10464-012-9522-x</pub-id><pub-id pub-id-type="pmid">22644083</pub-id></element-citation></ref><ref id="CR34"><label>34.</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Hall</surname><given-names>GE</given-names></name><name><surname>Hord</surname><given-names>SM</given-names></name></person-group><source>Implementing change: patterns, principles, and potholes</source><year>2011</year><publisher-loc>Upper Saddle River, NJ</publisher-loc><publisher-name>Pearson Education Inc.</publisher-name></element-citation></ref><ref id="CR35"><label>35.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chinman</surname><given-names>M</given-names></name><name><surname>Hunter</surname><given-names>SB</given-names></name><name><surname>Ebener</surname><given-names>P</given-names></name><name><surname>Paddock</surname><given-names>SM</given-names></name><name><surname>Stillman</surname><given-names>L</given-names></name><name><surname>Imm</surname><given-names>P</given-names></name><etal/></person-group><article-title>The getting to outcomes demonstration and evaluation: an illustration of the prevention support system</article-title><source>Am J Community Psychol</source><year>2008</year><volume>41</volume><issue>3&#x02013;4</issue><fpage>206</fpage><lpage>224</lpage><pub-id pub-id-type="doi">10.1007/s10464-008-9163-2</pub-id><pub-id pub-id-type="pmid">18278551</pub-id></element-citation></ref><ref id="CR36"><label>36.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chamberlain</surname><given-names>P</given-names></name><name><surname>Brown</surname><given-names>CH</given-names></name><name><surname>Saldana</surname><given-names>L</given-names></name></person-group><article-title>Observational measure of implementation progress in community based settings: the stages of implementation completion (SIC)</article-title><source>Implement Sci</source><year>2011</year><volume>6</volume><fpage>116</fpage><pub-id pub-id-type="doi">10.1186/1748-5908-6-116</pub-id><pub-id pub-id-type="pmid">21974914</pub-id></element-citation></ref><ref id="CR37"><label>37.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Proctor</surname><given-names>E</given-names></name><name><surname>Silmere</surname><given-names>H</given-names></name><name><surname>Raghavan</surname><given-names>R</given-names></name><name><surname>Hovmand</surname><given-names>P</given-names></name><name><surname>Aarons</surname><given-names>G</given-names></name><name><surname>Bunger</surname><given-names>A</given-names></name><etal/></person-group><article-title>Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda</article-title><source>Admin Pol Ment Health</source><year>2011</year><volume>38</volume><fpage>65</fpage><lpage>76</lpage><pub-id pub-id-type="doi">10.1007/s10488-010-0319-7</pub-id></element-citation></ref><ref id="CR38"><label>38.</label><mixed-citation publication-type="other">Institute for Healthcare Improvement. How to improve. 2017. <ext-link ext-link-type="uri" xlink:href="http://www.ihi.org/resources/Pages/HowtoImprove/default.aspx">http://www.ihi.org/resources/Pages/HowtoImprove/default.aspx</ext-link>. Retrieved June 8, 2017.</mixed-citation></ref><ref id="CR39"><label>39.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jacobs</surname><given-names>JA</given-names></name><name><surname>Duggan</surname><given-names>K</given-names></name><name><surname>Erwin</surname><given-names>P</given-names></name><name><surname>Smith</surname><given-names>C</given-names></name><name><surname>Borawski</surname><given-names>E</given-names></name><name><surname>Compton</surname><given-names>J</given-names></name><etal/></person-group><article-title>Capacity building for evidence-based decision making in local health departments: scaling up an effective training approach</article-title><source>Implement Sci</source><year>2014</year><volume>9</volume><issue>1</issue><fpage>124</fpage><pub-id pub-id-type="doi">10.1186/s13012-014-0124-x</pub-id><pub-id pub-id-type="pmid">25253081</pub-id></element-citation></ref><ref id="CR40"><label>40.</label><mixed-citation publication-type="other">Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 2011; 6:42.</mixed-citation></ref><ref id="CR41"><label>41.</label><mixed-citation publication-type="other">Rabin BA, Brownson R. In:Developing the terminology for dissemination and implementation research. Brownson R, Colditz G, Proctor E, editors. Dissemination and implementation research in health. New York, New York: Oxford University Press; 2012.</mixed-citation></ref><ref id="CR42"><label>42.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Milat</surname><given-names>AJ</given-names></name><name><surname>Bauman</surname><given-names>A</given-names></name><name><surname>Redman</surname><given-names>S</given-names></name></person-group><article-title>Narrative review of models and success factors for scaling up public health interventions</article-title><source>Implement Sci</source><year>2015</year><volume>10</volume><fpage>113</fpage><pub-id pub-id-type="doi">10.1186/s13012-015-0301-6</pub-id><pub-id pub-id-type="pmid">26264351</pub-id></element-citation></ref><ref id="CR43"><label>43.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Barker</surname><given-names>PM</given-names></name><name><surname>Reid</surname><given-names>A</given-names></name><name><surname>Schall</surname><given-names>MW</given-names></name></person-group><article-title>A framework for scaling up health interventions: lessons from large-scale improvement initiatives in Africa</article-title><source>Implement Sci</source><year>2016</year><volume>11</volume><fpage>12</fpage><pub-id pub-id-type="doi">10.1186/s13012-016-0374-x</pub-id><pub-id pub-id-type="pmid">26821910</pub-id></element-citation></ref><ref id="CR44"><label>44.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dearing</surname><given-names>JW</given-names></name></person-group><article-title>Evolution of diffusion and dissemination theory</article-title><source>J Public Health Manag Pract</source><year>2008</year><volume>14</volume><fpage>99</fpage><lpage>108</lpage><pub-id pub-id-type="doi">10.1097/01.PHH.0000311886.98627.b7</pub-id><pub-id pub-id-type="pmid">18287914</pub-id></element-citation></ref><ref id="CR45"><label>45.</label><mixed-citation publication-type="other">Leviton LC, Trujillo MD. Interaction of theory and practice to assess external validity. Eval Rev. 2016.</mixed-citation></ref><ref id="CR46"><label>46.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Craig</surname><given-names>P</given-names></name><name><surname>Dieppe</surname><given-names>P</given-names></name><name><surname>Macintyre</surname><given-names>S</given-names></name><name><surname>Michie</surname><given-names>S</given-names></name><name><surname>Nazareth</surname><given-names>I</given-names></name><name><surname>Petticrew</surname><given-names>M</given-names></name></person-group><article-title>Developing and evaluating complex interventions: the new Medical Research Council guidance</article-title><source>BMJ</source><year>2008</year><volume>337</volume><fpage>a1655</fpage><pub-id pub-id-type="doi">10.1136/bmj.a1655</pub-id><pub-id pub-id-type="pmid">18824488</pub-id></element-citation></ref><ref id="CR47"><label>47.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Powell</surname><given-names>BJ</given-names></name><name><surname>Beidas</surname><given-names>RS</given-names></name><name><surname>Lewis</surname><given-names>CC</given-names></name><name><surname>Aarons</surname><given-names>GA</given-names></name><name><surname>McMillen</surname><given-names>JC</given-names></name><name><surname>Proctor</surname><given-names>EK</given-names></name><name><surname>Mandell</surname><given-names>DS</given-names></name></person-group><article-title>Methods to improve the selection and tailoring of implementation strategies</article-title><source>J Behav Health Serv Res</source><year>2017</year><volume>44</volume><fpage>177</fpage><lpage>194</lpage><pub-id pub-id-type="doi">10.1007/s11414-015-9475-6</pub-id><pub-id pub-id-type="pmid">26289563</pub-id></element-citation></ref><ref id="CR48"><label>48.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fixsen</surname><given-names>DL</given-names></name><name><surname>Blase</surname><given-names>KA</given-names></name><name><surname>Naoom</surname><given-names>SF</given-names></name><name><surname>Wallace</surname><given-names>F</given-names></name></person-group><article-title>Core implementation components</article-title><source>Res Soc Work Pract</source><year>2009</year><volume>19</volume><fpage>531</fpage><lpage>540</lpage><pub-id pub-id-type="doi">10.1177/1049731509335549</pub-id></element-citation></ref><ref id="CR49"><label>49.</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wandersman</surname><given-names>A</given-names></name><name><surname>Chien</surname><given-names>VH</given-names></name><name><surname>Katz</surname><given-names>J</given-names></name></person-group><article-title>Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement</article-title><source>Am J Community Psychol</source><year>2012</year><volume>50</volume><fpage>445</fpage><lpage>459</lpage><pub-id pub-id-type="doi">10.1007/s10464-012-9509-7</pub-id><pub-id pub-id-type="pmid">22538406</pub-id></element-citation></ref></ref-list></back></article>