<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article"><?properties manuscript?><front><journal-meta><journal-id journal-id-type="nlm-journal-id">9430800</journal-id><journal-id journal-id-type="pubmed-jr-id">20222</journal-id><journal-id journal-id-type="nlm-ta">J Am Med Inform Assoc</journal-id><journal-id journal-id-type="iso-abbrev">J Am Med Inform Assoc</journal-id><journal-title-group><journal-title>Journal of the American Medical Informatics Association : JAMIA</journal-title></journal-title-group><issn pub-type="ppub">1067-5027</issn><issn pub-type="epub">1527-974X</issn></journal-meta><article-meta><article-id pub-id-type="pmid">28049635</article-id><article-id pub-id-type="pmc">5538577</article-id><article-id pub-id-type="doi">10.1093/jamia/ocw160</article-id><article-id pub-id-type="manuscript">HHSPA884488</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>Cost and Economic Benefit of Clinical Decision Support Systems (CDSS) for Cardiovascular Disease Prevention: A Community Guide Systematic Review</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Jacob</surname><given-names>Verughese</given-names></name><degrees>PhD, MPH</degrees></contrib><contrib contrib-type="author"><name><surname>Thota</surname><given-names>Anilkrishna B.</given-names></name><degrees>MBBS, MPH</degrees></contrib><contrib contrib-type="author"><name><surname>Chattopadhyay</surname><given-names>Sajal K.</given-names></name><degrees>PhD</degrees></contrib><contrib contrib-type="author"><name><surname>Njie</surname><given-names>Gibril J.</given-names></name><degrees>MPH</degrees></contrib><contrib contrib-type="author"><name><surname>Proia</surname><given-names>Krista K.</given-names></name><degrees>MPH</degrees></contrib><contrib contrib-type="author"><name><surname>Hopkins</surname><given-names>David P.</given-names></name><degrees>MD, MPH</degrees></contrib><contrib contrib-type="author"><name><surname>Ross</surname><given-names>Murray N.</given-names></name><degrees>PhD</degrees></contrib><contrib contrib-type="author"><name><surname>Pronk</surname><given-names>Nicolaas P.</given-names></name><degrees>PhD, MA</degrees></contrib><contrib contrib-type="author"><name><surname>Clymer</surname><given-names>John M.</given-names></name><degrees>BA</degrees></contrib><contrib contrib-type="author"><collab>the Community Preventive Services Task Force</collab></contrib><aff id="A1">The Community Guide Branch, Division of Public Health Information Dissemination (Jacob, Thota, Chattopadhyay, Njie, Proia, Hopkins), Center for Surveillance, Epidemiology, and Laboratory Services, Centers for Disease Control and Prevention, Atlanta, Georgia, USA; Kaiser Institute for Health Policy (Ross), Oakland, California, USA; Health Management Division, HealthPartners Research Foundation (Pronk), Minneapolis, Minnesota, USA; Executive Director, National Forum for Heart Disease &#x00026; Stroke Prevention (Clymer), Washington, DC, USA</aff></contrib-group><author-notes><corresp id="FN1">Address correspondence to: Verughese Jacob, Center for Surveillance, Epidemiology and Laboratory Services, CDC, 1600 Clifton Road, MS E-69, Atlanta, GA 30329, USA. <email>hir0@cdc.gov</email>. Phone: 1-404-498-6884</corresp><fn id="FN2"><p>Names and aff&#x00131;liations of Task Force members are available at <ext-link ext-link-type="uri" xlink:href="www.thecommunityguide.org/about/task-force-members.html">www.thecommunityguide.org/about/task-force-members.html</ext-link></p></fn></author-notes><pub-date pub-type="nihms-submitted"><day>14</day><month>6</month><year>2017</year></pub-date><pub-date pub-type="ppub"><day>01</day><month>5</month><year>2017</year></pub-date><pub-date pub-type="pmc-release"><day>01</day><month>5</month><year>2018</year></pub-date><volume>24</volume><issue>3</issue><fpage>669</fpage><lpage>676</lpage><!--elocation-id from pubmed: 10.1093/jamia/ocw160--><abstract><sec id="S1"><title>Objective</title><p id="P1">This review evaluates costs and benefits associated with acquiring, implementing, and operating clinical decision support systems (CDSS) to prevent cardiovascular disease (CVD).</p></sec><sec id="S2"><title>Materials and Methods</title><p id="P2">Methods developed for The Community Guide were used to review CDSS literature covering the period from January 1976 to October 2015. Twenty-one studies were identified for inclusion.</p></sec><sec id="S3"><title>Results</title><p id="P3">It was difficult to draw a meaningful estimate for the cost of acquiring and operating CDSS to prevent CVD from the available studies (n=12) due to considerable heterogeneity. Several studies (n=11) indicated healthcare costs were averted by using CDSS but many were partial assessments that did not consider all components of healthcare. Four cost-benefit studies reached conflicting conclusions about the net benefit of CDSS based on incomplete assessments of costs and benefits. Three cost-utility studies indicated inconsistent conclusions regarding cost-effectiveness based on a conservative $50,000 threshold.</p></sec><sec id="S4"><title>Discussion</title><p id="P4">Intervention costs were not negligible but specific estimates were not derived because of the heterogeneity of implementation and reporting metrics. Expected economic benefits from averted healthcare cost could not be determined with confidence because many studies did not fully account for all components of healthcare.</p></sec><sec id="S5"><title>Conclusion</title><p id="P5">We were unable to conclude whether CDSS for CVD prevention is either cost-beneficial or cost effective. Several evidence gaps are identified, most prominently the lack of information about major drivers of cost and benefit; the lack of standard metrics for the cost of CDSS; and not allowing for useful life of CDSS that generally extends beyond one accounting period.</p></sec></abstract><kwd-group><kwd>Decision support systems</kwd><kwd>clinical</kwd><kwd>Economics</kwd><kwd>Economics</kwd><kwd>medical</kwd></kwd-group></article-meta></front><body><sec sec-type="intro" id="S6"><title>INTRODUCTION</title><p id="P6">The 2016 statistical update from the American Heart Association estimated that the annual cost of cardiovascular disease (CVD) and stroke in 2011&#x02013;2012 was $193.1 billion in medical care and about $123 billion in lost productivity from premature death.(<xref rid="R1" ref-type="bibr">1</xref>) A substantial part of this burden is preventable by preventing and controlling major risk factors for CVD, including hypertension, hypercholesterolemia, and diabetes.(<xref rid="R1" ref-type="bibr">1</xref>) Clinical decision support systems (CDSS) are computer-based tools used to assist health providers to prevent and control these risk factors. The Community Preventive Services Task Force (Task Force) recently recommended CDSS for CVD prevention,(<xref rid="R2" ref-type="bibr">2</xref>) based on evidence from a systematic review conducted for The Community Guide.(<xref rid="R3" ref-type="bibr">3</xref>) The evidence showed CDSS improved screening for CVD risk factors and improved practices for CVD-related preventive care services, clinical tests, and treatments. The objective of the present study is to assess the economic value of CDSS interventions for CVD prevention, based on a systematic review of the literature.</p></sec><sec sec-type="materials|methods" id="S7"><title>METHODS AND MATERIALS</title><p id="P7">A full description of general methods for Community Guide systematic economic reviews is available online.(<xref rid="R4" ref-type="bibr">4</xref>). Briefly, Community Guide systematic economic reviews have the multiple objectives of providing evidence-based estimates of what it costs to implement an intervention, calculating the expected benefits from averted healthcare cost and worksite productivity losses due to reduced morbidity and mortality, and making a judgement of economic value based on estimated cost-benefit or cost-effectiveness. Estimates of economic outcomes generally vary considerably across evaluation studies. Therefore, Community Guide economic review methods attempt to account for the major elements that drive intervention costs and benefits, identified a priori based on information gained from published literature and subject matter experts.</p><p id="P8">Following the general methods, a systematic review team was constituted for the evaluation of CDSS for CVD prevention, including subject matter experts on CVD and CDSS from various agencies, organizations, and academic institutions together with expert systematic reviewers from The Community Guide branch at CDC. The team worked under the oversight of the Task Force.</p><p id="P9">CDSS for CVD prevention were defined as computer-based information systems designed to assist healthcare providers, in primary, secondary, and tertiary care settings, implement guidelines and evidence-based practices by providing tailored reminders to conduct or schedule preventive and screening services; assessments of patients&#x02019; risk for developing CVD based on their medical history; and alerts when CVD-related physiologic indicators are not at goal. The CDSS interface with the provider occurs at the point of care, based on individual patient data, and assists providers with recommendations for screening, preventive care, and treatment of their patients who have risk factors for CVD such as obesity, inactivity, smoking, hypertension, hyperlipidemia, or diabetes. Improved clinician actions should mitigate these risk factors and ultimately lead to reduced morbidity and mortality from CVD and therefore also improve economic outcomes. The complete definition and analytic framework are available in the published review of effectiveness.(<xref rid="R3" ref-type="bibr">3</xref>)</p><sec id="S8"><title>Search strategy and inclusion criteria</title><p id="P10">The studies for this systematic economic review were drawn from the results of three searches:</p><list list-type="order" id="L1"><list-item><p id="P11">The primary source was the set of studies referenced in a broad systematic review published in 2012, Bright et al.,(<xref rid="R5" ref-type="bibr">5</xref>) and the in the accompanying report to the Agency for Healthcare Research and Quality (AHRQ).(<xref rid="R6" ref-type="bibr">6</xref>)</p><list list-type="bullet" id="L2"><list-item><p id="P12">Period: January 1975&#x02013;January 2011</p></list-item><list-item><p id="P13">Databases: PubMed, CINAHL, PsycINFO, PubMed NLM, and Web of Science</p></list-item><list-item><p id="P14">Scope: CDSS in all health topics</p></list-item></list></list-item><list-item><p id="P15">The Bright et al. search was updated to cover more recent studies</p><list list-type="bullet" id="L3"><list-item><p id="P16">Period: January 2011&#x02013;October 2015</p></list-item><list-item><p id="P17">Databases: PubMed, CINAHL, PsycINFO, PubMed NLM, and Web of Science</p></list-item><list-item><p id="P18">Scope: CDSS in CVD prevention</p></list-item></list></list-item><list-item><p id="P19">Search was conducted within economics-related databases using the strategy implemented in Bright et al.</p><list list-type="bullet" id="L4"><list-item><p id="P20">Period: January 1970&#x02013;October 2015</p></list-item><list-item><p id="P21">Databases: JSTOR, EconLit, Centre for Reviews and Dissemination</p></list-item><list-item><p id="P22">Scope: CDSS in CVD prevention</p></list-item></list></list-item></list><p id="P23">The three searches used terms to identify evaluation studies of CDSS to prevent CVD across healthcare settings and ages. The studies referenced in the Bright et al. review were further screened to identify those related to CVD prevention because that review considered CDSS use under all health topics. Details including the complete list of search terms for the domains of CDSS intervention, target population, CVD prevention, and the databases searched for the Bright et al. search and its update are available online,(<xref rid="R7" ref-type="bibr">7</xref>) as are similar details for the economics-focused search.(<xref rid="R8" ref-type="bibr">8</xref>)</p><p id="P24">Studies were included in this review if they:</p><list list-type="bullet" id="L5"><list-item><p id="P25">met the intervention definition;</p></list-item><list-item><p id="P26">were in English;</p></list-item><list-item><p id="P27">were implemented in a high-income economy;(<xref rid="R9" ref-type="bibr">9</xref>) and</p></list-item><list-item><p id="P28">reported one or more of: the cost of intervention, change in healthcare cost, change in productivity, other economic benefits, cost-benefit, or cost-effectiveness.</p></list-item></list><p id="P29">CDSS interventions are generally implemented in clinics, hospitals, and other healthcare settings and the cost of implementation is borne by the same organizations. However, benefits can accrue to patients, their employers, or insurers. This review took both a health system and a societal perspective when assessing cost and benefit, so that reported estimates are meaningful for both the public and commercial perspectives of these implementers and funders.</p><sec id="S9"><title>Intervention cost</title><p id="P30">The cost to develop the CDSS is the cost of compiling evidence-based narrative guidelines and programming the guidelines and decisions into code to produce prompts for provider action. Resources are needed to then implement the system throughout the practice and for all providers. The day-to-day use and maintenance of the CDSS require staff time and other resources, and are categorized under operating cost. In summary, the components of capital cost are development and implementation and the components of operating cost are maintenance and operation. Annualized <italic>intervention cost</italic> was estimated by distributing the one-time cost of development and implementation equally over the assumed 5-year life of the system and adding this annual amortized cost, discounted at 3%, to the annual cost of operation. Details regarding the conceptualization and measurement of intervention cost is presented in the <xref rid="SD1" ref-type="supplementary-material">Appendix 1</xref>.</p><p id="P31">A CDSS may be embedded within an electronic health record (EHR) system containing patient demographics and all health-related data or it may be built on a registry that contains information only for patients with a specific disease or condition. The cost of collecting and populating the database with patient information, whether for an EHR or a registry, is not considered part of CDSS intervention cost.</p><p id="P32">A CDSS may also change the economic <italic>efficiency</italic> of the care process by altering the resources needed to care for a patient or by altering the number of patients cared for with the same level of resource use. The benefits of this efficiency accrue to the healthcare facility implementing the CDSS and would be observed in operation cost per patient or per patient visit.</p></sec><sec id="S10"><title>Intervention economic benefits</title><p id="P33">Effective CDSS interventions reduce CVD risk factors, such as systolic blood pressure. The reduction in risk factors, in turn, reduces morbidity and mortality and increases the quantity and quality of years lived, measured as quality-adjusted life years (QALYs) saved.</p><p id="P34">The impact of CDSS on <italic>healthcare cost</italic> is the difference in cost of healthcare products and services used by the intervention and control groups or the pre to post change where there is no control group. The implementation of CDSS in health care can increase or decrease healthcare utilization by the patient, either owing to adherence to guidelines for care (increased cost) or to improved health (decreased cost). The sum of these two changes is observed in changes in the component cost of outpatient, inpatient, medications, labs, and emergency room (ER) visits. A full accounting of healthcare cost would include all five of these components; this review considers them to be of equal weight and an estimate that includes at least three of the five components to be <italic>reasonably complete</italic>.</p><p id="P35">Reduced illness and increased years of life lived contribute to fewer illness-related absences from work, better performance when present, and a longer period of productivity. Hence, effective CDSS implementations that prevent CVD are expected to increase worksite <italic>productivity</italic>.</p><p id="P36">Reduced morbidity and mortality also increase both the quantity and quality of life years lived. This is captured in outcomes such as QALYs saved or disability-adjusted life years (DALYs) averted.</p></sec><sec id="S11" sec-type="conclusions"><title>Summary economic outcomes</title><p id="P37"><italic>Cost-benefit</italic> analysis compares economic benefit to intervention cost, where both benefit and cost are monetized and expressed in dollar terms; an intervention is cost-beneficial when economic benefit exceeds intervention cost.</p><p id="P38">Net cost (intervention cost plus healthcare cost) per QALY gained produces <italic>cost-utility</italic>, which is a type of cost-effectiveness assessment. An intervention is <italic>cost-effective</italic> when net cost per QALY gained is less than a $50,000. A threshold is applied because it is necessary to determine cost-effectiveness(<xref rid="R10" ref-type="bibr">10</xref>) and $50,000 is chosen for the threshold because it is a conservative estimate and the one most widely used in the literature.(<xref rid="R11" ref-type="bibr">11</xref>)</p></sec></sec><sec id="S12"><title>Measurements, metrics, and reviewer decisions</title><p id="P39">Intervention cost can differ for practices of different sizes because the scale of CDSS implementation ranges from small clinics to large health centers. The review team decided that intervention cost should be characterized by the size of practices where the CDSS is implemented. However, this review did not find any studies that fully characterized the association between cost of CDSS implementation and size of practice, whether based on number of physicians or of patients in the practice. Therefore, we used the following categories of practice size (based on number of physicians) reported in the 2012 survey of practices by the American Medical Association (AMA)(<xref rid="R12" ref-type="bibr">12</xref>) to classify practices: Small, 1&#x02013;4 physicians (40% of respondents); Medium, 5&#x02013;24 physicians (35% of respondents); Large, &#x02265;25 physicians (25% of respondents). For studies that reported only the number of patients, we estimated the number of physicians, based on an average patient panel and workload of U.S. primary care physicians.(<xref rid="R13" ref-type="bibr">13</xref>). All other cost and economic benefit estimates from included studies were standardized to a per-patient per-year basis when possible.</p><p id="P40">All monetary values were converted to 2015 U.S. dollars. The Consumer Price Index from the Bureau of Labor Statistics(<xref rid="R14" ref-type="bibr">14</xref>) was used to adjust for inflation. Purchasing Power Parity indices from the World Bank were used to convert from foreign currencies to U.S. dollars.(<xref rid="R15" ref-type="bibr">15</xref>) Results are summarized using medians and interquartile intervals.</p></sec></sec><sec sec-type="results" id="S13"><title>RESULTS</title><p id="P41">Twenty-one studies from the 7,508 papers screened met inclusion criteria (<xref rid="F1" ref-type="fig">Figure 1</xref>). Seventeen studies(<xref rid="R16" ref-type="bibr">16</xref>&#x02013;<xref rid="R28" ref-type="bibr">28</xref>) reported on EHR- or electronic medical record (EMR)-based CDSS, one study(<xref rid="R29" ref-type="bibr">29</xref>) piloted a CDSS residing on a stand-alone desktop, one(<xref rid="R30" ref-type="bibr">30</xref>) was based on a diabetes registry, and two studies(<xref rid="R31" ref-type="bibr">31</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>) covered both EHR-based and registry-based CDSS (two papers(<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>) reported on the same research and are counted as one study for this review). <xref rid="T1" ref-type="table">Table 1</xref> provides an overview of additional characteristics of the included 21 studies. Most of the studies were based in the U.S. (67%) and implemented in clinics (94%), based on trials with a control group (63%) or models based on trials (25%). The studies covered CDSS implemented alone (36%) or in combination with patient reminders/education (18%), or with team-based care (23%), where primary care providers and patients worked together with other providers to improve care and self-management support for patients. Most studies focused on diabetes (47%) as a risk factor, followed by other CVD risks. More than 90% of the studies were published since 2000. Details of the included studies are available online.(<xref rid="R34" ref-type="bibr">34</xref>)</p><sec id="S14"><title>Intervention Cost</title><p id="P42">Twelve studies reported estimates of intervention cost which are presented in <xref rid="T2" ref-type="table">Table 2</xref> for registry- and EHR-based CDSS implementations. The estimates are characterized further by size of the healthcare practice and whether studies included cost of development and implementation, ongoing cost of operations, or both. Nine(<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R23" ref-type="bibr">23</xref>, <xref rid="R25" ref-type="bibr">25</xref>, <xref rid="R27" ref-type="bibr">27</xref>, <xref rid="R30" ref-type="bibr">30</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>) of the 12 studies reported the intervention cost of CDSS implementations specifically (<xref rid="T2" ref-type="table">Table 2</xref>). Of the remaining three studies, two studies that provided the cost of intervention did not include the cost of CDSS, with one(<xref rid="R35" ref-type="bibr">35</xref>) reporting the cost of adding provider incentives to the CDSS implementation and the second(<xref rid="R36" ref-type="bibr">36</xref>) providing only the labor cost of the staff involved in team-based care. The intervention cost from another study(<xref rid="R29" ref-type="bibr">29</xref>) was computed by the review team from the incremental cost per unit reduction in low density lipoprotein-c (LDL-C) reported in the study, and is therefore assumed to include change in healthcare cost of outpatient visits and medications.</p><p id="P43">All three studies that assessed the cost of CDSS implemented in diabetes registries included both the one-time capital cost and ongoing operations cost. Based on a survey of users and vendors, one(<xref rid="R31" ref-type="bibr">31</xref>) of the studies estimated the annual cost per practice for a registry-based CDSS was about $9,500 for a small, $20,600 for a medium, and $76,000 for a large practice. The corresponding estimates for cost per patient per year were $69, $23, and $14, respectively. A U.S. study(<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>) that modeled the cost of scaling up a registry-based CDSS nationwide estimated the annual per patient costs at $55, which corresponds closely with the survey-based estimate for a small practice. On the other hand, another U.S. study(<xref rid="R30" ref-type="bibr">30</xref>) estimated the annual cost of a medium-size CDSS at $106 per patient ($132,400 per practice), based on data collected during a controlled trial.</p><p id="P44">Eight studies reported the intervention cost of EHR-embedded CDSS, of which five(<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R22" ref-type="bibr">22</xref>, <xref rid="R23" ref-type="bibr">23</xref>, <xref rid="R31" ref-type="bibr">31</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>) included both cost of development and implementation and ongoing cost of operation and three(<xref rid="R21" ref-type="bibr">21</xref>, <xref rid="R25" ref-type="bibr">25</xref>, <xref rid="R27" ref-type="bibr">27</xref>) included only the one-time cost of development and implementation. Among the five studies that provided reasonably complete assessments of intervention cost, the mean annual costs were: $102 per patient(<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R23" ref-type="bibr">23</xref>, <xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>) and $6,056 per practice(<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R23" ref-type="bibr">23</xref>) for small practices, and $49 per patient and $35,201 per practice(<xref rid="R22" ref-type="bibr">22</xref>, <xref rid="R31" ref-type="bibr">31</xref>) for medium-sized practices.</p></sec><sec id="S15"><title>Change in Healthcare Cost</title><p id="P45">Change in healthcare cost attributable to the intervention was reported in 15 studies: 13(<xref rid="R16" ref-type="bibr">16</xref>&#x02013;<xref rid="R25" ref-type="bibr">25</xref>, <xref rid="R28" ref-type="bibr">28</xref>, <xref rid="R37" ref-type="bibr">37</xref>, <xref rid="R38" ref-type="bibr">38</xref>) EHR-based implementations, one(<xref rid="R30" ref-type="bibr">30</xref>) registry-based, and one(<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>) reporting both types (<xref rid="T3" ref-type="table">Table 3</xref>). Interventions in addition to the CDSS were present in several studies; therefore, the effect on healthcare cost and other outcomes cannot be attributed to CDSS alone. This is especially the case where intensive interventions were added, as for four CDSS interventions that included team-based care,(<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R24" ref-type="bibr">24</xref>, <xref rid="R28" ref-type="bibr">28</xref>, <xref rid="R38" ref-type="bibr">38</xref>) followed by those that added less-intensive interventions, such as quality improvement,(<xref rid="R37" ref-type="bibr">37</xref>) provider incentives,(<xref rid="R22" ref-type="bibr">22</xref>) provider audit and feedback,(<xref rid="R21" ref-type="bibr">21</xref>) and patient reminders.(<xref rid="R20" ref-type="bibr">20</xref>, <xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>)</p><p id="P46">Based on eight studies(<xref rid="R16" ref-type="bibr">16</xref>&#x02013;<xref rid="R19" ref-type="bibr">19</xref>, <xref rid="R22" ref-type="bibr">22</xref>, <xref rid="R24" ref-type="bibr">24</xref>, <xref rid="R25" ref-type="bibr">25</xref>, <xref rid="R30" ref-type="bibr">30</xref>) that included at least three of five components of healthcare cost, the median change in healthcare cost per patient per year was &#x02212;$35 (interquartile interval [IQI]: &#x02212;$127 to $75). However, the estimated change in healthcare cost cannot be attributed to CDSS alone for two(<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R24" ref-type="bibr">24</xref>) nterventions that included team-based care. With these studies removed, the remaining 6 studies produced a median change in healthcare cost per patient per year of &#x02212;$35 (IQI: &#x02212;$114 to $93).</p></sec><sec id="S16"><title>Worksite Productivity</title><p id="P47">No studies assessed the economic benefit of worksite productivity improvements for patients whose health improved through use of a CDSS.</p></sec><sec id="S17"><title>Cost-benefit and Cost-effectiveness</title><p id="P48">Economic benefit was compared to intervention cost in two(<xref rid="R21" ref-type="bibr">21</xref>, <xref rid="R23" ref-type="bibr">23</xref>) studies of EHR-based CDSS and one(<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>) study of both EHR- and registry-based CDSS (<xref rid="T4" ref-type="table">Table 4</xref>). The same time horizons were used for benefits and cost in these studies. All three studies included fewer than three components of healthcare cost and did not estimate productivity effects; they were therefore incomplete assessments of economic benefit. One study(<xref rid="R21" ref-type="bibr">21</xref>) that reported a benefit-to-cost ratio of 2.03:1 considered only the averted cost of medication and did not include ongoing operating cost in its estimate for intervention cost. The second study(<xref rid="R23" ref-type="bibr">23</xref>) provided a reasonably complete assessment of intervention cost but only considered the cost of inpatient stays and emergency room (ER) visits, estimating benefit-to-cost at 3.8:1. The third study(<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>) estimated the benefit of averted inpatient stays and outpatient visits to a reasonably complete assessment of intervention cost at 2.3:1 for a registry-based CDSS but 0.55:1 for an EHR-based CDSS. The latter, unfavorable, ratio arose primarily because the only high-quality trial of an EHR-based CDSS for diabetes management at the time showed an increase in systolic blood pressure for the intervention group, which translated to increased CVD risk and CVD events in the economic modeling. In summary, the results from cost-benefit studies are incomplete assessments and indicate mixed conclusions on whether economic benefits exceed the cost of CDSS interventions to prevent CVD.</p><p id="P49">Three studies provided estimates of cost per QALY saved (<xref rid="T4" ref-type="table">Table 4</xref>), where the same time horizons were used for net cost and adjusted life years lived outcomes: two reported the interventions were cost-effective at $49,000(<xref rid="R18" ref-type="bibr">18</xref>) and $16,500(<xref rid="R22" ref-type="bibr">22</xref>) and one reported that it was not cost-effective at $143,000.(<xref rid="R25" ref-type="bibr">25</xref>) Estimates for healthcare cost from all three studies were reasonably complete but one study(<xref rid="R25" ref-type="bibr">25</xref>) did not include annual operating cost in the intervention cost. Further, the two studies with cost per QALY saved &#x0003c;$50,000 included interventions in addition to CDSS, namely team-based care(<xref rid="R18" ref-type="bibr">18</xref>) and provider incentives.(<xref rid="R22" ref-type="bibr">22</xref>) The demonstration of cost-effectiveness from these two studies is for the combination intervention and cannot be attributed to CDSS alone.</p></sec></sec><sec sec-type="discussion" id="S18"><title>DISCUSSION</title><p id="P50">A recent symposium concluded(<xref rid="R39" ref-type="bibr">39</xref>) that methodologies are yet to be developed that can rigorously evaluate the economic value of health information technologies at the population and national level even though economic value is evident from individual observations of their success at the local and organizational level. The symposium noted the difficulty in transitioning from judgements of economic value at the level of specific implementations to a judgement about the aggregate of the implementations: costs and benefits have to be summed over implementations with different organizational contexts, technologies, functions, outcomes, scales, and scope. This systematic economic review of one type of health information technology, namely CDSS, encountered similar difficulties among others in synthesizing the economic evidence from various implementation instances.</p><p id="P51">The cost and economic benefit of CDSS implementations from included studies were poorly reported and many studies did not adhere to sound evaluation or accounting practices. Only a few studies provided a complete accounting of cost to develop, implement, maintain, and operate a CDSS. More complete economic evaluations are necessary to obtain reliable estimates for intervention cost across types and sizes of healthcare settings. Reported economic benefits of a CDSS are often determined or guided by the implementation&#x02019;s disease or risk-factor focus (e.g., hypertension, CVD, diabetes, depression), functionality (e.g., provider prompts, management of orders, disease management), or the implementer&#x02019;s objective (e.g., containing cost with cheaper drugs or averting hospital re-admissions). However, despite the heterogeneity in the research literature for the focus, functionality, and objective of CDSS implementations, certain guidelines for the evaluation of economic costs and benefits can still be described.</p><p id="P52">Starting with cost, important features of CDSS from an evaluation perspective are its useful life that generally spans multiple years, and the substantial one-time cost of development and implementation. In addition to the one-time cost, maintaining and operating the CDSS requires technical and medical staff time. The present review estimated intervention cost as the sum of these two components, based on recommended accounting practices and tax rules. Details and references are provided in <xref rid="SD1" ref-type="supplementary-material">Appendix 1</xref>. Because the cost of a CDSS is generally borne by the practice and may differ by practice size, it is useful to communicate the intervention cost in both per-practice and per-patient terms. Most included evaluation studies did one or the other. An additional advantage of intervention cost measured in per-patient terms is its immediate comparability to healthcare cost and health effects that are generally reported in per-patient terms.</p><p id="P53">Moving to the benefits side of the evaluation, only those benefits that likely resulted from changes in provider clinical decisions and any consequent change in patient behavior and health should be ascribed to the CDSS implementation. The societal perspective is recommended for economic evaluations to account for all healthcare, regardless of who pays for the various components. It is important to know what impact the CDSS has on total healthcare utilization; following the guidelines prompted by the CDSS may increase outpatient visits and/or medications within primary care but may avert very costly inpatient stays and ER visits in tertiary care. This is not to say a partial perspective is without merit. A primary care study evaluating a CDSS to treat hypertension may report the intervention cost per unit reduction in blood pressure ($/mmHg), a useful statistic for clinic managers.</p><p id="P54">Evaluations are more complex when one or more additional interventions occur along with the CDSS. Both the intervention cost and economic benefit (including QALY saved) must be ascribable to the CDSS when statements are made about the cost-benefit or cost-effectiveness of CDSS implementations. It is often feasible to estimate the cost of the CDSS and additional intervention(s) separately, but obtaining separate estimates for benefits from the component intervention(s) is likely to be difficult, whether analytically or by study design. For example, in an intervention where team-based care is implemented along with the CDSS, a cost-benefit analysis that included only the cost of CDSS in intervention cost and the combined effect of both team-based care and the CDSS in the benefits would be incomplete. In the absence of complete data, statements about the economic value of the CDSS would have to include appropriate caveats.</p><p id="P55">Many studies included in this review focused on a single CVD risk factor such as diabetes, high cholesterol, or high blood pressure. Outcomes for lifetime cost per QALY saved or cost-benefit ratios were often modeled based on measured improvements in a single or a few risk factors such as blood pressure, blood glucose, or cholesterol. However, a CDSS for CVD prevention and control would, in practice, be implemented with a multiplicity of functionalities including simple provider and patient reminders for screening and testing, patient risk assessments, and medication and lifestyle counseling recommendations across the range of risk factors and indicators for CVD (and diabetes).</p><p id="P56">The results presented in the current review are consistent with those found in the broader review of evidence for CDSS implementations for all diseases and conditions.(<xref rid="R5" ref-type="bibr">5</xref>, <xref rid="R6" ref-type="bibr">6</xref>) That review found that CDSS/Knowledge Management Systems reduced healthcare cost and produced healthcare cost-savings, but it reached mixed conclusions about cost-effectiveness. Similar to the current review, that review also called for evaluations to standardize the metrics for efficiency and cost.</p></sec><sec sec-type="conclusions" id="S19"><title>CONCLUSION</title><p id="P57">An overall conclusion cannot be reached about the cost-effectiveness or cost-benefit of CDSS for CVD prevention and control. The evidence on cost and benefit is limited by many estimates that do not account for major components, and mixed evidence when the estimates are reasonably complete. Further, the reported cost and benefit in many studies included the effect of interventions in addition to the CDSS.</p><p id="P58">The quality of economic evidence for CDSS can improve with more evaluations that acknowledge its capital good features and account for both development and operating cost over its span of useful life.</p></sec><sec sec-type="supplementary-material" id="S20"><title>Supplementary Material</title><supplementary-material content-type="local-data" id="SD1"><label>Appendix</label><media xlink:href="NIHMS884488-supplement-Appendix.docx" orientation="portrait" xlink:type="simple" id="d36e715" position="anchor"/></supplementary-material></sec></body><back><ack id="S21"><p>This authors acknowledge the Division for Heart Disease and Stroke Prevention, CDC, for support and subject matter expertise, particularly the late David B. Callahan, MD. We thank members of our coordination team in the Community Guide Branch at CDC and from other areas of CDC, and our external partners, Kimberly J. Rask, MD, PhD, Emory University, Atlanta; Daniel T. Lackland, DrPH, Medical University of South Carolina, Charleston; and Lynne T. Braun, PhD, ANP, FAAN, FACAA, Rush College of Nursing, Chicago. The authors acknowledge Randy W. Elder, PhD, Kate W. Harris, BA, and Onnalee Gomez, MS, from the Community Guide Branch at CDC for their assistance throughout the review, and John Tibbs, BA, MBA, Office of Noncommunicable Diseases, Injury and Environmental Health, CDC, for assistance with accounting concepts for capital expenditures. The authors also thank Gillian Sanders, PhD, Duke Evidence-based Practice Center, and Amy Kendrick, RN, MSN, MS-CRM, Duke Clinical Research Institute, Durham, North Carolina for the references of additional economic studies identified but not included in the Agency for Healthcare Research and Quality (AHRQ) review.</p><p>The work of Gibril Njie and Krista Proia was supported with stipends from the Oak Ridge Institute for Science and Education (ORISE).</p><p><bold>FUNDING STATEMENT</bold></p><p>The work of Gibril J. Njie and Krista K. Proia were supported with stipends from the Oak Ridge Institute for Science and Education (ORISE).</p></ack><fn-group><fn fn-type="COI-statement" id="FN3"><p><bold>COMPETING INTERESTS SATEMENT</bold></p><p>The authors have no competing interests to declare.</p></fn><fn id="FN4" fn-type="con"><p><bold>CONTRIBUTORSHIP STATEMENT</bold></p><p>All authors contributed substantially to the conception and design of the work. VJ, ABT, SKC, GJN, KKP, and DPH drafted the manuscript, and all authors contributed to revising it critically for important intellectual content. VJ and SKC contributed to acquisition, analysis, and interpretation of data. All authors have approved the manuscript for publication and agree to be accountable for all aspects of the work.</p></fn></fn-group><ref-list><ref id="R1"><label>1</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mozaffarian</surname><given-names>D</given-names></name><name><surname>Benjamin</surname><given-names>EJ</given-names></name><name><surname>Go</surname><given-names>AS</given-names></name><etal/></person-group><article-title>Executive Summary: Heart Disease and Stroke Statistics&#x02014;2016 Update A Report From the American Heart Association</article-title><source>Circulation</source><year>2016</year><volume>133</volume><issue>4</issue><fpage>447</fpage><lpage>54</lpage><pub-id pub-id-type="pmid">26811276</pub-id></element-citation></ref><ref id="R2"><label>2</label><element-citation publication-type="journal"><collab>Community Preventive Services Task Force</collab><article-title>Clinical Decision Support Systems Recommended to Prevent Cardiovascular Disease</article-title><source>Am J Prev Med</source><year>2015</year><volume>49</volume><issue>5</issue><fpage>796</fpage><lpage>9</lpage><pub-id pub-id-type="pmid">26477806</pub-id></element-citation></ref><ref id="R3"><label>3</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Njie</surname><given-names>GJ</given-names></name><name><surname>Proia</surname><given-names>KK</given-names></name><name><surname>Thota</surname><given-names>AB</given-names></name><etal/></person-group><article-title>Clinical Decision Support Systems and Prevention: A Community Guide Cardiovascular Disease Systematic Review</article-title><source>Am J Prev Med</source><year>2015</year><month>11</month><volume>49</volume><issue>5</issue><fpage>784</fpage><lpage>95</lpage><pub-id pub-id-type="pmid">26477805</pub-id></element-citation></ref><ref id="R4"><label>4</label><element-citation publication-type="web"><collab>Guide to Community Preventive Services</collab><source>Economic Reviews</source><year>2014</year><comment>[cited September 14, 2016]; Available from: <ext-link ext-link-type="uri" xlink:href="https://www.thecommunityguide.org/about/economic-reviews">https://www.thecommunityguide.org/about/economic-reviews</ext-link></comment></element-citation></ref><ref id="R5"><label>5</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bright</surname><given-names>TJ</given-names></name><name><surname>Wong</surname><given-names>A</given-names></name><name><surname>Dhurjati</surname><given-names>R</given-names></name><etal/></person-group><article-title>Effect of clinical decision-support systems: a systematic review</article-title><source>Ann Intern Med</source><year>2012</year><volume>157</volume><issue>1</issue><fpage>29</fpage><lpage>43</lpage><pub-id pub-id-type="pmid">22751758</pub-id></element-citation></ref><ref id="R6"><label>6</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Lobach</surname><given-names>D</given-names></name><name><surname>Sanders</surname><given-names>GD</given-names></name><name><surname>Bright</surname><given-names>TJ</given-names></name><etal/></person-group><article-title>Enabling health care decisionmaking through clinical decision support and knowledge management</article-title><source>Evidence Report No. 203</source><comment>AHRQ Publication No. 12-E001-EF</comment><publisher-loc>Rockville, MD</publisher-loc><publisher-name>Agency for Healthcare Research and Quality</publisher-name><year>2012</year></element-citation></ref><ref id="R7"><label>7</label><element-citation publication-type="web"><collab>Guide to Community Preventive Services</collab><source>Cardiovascular Disease Prevention and Control: Clinical Decision-Support Systems (CDSS): Search Strategy</source><year>2013</year><comment>[cited September 14, 2016]; Available from: <ext-link ext-link-type="uri" xlink:href="https://www.thecommunityguide.org/findings/cardiovascular-disease-clinical-decision-support-systems-cdss">https://www.thecommunityguide.org/findings/cardiovascular-disease-clinical-decision-support-systems-cdss</ext-link></comment></element-citation></ref><ref id="R8"><label>8</label><element-citation publication-type="web"><collab>Guide to Community Preventive Services</collab><source>Cardiovascular Disease Prevention and Control: Clinical Decision-Support Systems (CDSS): Search Strategy &#x02013; Economic Review</source><year>2014</year><comment>[cited September 14, 2016]; Available from: <ext-link ext-link-type="uri" xlink:href="https://www.thecommunityguide.org/findings/cardiovascular-disease-clinical-decision-support-systems-cdss">https://www.thecommunityguide.org/findings/cardiovascular-disease-clinical-decision-support-systems-cdss</ext-link></comment></element-citation></ref><ref id="R9"><label>9</label><element-citation publication-type="web"><collab>World Bank Country and Lending Groups</collab><year>2010</year><comment>[cited; Available from: <ext-link ext-link-type="uri" xlink:href="http://data.worldbank.org/about/country-and-lending-groups">http://data.worldbank.org/about/country-and-lending-groups</ext-link></comment></element-citation></ref><ref id="R10"><label>10</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eichler</surname><given-names>H-G</given-names></name><name><surname>Kong</surname><given-names>SX</given-names></name><name><surname>Gerth</surname><given-names>WC</given-names></name><name><surname>Mavros</surname><given-names>P</given-names></name><name><surname>J&#x000f6;nsson</surname><given-names>B</given-names></name></person-group><article-title>Use of cost-effectiveness analysis in health-care resource allocation decision-making: how are cost-effectiveness thresholds expected to emerge?</article-title><source>Value Health</source><year>2004</year><volume>7</volume><issue>5</issue><fpage>518</fpage><lpage>28</lpage><pub-id pub-id-type="pmid">15367247</pub-id></element-citation></ref><ref id="R11"><label>11</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grosse</surname><given-names>SD</given-names></name></person-group><article-title>Assessing cost-effectiveness in healthcare: history of the $50,000 per QALY threshold</article-title><source>Expert Rev Pharmacoecon Outcomes Res</source><year>2008</year><volume>8</volume><issue>2</issue><fpage>165</fpage><lpage>78</lpage><pub-id pub-id-type="pmid">20528406</pub-id></element-citation></ref><ref id="R12"><label>12</label><element-citation publication-type="web"><person-group person-group-type="author"><name><surname>Kane</surname><given-names>CK</given-names></name><name><surname>Emmons</surname><given-names>DW</given-names></name></person-group><source>New data on physician practice arrangements: private practice remains strong despite shifts toward hospital employment</source><year>2013</year><comment>[cited May 12, 2015]; Available from: <ext-link ext-link-type="uri" xlink:href="http://www.nmms.org/sites/default/files/images/2013_9_23_ama_survey_prp-physician-practice-arrangements.pdf">http://www.nmms.org/sites/default/files/images/2013_9_23_ama_survey_prp-physician-practice-arrangements.pdf</ext-link></comment></element-citation></ref><ref id="R13"><label>13</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>&#x000d8;stbye</surname><given-names>T</given-names></name><name><surname>Yarnall</surname><given-names>KS</given-names></name><name><surname>Krause</surname><given-names>KM</given-names></name><name><surname>Pollak</surname><given-names>KI</given-names></name><name><surname>Gradison</surname><given-names>M</given-names></name><name><surname>Michener</surname><given-names>JL</given-names></name></person-group><article-title>Is there time for management of patients with chronic diseases in primary care?</article-title><source>Ann Fam Med</source><year>2005</year><volume>3</volume><issue>3</issue><fpage>209</fpage><lpage>14</lpage><pub-id pub-id-type="pmid">15928223</pub-id></element-citation></ref><ref id="R14"><label>14</label><element-citation publication-type="web"><collab>U.S. Department of Labor, Bureau of Labor Statistics</collab><source>Consumer Price Index</source><comment>[cited September 14, 2016]; Available from: <ext-link ext-link-type="uri" xlink:href="http://www.bls.gov/cpi/cpid1512.pdf">http://www.bls.gov/cpi/cpid1512.pdf</ext-link></comment></element-citation></ref><ref id="R15"><label>15</label><element-citation publication-type="web"><collab>World Bank</collab><source>Purchasing power parities</source><comment>[cited Sept. 6, 2016]; Available from: <ext-link ext-link-type="uri" xlink:href="http://data.worldbank.org/indicator/PA.NUS.PRVT.PP">http://data.worldbank.org/indicator/PA.NUS.PRVT.PP</ext-link></comment></element-citation></ref><ref id="R16"><label>16</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Apkon</surname><given-names>M</given-names></name><name><surname>Mattera</surname><given-names>JA</given-names></name><name><surname>Lin</surname><given-names>Z</given-names></name><etal/></person-group><article-title>A randomized outpatient trial of a decision-support information technology tool</article-title><source>Arch Intern Med</source><year>2005</year><month>11</month><day>14</day><volume>165</volume><issue>20</issue><fpage>2388</fpage><lpage>94</lpage><pub-id pub-id-type="pmid">16287768</pub-id></element-citation></ref><ref id="R17"><label>17</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bassa</surname><given-names>A</given-names></name><name><surname>Del Val</surname><given-names>M</given-names></name><name><surname>Cobos</surname><given-names>A</given-names></name><etal/></person-group><article-title>Impact of a clinical decision support system on the management of patients with hypercholesterolemia in the primary healthcare setting</article-title><source>Dis Manage Health Outcomes</source><year>2005</year><volume>13</volume><issue>1</issue><fpage>65</fpage><lpage>72</lpage></element-citation></ref><ref id="R18"><label>18</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cleveringa</surname><given-names>FG</given-names></name><name><surname>Welsing</surname><given-names>PM</given-names></name><name><surname>van den Donk</surname><given-names>M</given-names></name><etal/></person-group><article-title>Cost-effectiveness of the diabetes care protocol, a multifaceted computerized decision support diabetes management intervention that reduces cardiovascular risk</article-title><source>Diabetes Care</source><year>2010</year><month>2</month><volume>33</volume><issue>2</issue><fpage>258</fpage><lpage>63</lpage><pub-id pub-id-type="pmid">19933991</pub-id></element-citation></ref><ref id="R19"><label>19</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cobos</surname><given-names>A</given-names></name><name><surname>Vilaseca</surname><given-names>J</given-names></name><name><surname>Asenjo</surname><given-names>C</given-names></name><etal/></person-group><article-title>Cost effectiveness of a clinical decision support system based on the recommendations of the European Society of Cardiology and other societies for the management of hypercholesterolemia: Report of a cluster-randomized trial</article-title><source>Dis Manage Health Outcomes</source><year>2005</year><volume>13</volume><issue>6</issue><fpage>421</fpage><lpage>32</lpage></element-citation></ref><ref id="R20"><label>20</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frame</surname><given-names>PS</given-names></name><name><surname>Zimmer</surname><given-names>JG</given-names></name><name><surname>Werth</surname><given-names>PL</given-names></name><name><surname>Hall</surname><given-names>WJ</given-names></name><name><surname>Eberly</surname><given-names>SW</given-names></name></person-group><article-title>Computer-based vs manual health maintenance tracking. A controlled trial</article-title><source>Arch Fam Med</source><year>1994</year><month>7</month><volume>3</volume><issue>7</issue><fpage>581</fpage><lpage>8</lpage><pub-id pub-id-type="pmid">7921293</pub-id></element-citation></ref><ref id="R21"><label>21</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fretheim</surname><given-names>A</given-names></name><name><surname>Aaserud</surname><given-names>M</given-names></name><name><surname>Oxman</surname><given-names>AD</given-names></name></person-group><article-title>Rational prescribing in primary care (RaPP): economic evaluation of an intervention to improve professional practice</article-title><source>PLoS Med</source><year>2006</year><month>6</month><volume>3</volume><issue>6</issue><fpage>e216</fpage><pub-id pub-id-type="pmid">16737349</pub-id></element-citation></ref><ref id="R22"><label>22</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gilmer</surname><given-names>TP</given-names></name><name><surname>O&#x02019;Connor</surname><given-names>PJ</given-names></name><name><surname>Sperl-Hillen</surname><given-names>JM</given-names></name><etal/></person-group><article-title>Cost-effectiveness of an electronic medical record based clinical decision support system</article-title><source>Health Serv Res</source><year>2012</year><month>12</month><volume>47</volume><issue>6</issue><fpage>2137</fpage><lpage>58</lpage><pub-id pub-id-type="pmid">22578085</pub-id></element-citation></ref><ref id="R23"><label>23</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Khan</surname><given-names>S</given-names></name><name><surname>Maclean</surname><given-names>CD</given-names></name><name><surname>Littenberg</surname><given-names>B</given-names></name></person-group><article-title>The effect of the Vermont Diabetes Information System on inpatient and emergency room use: results from a randomized trial</article-title><source>Health Outcomes Res Med</source><year>2010</year><month>7</month><volume>1</volume><issue>1</issue><fpage>e61</fpage><lpage>e6</lpage><pub-id pub-id-type="pmid">20975923</pub-id></element-citation></ref><ref id="R24"><label>24</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Murray</surname><given-names>MD</given-names></name><name><surname>Harris</surname><given-names>LE</given-names></name><name><surname>Overhage</surname><given-names>JM</given-names></name><etal/></person-group><article-title>Failure of computerized treatment suggestions to improve health outcomes of outpatients with uncomplicated hypertension: results of a randomized controlled trial</article-title><source>Pharmacotherapy</source><year>2004</year><month>3</month><volume>24</volume><issue>3</issue><fpage>324</fpage><lpage>37</lpage><pub-id pub-id-type="pmid">15040645</pub-id></element-citation></ref><ref id="R25"><label>25</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>O&#x02019;Reilly</surname><given-names>D</given-names></name><name><surname>Holbrook</surname><given-names>A</given-names></name><name><surname>Blackhouse</surname><given-names>G</given-names></name><name><surname>Troyan</surname><given-names>S</given-names></name><name><surname>Goeree</surname><given-names>R</given-names></name></person-group><article-title>Cost-effectiveness of a shared computerized decision support system for diabetes linked to electronic medical records</article-title><source>J Am Med Inform Assoc</source><year>2012</year><season>May-Jun</season><volume>19</volume><issue>3</issue><fpage>341</fpage><lpage>5</lpage><pub-id pub-id-type="pmid">22052900</pub-id></element-citation></ref><ref id="R26"><label>26</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Overhage</surname><given-names>JM</given-names></name><name><surname>Tierney</surname><given-names>WM</given-names></name><name><surname>Zhou</surname><given-names>XH</given-names></name><name><surname>McDonald</surname><given-names>CJ</given-names></name></person-group><article-title>A randomized trial of &#x0201c;corollary orders&#x0201d; to prevent errors of omission</article-title><source>J Am Med Inform Assoc</source><year>1997</year><season>Sep-Oct</season><volume>4</volume><issue>5</issue><fpage>364</fpage><lpage>75</lpage><pub-id pub-id-type="pmid">9292842</pub-id></element-citation></ref><ref id="R27"><label>27</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shih</surname><given-names>SC</given-names></name><name><surname>McCullough</surname><given-names>CM</given-names></name><name><surname>Wang</surname><given-names>JJ</given-names></name><name><surname>Singer</surname><given-names>J</given-names></name><name><surname>Parsons</surname><given-names>AS</given-names></name></person-group><article-title>Health information systems in small practices. Improving the delivery of clinical preventive services</article-title><source>Am J Prev Med</source><year>2011</year><volume>41</volume><issue>6</issue><fpage>603</fpage><lpage>9</lpage><pub-id pub-id-type="pmid">22099237</pub-id></element-citation></ref><ref id="R28"><label>28</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname><given-names>SA</given-names></name><name><surname>Shah</surname><given-names>ND</given-names></name><name><surname>Bryant</surname><given-names>SC</given-names></name><etal/></person-group><article-title>Chronic care model and shared care in diabetes: randomized trial of an electronic decision support system</article-title><source>Mayo Clin Proc</source><year>2008</year><month>7</month><volume>83</volume><issue>7</issue><fpage>747</fpage><lpage>57</lpage><pub-id pub-id-type="pmid">18613991</pub-id></element-citation></ref><ref id="R29"><label>29</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zamora</surname><given-names>A</given-names></name><name><surname>de Bobadilla</surname><given-names>FF</given-names></name><name><surname>Carrion</surname><given-names>C</given-names></name><etal/></person-group><article-title>Pilot study to validate a computer-based clinical decision support system for dyslipidemia treatment (HTE-DLP)</article-title><source>Atherosclerosis</source><year>2013</year><volume>231</volume><issue>2</issue><fpage>401</fpage><lpage>4</lpage><pub-id pub-id-type="pmid">24267258</pub-id></element-citation></ref><ref id="R30"><label>30</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Blanchfield</surname><given-names>BB</given-names></name><name><surname>Grant</surname><given-names>RW</given-names></name><name><surname>Estey</surname><given-names>GA</given-names></name><name><surname>Chueh</surname><given-names>HC</given-names></name><name><surname>Gazelle</surname><given-names>GS</given-names></name><name><surname>Meigs</surname><given-names>JB</given-names></name></person-group><article-title>Cost of an informatics-based diabetes management program</article-title><source>Int J Technol Assess Health Care</source><year>2006</year><volume>22</volume><issue>02</issue><fpage>249</fpage><lpage>54</lpage><pub-id pub-id-type="pmid">16571201</pub-id></element-citation></ref><ref id="R31"><label>31</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Adler-Milstein</surname><given-names>J</given-names></name><name><surname>Bu</surname><given-names>D</given-names></name><name><surname>Pan</surname><given-names>E</given-names></name><etal/></person-group><article-title>The cost of information technology-enabled diabetes management</article-title><source>Dis Manag</source><year>2007</year><volume>10</volume><issue>3</issue><fpage>115</fpage><lpage>28</lpage><pub-id pub-id-type="pmid">17590142</pub-id></element-citation></ref><ref id="R32"><label>32</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Bu</surname><given-names>D</given-names></name><name><surname>Pan</surname><given-names>E</given-names></name><name><surname>Johnston</surname><given-names>D</given-names></name><etal/></person-group><source>The value of information technology-enabled diabetes management</source><publisher-name>Center for Information Technology Leadership, Healthcare Information and Management System Society</publisher-name><publisher-loc>Charleston, MA</publisher-loc><comment>(<ext-link ext-link-type="uri" xlink:href="http://www.partners.org/cird/pdfs/CITL_ITDM_Report.pdf">http://www.partners.org/cird/pdfs/CITL_ITDM_Report.pdf</ext-link>) Role and Potential Influence of Technologies on the Most Relevant Challenges for LTC</comment><year>2007</year><fpage>51</fpage></element-citation></ref><ref id="R33"><label>33</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bu</surname><given-names>D</given-names></name><name><surname>Pan</surname><given-names>E</given-names></name><name><surname>Walker</surname><given-names>J</given-names></name><etal/></person-group><article-title>Benefits of information technology-enabled diabetes management</article-title><source>Diabetes Care</source><year>2007</year><month>5</month><volume>30</volume><issue>5</issue><fpage>1137</fpage><lpage>42</lpage><pub-id pub-id-type="pmid">17322483</pub-id></element-citation></ref><ref id="R34"><label>34</label><element-citation publication-type="web"><collab>Guide to Community Preventive Services</collab><article-title>Cardiovascular Disease Prevention and Control: Clinical Decision-Support Systems (CDSS)</article-title><source>Summary Evidence Table: Economic Review</source><comment>[cited September 14, 2016]; Available from: <ext-link ext-link-type="uri" xlink:href="https://www.thecommunityguide.org/sites/default/files/assets/SET-CDSS-econ-2013.pdf">https://www.thecommunityguide.org/sites/default/files/assets/SET-CDSS-econ-2013.pdf</ext-link></comment></element-citation></ref><ref id="R35"><label>35</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bardach</surname><given-names>NS</given-names></name><name><surname>Wang</surname><given-names>JJ</given-names></name><name><surname>De Leon</surname><given-names>SF</given-names></name><etal/></person-group><article-title>Effect of pay-for-performance incentives on quality of care in small practices with electronic health records: a randomized trial</article-title><source>JAMA</source><year>2013</year><volume>310</volume><issue>10</issue><fpage>1051</fpage><lpage>9</lpage><pub-id pub-id-type="pmid">24026600</pub-id></element-citation></ref><ref id="R36"><label>36</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Munoz</surname><given-names>M</given-names></name><name><surname>Pronovost</surname><given-names>P</given-names></name><name><surname>Dintzis</surname><given-names>J</given-names></name><etal/></person-group><article-title>Implementing and evaluating a multicomponent inpatient diabetes management program: putting research into practice</article-title><source>Joint Commission journal on quality and patient safety/Joint Commission Resources</source><year>2012</year><volume>38</volume><issue>5</issue><fpage>195</fpage></element-citation></ref><ref id="R37"><label>37</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Oxendine</surname><given-names>V</given-names></name><name><surname>Meyer</surname><given-names>A</given-names></name><name><surname>Reid</surname><given-names>PV</given-names></name><name><surname>Adams</surname><given-names>A</given-names></name><name><surname>Sabol</surname><given-names>V</given-names></name></person-group><article-title>Evaluating Diabetes Outcomes and Costs Within an Ambulatory Setting: A Strategic Approach Utilizing a Clinical Decision Support System</article-title><source>Clinical Diabetes</source><year>2014</year><volume>32</volume><issue>3</issue><fpage>113</fpage><lpage>20</lpage><pub-id pub-id-type="pmid">26246682</pub-id></element-citation></ref><ref id="R38"><label>38</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Herring</surname><given-names>R</given-names></name><name><surname>Russell-Jones</surname><given-names>D</given-names></name><name><surname>Pengilley</surname><given-names>C</given-names></name><etal/></person-group><article-title>Management of raised glucose, a clinical decision tool to reduce length of stay of patients with hyperglycaemia</article-title><source>Diabet Med</source><year>2013</year><volume>30</volume><issue>1</issue><fpage>81</fpage><lpage>7</lpage><pub-id pub-id-type="pmid">22950637</pub-id></element-citation></ref><ref id="R39"><label>39</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Payne</surname><given-names>TH</given-names></name><name><surname>Bates</surname><given-names>DW</given-names></name><name><surname>Berner</surname><given-names>ES</given-names></name><etal/></person-group><article-title>Healthcare information technology and economics</article-title><source>J Am Med Inform Assoc</source><year>2013</year><volume>20</volume><issue>2</issue><fpage>212</fpage><lpage>7</lpage><pub-id pub-id-type="pmid">22781191</pub-id></element-citation></ref></ref-list></back><floats-group><fig id="F1" orientation="portrait" position="float"><label>Figure 1</label><caption><p>Search Process</p></caption><graphic xlink:href="nihms884488f1"/></fig><table-wrap id="T1" position="float" orientation="portrait"><label>Table 1</label><caption><p>Characteristics of Included Studies and Proportion of Studies with Each Characteristic</p></caption><table frame="above" rules="groups"><thead><tr><th valign="middle" align="left" rowspan="1" colspan="1">Characteristic</th><th valign="middle" align="left" rowspan="1" colspan="1"/><th valign="middle" align="left" rowspan="1" colspan="1">No. of studies<break/>(% of all reviewed studies)</th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="2" colspan="1"><bold>Country</bold></td><td align="left" valign="top" rowspan="1" colspan="1">U.S.</td><td align="left" valign="top" rowspan="1" colspan="1">14 (<xref rid="R16" ref-type="bibr">16</xref>, <xref rid="R20" ref-type="bibr">20</xref>, <xref rid="R22" ref-type="bibr">22</xref>&#x02013;<xref rid="R24" ref-type="bibr">24</xref>, <xref rid="R26" ref-type="bibr">26</xref>&#x02013;<xref rid="R28" ref-type="bibr">28</xref>, <xref rid="R30" ref-type="bibr">30</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>, <xref rid="R35" ref-type="bibr">35</xref>&#x02013;<xref rid="R37" ref-type="bibr">37</xref>)<break/>(67%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Non-U.S.</td><td align="left" valign="top" rowspan="1" colspan="1">7 (<xref rid="R17" ref-type="bibr">17</xref>&#x02013;<xref rid="R19" ref-type="bibr">19</xref>, <xref rid="R21" ref-type="bibr">21</xref>, <xref rid="R25" ref-type="bibr">25</xref>, <xref rid="R29" ref-type="bibr">29</xref>, <xref rid="R38" ref-type="bibr">38</xref>)<break/>(33%)</td></tr><tr><td align="left" valign="top" rowspan="2" colspan="1"><bold>Setting</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Clinic</td><td align="left" valign="top" rowspan="1" colspan="1">18 (<xref rid="R16" ref-type="bibr">16</xref>&#x02013;<xref rid="R25" ref-type="bibr">25</xref>, <xref rid="R27" ref-type="bibr">27</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>, <xref rid="R35" ref-type="bibr">35</xref>, <xref rid="R37" ref-type="bibr">37</xref>)<break/>(86%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Hospital</td><td align="left" valign="top" rowspan="1" colspan="1">3 (<xref rid="R26" ref-type="bibr">26</xref>, <xref rid="R36" ref-type="bibr">36</xref>, <xref rid="R38" ref-type="bibr">38</xref>)<break/>(14%)</td></tr><tr><td align="left" valign="top" rowspan="4" colspan="1"><bold>Study Type</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Trial</td><td align="left" valign="top" rowspan="1" colspan="1">15 (<xref rid="R16" ref-type="bibr">16</xref>, <xref rid="R17" ref-type="bibr">17</xref>, <xref rid="R19" ref-type="bibr">19</xref>, <xref rid="R20" ref-type="bibr">20</xref>, <xref rid="R23" ref-type="bibr">23</xref>, <xref rid="R24" ref-type="bibr">24</xref>, <xref rid="R26" ref-type="bibr">26</xref>&#x02013;<xref rid="R30" ref-type="bibr">30</xref>, <xref rid="R35" ref-type="bibr">35</xref>&#x02013;<xref rid="R38" ref-type="bibr">38</xref>)<break/>(71%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Model</td><td align="left" valign="top" rowspan="1" colspan="1">1 (<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>)<break/>(5%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Trial + Model</td><td align="left" valign="top" rowspan="1" colspan="1">4 (<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R21" ref-type="bibr">21</xref>, <xref rid="R22" ref-type="bibr">22</xref>, <xref rid="R25" ref-type="bibr">25</xref>)<break/>(19%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Survey</td><td align="left" valign="top" rowspan="1" colspan="1">1 (<xref rid="R31" ref-type="bibr">31</xref>)<break/>(5%)</td></tr><tr><td align="left" valign="top" rowspan="5" colspan="1"><bold>CDSS Risk Factor Focus</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Diabetes</td><td align="left" valign="top" rowspan="1" colspan="1">10 (<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R22" ref-type="bibr">22</xref>, <xref rid="R25" ref-type="bibr">25</xref>, <xref rid="R28" ref-type="bibr">28</xref>, <xref rid="R30" ref-type="bibr">30</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>, <xref rid="R36" ref-type="bibr">36</xref>&#x02013;<xref rid="R38" ref-type="bibr">38</xref>)<break/>(47%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Hypertension</td><td align="left" valign="top" rowspan="1" colspan="1">1 (<xref rid="R24" ref-type="bibr">24</xref>)<break/>(5%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Hyperlipidemia</td><td align="left" valign="top" rowspan="1" colspan="1">2 (<xref rid="R17" ref-type="bibr">17</xref>, <xref rid="R19" ref-type="bibr">19</xref>)<break/>(10%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Hypertension and Hyperlipidemia</td><td align="left" valign="top" rowspan="1" colspan="1">1 (<xref rid="R21" ref-type="bibr">21</xref>)<break/>(5%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Including multiple CVD risk factors</td><td align="left" valign="top" rowspan="1" colspan="1">7 (<xref rid="R16" ref-type="bibr">16</xref>, <xref rid="R20" ref-type="bibr">20</xref>, <xref rid="R23" ref-type="bibr">23</xref>, <xref rid="R26" ref-type="bibr">26</xref>, <xref rid="R27" ref-type="bibr">27</xref>, <xref rid="R29" ref-type="bibr">29</xref>, <xref rid="R35" ref-type="bibr">35</xref>)<break/>(33%)</td></tr><tr><td align="left" valign="top" rowspan="3" colspan="1"><bold>Control group</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Pre and post with no control group</td><td align="left" valign="top" rowspan="1" colspan="1">5 (<xref rid="R17" ref-type="bibr">17</xref>, <xref rid="R27" ref-type="bibr">27</xref>, <xref rid="R36" ref-type="bibr">36</xref>&#x02013;<xref rid="R38" ref-type="bibr">38</xref>)<break/>(24%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">With control group</td><td align="left" valign="top" rowspan="1" colspan="1">14 (<xref rid="R16" ref-type="bibr">16</xref>, <xref rid="R18" ref-type="bibr">18</xref>&#x02013;<xref rid="R26" ref-type="bibr">26</xref>, <xref rid="R28" ref-type="bibr">28</xref>&#x02013;<xref rid="R30" ref-type="bibr">30</xref>, <xref rid="R35" ref-type="bibr">35</xref>)<break/>(67%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Survey, Model with no control group</td><td align="left" valign="top" rowspan="1" colspan="1">2 (<xref rid="R31" ref-type="bibr">31</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>)<break/>(10%)</td></tr><tr><td align="left" valign="top" rowspan="6" colspan="1"><bold>Intervention added to CDSS</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Team-based care</td><td align="left" valign="top" rowspan="1" colspan="1">5 (<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R24" ref-type="bibr">24</xref>, <xref rid="R28" ref-type="bibr">28</xref>, <xref rid="R36" ref-type="bibr">36</xref>, <xref rid="R38" ref-type="bibr">38</xref>)<break/>(23%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Provider incentives</td><td align="left" valign="top" rowspan="1" colspan="1">2 (<xref rid="R22" ref-type="bibr">22</xref>, <xref rid="R35" ref-type="bibr">35</xref>)<break/>(9%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Provider audit and feedback</td><td align="left" valign="top" rowspan="1" colspan="1">1 (<xref rid="R21" ref-type="bibr">21</xref>)<break/>(5%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Patient phone reminders or report to patient</td><td align="left" valign="top" rowspan="1" colspan="1">4 (<xref rid="R20" ref-type="bibr">20</xref>, <xref rid="R23" ref-type="bibr">23</xref>, <xref rid="R31" ref-type="bibr">31</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>)<break/>(18%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Quality improvement</td><td align="left" valign="top" rowspan="1" colspan="1">2 (<xref rid="R35" ref-type="bibr">35</xref>, <xref rid="R37" ref-type="bibr">37</xref>)<break/>(9%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">None</td><td align="left" valign="top" rowspan="1" colspan="1">8 (<xref rid="R16" ref-type="bibr">16</xref>, <xref rid="R17" ref-type="bibr">17</xref>, <xref rid="R19" ref-type="bibr">19</xref>, <xref rid="R25" ref-type="bibr">25</xref>&#x02013;<xref rid="R27" ref-type="bibr">27</xref>, <xref rid="R29" ref-type="bibr">29</xref>, <xref rid="R30" ref-type="bibr">30</xref>)<break/>(36%)</td></tr><tr><td align="left" valign="top" rowspan="3" colspan="1"><bold>Publication period</bold></td><td align="left" valign="top" rowspan="1" colspan="1">1990s</td><td align="left" valign="top" rowspan="1" colspan="1">2 (<xref rid="R20" ref-type="bibr">20</xref>, <xref rid="R26" ref-type="bibr">26</xref>)<break/>(9%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2000s</td><td align="left" valign="top" rowspan="1" colspan="1">9 (<xref rid="R16" ref-type="bibr">16</xref>, <xref rid="R17" ref-type="bibr">17</xref>, <xref rid="R19" ref-type="bibr">19</xref>, <xref rid="R21" ref-type="bibr">21</xref>, <xref rid="R24" ref-type="bibr">24</xref>, <xref rid="R28" ref-type="bibr">28</xref>, <xref rid="R30" ref-type="bibr">30</xref>&#x02013;<xref rid="R33" ref-type="bibr">33</xref>)<break/>(43%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2010s</td><td align="left" valign="top" rowspan="1" colspan="1">10 (<xref rid="R18" ref-type="bibr">18</xref>, <xref rid="R22" ref-type="bibr">22</xref>, <xref rid="R23" ref-type="bibr">23</xref>, <xref rid="R25" ref-type="bibr">25</xref>, <xref rid="R27" ref-type="bibr">27</xref>, <xref rid="R29" ref-type="bibr">29</xref>, <xref rid="R35" ref-type="bibr">35</xref>&#x02013;<xref rid="R38" ref-type="bibr">38</xref>)<break/>(48%)</td></tr></tbody></table><table-wrap-foot><fn id="TFN1"><p>CDSS, clinical decision support system; CVD, cardiovascular disease</p></fn></table-wrap-foot></table-wrap><table-wrap id="T2" position="float" orientation="landscape"><label>Table 2</label><caption><p>Intervention Cost with Components and Characteristics of CDSS</p></caption><table frame="box" rules="all"><thead><tr><th valign="top" rowspan="2" align="left" colspan="1">Study</th><th valign="top" rowspan="2" align="left" colspan="1">Size<xref rid="TFN3" ref-type="table-fn">a</xref></th><th valign="top" rowspan="2" align="left" colspan="1">Development and Implementation Cost Included</th><th valign="top" rowspan="2" align="left" colspan="1">Ongoing Cost Included</th><th valign="top" rowspan="2" align="left" colspan="1">Reasonably Complete Estimates</th><th colspan="2" valign="top" align="left" rowspan="1">Annual Cost<xref rid="TFN4" ref-type="table-fn">b</xref> (5-year life)</th></tr><tr><th valign="top" align="left" rowspan="1" colspan="1">Per Patient</th><th valign="top" align="left" rowspan="1" colspan="1">Per Practice</th></tr></thead><tbody><tr><td colspan="7" align="left" valign="top" rowspan="1">Registry-based</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Adler-Milstein 07 (<xref rid="R31" ref-type="bibr">31</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">$69</td><td align="left" valign="top" rowspan="1" colspan="1">$9,511</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Adler-Milstein 07 (<xref rid="R31" ref-type="bibr">31</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Medium</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">$23</td><td align="left" valign="top" rowspan="1" colspan="1">$20,649</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Adler-Milstein 07 (<xref rid="R31" ref-type="bibr">31</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Large</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">$14</td><td align="left" valign="top" rowspan="1" colspan="1">$75,964</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Blanchfield 06 (<xref rid="R30" ref-type="bibr">30</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Medium</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">$106</td><td align="left" valign="top" rowspan="1" colspan="1">$132,438</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Bu 07a,b (<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">$55</td><td align="left" valign="top" rowspan="1" colspan="1">NR</td></tr><tr><td colspan="7" align="left" valign="top" rowspan="1">EHR-based</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Adler-Milstein 07 (<xref rid="R31" ref-type="bibr">31</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Medium<xref rid="TFN5" ref-type="table-fn">c</xref></td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">$56</td><td align="left" valign="top" rowspan="1" colspan="1">$49,808</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Bardach 13 (<xref rid="R35" ref-type="bibr">35</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">$9</td><td align="left" valign="top" rowspan="1" colspan="1">$18,650<xref rid="TFN6" ref-type="table-fn">d</xref></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Bu 07a,b (<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">$170</td><td align="left" valign="top" rowspan="1" colspan="1">NR</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Cleveringa 10 (<xref rid="R18" ref-type="bibr">18</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">$73</td><td align="left" valign="top" rowspan="1" colspan="1">$4,794</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Fretheim 06 (<xref rid="R21" ref-type="bibr">21</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">NR</td><td align="left" valign="top" rowspan="1" colspan="1">$346</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Gilmer 12 (<xref rid="R22" ref-type="bibr">22</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Medium</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">$43</td><td align="left" valign="top" rowspan="1" colspan="1">$20,595</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Khan 10 (<xref rid="R23" ref-type="bibr">23</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">Subscription fee</td><td align="left" valign="top" rowspan="1" colspan="1">Subscription fee</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">$63</td><td align="left" valign="top" rowspan="1" colspan="1">$7,318</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Munoz 12 (<xref rid="R36" ref-type="bibr">36</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Large</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">$61</td><td align="left" valign="top" rowspan="1" colspan="1">$386,750<xref rid="TFN7" ref-type="table-fn">e</xref></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">O&#x02019;Reilly 12 (<xref rid="R25" ref-type="bibr">25</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">$27</td><td align="left" valign="top" rowspan="1" colspan="1">$3,739</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Shih 11 (<xref rid="R27" ref-type="bibr">27</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">$4</td><td align="left" valign="top" rowspan="1" colspan="1">$7,053</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Zamora 13 (<xref rid="R29" ref-type="bibr">29</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Small</td><td align="left" valign="top" rowspan="1" colspan="1">NR</td><td align="left" valign="top" rowspan="1" colspan="1">NR</td><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">$225<xref rid="TFN8" ref-type="table-fn">f</xref></td><td align="left" valign="top" rowspan="1" colspan="1">NR</td></tr></tbody></table><table-wrap-foot><fn id="TFN2"><p>CDSS, clinical decision support system; EHR, electronic health record; Y, Yes; N, No; NR, not reported</p></fn><fn id="TFN3"><label>a</label><p>Size of practice based on number of providers: Small, 1&#x02013;4 physicians; Medium, 5&#x02013;24 physicians; Large, &#x02265;25 physicians.</p></fn><fn id="TFN4"><label>b</label><p>Capital cost amortized over 5 years at 3% discount rate.</p></fn><fn id="TFN5"><label>c</label><p>Study assumes the implementation is perfectly scalable.</p></fn><fn id="TFN6"><label>d</label><p>Cost of provider incentives only</p></fn><fn id="TFN7"><label>e</label><p>Annual budget reported to include cost of team-based care staff</p></fn><fn id="TFN8"><label>f</label><p>Based on reported incremental cost per mg/dL reduction in low density lipoprotein-c (LDL-C)</p></fn></table-wrap-foot></table-wrap><table-wrap id="T3" position="float" orientation="landscape"><label>Table 3</label><caption><p>Healthcare Cost: Components and Estimates</p></caption><table frame="box" rules="all"><thead><tr><th valign="top" rowspan="2" align="left" colspan="1">Study Type of CDSS</th><th valign="top" rowspan="2" align="left" colspan="1">Additional Intervention</th><th valign="top" rowspan="2" align="left" colspan="1">Time Horizon</th><th colspan="5" valign="top" align="left" rowspan="1">Components</th><th valign="top" rowspan="2" align="left" colspan="1">Reasonably Complete Estimate</th><th valign="top" rowspan="2" align="left" colspan="1">Change in Healthcare Cost Per Patient Per Year<xref rid="TFN10" ref-type="table-fn">a</xref></th></tr><tr><th valign="top" align="left" rowspan="1" colspan="1">Outpatient</th><th valign="top" align="left" rowspan="1" colspan="1">Inpatient</th><th valign="top" align="left" rowspan="1" colspan="1">ER</th><th valign="top" align="left" rowspan="1" colspan="1">Drugs</th><th valign="top" align="left" rowspan="1" colspan="1">Labs</th></tr></thead><tbody><tr><td colspan="10" align="left" valign="top" rowspan="1">Registry-based</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Blanchfield 06 (<xref rid="R30" ref-type="bibr">30</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">None</td><td align="left" valign="top" rowspan="1" colspan="1">1 Year</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">+$6</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Bu 07ab (<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Patient reminders</td><td align="left" valign="top" rowspan="1" colspan="1">10 Years</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$127</td></tr><tr><td colspan="10" align="left" valign="top" rowspan="1">EHR-based</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Apkon 05 (<xref rid="R16" ref-type="bibr">16</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">None</td><td align="left" valign="top" rowspan="1" colspan="1">2 Months</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">+$355</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Bassa 05 (<xref rid="R17" ref-type="bibr">17</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">None</td><td align="left" valign="top" rowspan="1" colspan="1">1 Year</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$133</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Bu 07ab (<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">None</td><td align="left" valign="top" rowspan="1" colspan="1">10 Years</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$94</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Cleveringa 10 (<xref rid="R18" ref-type="bibr">18</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">TBC</td><td align="left" valign="top" rowspan="1" colspan="1">10 Years</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">All Patients: +$148; Patients with CVD: +$98</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Cobos 05 (<xref rid="R19" ref-type="bibr">19</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">None</td><td align="left" valign="top" rowspan="1" colspan="1">1 Year</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$107</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Frame 94 (<xref rid="R20" ref-type="bibr">20</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Patient reminders</td><td align="left" valign="top" rowspan="1" colspan="1">2 Years</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">$0</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Fretheim 06b (<xref rid="R21" ref-type="bibr">21</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Provider audit and feedback</td><td align="left" valign="top" rowspan="1" colspan="1">1 Year</td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$10</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Gilmer 12 (<xref rid="R22" ref-type="bibr">22</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Provider incentives</td><td align="left" valign="top" rowspan="1" colspan="1">40 Years</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$46</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Herring 13 (<xref rid="R38" ref-type="bibr">38</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">TBC</td><td align="left" valign="top" rowspan="1" colspan="1">9 months</td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$539</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Khan 10 (<xref rid="R23" ref-type="bibr">23</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">None</td><td align="left" valign="top" rowspan="1" colspan="1">32 months</td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$236</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Murray 04 (<xref rid="R24" ref-type="bibr">24</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">TBC</td><td align="left" valign="top" rowspan="1" colspan="1">1 Year</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$2986</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">O&#x02019;Reilly 12 (<xref rid="R25" ref-type="bibr">25</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">None</td><td align="left" valign="top" rowspan="1" colspan="1">40 Years</td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">Y</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;$23</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Oxendine 14 (<xref rid="R37" ref-type="bibr">37</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">Quality improvement</td><td align="left" valign="top" rowspan="1" colspan="1">1 Year</td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">+$6532 during intervention<break/>&#x02212;$1960 1 year post</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Smith 08 (<xref rid="R28" ref-type="bibr">28</xref>)</td><td align="left" valign="top" rowspan="1" colspan="1">TBC</td><td align="left" valign="top" rowspan="1" colspan="1">1 Year</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x02713;</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">N</td><td align="left" valign="top" rowspan="1" colspan="1">Outpatient was &#x02212;$349. Total with inpatient was &#x02212;$2800 (authors noted that inpatient cost increase was primarily due to elective surgeries for musculoskeletal pain).</td></tr></tbody></table><table-wrap-foot><fn id="TFN9"><p>CDSS, clinical decision support system; ER, emergency room; TBC, team-based care; Y, Yes, N, No</p></fn><fn id="TFN10"><label>a</label><p>Healthcare cost for intervention versus control group or pre to post change where there is no control group.</p></fn></table-wrap-foot></table-wrap><table-wrap id="T4" position="float" orientation="portrait"><label>Table 4</label><caption><p>Cost-Benefit and Cost per QALY Saved Estimates</p></caption><table frame="box" rules="all"><thead><tr><th valign="top" align="left" rowspan="1" colspan="1">Study Type of CDSS</th><th valign="top" align="left" rowspan="1" colspan="1">Benefit-to-Cost Ratio</th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">Fretheim 06b (<xref rid="R21" ref-type="bibr">21</xref>)<break/>EHR -based</td><td align="left" valign="top" rowspan="1" colspan="1">0.42:1 over 12 months<break/>2.0:1 over 24 months</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Khan 10 (<xref rid="R23" ref-type="bibr">23</xref>)<break/>EHR -based</td><td align="left" valign="top" rowspan="1" colspan="1">3.8:1</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Bu 07a,b (<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>)<break/>EHR -based</td><td align="left" valign="top" rowspan="1" colspan="1">0.55:1</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Bu 07a,b (<xref rid="R32" ref-type="bibr">32</xref>, <xref rid="R33" ref-type="bibr">33</xref>)<break/>Registry-based</td><td align="left" valign="top" rowspan="1" colspan="1">2.3:1</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><bold>Cost per QALY saved</bold></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Cleveringa 10 (<xref rid="R18" ref-type="bibr">18</xref>)<break/>EHR-based</td><td align="left" valign="top" rowspan="1" colspan="1">All patients &#x02212; $49,500<break/>Patients with CVD &#x02212; $19,600<break/>Patients without CVD &#x02212; $162,000</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Gilmer 12 (<xref rid="R22" ref-type="bibr">22</xref>)<break/>EHR -based</td><td align="left" valign="top" rowspan="1" colspan="1">$16,500</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">O&#x02019;Reilly 12 (<xref rid="R25" ref-type="bibr">25</xref>)<break/>EHR -based</td><td align="left" valign="top" rowspan="1" colspan="1">$143,000</td></tr></tbody></table><table-wrap-foot><fn id="TFN11"><p>CDSS, clinical decision support system; CVD, cardiovascular disease; EHR, electronic health record; QALY, quality-adjusted life year;</p></fn></table-wrap-foot></table-wrap></floats-group></article>