<!DOCTYPE article
PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD with MathML3 v1.2 20190208//EN" "JATS-archivearticle1-mathml3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article"><?properties manuscript?><front><journal-meta><journal-id journal-id-type="nlm-journal-id">0322116</journal-id><journal-id journal-id-type="pubmed-jr-id">6595</journal-id><journal-id journal-id-type="nlm-ta">Prev Med</journal-id><journal-id journal-id-type="iso-abbrev">Prev Med</journal-id><journal-title-group><journal-title>Preventive medicine</journal-title></journal-title-group><issn pub-type="ppub">0091-7435</issn><issn pub-type="epub">1096-0260</issn></journal-meta><article-meta><article-id pub-id-type="pmid">31152830</article-id><article-id pub-id-type="pmc">6778688</article-id><article-id pub-id-type="doi">10.1016/j.ypmed.2019.05.022</article-id><article-id pub-id-type="manuscript">HHSPA1050420</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>A review of the cost-effectiveness of adult influenza vaccination and other preventive services</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Dabestani</surname><given-names>Nazila M.</given-names></name><xref ref-type="aff" rid="A1">a</xref><xref rid="CR1" ref-type="corresp">*</xref></contrib><contrib contrib-type="author"><name><surname>Leidner</surname><given-names>Andrew J.</given-names></name><xref ref-type="aff" rid="A2">b</xref></contrib><contrib contrib-type="author"><name><surname>Seiber</surname><given-names>Eric E.</given-names></name><xref ref-type="aff" rid="A1">a</xref></contrib><contrib contrib-type="author"><name><surname>Kim</surname><given-names>Hyoshin</given-names></name><xref ref-type="aff" rid="A1">a</xref></contrib><contrib contrib-type="author"><name><surname>Graitcer</surname><given-names>Samuel B.</given-names></name><xref ref-type="aff" rid="A3">c</xref></contrib><contrib contrib-type="author"><name><surname>Foppa</surname><given-names>Ivo M.</given-names></name><xref ref-type="aff" rid="A1">a</xref></contrib><contrib contrib-type="author"><name><surname>Bridges</surname><given-names>Carolyn B.</given-names></name><xref ref-type="aff" rid="A3">c</xref><xref ref-type="aff" rid="A4">d</xref></contrib></contrib-group><aff id="A1"><label>a</label>Battelle Memorial Institute, Public Health and Advanced Analytics, Seattle, WA, USA</aff><aff id="A2"><label>b</label>Berry Technology Solutions, Atlanta, GA, USA</aff><aff id="A3"><label>c</label>Centers for Disease Control and Prevention, Immunization Services Division, Atlanta, GA, USA</aff><aff id="A4"><label>d</label>Immunization Action Coalition, St Paul, MN, USA</aff><author-notes><corresp id="CR1"><label>*</label>Corresponding author at: PSC 817 Box 2897, FPO, AE, 09622, USA., <email>nazila@sazan.com</email> (N.M. Dabestani).</corresp></author-notes><pub-date pub-type="nihms-submitted"><day>16</day><month>9</month><year>2019</year></pub-date><pub-date pub-type="epub"><day>29</day><month>5</month><year>2019</year></pub-date><pub-date pub-type="ppub"><month>9</month><year>2019</year></pub-date><pub-date pub-type="pmc-release"><day>01</day><month>9</month><year>2020</year></pub-date><volume>126</volume><fpage>105734</fpage><lpage>105734</lpage><!--elocation-id from pubmed: 10.1016/j.ypmed.2019.05.022--><abstract id="ABS1"><p id="P1">The Centers for Disease Control and Prevention recommend annual influenza vaccination of persons &#x02265; 6 months old. However, in 2016&#x02013;17, only 43.3% of U.S. adults reported receiving an influenza vaccination. Limited awareness about the cost-effectiveness (CE) or the economic value of influenza vaccination may contribute to low vaccination coverage. In 2017, we conducted a literature review to survey estimates of the CE of influenza vaccination of adults compared to no vaccination. We also summarized CE estimates of other common preventive interventions that are recommended for adults by the U.S. Preventive Services Task Force. Results are presented as costs in US$2015 per quality-adjusted life-year (QALY) saved. Among adults aged 18&#x02013;64, the CE of influenza vaccination ranged from $8000 to $39,000 per QALY. Assessments for adults aged &#x02265; 65 yielded lower CE ratios, ranging from being cost-saving to $15,300 per QALY. Influenza vaccination was cost-saving to $85,000 per QALY for pregnant women in moderate or severe influenza seasons and $260,000 per QALY in low-incidence seasons. For other preventive interventions, CE estimates ranged from cost-saving to $170,000 per QALY saved for breast cancer screening among women aged 50&#x02013;74, from cost-saving to $16,000 per QALY for colorectal cancer screening, and from $27,000 to $600,000 per QALY for hypertension screening and treatment. Influenza vaccination in adults appears to have a similar CE profile as other commonly utilized preventive services for adults. Efforts to improve adult vaccination should be considered by adult-patient providers, healthcare systems and payers given the health and economic benefits of influenza vaccination.</p></abstract><kwd-group><kwd>Adult</kwd><kwd>Influenza vaccines</kwd><kwd>Preventive medicine</kwd><kwd>Literature review</kwd></kwd-group></article-meta></front><body><sec id="S1"><label>1.</label><title>Introduction</title><p id="P2">Millions of influenza-related illnesses, lost work days and outpatient medical visits - including an estimated 140,000 to 710,000 influenza-related hospitalizations and 12,000 to 56,000 deaths - occur in the United States (U.S.) during influenza seasons (<xref rid="R7" ref-type="bibr">Centers for Disease Control and Prevention, 2018</xref>). The Centers for Disease Control and Prevention recommend that all people aged &#x02265; 6 months receive the influenza vaccination each year (<xref rid="R20" ref-type="bibr">Grohskopf et al., 2017</xref>). However, only 59.0% of children 6 months to 17 years old and 43.3% of adults &#x02265;18 years old were vaccinated in the U.S. in the 2016&#x02013;17 influenza season (<xref rid="R6" ref-type="bibr">Centers for Disease Control and Prevention, 2017</xref>). Other health prevention services for adults appear to have higher levels of utilization, with 71.5% of women aged 50&#x02013;74 undergoing mammography (<xref rid="R9" ref-type="bibr">Centers for Disease Control and Prevention/National Center for Health Statistics, 2016</xref>), 62.4% of adults aged &#x02265;50 undergoing colorectal cancer screening (<xref rid="R49" ref-type="bibr">White et al., 2017</xref>), and about 82.8% of adults aged &#x02265; 18 screened for high blood pressure (<xref rid="R32" ref-type="bibr">Mozaffarian et al., 2015</xref>). The relatively lower utilization of influenza vaccination may in part be due to limited awareness of the cost-effectiveness (CE) profile of adult influenza vaccination and the health burden that can be avoided by increasing the influenza vaccine uptake, as providers tend to have better knowledge of recommendations for higher risk groups (<xref rid="R6" ref-type="bibr">Centers for Disease Control and Prevention, 2017</xref>; <xref rid="R35" ref-type="bibr">Nowak et al., 2018</xref>).</p><p id="P3">CE analysis is one way to estimate and quantify the economic value of different health services and public health interventions. CE studies provide information that can be used by healthcare providers, healthcare systems, payers, and policy makers who are making decisions regarding which services to prioritize and how to allocate additional health-related investments. This study collects and summarizes results of research on the CE of adult influenza vaccinations as well as other preventive services relevant to adults - specifically breast cancer screening, colorectal cancer screening, and hypertension screening and treatment. The results from this study provide support for the ongoing use and promotion of influenza vaccinations as well as additional context for future CE analyses of influenza vaccination.</p></sec><sec id="S2"><label>2.</label><title>Methods</title><p id="P4">In 2017, we conducted a literature review identifying and synthesizing CE analyses that evaluated the use of influenza vaccination in the U.S. adult population. To summarize selected CE findings for other common preventive services for U.S. adults, we reviewed the economic literature related to colorectal cancer for persons &#x02265; 50 years old, blood pressure screening for adults of all ages, and breast cancer screening for women aged 50&#x02013;74. The selection of these three other preventive services was informed by recommendations made by the U.S. Preventive Services Task Force (USPSTF), which indicates the quality of a recommendation using a scale of letter grades, with A and B grades signaling a &#x0201c;high certainty that the benefit is moderate to substantial&#x0201d;(<xref rid="R14" ref-type="bibr">Drummond et al., 2007</xref>).</p><p id="P5">We searched all major medical and public health research literature databases - PubMed, ProQuest, EBSCO, Thomson Reuters, ProQuest Science &#x00026; Technology, ScienceDirect, Web of Science, EBSCO, Thomson Reuters, Applied Science &#x00026; Technology Abstracts, Business Source Complete, and MEDLINE - for publications dated from 1996 to 2016 using a combination of terms that were designed to identify economic evaluations and CE analyses of influenza vaccinations, colorectal cancer screening, mammography, and hypertension screening and treatment (see <xref rid="SD1" ref-type="supplementary-material">Appendix A</xref>). Note that the USPSTF only refers to &#x0201c;hypertension screening,&#x0201d; while our searches identified studies that assessed the CE of screening in combination with treatment for hypertension. A professional librarian conducted these searches in January 2017. To capture additional studies that may not have been identified with our database searches, we added studies to our final list by reviewing the reference and citation lists in each of the articles identified by the database searches. The original searches and subsequent additions yielded 1089 peer-reviewed articles.</p><p id="P6">These 1089 articles were then subjected to an initial review of the titles and abstracts, during which we excluded 978 articles that did not appear to be relevant to our study objectives. In particular, we excluded studies with titles and abstracts that did not contain any relevant terminology, such as quality-adjusted life-year (QALY), CE ratio (CER), life-years saved (LYS), cost, or benefit. Following the initial title and abstract review, there were 70 research articles related to influenza vaccination in the United States and 41 articles related to the other preventive services that we considered for the comparator group (see <xref rid="F1" ref-type="fig">Fig. 1</xref>).</p><p id="P7">Of the 70 influenza vaccination articles, 51 were excluded because they either focused exclusively on non-U.S. populations, were duplicates, compared two distinct types of influenza vaccines but did not have a &#x0201c;no vaccination&#x0201d; comparison, were not CE analyses, were not from the societal perspective, or did not meet our criteria for quality. The evaluation of quality for the remaining CE studies was based on a checklist developed by Drummond and colleagues (see <xref rid="SD1" ref-type="supplementary-material">Appendix B</xref>). In the assessment of quality, one point was given for each of the ten questions in the Drummond check list that was effectively answered by the study being assessed (see <xref rid="SD1" ref-type="supplementary-material">Appendix C</xref>). Questions consisting of multiple parts were assessed as a one, receiving one point if both parts were answered or zero if any part of the was unanswered. Studies that received six or more points, out of a total of ten, were included in the final analysis. These quality scores were determined by two independent reviewers, with any discrepancies in the two reviews resolved by discussion. Another 7 articles were then excluded because they focused on childhood vaccinations, leaving a total of 12 studies that assessed adult influenza vaccination CE for inclusion in the final analysis. Of the 41 other preventive services studies that remained following the title and abstract review, three were retained based on their relevance and quality scores.</p><p id="P8">From the 12 influenza vaccination CE articles and the three studies of CE of other preventive services that were included in our final analysis, we extracted and quantified relevant study characteristics. These characteristics included the specific types of interventions being assessed, the age ranges of the study population, the study perspective, the types of outcomes assessed, and the estimated cost per outcome (or the CE ratios). All monetary values were adjusted to US$2015 using the U.S. consumer price index (<xref rid="R45" ref-type="bibr">The World Bank, 2018</xref>). CE ratios from the societal perspective were utilized and the units of outcome focused on in this review included final outcome measures such as persons vaccinated, LYS, and QALYs saved, to maintain comparability across studies.</p></sec><sec id="S3"><label>3.</label><title>Results</title><p id="P9">The type of outcomes used in the CE ratios varied across the 12 studies on influenza CE that were included in the final dataset. While cost per QALY saved was the most common CE ratio measure used, several studies reported costs per outcome using other health outcomes, such as LYS (<xref rid="R14" ref-type="bibr">Drummond et al., 2007</xref>; <xref rid="R37" ref-type="bibr">Patel and Davis, 2006</xref>), illnesses averted (<xref rid="R29" ref-type="bibr">Luce et al., 2001</xref>), and costs per person vaccinated (<xref rid="R48" ref-type="bibr">White et al., 1999</xref>; <xref rid="R34" ref-type="bibr">Nichol, 2001</xref>; <xref rid="R24" ref-type="bibr">Jordan et al., 2006</xref>; <xref rid="R17" ref-type="bibr">Gibson et al., 2016</xref>; <xref rid="R4" ref-type="bibr">Bridges et al., 2000</xref>).</p><p id="P10">The influenza vaccination studies looking at adult populations reported CE ratios that would likely be considered CE by traditional standards (<xref rid="R21" ref-type="bibr">Grosse, 2008</xref>). Among the studies that estimated CE ratios in terms of cost per QALY saved, CE estimates for adult influenza vaccination ranged from being cost-saving (<xref rid="R39" ref-type="bibr">Prosser et al., 2008</xref>) to $39,000 <xref rid="R30" ref-type="bibr">Maciosek et al., 2006</xref> per QALY saved adults, excluding pregnant women. Among pregnant women, the CE ranged from being cost-saving (<xref rid="R50" ref-type="bibr">Xu et al., 2016</xref>; <xref rid="R3" ref-type="bibr">Beigi et al., 2009</xref>) during a moderate influenza season to $260,000 per QALY saved (<xref rid="R50" ref-type="bibr">Xu et al., 2016</xref>) during an influenza season with little influenza activity (<xref rid="F2" ref-type="fig">Fig. 2</xref>, details available in <xref rid="SD1" ref-type="supplementary-material">Appendices</xref>).</p><p id="P11">The three studies of other preventive services yielded a range of preventive service interventions, age groups, and outcome measures. The CE ranged from being cost-saving to $170,000 per QALY saved for breast cancer screening interventions (<xref rid="R44" ref-type="bibr">Stout et al., 2014</xref>), from cost-saving to $16,000 per QALY saved for colorectal cancer screening interventions (<xref rid="R26" ref-type="bibr">Kingsley et al., 2016</xref>) and from $27,000 to $600,000 per QALY saved for hypertension screening and treatment (<xref rid="R11" ref-type="bibr">Dehmer et al., 2017</xref>). Among adult populations, the CE estimates for influenza vaccination were comparable with the estimates for these other preventive services considered (<xref rid="F2" ref-type="fig">Fig. 2</xref>).</p></sec><sec id="S4"><label>4.</label><title>Discussion</title><p id="P12">We found that influenza vaccination compared favorably with other commonly accepted and well-implemented preventive services for adults in terms of CE. This comparability is noteworthy given the differences observed in implementation coverage and implementation rates between other preventive services and influenza vaccinations among adult populations. While at least one other recent study has summarized the cost-effectiveness of many types of adult vaccinations (<xref rid="R28" ref-type="bibr">Leidner et al., 2018</xref>), our study goes further by focusing on the cost-effectiveness of influenza vaccinations with comparisons to other preventive health interventions in adults. In particular, this study highlights the difference in utilization rates between influenza vaccination, which suggests that additional utilization of influenza vaccinations could benefit adult patients.</p><p id="P13">A recent Cochrane review found influenza vaccination of healthy adults protects against experiencing a case of laboratory-confirmed influenza and influenza-like-illness (<xref rid="R12" ref-type="bibr">Demicheli et al., 2018a</xref>). This large systematic review of randomized-control and quasi-randomized studies also concluded that the influenza vaccine has a minimal or modest effect in reducing hospitalizations (risk-ratio = 0.96 with 95% confidence interval from 0.85 to 1.08) and days off work (&#x02212;0.04 days with 95% confidence interval from - 0.14 days to 0.06 days). Both of these findings were characterized as having low-certainty of evidence. Recent observational studies that were not included in the Cochrane review found evidence of vaccine effectiveness against hospitalizations that ranged 45% and 57% (<xref rid="R22" ref-type="bibr">Havers et al., 2016</xref>; <xref rid="R15" ref-type="bibr">Ferdinands et al., 2018</xref>). The majority of CEA studies summarized in our review assumed a moderate level of vaccine effectiveness against all influenza-related disease outcomes. Base case assumptions of vaccine effectiveness ranged from 13% to 75% with differences related to outcomes of interest (<xref rid="R30" ref-type="bibr">Maciosek et al., 2006</xref>), patient type (<xref rid="R50" ref-type="bibr">Xu et al., 2016</xref>; <xref rid="R3" ref-type="bibr">Beigi et al., 2009</xref>), and vaccine match with the circulating types of influenza (<xref rid="R34" ref-type="bibr">Nichol, 2001</xref>).</p><p id="P14">The cost-effectiveness ratios that were estimated by the studies summarized in this review looked at the differences in costs and health outcomes under scenarios with and without influenza vaccination. We focused on results that utilized QALYs saved by vaccination as the primary health outcome of interest. Prevented influenza-related deaths and disease resulted in QALYs saved, where the types of disease included in the models varied across studies. Looking across all studies, disease states included influenza cases that were not medically attended, outpatient cases, hospitalizations or inpatient cases, deaths, preterm births, as well as adverse events from vaccinations.</p><p id="P15">Across the studies we reviewed, a number of estimates of cost-effectiveness for influenza vaccination identified cost-saving results. Under a variety of modeling assumptions and across several target populations, estimates of influenza vaccination cost-effectiveness varied from being cost-saving to $260,000 per QALY saved. The majority of estimates costing less than equal to $85,000 per QALY saved. In addition, influenza vaccination appears favorable in terms of CE relative to other commonly recommended preventive services given A or B grades by the USPSTF (<xref rid="R46" ref-type="bibr">U.S. Preventive Services Task Force, 2018</xref>): screening for colon cancer for adults 50&#x02013;74 years, breast cancer for women aged 50&#x02013;74 years, and hypertension for adults &#x02265;18 years (<xref rid="R46" ref-type="bibr">U.S. Preventive Services Task Force, 2018</xref>). Relative economic favorability may depend on a number of factors, including emerging data and scientific consensus on the effectiveness of clinical interventions such as influenza vaccination (<xref rid="R13" ref-type="bibr">Demicheli et al., 2018b</xref>) and mammography (<xref rid="R18" ref-type="bibr">Gotzsche and Nielsen, 2013</xref>). Among influenza vaccination CEA studies reviewed here, the greatest variability in influenza vaccination economic outcomes is associated with pregnant women, with less variation observed among the other, strictly age-based population groups among studies included in our analyses. Variation among cost-effectiveness results could be due to multiple factors that vary across population groups and across influenza seasons, including influenza antigenic match between vaccine strains and circulating influenza viruses, and influenza illness rates and severity of influenza illnesses in a given season and age groups most impacted.</p><p id="P16">USPSTF formulates recommendations based on evidence of effectiveness, but their recommendations do not explicitly include economic CE <xref rid="R46" ref-type="bibr">U.S. Preventive Services Task Force, 2018</xref>. The recommended use of vaccines in the United States are not evaluated by the USPSTF, but rather by the Advisory Committee on Immunization Practices (ACIP). The ACIP, in contrast to the USPSTF, considers cost-effectiveness analyses in their deliberations of vaccine recommendations (<xref rid="R43" ref-type="bibr">Smith, 2010</xref>; <xref rid="R38" ref-type="bibr">Pike et al., 2019</xref>), which may explain, in part, the larger number of CE studies found on influenza vaccination relative to other preventive services. The effectiveness of the influenza vaccine varies across age groups, influenza seasons, and measurable disease outcomes which also impacts that range of CE estimates (<xref rid="R13" ref-type="bibr">Demicheli et al., 2018b</xref>; <xref rid="R10" ref-type="bibr">Cowling et al., 2016</xref>; <xref rid="R36" ref-type="bibr">Ohmit et al., 2013</xref>; <xref rid="R27" ref-type="bibr">Kostova et al., 2013</xref>); however, the relatively favorable CE results associated with this vaccine are likely related to the low cost of influenza vaccines - with a cost between $11 and $22 per dose (<xref rid="R8" ref-type="bibr">Centers for Disease Control and Prevention, 2019</xref>) -as well as the substantial disease burden associated with influenza (<xref rid="R40" ref-type="bibr">Reed et al., 2015</xref>).</p><p id="P17">Based on a survey conducted in 2016, approximately 53% of influenza vaccinations among adults appear to occur at health-care locations, such as a physician&#x02019;s office, hospital, or public health clinic (<xref rid="R5" ref-type="bibr">Centers for Disease Control and Prevention, 2016</xref>). This finding is consistent with an earlier study that used data from the Behavioral Risk Factor Surveillance System that found 70% of influenza vaccinations among adults aged 18 years and older were administered in physician offices and other traditional settings (<xref rid="R42" ref-type="bibr">Singleton et al., 2005</xref>). This is also consistent with a more recent study that investigated the factors associated with receiving influenza vaccinations in non-traditional settings, in which 60% of individuals in this study that received an influenza vaccination did so in a traditional setting (<xref rid="R25" ref-type="bibr">Kim and Mountain, 2017</xref>). The challenge to allocate time during routine patient visits to implement all vaccine and USPSTF A and B recommended preventive services (<xref rid="R23" ref-type="bibr">Hurley et al., 2016</xref>) may force healthcare providers to prioritize specific preventive services at each visit. Concerns about payment adequacy and patient insurance coverage and patient out-of-pocket costs may also influence preventive services decisions (<xref rid="R23" ref-type="bibr">Hurley et al., 2016</xref>). Utilization of preventive visits for adults, such as Medicare annual wellness visits, may help providers expand the implementation of preventive services by patients, including influenza vaccination when visits are timed to coincide with influenza vaccination timing.</p><p id="P18">Influenza vaccination has been demonstrated to offer multiple benefits to patients of all ages, including reduced risk of influenza-related hospitalization in both children age 6 months to 17 years and adults aged &#x02265; 18 (<xref rid="R22" ref-type="bibr">Havers et al., 2016</xref>), reduced risk of major acute cardiovascular events among persons with existing cardiovascular disease (<xref rid="R47" ref-type="bibr">Udell et al., 2013</xref>; <xref rid="R1" ref-type="bibr">Barnes et al., 2015</xref>), reduced risk of influenza in pregnant women and infants born to vaccinated pregnant women (<xref rid="R31" ref-type="bibr">Madhi et al., 2014</xref>), and finally, reduced risk of deaths in children (<xref rid="R16" ref-type="bibr">Flannery et al., 2017</xref>) and adults (<xref rid="R45" ref-type="bibr">The World Bank, 2018</xref>; <xref rid="R41" ref-type="bibr">Shay et al., 2017</xref>; <xref rid="R19" ref-type="bibr">Grohskopf, 2016</xref>). A 2018 Cochrane review found influenza vaccination of healthy adults protects against experiencing a case of laboratory-confirmed influenza - with a risk ratio of 0.41 (confidence interval (CI): 0.36 to 0.47) - and protects against influenza-like-illness - with a risk ratio of 0.84 (CI: 0.75 to 0.95) (<xref rid="R12" ref-type="bibr">Demicheli et al., 2018a</xref>). Similar results were also found among the elderly, where influenza vaccinations protect against laboratory-confirmed influenza illness - with a risk ratio of 0.42 (CI: 0.27 to 0.66) - and against influenza-like-illness - with a risk ratio of 0.59 (CI: 0.47 to 0.73) (<xref rid="R13" ref-type="bibr">Demicheli et al., 2018b</xref>). While these results confirm the vaccine confers substantial benefits in terms of protection against illness, the review did not identify significant protection from certain specific outcomes, such as hospitalization or work loss (<xref rid="R13" ref-type="bibr">Demicheli et al., 2018b</xref>). These outcomes were also associated with substantial uncertainty around effectiveness estimates. Our review of the economic literature on influenza vaccinations of adults also identifies uncertainty across studies, which depended on attributes of the population under consideration as well as the severity of the influenza season. Across the studies we reviewed, the substantial burden of influenza among persons of all ages and the benefits of vaccination suggest that providers and health systems should include influenza vaccination in routine care.</p><p id="P19">This study is subject to several limitations. The rigor of our study criteria and of our assessments of economic evaluations - in addition to the relative scarcity of intervention CE studies - yielded few eligible studies. A number of high-quality economic evaluation studies we found utilized different economic perspectives (i.e. provider), study types (i.e. cost benefit analysis), and denominator units (i.e. illness averted). We therefore could not compare these studies. The final studies we included, however, are high quality and representative of the respective preventive health interventions. The small number of CE studies underscores the need for additional economic evaluations of health prevention interventions that - among other criteria - focus on the societal perspective, utilize a consistent economic metric, and compare interventions to no intervention. We were not able to assess the potential impact of herd immunity on CE since herd immunity was not included in the majority of studies we reviewed. Omitting herd immunity impact is likely to underestimate the CE of influenza vaccination (<xref rid="R2" ref-type="bibr">Bauch et al., 2009</xref>). The severity of an influenza season as well as the efficacy of an influenza vaccine can vary substantially across different years. In this review, we found that many influenza vaccination studies reported only single-year data which may limit generalizability of the results (<xref rid="R4" ref-type="bibr">Bridges et al., 2000</xref>; <xref rid="R22" ref-type="bibr">Havers et al., 2016</xref>; <xref rid="R41" ref-type="bibr">Shay et al., 2017</xref>; <xref rid="R19" ref-type="bibr">Grohskopf, 2016</xref>). Multi-year data analyses would offer additional evidence useful to CE studies. We were unable to fully investigate the impact of adverse events on the different interventions; however, the incidence and cost of adverse events from the interventions were included in the CE analyses. While we consider this issue to be important, it is beyond the scope of the current review. We also limited our review to influenza vaccination and a few selected other USPSTF A and B grade prevention interventions. The relative CE of influenza vaccination when compared to other preventive services recommended by USPSTF that were not included in this study may differ from the preventive services that were included.</p></sec><sec id="S5"><label>5.</label><title>Conclusion</title><p id="P20">Our literature review found several studies that demonstrate that influenza vaccination among adult populations would likely be considered cost-effective by many standards. The CE results for influenza vaccination among adults was comparable to the CE of other USPTF grade A and B preventive health interventions targeting adults, including colorectal screening, breast cancer screening, and hypertension screening and treatment. Healthcare practitioners and healthcare systems may want to consider these findings in making decisions regarding their level of effort and investment in promoting, implementing, and incentivizing influenza vaccination programs. Adoption of the National Vaccine Advisory Committee Standards for Adult Immunization Practice (<xref rid="R33" ref-type="bibr">National Vaccine Advisory Committee, 2014</xref>) is recommended so that all adults may benefit from influenza and other vaccines and to reduce the health burden of vaccine preventable illnesses. Adoption of these standards, especially as they apply to influenza vaccination of adults, may require system- and policy-level changes to ensure all patients receive a strong provider recommendation for vaccination and have the opportunity to benefit from influenza vaccination.</p></sec><sec sec-type="supplementary-material" id="SM1"><title>Supplementary Material</title><supplementary-material content-type="local-data" id="SD1"><label>Appendices</label><media xlink:href="NIHMS1050420-supplement-Appendices.docx" orientation="portrait" xlink:type="simple" id="d36e462" position="anchor"/></supplementary-material></sec></body><back><ack id="S6"><title>Acknowledgments</title><p id="P21">The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention. We thank the Centers for Disease Control and Prevention&#x02019;s Immunization Services Division - who contracted Battelle&#x02019;s Public Health and Advanced Analytics division for this project - for their guidance and funding. This study was designed by ND, ES, HK, SG, AL, and CB. ND, ES, and HK conducted the literature search, assessed study quality, and conducted primary data abstraction. AL and IF assisted with the analysis. The manuscript was drafted and reviewed by ND, ES, HK, SG, AL, IF, DJ, and CB. We thank Dr. Joy Schwerzmann for project management assistance and Dr. Gavin Hougham for edits made in early drafts. No conflicts of interest were reported by authors of this paper.</p></ack><fn-group><fn id="FN1"><p id="P22">Financial disclosures</p><p id="P23">There are no financial disclosures to report.</p></fn><fn fn-type="COI-statement" id="FN2"><p id="P24">Declaration of Competing Interest</p><p id="P25">There are no conflicts of interest to report.</p></fn><fn id="FN3"><p id="P26">Appendices. Supplementary data</p><p id="P27">Supplementary data to this article can be found online at <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.ypmed.2019.05.022">https://doi.org/10.1016/j.ypmed.2019.05.022</ext-link>.</p></fn></fn-group><ref-list><title>References</title><ref id="R1"><mixed-citation publication-type="journal"><name><surname>Barnes</surname><given-names>M</given-names></name>, <name><surname>Heywood</surname><given-names>AE</given-names></name>, <name><surname>Mahimbo</surname><given-names>A</given-names></name>, <name><surname>Rahman</surname><given-names>B</given-names></name>, <name><surname>Newall</surname><given-names>AT</given-names></name>, <name><surname>Macintyre</surname><given-names>CR</given-names></name>, <year>2015</year>
<article-title>Acute myocardial infarction and influenza: a meta-analysis of case-control studies</article-title>. <source>Heart</source>
<volume>101</volume> (<issue>21</issue>), <fpage>1738</fpage>&#x02013;<lpage>1747</lpage>.<pub-id pub-id-type="pmid">26310262</pub-id></mixed-citation></ref><ref id="R2"><mixed-citation publication-type="journal"><name><surname>Bauch</surname><given-names>CT</given-names></name>, <name><surname>Anonychuk</surname><given-names>AM</given-names></name>, <name><surname>Van Effelterre</surname><given-names>T</given-names></name>, <name><surname>Pham</surname><given-names>BZ</given-names></name>, <name><surname>Merid</surname><given-names>MF</given-names></name>, <year>2009</year>
<article-title>Incorporating herd immunity effects into cohort models of vaccine cost-effectiveness</article-title>. <source>Med. Decis. Mak</source>. <volume>29</volume> (<issue>5</issue>), <fpage>557</fpage>&#x02013;<lpage>569</lpage>.</mixed-citation></ref><ref id="R3"><mixed-citation publication-type="journal"><name><surname>Beigi</surname><given-names>RH</given-names></name>, <name><surname>Wiringa</surname><given-names>AE</given-names></name>, <name><surname>Bailey</surname><given-names>RR</given-names></name>, <name><surname>Assi</surname><given-names>TM</given-names></name>, <name><surname>Lee</surname><given-names>BY</given-names></name>, <year>2009</year>
<article-title>Economic value of seasonal and pandemic influenza vaccination during pregnancy</article-title>. <source>Clin. Infect. Dis</source>. <volume>49</volume> (<issue>12</issue>), <fpage>1784</fpage>&#x02013;<lpage>1792</lpage>.<pub-id pub-id-type="pmid">19911967</pub-id></mixed-citation></ref><ref id="R4"><mixed-citation publication-type="journal"><name><surname>Bridges</surname><given-names>CB</given-names></name>, <name><surname>Thompson</surname><given-names>WW</given-names></name>, <name><surname>Meltzer</surname><given-names>MI</given-names></name>, <name><surname>Reeve</surname><given-names>GR</given-names></name>, <name><surname>Talamonti</surname><given-names>WJ</given-names></name>, <name><surname>Cox</surname><given-names>NJ</given-names></name>, <etal/>, <year>2000</year>
<article-title>Effectiveness and cost-benefit of influenza vaccination of healthy working adults: a randomized controlled trial</article-title>. <source>JAMA</source>
<volume>284</volume> (<issue>13</issue>), <fpage>1655</fpage>&#x02013;<lpage>1663</lpage>.<pub-id pub-id-type="pmid">11015795</pub-id></mixed-citation></ref><ref id="R5"><mixed-citation publication-type="journal"><collab>Centers for Disease Control and Prevention</collab>, <year>2016</year>
<source>National Early-season Flu Vaccination Coverage, United States</source>, <month>11</month>
<year>2016</year>
<year>2016</year>
<month>12</month>
<day>9</day>.</mixed-citation></ref><ref id="R6"><mixed-citation publication-type="web"><collab>Centers for Disease Control and Prevention</collab>, <year>2017</year>
<source>Flu vaccination coverage, United States, 2016&#x02013;17 influenza season</source>. <date-in-citation>updated September 28, 2017</date-in-citation> Available from. <comment><ext-link ext-link-type="uri" xlink:href="https://www.cdc.gov/flu/fluvaxview/coverage-1617estimates.htm">https://www.cdc.gov/flu/fluvaxview/coverage-1617estimates.htm</ext-link>.</comment></mixed-citation></ref><ref id="R7"><mixed-citation publication-type="web"><collab>Centers for Disease Control and Prevention</collab>, <year>2018</year>
<source>Disease Burden of Influenza</source>. Available from: <comment><ext-link ext-link-type="uri" xlink:href="https://www.cdc.gov/flu/about/disease/burden.htm">https://www.cdc.gov/flu/about/disease/burden.htm</ext-link>.</comment></mixed-citation></ref><ref id="R8"><mixed-citation publication-type="journal"><collab>Centers for Disease Control and Prevention</collab>, <year>2019</year>
<source>CDC Vaccine Price List, Adult Influenza Caccine Price List</source>.</mixed-citation></ref><ref id="R9"><mixed-citation publication-type="web"><collab>Centers for Disease Control and Prevention/National Center for Health Statistics</collab>, <year>2016</year>
<source>Public-use data files and documentation</source>. <date-in-citation>updated July 25, 2016</date-in-citation> Available from: <comment><ext-link ext-link-type="uri" xlink:href="https://www.cdc.gov/nchs/data_access/ftp_data.htm">https://www.cdc.gov/nchs/data_access/ftp_data.htm</ext-link>.</comment></mixed-citation></ref><ref id="R10"><mixed-citation publication-type="journal"><name><surname>Cowling</surname><given-names>BJ</given-names></name>, <name><surname>Feng</surname><given-names>S</given-names></name>, <name><surname>Finelli</surname><given-names>L</given-names></name>, <name><surname>Steffens</surname><given-names>A</given-names></name>, <name><surname>Fowlkes</surname><given-names>A</given-names></name>, <year>2016</year>
<article-title>Assessment of influenza vaccine effectiveness in a sentinel surveillance network 2010&#x02013;13, United States</article-title>. <source>Vaccine</source>
<volume>34</volume> (<issue>1</issue>), <fpage>61</fpage>&#x02013;<lpage>66</lpage>.<pub-id pub-id-type="pmid">26611200</pub-id></mixed-citation></ref><ref id="R11"><mixed-citation publication-type="journal"><name><surname>Dehmer</surname><given-names>SP</given-names></name>, <name><surname>Maciosek</surname><given-names>MV</given-names></name>, <name><surname>LaFrance</surname><given-names>AB</given-names></name>, <name><surname>Flottemesch</surname><given-names>TJ</given-names></name>, <year>2017</year>
<article-title>Health benefits and cost-effectiveness of asymptomatic screening for hypertension and high cholesterol and aspirin counseling for primary prevention</article-title>. <source>Ann. Fam. Med</source>. <volume>15</volume> (<issue>1</issue>), <fpage>23</fpage>&#x02013;<lpage>36</lpage>.<pub-id pub-id-type="pmid">28376458</pub-id></mixed-citation></ref><ref id="R12"><mixed-citation publication-type="journal"><name><surname>Demicheli</surname><given-names>V</given-names></name>, <name><surname>Jefferson</surname><given-names>T</given-names></name>, <name><surname>Ferroni</surname><given-names>E</given-names></name>, <name><surname>Rivetti</surname><given-names>A</given-names></name>, <name><surname>Di Pietrantonj</surname><given-names>C</given-names></name>, <year>2018a</year>
<article-title>Vaccines for preventing influenza in healthy adults</article-title>. <source>Cochrane Database Syst. Rev</source>. <volume>2</volume>, CD001269.</mixed-citation></ref><ref id="R13"><mixed-citation publication-type="journal"><name><surname>Demicheli</surname><given-names>V</given-names></name>, <name><surname>Jefferson</surname><given-names>T</given-names></name>, <name><surname>Di Pietrantonj</surname><given-names>C</given-names></name>, <name><surname>Ferroni</surname><given-names>E</given-names></name>, <name><surname>Thorning</surname><given-names>S</given-names></name>, <name><surname>Thomas</surname><given-names>R</given-names></name>, <etal/>, <year>2018b</year>
<article-title>Vaccines for preventing influenza in the elderly</article-title>. <source>Cochrane Database Syst. Rev</source>. (<issue>2</issue>), CD004876.</mixed-citation></ref><ref id="R14"><mixed-citation publication-type="journal"><name><surname>Drummond</surname><given-names>M</given-names></name>, <name><surname>Chevat</surname><given-names>C</given-names></name>, <name><surname>Lothgren</surname><given-names>M</given-names></name>, <year>2007</year>
<article-title>Do we fully understand the economic value of vaccines?</article-title>
<source>Vaccine</source>
<volume>25</volume> (<issue>32</issue>), <fpage>5945</fpage>&#x02013;<lpage>5957</lpage>.<pub-id pub-id-type="pmid">17629362</pub-id></mixed-citation></ref><ref id="R15"><mixed-citation publication-type="journal"><name><surname>Ferdinands</surname><given-names>J</given-names></name>, <name><surname>Gaglani</surname><given-names>M</given-names></name>, <name><surname>Martin</surname><given-names>E</given-names></name>, <name><surname>Middleton</surname><given-names>D</given-names></name>, <name><surname>Monto</surname><given-names>A</given-names></name>, <name><surname>Murthy</surname><given-names>K</given-names></name>, <etal/>, <year>2018</year>
<article-title>Prevention of influenza hospitalization among adults in the United States, 2015&#x02013;2016: results from the US Hospitalized Adult Influenza Vaccine Effectiveness Network (HAIVEN)</article-title>. <source>J. Infect. Dis</source>. <pub-id pub-id-type="doi">10.1093/infdis/jiy723</pub-id><comment>.</comment></mixed-citation></ref><ref id="R16"><mixed-citation publication-type="journal"><name><surname>Flannery</surname><given-names>B</given-names></name>, <name><surname>Reynolds</surname><given-names>SB</given-names></name>, <name><surname>Blanton</surname><given-names>L</given-names></name>, <name><surname>Santibanez</surname><given-names>TA</given-names></name>, <name><surname>O&#x02019;Halloran</surname><given-names>A</given-names></name>, <name><surname>Lu</surname><given-names>P-J</given-names></name>, <etal/>, <year>2017</year>
<article-title>Influenza vaccine effectiveness against pediatric deaths: 2010&#x02013;2014</article-title>. <source>Pediatrics</source>
<volume>139</volume> (<issue>5</issue>), <comment>e20164244</comment>.</mixed-citation></ref><ref id="R17"><mixed-citation publication-type="journal"><name><surname>Gibson</surname><given-names>E</given-names></name>, <name><surname>Begum</surname><given-names>N</given-names></name>, <name><surname>Sigmundsson</surname><given-names>B</given-names></name>, <name><surname>Sackeyfio</surname><given-names>A</given-names></name>, <name><surname>Hackett</surname><given-names>J</given-names></name>, <name><surname>Rajaram</surname><given-names>S</given-names></name>, <year>2016</year>
<article-title>Economic evaluation of pediatric influenza immunization program compared with other pediatric immunization programs: a systematic review</article-title>. <source>Hum. Vaccin. Immunother</source>. <volume>12</volume> (<issue>5</issue>), <fpage>1202</fpage>&#x02013;<lpage>1216</lpage>.<pub-id pub-id-type="pmid">26837602</pub-id></mixed-citation></ref><ref id="R18"><mixed-citation publication-type="journal"><name><surname>Gotzsche</surname><given-names>P</given-names></name>, <name><surname>Nielsen</surname><given-names>M</given-names></name>, <year>2013</year>
<article-title>Screening for breast cancer with mammography</article-title>. <source>Cochrane Database Syst. Rev</source>. <volume>4</volume> (<issue>6</issue>), CD001877.</mixed-citation></ref><ref id="R19"><mixed-citation publication-type="journal"><name><surname>Grohskopf</surname><given-names>LA</given-names></name>, <year>2016</year>
<article-title>Prevention and control of seasonal influenza with vaccines</article-title>. <source>MMWR Recomm. Rep</source>. <volume>65</volume>.</mixed-citation></ref><ref id="R20"><mixed-citation publication-type="journal"><name><surname>Grohskopf</surname><given-names>LA</given-names></name>, <name><surname>Sokolow</surname><given-names>LZ</given-names></name>, <name><surname>Broder</surname><given-names>KR</given-names></name>, <name><surname>Walter</surname><given-names>EB</given-names></name>, <name><surname>Bresee</surname><given-names>JS</given-names></name>, <name><surname>Fry</surname><given-names>AM</given-names></name>, <etal/>, <year>2017</year>
<article-title>Prevention and control of seasonal influenza with vaccines: recommendations of the advisory committee on immunization practices - United States, 2017&#x02013;18 influenza season</article-title>. <source>MMWR Recomm. Rep</source>. <volume>66</volume> (<issue>2</issue>), <fpage>1</fpage>&#x02013;<lpage>20</lpage>.</mixed-citation></ref><ref id="R21"><mixed-citation publication-type="journal"><name><surname>Grosse</surname><given-names>SD</given-names></name>, <year>2008</year>
<source>Assessing Cost-Effectiveness in Healthcare: History of the $50,000 per QALY Threshold</source>.</mixed-citation></ref><ref id="R22"><mixed-citation publication-type="journal"><name><surname>Havers</surname><given-names>F</given-names></name>, <name><surname>Sokolow</surname><given-names>L</given-names></name>, <name><surname>Shay</surname><given-names>DK</given-names></name>, <name><surname>Farley</surname><given-names>MM</given-names></name>, <name><surname>Monroe</surname><given-names>M</given-names></name>, <name><surname>Meek</surname><given-names>J</given-names></name>, <etal/>, <year>2016</year>
<article-title>Case-control study of vaccine effectiveness in preventing laboratory-confirmed influenza hospitalizations in older adults, United States, 2010&#x02013;2011</article-title>. <source>Clin. Infect. Dis</source>. <volume>63</volume> (<issue>10</issue>), <fpage>1304</fpage>&#x02013;<lpage>1311</lpage>.<pub-id pub-id-type="pmid">27486114</pub-id></mixed-citation></ref><ref id="R23"><mixed-citation publication-type="journal"><name><surname>Hurley</surname><given-names>LP</given-names></name>, <name><surname>Bridges</surname><given-names>CB</given-names></name>, <name><surname>Harpaz</surname><given-names>R</given-names></name>, <name><surname>Allison</surname><given-names>MA</given-names></name>, <name><surname>Leary</surname><given-names>STO</given-names></name>, <name><surname>Crane</surname><given-names>LA</given-names></name>, <etal/>, <year>2016</year>
<article-title>Physician attitudes toward adult vaccines and other preventive practices, United States, 2012</article-title>. <source>Public Health Rep</source>. <volume>131</volume> (<issue>2</issue>), <fpage>320</fpage>&#x02013;<lpage>330</lpage>.<pub-id pub-id-type="pmid">26957667</pub-id></mixed-citation></ref><ref id="R24"><mixed-citation publication-type="journal"><name><surname>Jordan</surname><given-names>R</given-names></name>, <name><surname>Connock</surname><given-names>M</given-names></name>, <name><surname>Albon</surname><given-names>E</given-names></name>, <name><surname>Fry-Smith</surname><given-names>A</given-names></name>, <name><surname>Olowokure</surname><given-names>B</given-names></name>, <name><surname>Hawker</surname><given-names>J</given-names></name>, <etal/>, <year>2006</year>
<article-title>Universal vaccination of children against influenza: are there indirect benefits to the community? A systematic review of the evidence</article-title>. <source>Vaccine</source>
<volume>24</volume> (<issue>8</issue>), <fpage>1047</fpage>&#x02013;<lpage>1062</lpage>.<pub-id pub-id-type="pmid">16298026</pub-id></mixed-citation></ref><ref id="R25"><mixed-citation publication-type="journal"><name><surname>Kim</surname><given-names>N</given-names></name>, <name><surname>Mountain</surname><given-names>T</given-names></name>, <year>2017</year>
<article-title>Role of non-traditional locations for seasonal flu vaccination: empirical evidence and evaluation</article-title>. <source>Vaccine</source>
<volume>35</volume> (<issue>22</issue>), <fpage>2943</fpage>&#x02013;<lpage>2948</lpage>.<pub-id pub-id-type="pmid">28433328</pub-id></mixed-citation></ref><ref id="R26"><mixed-citation publication-type="journal"><name><surname>Kingsley</surname><given-names>J</given-names></name>, <name><surname>Karanth</surname><given-names>S</given-names></name>, <name><surname>Revere</surname><given-names>FL</given-names></name>, <name><surname>Agrawal</surname><given-names>D</given-names></name>, <year>2016</year>
<article-title>Cost effectiveness of screening colonoscopy depends on adequate bowel preparation rates-a modeling study</article-title>. <source>PLoS One</source>
<volume>11</volume> (<issue>12</issue>), <comment>e0167452</comment>.</mixed-citation></ref><ref id="R27"><mixed-citation publication-type="journal"><name><surname>Kostova</surname><given-names>D</given-names></name>, <name><surname>Reed</surname><given-names>C</given-names></name>, <name><surname>Finelli</surname><given-names>L</given-names></name>, <name><surname>Cheng</surname><given-names>P</given-names></name>, <name><surname>Gargiullo</surname><given-names>P</given-names></name>, <name><surname>Shay</surname><given-names>DK</given-names></name>, <etal/>, <year>2013</year>
<article-title>Influenza illness and hospitalizations averted by influenza vaccination in the United States, 2005&#x02013;2011</article-title>. <source>PLoS One</source>
<volume>8</volume> (<issue>6</issue>), <comment>e66312</comment>.</mixed-citation></ref><ref id="R28"><mixed-citation publication-type="journal"><name><surname>Leidner</surname><given-names>A</given-names></name>, <name><surname>Murthy</surname><given-names>N</given-names></name>, <name><surname>Chesson</surname><given-names>H</given-names></name>, <name><surname>Biggerstaff</surname><given-names>M</given-names></name>, <name><surname>Stoecker</surname><given-names>C</given-names></name>, <name><surname>Harris</surname><given-names>A</given-names></name>, <etal/>, <year>2018</year>
<article-title>Cost-effectiveness of adult vaccinations: a systematic review</article-title>. <source>Vaccine</source>
<volume>37</volume> (<issue>2</issue>), <fpage>226</fpage>&#x02013;<lpage>34</lpage>.<pub-id pub-id-type="pmid">30527660</pub-id></mixed-citation></ref><ref id="R29"><mixed-citation publication-type="journal"><name><surname>Luce</surname><given-names>BR</given-names></name>, <name><surname>Zangwill</surname><given-names>KM</given-names></name>, <name><surname>Palmer</surname><given-names>CS</given-names></name>, <name><surname>Mendelman</surname><given-names>PM</given-names></name>, <name><surname>Yan</surname><given-names>L</given-names></name>, <name><surname>Wolff</surname><given-names>MC</given-names></name>, <etal/>, <year>2001</year>
<article-title>Cost-effectiveness analysis of an intranasal influenza vaccine for the prevention of influenza in healthy children</article-title>. <source>Pediatrics</source>
<volume>108</volume> (<issue>2</issue>), <fpage>E24</fpage>.<pub-id pub-id-type="pmid">11483834</pub-id></mixed-citation></ref><ref id="R30"><mixed-citation publication-type="journal"><name><surname>Maciosek</surname><given-names>MV</given-names></name>, <name><surname>Solberg</surname><given-names>LI</given-names></name>, <name><surname>Coffield</surname><given-names>AB</given-names></name>, <name><surname>Edwards</surname><given-names>NM</given-names></name>, <name><surname>Goodman</surname><given-names>MJ</given-names></name>, <year>2006</year>
<article-title>Influenza vaccination: health impact and cost effectiveness among adults aged 50 to 64 and 65 and older</article-title>. <source>Am. J. Prev. Med</source>. <volume>31</volume> (<issue>1</issue>), <fpage>72</fpage>&#x02013;<lpage>79</lpage>.<pub-id pub-id-type="pmid">16777545</pub-id></mixed-citation></ref><ref id="R31"><mixed-citation publication-type="journal"><name><surname>Madhi</surname><given-names>SA</given-names></name>, <name><surname>Cutland</surname><given-names>CL</given-names></name>, <name><surname>Kuwanda</surname><given-names>L</given-names></name>, <name><surname>Weinberg</surname><given-names>A</given-names></name>, <name><surname>Hugo</surname><given-names>A</given-names></name>, <name><surname>Jones</surname><given-names>S</given-names></name>, <etal/>, <year>2014</year>
<article-title>Influenza vaccination of pregnant women and protection of their infants</article-title>. <source>N. Engl. J. Med</source>. <volume>371</volume> (<issue>10</issue>), <fpage>918</fpage>&#x02013;<lpage>931</lpage>.<pub-id pub-id-type="pmid">25184864</pub-id></mixed-citation></ref><ref id="R32"><mixed-citation publication-type="journal"><name><surname>Mozaffarian</surname><given-names>D</given-names></name>, <name><surname>Benjamin</surname><given-names>EJ</given-names></name>, <name><surname>Go</surname><given-names>AS</given-names></name>, <name><surname>Arnett</surname><given-names>DK</given-names></name>, <name><surname>Blaha</surname><given-names>MJ</given-names></name>, <name><surname>Cushman</surname><given-names>M</given-names></name>, <etal/>, <year>2015</year>
<article-title>Heart disease and stroke statistics&#x02014;2015 update: a report from the American Heart Association</article-title>. <source>Circulation</source>
<volume>131</volume> (<issue>4</issue>), <fpage>e29</fpage>&#x02013;<lpage>e322</lpage>.<pub-id pub-id-type="pmid">25520374</pub-id></mixed-citation></ref><ref id="R33"><mixed-citation publication-type="journal"><collab>National Vaccine Advisory Committee</collab>, <year>2014</year>
<article-title>Recommendations from the National Vaccine Advisory Committee: standards for adult immunization practice</article-title>. <source>Public Health Rep</source>. <volume>129</volume> (<issue>2</issue>), <fpage>115</fpage>&#x02013;<lpage>123</lpage>.<pub-id pub-id-type="pmid">24587544</pub-id></mixed-citation></ref><ref id="R34"><mixed-citation publication-type="journal"><name><surname>Nichol</surname><given-names>KL</given-names></name>, <year>2001</year>
<article-title>Cost-benefit analysis of a strategy to vaccinate healthy working adults against influenza</article-title>. <source>Arch. Intern. Med</source>. <volume>161</volume> (<issue>5</issue>), <fpage>749</fpage>&#x02013;<lpage>759</lpage>.<pub-id pub-id-type="pmid">11231710</pub-id></mixed-citation></ref><ref id="R35"><mixed-citation publication-type="journal"><name><surname>Nowak</surname><given-names>G</given-names></name>, <name><surname>Sheedy</surname><given-names>K</given-names></name>, <name><surname>Bursey</surname><given-names>K</given-names></name>, <name><surname>Smith</surname><given-names>T</given-names></name>, <name><surname>Basket</surname><given-names>M</given-names></name>, <year>2018</year>
<article-title>Promoting influenza vaccination: insights from a qualitative meta-analysis of 14 years of influenza-related communications research by U.S. Centers for Disease Control and Prevention (CDC)</article-title>. <source>Vaccine</source>
<volume>33</volume> (<issue>24</issue>), <fpage>2741</fpage>&#x02013;<lpage>2756</lpage>.</mixed-citation></ref><ref id="R36"><mixed-citation publication-type="journal"><name><surname>Ohmit</surname><given-names>SE</given-names></name>, <name><surname>Petrie</surname><given-names>JG</given-names></name>, <name><surname>Malosh</surname><given-names>RE</given-names></name>, <name><surname>Cowling</surname><given-names>BJ</given-names></name>, <name><surname>Thompson</surname><given-names>MG</given-names></name>, <name><surname>Shay</surname><given-names>DK</given-names></name>, <etal/>, <year>2013</year>
<article-title>Influenza vaccine effectiveness in the community and the household</article-title>. <source>Clin. Infect. Dis</source>. <volume>56</volume> (<issue>10</issue>), <fpage>1363</fpage>&#x02013;<lpage>1369</lpage>.<pub-id pub-id-type="pmid">23413420</pub-id></mixed-citation></ref><ref id="R37"><mixed-citation publication-type="journal"><name><surname>Patel</surname><given-names>MS</given-names></name>, <name><surname>Davis</surname><given-names>MM</given-names></name>, <year>2006</year>
<article-title>Could a federal program to promote influenza vaccination among elders be cost-effective?</article-title>
<source>Prev. Med</source>. <volume>42</volume> (<issue>3</issue>), <fpage>240</fpage>&#x02013;<lpage>246</lpage>.<pub-id pub-id-type="pmid">16480761</pub-id></mixed-citation></ref><ref id="R38"><mixed-citation publication-type="journal"><name><surname>Pike</surname><given-names>J</given-names></name>, <name><surname>Leidner</surname><given-names>A</given-names></name>, <name><surname>MacNeil</surname><given-names>J</given-names></name>, <name><surname>Cohn</surname><given-names>A</given-names></name>, <year>2019</year>
<article-title>Review of the economic evidence presented to the United States advisory committee on immunization practices, 2012&#x02013;2016</article-title>
<source>Vaccine</source>
<volume>37</volume> (<issue>1</issue>), <fpage>7</fpage>&#x02013;<lpage>10</lpage>.<pub-id pub-id-type="pmid">30473183</pub-id></mixed-citation></ref><ref id="R39"><mixed-citation publication-type="journal"><name><surname>Prosser</surname><given-names>LA</given-names></name>, <name><surname>O&#x02019;Brien</surname><given-names>MA</given-names></name>, <name><surname>Molinari</surname><given-names>NA</given-names></name>, <name><surname>Hohman</surname><given-names>KH</given-names></name>, <name><surname>Nichol</surname><given-names>KL</given-names></name>, <name><surname>Messonnier</surname><given-names>ML</given-names></name>, <etal/>, <year>2008</year>
<article-title>Non-traditional settings for influenza vaccination of adults: costs and cost effectiveness</article-title>. <source>PharmacoEconomics</source>
<volume>26</volume> (<issue>2</issue>), <fpage>163</fpage>&#x02013;<lpage>178</lpage>.<pub-id pub-id-type="pmid">18198935</pub-id></mixed-citation></ref><ref id="R40"><mixed-citation publication-type="journal"><name><surname>Reed</surname><given-names>C</given-names></name>, <name><surname>Chaves</surname><given-names>SS</given-names></name>, <name><surname>Kirley</surname><given-names>PD</given-names></name>, <name><surname>Emerson</surname><given-names>R</given-names></name>, <name><surname>NAragon</surname><given-names>D</given-names></name>, <name><surname>Hancock</surname><given-names>EB</given-names></name>, <etal/>, <year>2015</year>
<article-title>Estimating influenza disease burden from population-based surveillance data in the United States</article-title>. <source>PLoS One</source>
<volume>10</volume> (<issue>3</issue>), <comment>e0118369</comment>.</mixed-citation></ref><ref id="R41"><mixed-citation publication-type="journal"><name><surname>Shay</surname><given-names>DK</given-names></name>, <name><surname>Chillarige</surname><given-names>Y</given-names></name>, <name><surname>Kelman</surname><given-names>J</given-names></name>, <name><surname>Forshee</surname><given-names>RA</given-names></name>, <name><surname>Foppa</surname><given-names>IM</given-names></name>, <name><surname>Wernecke</surname><given-names>M</given-names></name>, <etal/>, <year>2017</year>
<article-title>Comparative effectiveness of high-dose versus standard-dose influenza vaccines among US medicare beneficiaries in preventing postinfluenza deaths during 2012&#x02013;2013 and 2013&#x02013;2014</article-title>. <source>J. Infect. Dis</source>. <volume>215</volume> (<issue>4</issue>), <fpage>510</fpage>&#x02013;<lpage>517</lpage>.<pub-id pub-id-type="pmid">28329311</pub-id></mixed-citation></ref><ref id="R42"><mixed-citation publication-type="journal"><name><surname>Singleton</surname><given-names>JA</given-names></name>, <name><surname>Poel</surname><given-names>AJ</given-names></name>, <name><surname>Lu</surname><given-names>PJ</given-names></name>, <name><surname>Nichol</surname><given-names>KL</given-names></name>, <name><surname>Iwane</surname><given-names>MK</given-names></name>, <year>2005</year>
<article-title>Where adults reported receiving influenza vaccination in the United States</article-title>. <source>Am. J. Infect. Control</source>
<volume>33</volume> (<issue>10</issue>), <fpage>563</fpage>&#x02013;<lpage>570</lpage>.<pub-id pub-id-type="pmid">16330304</pub-id></mixed-citation></ref><ref id="R43"><mixed-citation publication-type="journal"><name><surname>Smith</surname><given-names>JC</given-names></name>, <year>2010</year>
<article-title>The structure, role, and procedures of the US Advisory Committee on Immunization Practices (ACIP)</article-title>. <source>Vaccine</source>
<volume>28</volume>, <fpage>A68</fpage>&#x02013;<lpage>A75</lpage>.<pub-id pub-id-type="pmid">20413002</pub-id></mixed-citation></ref><ref id="R44"><mixed-citation publication-type="journal"><name><surname>Stout</surname><given-names>NK</given-names></name>, <name><surname>Lee</surname><given-names>SJ</given-names></name>, <name><surname>Schechter</surname><given-names>CB</given-names></name>, <name><surname>Kerlikowske</surname><given-names>K</given-names></name>, <name><surname>Alagoz</surname><given-names>O</given-names></name>, <name><surname>Berry</surname><given-names>D</given-names></name>, <etal/>, <year>2014</year>
<article-title>Benefits, harms, and costs for breast cancer screening after US implementation of digital mammography</article-title>. <source>J. Natl. Cancer Inst</source>. <volume>106</volume> (<issue>6</issue>), dju092.</mixed-citation></ref><ref id="R45"><mixed-citation publication-type="web"><collab>The World Bank</collab>, <year>2018</year>
<source>Consumer Price Index: United States</source>. Available from: <comment><ext-link ext-link-type="uri" xlink:href="https://data.worldbank.org/indicator/FP.CPI.TOTL?locations=US">https://data.worldbank.org/indicator/FP.CPI.TOTL?locations=US</ext-link>.</comment></mixed-citation></ref><ref id="R46"><mixed-citation publication-type="web"><collab>U.S. Preventive Services Task Force</collab>, <year>2018</year>
<source>USPSTF A and B recommendations</source>. <date-in-citation>updated April, 2018</date-in-citation> Available from: <comment><ext-link ext-link-type="uri" xlink:href="https://www.uspreventiveservicestaskforce.org/Page/Name/uspstf-a-and-b-recommendations/">https://www.uspreventiveservicestaskforce.org/Page/Name/uspstf-a-and-b-recommendations/</ext-link>.</comment></mixed-citation></ref><ref id="R47"><mixed-citation publication-type="journal"><name><surname>Udell</surname><given-names>JA</given-names></name>, <name><surname>Zawi</surname><given-names>R</given-names></name>, <name><surname>Bhatt</surname><given-names>DL</given-names></name>, <name><surname>Keshtkar-Jahromi</surname><given-names>M</given-names></name>, <name><surname>Gaughran</surname><given-names>F</given-names></name>, <name><surname>Phrommintikul</surname><given-names>A</given-names></name>, <etal/>, <year>2013</year>
<article-title>Association between influenza vaccination and cardiovascular outcomes in high-risk patients: a meta-analysis</article-title>. <source>JAMA</source>
<volume>310</volume> (<issue>16</issue>), <fpage>1711</fpage>&#x02013;<lpage>1720</lpage>.<pub-id pub-id-type="pmid">24150467</pub-id></mixed-citation></ref><ref id="R48"><mixed-citation publication-type="journal"><name><surname>White</surname><given-names>T</given-names></name>, <name><surname>Lavoie</surname><given-names>S</given-names></name>, <name><surname>Nettleman</surname><given-names>MD</given-names></name>, <year>1999</year>
<article-title>Potential cost savings attributable to influenza vaccination of school-aged children</article-title>. <source>Pediatrics</source>
<volume>103</volume> (<issue>6</issue>), <fpage>e73</fpage>.<pub-id pub-id-type="pmid">10353970</pub-id></mixed-citation></ref><ref id="R49"><mixed-citation publication-type="journal"><name><surname>White</surname><given-names>A</given-names></name>, <name><surname>Thompson</surname><given-names>T</given-names></name>, <name><surname>White</surname><given-names>MC</given-names></name>, <name><surname>Sabatino</surname><given-names>S</given-names></name>, <name><surname>Doria-Rose</surname><given-names>P</given-names></name>, <name><surname>Geiger</surname><given-names>A</given-names></name>, <etal/>, <year>2017</year>
<article-title>Cancer screening test use-United States, 2015</article-title>. <source>MMWR Morb. Mortal. Wkly Rep</source>. <volume>66</volume> (<issue>8</issue>), <fpage>201</fpage>&#x02013;<lpage>206</lpage>.<pub-id pub-id-type="pmid">28253225</pub-id></mixed-citation></ref><ref id="R50"><mixed-citation publication-type="journal"><name><surname>Xu</surname><given-names>J</given-names></name>, <name><surname>Zhou</surname><given-names>F</given-names></name>, <name><surname>Reed</surname><given-names>C</given-names></name>, <name><surname>Chaves</surname><given-names>SS</given-names></name>, <name><surname>Messonnier</surname><given-names>M</given-names></name>, <name><surname>Kim</surname><given-names>IK</given-names></name>, <year>2016</year>
<article-title>Cost-effectiveness of seasonal inactivated influenza vaccination among pregnant women</article-title>. <source>Vaccine</source>
<volume>34</volume> (<issue>27</issue>), <fpage>3149</fpage>&#x02013;<lpage>3155</lpage>.<pub-id pub-id-type="pmid">27161997</pub-id></mixed-citation></ref></ref-list></back><floats-group><fig id="F1" orientation="portrait" position="float"><label>Fig. 1.</label><caption><p id="P28">Diagram of search, identification, screening, and eligibility of included studies.</p></caption><graphic xlink:href="nihms-1050420-f0001"/></fig><fig id="F2" orientation="portrait" position="float"><label>Fig. 2.</label><caption><p id="P29">Summary of cost-effectiveness estimates of influenza vaccinations and other preventive services among U.S. adults.</p><p id="P30">QALY = quality-adjusted life-year. Cost-effectiveness ratios that were cost-saving are represented as a point on the x-axis. The &#x0201c;X&#x0201d; indicates a value that was truncated to simplify presentation, where the upper range of this value was $600,000/QALY saved.</p></caption><graphic xlink:href="nihms-1050420-f0002"/></fig></floats-group></article>