PLoS OnePLoS ONEplosplosonePLoS ONE1932-6203Public Library of ScienceSan Francisco, USA244981453909220PONE-D-13-2560610.1371/journal.pone.0087590Research ArticleMedicineClinical ImmunologyImmunityVaccinationVaccinesInfectious DiseasesViral DiseasesInfluenzaInfectious Disease ControlNon-Clinical MedicineHealth EconomicsCost EffectivenessHealth Care PolicyPediatricsScience PolicyScience Policy and EconomicsSocial and Behavioral SciencesEconomicsHealth EconomicsCost EffectivenessCost-Effectiveness AnalysisCost-Effectiveness of Alternative Strategies for Annual Influenza Vaccination among Children Aged 6 Months to 14 Years in Four Provinces in ChinaInfluenza Vaccination Cost-Effectiveness, ChinaZhouLei1*SituSujian2FengZijian1*AtkinsCharisma Y.3FungIsaac Chun-Hai34XuZhen5HuangTing6HuShixiong7WangXianjun8MeltzerMartin I.3Public Health Emergency Center, Chinese Center for Disease Control and Prevention, Beijing, ChinaU.S. Centers for Disease Control and Prevention, Beijing, ChinaU.S. Centers for Disease Control and Prevention, National Center for Emerging and Zoonotic Infectious Diseases, Division of Preparedness and Emerging Infections, Atlanta, Georgia, United States of AmericaDepartment of Epidemiology, Jiann-Ping Hsu College of Public Health, Georgia Southern University, Statesboro, Georgia, United States of AmericaKey Laboratory of Surveillance and Early-warning on Infectious Disease, Division of Infectious Disease, Chinese Center for Disease Control and Prevention, Beijing, ChinaSichuan Center for Disease Control and Prevention, Chengdu, Sichuan, ChinaHunan Center for Disease Control and Prevention, Changsha, Hunan, ChinaShandong Center for Disease Control and Prevention, Jinan, Shandong, ChinaXuJianqingEditorFudan University, China* E-mail: fengzj@chinacdc.cn (ZF); zhoulei@chinacdc.cn (LZ)

Competing Interests: The authors have declared that no competing interests exist.

Conceived and designed the experiments: LZ ZJF. Performed the experiments: LZ SJS CYA ICHF MIM. Analyzed the data: LZ SJS CYA ICHF MIM. Contributed reagents/materials/analysis tools: LZ SJS CYA ICHF MIM. Wrote the paper: LZ. Interpreted the findings, commented on and helped revise drafts of the manuscrip: SJS MIM ICHF CYA. Assisted in data collection and management: ZX TH SXH XJW.

2014311201491e875902162013301220132014This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.Background

To support policy making, we developed an initial model to assess the cost-effectiveness of potential strategies to increase influenza vaccination rates among children in China.

Methods

We studied on children aged 6 months to 14 years in four provinces (Shandong, Henan, Hunan, and Sichuan), with a health care system perspective. We used data from 2005/6 to 2010/11, excluding 2009/10. Costs are reported in 2010 U.S. dollars.

Results

In comparison with no vaccination, the mean (range) of Medically Attended Cases averted by the current self-payment policy for the two age groups (6 to 59 months and 60 months to 14 years) was 1,465 (23∼11,132) and 792 (36∼4,247), and the cost effectiveness ratios were $ 0 (-11-51) and $ 37 (6-125) per case adverted, respectively. In comparison with the current policy, the incremental cost effectiveness ratio (ICER) of alternative strategies, OPTION One-reminder and OPTION Two-comprehensive package, decreased as vaccination rate increased. The ICER for children aged 6 to 59 months was lower than that for children aged 60 months to 14 years.

Conclusions

The model is a useful tool in identifying elements for evaluating vaccination strategies. However, more data are needed to produce more accurate cost-effectiveness estimates of potential vaccination policies.

This study was supported by the China-U.S. Collaborative Program on Emerging and Re-emerging Infectious Diseases. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.Introduction

Influenza can increase acute respiratory infections and hospital admissions, imposing a significant burden of illness among vulnerable groups including children. The World Health Organization (WHO) and many countries recommend annual influenza vaccines for children [1]–[3]. In 2003, the Chinese Ministry of Health issued the first guidance on seasonal influenza vaccination [4]. Prior to the start of each influenza season since 2007, the Chinese Center for Disease Control and Prevention (China CDC) released annual seasonal influenza vaccination guidance recommending that children should be included in the priority population [5]–[8]. Nonetheless, the influenza vaccination rate among children in China remains low, in part due to a low level of available vaccine supply sufficient for 1.9% of the Chinese population [9].

China's influenza vaccination program is administered by the CDC system. Every year, local governments authorize local CDCs to purchase vaccine before the influenza season and deploy to vaccination clinics. These clinics are usually located in close proximity to the local CDC or other community health care centers, but not in hospitals. Patients have to pay for the vaccination, except in a few cities such as Beijing. The influenza vaccination policy has not been modified for many years because decision makers lack scientific evidence on the impact of alternative strategies.

The objective of this study is to present for public health policy makers, an initial model, using both available data and assumptions, to evaluate the cost-effectiveness of the current influenza vaccination policy in children as well as other alternative influenza vaccination strategies in China.

Methods

We built a spreadsheet-based model to evaluate the cost-effectiveness of current seasonal influenza vaccination policies in children aged 6 months to 14 years in four provinces (Shandong, Henan, Hunan, and Sichuan) in China. We also developed a methodology to evaluate the cost-effectiveness of using alternative strategies to increase the influenza vaccination coverage rate among children in China. All analyses are from the health care system perspective with the government as the payer. Our study focused on patients who attended government-run hospitals and clinics. Costs are reported in 2010 U.S. dollars. We did not discount any cost or health outcomes as each influenza season lasts less than one year.

Variables to estimate the number of cases

The population (P) for the model was census data for calendar year 2009 [10]. Two age groups of children were analyzed, 6 to 59 months and 60 months to 14 years. See Table S1 in Appendix S1 for specific provincial population numbers.

We used five years of epidemiological data from the season 2005/06 to 2010/11 according to Chinese Influenza-Like-Illness (ILI) sentinel surveillance system, excluding the 2009/10 season which was influenza pandemic, causing an extraordinary public health response with large vaccination coverage [11]. See Table S2 in Appendix S1 for specific seasonal and provincial numbers.

Number of outpatients and inpatients: We estimated the number of confirmed influenza outpatients among children using the following equation:

# confirmed influenza outpatients  =  rate of outpatient visits (p1)×rate of ILI cases in outpatients (p2) ×influenza positive rate among ILI (p3) ×population (P)

Data for the rate of outpatient visits for all causes (p1) (Table 1) came from the 4th National Health Services Survey [12], which asked for respondents' outpatient visits in the previous two weeks. Assuming the influenza season lasted for 24 weeks, we then multiplied the rate of outpatient visits in 2 weeks by 12 to get the overall rate of the influenza season.

10.1371/journal.pone.0087590.t001Epidemiology input data of model.
Parameter and definitionAge groupMean or Median (range)Source
PPopulation6–59 ms14,301,091Statistic yearbook in China, 2009 [10]
60 ms-14 yrs45,737,342
p1Number of outpatients of age specific visit per 100 persons of all age for any cause in influenza season (6 months)6–59 ms297.604th national health service research in 2008 [12]
60 ms-14 yrs109.20
p2ILI of age specific per 100 outpatients of all age6–59 ms1.58 (0.22, 3.30)ILI sentinel surveillance, CCDC (from 05/06 to 10/11 except 09/10 season)
60 ms-14 yrs0.55 (0.16, 0.99)
p3Influenza positive per 100 ILI with lab test of age specific6–59 ms9.08 (6.95, 11.30)ILI sentinel surveillance, CCDC (from 05/06 to 10/11 except 09/10 season)
60 ms-14 yrs17.47 (14.77, 22.72)
p4ILI outpatients of age specific per SARI hospitalization in same SARI sentinel hospital6–59 ms5.63 (0.32–593.63)Data of cost survey in three SARI sentinel hospitals in 2011
60 ms-14 yrs8.58 (0.75–941.00)
p5Number of influenza positive per 100 SARI cases6 ms-14 yrs14.97Data of cost survey in three SARI sentinel hospitals in 2011
VCRInfluenza vaccination coverage rate (%)6–59 ms11.85 (1.18, 37.69)(1)VCR of 05/06-08/09 are assumed as ratio of sales vs pop, and VCR of two age groups are assumed same; (2)VCR of 10/11 and 11/12 were from telephone survey in five provinces conducted by CCDC in 2011
60 ms-14 yrs10.81 (1.18, 39.09)
VEInfluenza vaccine effectiveness (%)6 ms-14 yrs61 (52, 68)A.S. Monto et al, 2009 [15], D.M. Skowronski et al, 2007 [16], [17] Eelko Hak, et al, 2000 [18], Steens A, et al, 2011 [19]

The rate of ILI (p2) and influenza positive rate among ILI (p3) were from the Chinese ILI sentinel surveillance system, which records demographic, clinic visit and laboratory testing data by specific province.

We used the following equation to calculate the number of confirmed influenza inpatients:

# confirmed influenza inpatients =  ((rate of outpatient visits (p1) × rate of ILI cases in outpatients (p2))/rate of ILI outpatients per Severe Acute Respiratory Infection (SARI) hospitalization (p4)) ×influenza positive rate among SARI cases (p5) ×population (P)

We used Chinese sentinel SARI surveillance data, from Oct 1, 2010 to Mar 31, 2011, to calculate the rate of ILI outpatients per SARI inpatient (p4) (Table 1). The SARI surveillance hospitals were also the ILI surveillance hospitals. Patients who met the SARI definitions [13] were eligible for enrollment and nasopharyngeal and throat swabs were collected for influenza viruses testing as described previously [13], [14]. Once each SARI case is tested for influenza virus, we then have the influenza positive rate per 100 SARI cases (p5).

Number of cases adverted: We collected the age and province specific influenza vaccination coverage rate for seasons 2010/11 and 2011/12 from telephone surveys conducted by China CDC in 2011 (Table 1 and Table S3 in Appendix S1) [15]. We also used the annual sales of influenza vaccine to estimate the coverage rate for season 2005/06 to 2008/09, and assumed the coverage rate was the same for children in both age groups.

The influenza vaccine effectiveness by age group was collected from published literature [16]–[20]. The mean was 61% with range of 52% to 68% (Table 1).

In this study we used the health outcome of Medically Attended Cases (MAC), excluding those who do not seek medical care in public health facilities.

We applied the following equation to generate the number of cases averted:

# cases averted (both outpatient and inpatient)  =  (# confirmed influenza outpatients + # confirmed influenza inpatients)/(1 – % vaccine coverage×% vaccine effectiveness) ×% vaccine coverage×% vaccine effectiveness

Variables used to estimate the economic impact of vaccination

Program and vaccine cost: Data were not available on the programmatic cost of the influenza vaccination program in China. However, the Expanded Program of Immunization (EPI) system shares the same management system with the influenza vaccination program and those data are documented in previous reports [21]. The programmatic cost of the EPI system per dose per child was $ 1.69, including staff payment at provincial, prefecture and county level, program operation (i.e. advertisement, training, and monitoring), logistics, and cold-chain (Table 2).

10.1371/journal.pone.0087590.t002Cost input data of model.
Parameter and definitionGroupValue (US$)Source
Mean cost of EPI system per child per doseTotal programmatic cost1.69WZ Yu, et al, 2006 [19]
staff payment0.52
program operation0.73
logistics0.35
cold-chain0.09
Cost of influenza vaccine per doseGovernment purchase price3.95Sichuan's data, authors' unpublished data
Vaccination feeVaccination fee to parents5.61Sichuan's data, authors' unpublished data
Net cost of influenza vaccination program to government per child per doseCurrent policy0.03Model calculation
Cost of confirmed influenza outpatient aged 6ms-14 yrsDirect medical cost11.28Zhou L, et al, 2013 [13]
Cost of confirmed influenza inpatient aged 6ms-14 yrsDirect medical cost284.44

In China, influenza vaccines are purchased from both domestic and international suppliers. We assumed that vaccine cost was the same as the purchase price. In season 2010/11, the mean (range) government purchase price of influenza vaccine for children was $ 3.20 (2.89–3.38) for domestic suppliers and $ 6.59 (6.43–6.75) for international suppliers.

Based on sales from 2010/11, we estimated that 78% of the vaccines purchased were from domestic suppliers and 22% were from international suppliers [9]. Therefore our weighted average of government purchase price was $ 3.95.

Under the current policy, patients pay $ 4.52 (3.94–4.87) for domestic vaccine and $ 9.49 (8.57–9.65) for vaccines produced by international companies (authors' unpublished data), with a weighted average of $ 5.61 in the four provinces.

We used the following equation to determine the cost of the influenza vaccination program to the government (per child per dose) under the current self-payment policy:

Cost of influenza vaccination program to the government (per child per dose)  =  Programmatic cost per child per dose + cost of influenza vaccine per dose to government - price paid by parents per dose  =  $1.69 + $3.95 − $5.61  =  $ 0.03.

Cost of illness (Outpatient and inpatient costs): We used the health care system perspective with the government as the payer. Our study focused on patients who attended government-run hospitals and clinics, and we only included the cost borne by the health care system. We did not include patient co-payments, direct non-medical cost and lost productivity.

The cost of confirmed influenza outpatient and inpatient cases for children aged 6 months to 14 years was estimated $ 11.28 and $ 284.44, respectively. The estimated reimbursement rate from the survey was 19.25% for children. Parents paid the remainder. Therefore, the health care system paid $2.17 per outpatient case and $54.67 per inpatient case. The estimated cost and reimbursement rate was based on a survey [13].

Cost-effectiveness analysis of the current policy

Expected costs, outcomes, and cost effectiveness ratios (CERs) were calculated in the spreadsheet model for each of the four provinces and the two age groups from season 2005/06 to 2010/11, excluding season 2009/10. CERs were reported as cost per case averted for the current influenza vaccination program compared with no vaccination.

We used historical data on clinical visits and vaccination coverage rates in the four provinces as the best available data to model the natural fluctuation of influenza prevalence and vaccination coverage rate.

The equation below was used to calculate the CERs:

$ Cost per case adverted  =  Net cost/# cases averted  =  ($ cost of influenza vaccination program –$ health care cost saved)/# cases averted

Evaluation of alternative strategies to increase vaccination rate

We also used this model to evaluate the cost-effectiveness of alternative strategies.

Price and demand curve: To explore the impact on demand due to change in vaccine price to parents, we drew a price and demand curve (Figure 1). Given that the Beijing public health authority began to subsidize influenza vaccination for school children in 2007 and to provide free influenza vaccination to school children in 2009 [22], we compared vaccination coverage rates in Beijing before and after subsidy and free vaccination. We also analyzed vaccine coverage rates in Sichuan pre- and post-pandemic to illustrate the effects of other factors, since there was no change in price.

10.1371/journal.pone.0087590.g001Impact on demand due to price of vaccine change to the parents.

This figure used data of vaccination coverage rate and vaccine price to the parents in Beijing and Sichuan Province from season 05/06 to 11/12, excluding 09/10 the pandemic season. Beijing initiated an influenza vaccination subsidy policy for children and the elderly in 2007 and 2008, and has provided free influenza vaccine for children and the elderly since 2009.

OPTION description and assumptions: Experience from other countries suggests that measures such as providing vaccination reminders, sending free vaccination vouchers to parents, and expanding vaccination sites could increase influenza vaccination rates [23]–[25]. We constructed two alternative OPTIONs for increasing vaccination rates based on these experiences with adjustment for the Chinese situation.

OPTION One is a telephone reminder to parents of targeted children for influenza vaccination. For example, staff in the EPI system can call parents before influenza season, reminding them to bring their children for influenza vaccination. To capture different levels of impact by this measure, we assumed this could increase the vaccination rate by 5%, 10%, and 15%. We also assumed that the current system could absorb a 5% and 10% increase in vaccination rate, and the program cost per child was assumed to be the same as prior. When the vaccination rate increased by 15%, we assumed that the current system would require additional resources to meet the demand, so the programmatic cost per child would be 1.5 times prior cost (Table 3).

10.1371/journal.pone.0087590.t003Impact of illustration potential options to increase influenza vaccination rate among children (6 months to 14 years) in China.
MeasuresInput variableValueSource
OPTION One: recall/text message reminderImpact of increasing vaccination rate (%)5, 10, 15Eelko Hak, et al, 2000 [17] and assumption
Cost of EPI system (US$)Prior: $1.69Assumption
If vaccination rate increases 5%same with prior $
If vaccination rate increases 10%same with prior $
If vaccination rate increases 15%1.5 times of prior $Assumption
Cost of Recall (US$)0.17
staff cost0.14
Telephone charge0.03
OPTION Two: free vouchers and expanding vaccination sitesImpact of increasing vaccination rate (%)10, 15, 25Rancé F, et al, 2008 [22], Daley MF, et al, 2004 [23], Britto MT, et al, 2007 [24] and assumption
Cost of EPI system (US$)Prior: $1.69Assumption
If vaccination rate increases 10%same with prior $
If vaccination rate increases 15%1.5 times of prior $
If vaccination rate increases 25%2.5 times of prior $
Cost of measure (US$)0.73, 0.84, 1.18
Voucher print cost (per copy)0.07Assumption
Staff cost0.033, 0.050, 0.100Assumption
Staff payment per person month443.16
Staff working months6
Staff working time (%)25, 50, 50
Number of hospital expanded
If vaccination rate increases 10%In general hospitals (mean = 745, range 500–892)Assumption
If vaccination rate increases 15%In general hospitals and half of the other hospitals (mean = 922, range 627–1102)
If vaccination rate increases 25%All hospitals (mean = 1117, range 768–1319)

OPTION Two is a comprehensive package consisting of providing vouchers for free vaccination, and expanding vaccination sites to include hospitals. We assumed that this comprehensive measure could increase the vaccination rate by 10%, 15%, and 25%, and the programmatic cost with this measure was assumed to be the same as prior, 1.5 times, and 2.5 times prior cost, respectively.

To meet the increasing demand of vaccination clinics caused by the increase in vaccination rate, we assumed that in OPTION Two, vaccination sites will be expanded in hospitals in the following order: (1) general hospitals for a 10% increase in vaccination coverage rate, (2) further expanded to half of traditional and specialized hospitals for a 15% increase, and (3) to all hospitals for a 25% increase (Table 3) [12]. We assumed there will be one nurse working in each vaccination site.

Incremental cost effectiveness ratio: We then used the spreadsheet-based model to calculate the incremental cost effectiveness ratio (ICER) for each option, compared with the current situation of the self-payment policy using the formula below:

ICER (for different options, age groups, and provinces)  =  $ incremental net cost/# incremental cases averted  =  ($ incremental cost of influenza vaccination program – $ incremental cost of health care saved)/(# cases averted by the option – # cases averted in current situation)

Sensitivity analyses

Although we examined the impact of a wide range of values for a number of critical inputs (Tables 1 and 2), the spreadsheet model allows a user to further explore the impact of changes in input values, either as assumptions or as additional data from the field becomes available.

Ethics statement

The study was reviewed and approved by the Chinese Center for Disease Control and Prevention Institute Review Board which is registered with the Office for Human Research Protections (active no. in 2012 was IRB 00005183) and has a US Federal Wide Assurance (FWA 00002896). As a study on in-hand surveillance and survey data with no personal contact and no collection of personal data, the Chinese Center for Disease Control and Prevention Institute Review Board waived the need for written informed consent from the individuals.

ResultsCurrent situation

The mean (per season) MAC averted for the two age groups (6 to 59 months and 60 months to 14 years) was 1,465 (range: 23∼11,132) and 792 (36∼4,247), respectively, during the studied five influenza seasons (Table 4).

10.1371/journal.pone.0087590.t004Cost effectiveness of current influenza vaccination intervention by province and age group in four provinces without subsidy policy in China, comparing with no vaccination.
Age groupMean # MAC averted (range)Mean $ of program (range)Mean $ Net cost(range)Mean CER for one MAC averted (range)
6–59 ms1,465(23∼11,132)6,983(837∼36,209)−11,430(−111,829∼2,411)0(−11∼51)
60ms-14yrs792(36∼4,247)17,918(2,677∼92,195)11,965(1,851∼59,412)37(6∼125)

The cost of the influenza vaccination program to government for the two age groups was $ 6,983 and $ 17,918, and the CER was $ 0 (−11∼51) and $ 37 (6∼125) per case adverted, respectively (Table 4). For age group 6–59 months, the vaccination program was cost-saving in Henan and Hunan in all studied seasons, in Shandong in season 05/06 and 10/11, and in Sichuan in season 10/11. For age group 60 months to 14 years, it was not cost saving in any season.

Alternative OPTIONs

Cost of OPTIONs: Results for the two alternative strategies are shown in Table 5 and specific seasonal and provincial data are in Table S6 in Appendix S1.

10.1371/journal.pone.0087590.t005Example illustration of options to increase influenza vaccination coverage: effectiveness and cost of options comparing with the current situation in four provinces currently without subsidy policy.
ItemOPTION One: telephone reminderOPTION Two: comprehensive package (free vaccination voucher, and expanding vaccination sites in hospitals)
Increasing vaccination rate5%10%15%10%15%25%
Additional $ of program per child per doseProgrammatic cost0.170.171.0150.730.841.18
Vaccine cost to government---3.953.953.95
6–59 msMean # MAC averted (range)6,518(2,355∼11,689)6,829(2,467∼12,245)7,139 (2,579∼12,802)6,829(2,467∼12,245)7,139(2,579∼12,802)7,760(2,803∼13,915)
Mean $ additional Net cost (range)2,524,821(1,942,053∼3,325,135)2,522,563(1,936,598∼3,322,974)1,148,715(888,580∼1,725,849)8,908,801(7,336,618∼12,935,033)10,636,205(8,762,536∼15,413,691)12,045,936(9,287,728∼18,047,836)
60 ms-14 yrsMean # MAC averted (range)3,263(1,921∼4,459)3,418(2,012∼4,672)3,574(2,104∼4,884)3,418(2,012∼4,672)3,574(2,104∼4,884)3,884(2,287∼5,309)
Mean $ additional Net cost (range)2,568,540(1,980,268∼3,382,730)2,572,432(1,983,057∼3,388,644)3,906,746(3,047,917∼5,791,743)26,113,358(20,810,630-38,346,291)31,328,683(24,966,635-45,977,245)40,419,128(31,503,999-59,957,413)

OPTION One would cost an additional $ 0.17 per child per dose for 5% and 10% increased vaccination rate, and $ 1.02 per child per dose for 15% increased vaccination rate. While OPTION Two would require an additional programmatic cost of $ 0.73, $ 0.84, and $ 1.18 for 10%, 15%, and 25% increased vaccination rate, respectively, including the cost of printing vouchers and staff payment for nurses working in the expanded vaccination sites in hospitals (Table 5). OPTION Two also assumes that the government is paying for the vaccine, which means an additional $3.95 per child per dose.

The additional net cost of OPTION One for 5% and 10% influenza vaccination rate increase was more than $ 2.5 million for both age groups. The additional net cost of OPTION One for a 15% increase in the 60 months to 14 years age group was around $ 3.9 million, more than triple that for the 6–59 months age group (approximately $ 1.1 million) (Table 5).

The additional net cost of OPTION Two was much higher than that of OPTION One. The mean additional net cost of OPTION Two was around $ 9–12 million and $ 26–40 million for the 6–59 months and 60 months to 14 years age group, respectively (Table 5).

Health Outcomes: The additional numbers of MAC averted by OPTION One for the 6–59 months age group were 6,518 for a 5% increase in influenza vaccination rate, 6,829 for 10% increase, and 7,139 for a 15% increase, around double that of the 60 months to 14 years age group. Similar results were found for numbers of MAC averted by OPTION Two for both age groups (Table 5).

Cost Effectiveness: In comparison with no vaccination, the mean (range) of MAC averted by the current self-payment policy for the two age groups (6 to 59 months and 60 months to 14 years) was 1,465 (23∼11,132) and 792 (36∼4,247), respectively, during the studied five influenza seasons. The total influenza vaccination program cost to government for the two age groups was $ 6,983 and $ 17,918, and the CER was $ 0 (−11∼51) and $ 37 (6∼125) per case adverted, respectively. In comparison with the current policy, the ICER of alternative strategies, OPTION One-telephone reminder and OPTION Two-comprehensive package, decreased as influenza vaccination rate increased. For instance, the highest ICER for OPTION One was $28,118 at a vaccination rate of 5% for children aged 60 months-14 years, but as the vaccination rate increased to 15% the ICER was reduced to $5,838. In OPTION Two, the highest ICER was found to be $113,757 for children 60 months-14 years at a vaccination rate of 10%, but when the vaccination rate increased to 25% the ICER decreased to $36,279. In both OPTIONs, it is concluded that vaccinating children aged 6–59 months is more cost-effective than vaccinating older children (Figure 2). The province specific cost effectiveness of the two OPTIONs is in Table S6 in Appendix S1.

10.1371/journal.pone.0087590.g002Incremental cost effectiveness ratio (ICER) of two potential strategies to increase influenza vaccination coverage rates among children by age groups in China comparing with the base situation of current policy.

OPTION One includes a single telephone vaccination reminder. OPTION Two includes comprehensive measures of free vaccination voucher, and expanding vaccination sites in hospital clinics. The bars in each column shows the ranges due to differences in input values such as rates of influenza like illness (ILI), vaccine effectiveness, and program costs (c.f., Tables 1 and 2).

Discussion

Under the current situation, the influenza vaccination program is more cost-effective among children 6 to 59 months than children 60 months to 14 years old. It costs $0 ($-11∼$51) per case averted among children aged 6–59 months, while it costs $37 ($6∼$125) among children aged 60 months to 14 years old per case averted. Cost-savings was observed among children 6–59 months when the influenza virus was more active and the vaccination rate was relatively high.

The price and demand curve (Figure 1) illustrated that reducing the price of influenza vaccination to parents has a limited effect on increasing the vaccination rate. Alternative strategies are needed in order to increase coverage and thus prevent more influenza cases and related economic loss. Our model was built to demonstrate the potential impact of various policy options.

Both alternative OPTIONs demonstrated in our model had a broad range of ICERs, OPTION One-sending reminder ranged from $590 to $28,118, while OPTION Two-comprehensive measures ranged from $3,753 to $ 113,757.

Switching from the current policy to the alternative OPTION would dramatically increase the vaccination program cost, from $0.03 to more than $5.64 per person per dose at the highest. It requires a significant expenditure. Meanwhile, health care cost saved from additional case averting was relatively low. The estimated cost of influenza outpatient and inpatient was $11.28 and $284.44, which was much lower than that in other countries. Furthermore, the current reimbursement rate of health insurance for children in the four provinces was estimated 19.25% based on a survey [13]. So we anticipate that in places with higher medical cost or better health insurance coverage, an influenza vaccination program will save more health care costs.

The health care utilization pattern revealed in this study may also be the reason for the relatively small number of MAC cases averted. There appeared to be a higher rate of visits to the hospital among patients with severe disease than mild. The rate of outpatients per hospitalization is notably low (i.e. one hospitalized SARI case per 6–9 outpatients) compared to the rate of other countries. For example, in the U.S. the rates of outpatient visits and hospitalizations vary greatly by age and season. The risk of hospitalization for 6–23 month old children, given an outpatient visit, can vary, from one hospitalization for every 18 to 42 outpatient visits. Among older children, where the risk of hospitalization drops, the rate can increase to 52 [26]–[27].

The wide range of ICERs of the two alternative OPTIONs(mean range of two OPTIONs: $1,600∼$87,908) were associated with the large variability in the four provinces, in terms of population size, social economic level, health service utilization, influenza prevalence, influenza vaccination coverage rate, etc. It indicated that in a country with huge disparities like China, decision-making may require more specific data to account for different situations. Our model allows for more precise estimates of influenza prevalence, vaccine effectiveness, disease associated medical costs, and increase in vaccination coverage rate by options and other inputs. It is not limited to the illustrated OPTION One and OPTION Two. It can be a useful tool for evaluation of other alternative strategies, as well as among other populations.

There are a number of limitations to this study, mostly due to lack of available data. We again stress that the objective of this study is to help public health officials assess the value of both investing in such potential programs, as well as collecting additional data to replace the assumptions used here. Although there is vast literature on the epidemiology of influenza, specific data were not always available, thus we had to make some assumptions. For example, to estimate the number of cases, we assumed that outpatient visit (p1) was constant throughout the year. It is possible that there is a seasonal pattern to this value, with an increase during influenza circulation months, which would increase our estimate of influenza cases. On the other hand, we used 24 weeks for the influenza season, which may overestimate the rate of cases seeking medical care for influenza.

Also, the cost of illness from the survey may be biased since study participants came from SARI sentinel surveillance hospitals and most were severe cases. However, it was much lower than the $624 per hospitalized case reported in the Suzhou study [28]. The difference may be influenced by local economics as our study sites are less developed than Suzhou. If hospitalization cost in our model increased to $624 (the governmental cost would increase from $54.67 to $120.12), we would have lower ICERs. It implied that in places with higher economic burden of influenza, the vaccination strategies could be more cost-effective.

Our model is a static model, which does not take into account an intervention's impact upon onwards transmission. This model only incorporates the direct effect of a vaccine, that of protecting an individual from getting sick, whereas a dynamic model (e.g. an ordinary differential equation model) will take into account onwards transmission. Hence, this model is used as a tool to communicate to policy-makers the various options available and their relative impact. Its strengths include the fact that it is relatively simple and easy-to-understand, despite its many limitations.

Furthermore, we used the perspective of the health care system, which only captured the cost and benefit to the health care system. Many studies have shown that lost productivity due to influenza infection among children is substantial [29]; therefore, a more comprehensive societal viewpoint may lead to different cost-effectiveness ratios.

Conclusion

The spreadsheet-based model we developed is a useful tool in identifying the elements for the cost-effectiveness analysis of using alternative strategies to increase influenza vaccination coverage rate in children. However, to produce more accurate estimates of cost-effectiveness among vaccination policies, more data are needed.

Supporting Information

File includes Tables S1-S4. Table S1. General information of the five provinces/municipalities. This table provides general information, including areas, overall population, GDP per capita and population aged 6 months to 14 years, of the five provinces (the four studied province Shandong, Henan, Hunan, Sichuan and the compared municipality Beijing). Table S2. Epidemiologic inputs by province, season, and age group. This table showed the epidemiologic inputs that were used to calculate case numbers by province, season and age group from season 05/06 to 10/11, excluding 09/10 the pandemic season. Table S3. Current situation: influenza vaccination coverage rates among target populations by province, season and age group, influenza vaccine effectiveness by season for all ages. This table used data of vaccination coverage rate and effectiveness of influenza vaccine by province from season 05/06 to 11/12, excluding 09/10 the pandemic season. Table S4. Number of influenza cases and cases averted by vaccination program. It showed the calculation results of number of cases and cases averted by the vaccination program, comparing with no vaccination, from season 05/06 to 10/11, excluding 09/10 the pandemic season. Table S5. Current situation: Cost effectiveness of influenza vaccination program in season 05/06-10/11, 09/10 not included; by province, season and age group. Demonstration of results on cost- effectiveness of comparing the current pay-out-of-pocket policy with no vaccination. Table S6. A: cost-effectiveness of OPTION 1-reminder, by province and age group. Demonstration of results on cost-effectiveness of comparing the current situation with two OPTIONS: OPTION 1 reminder and OPTION 2- sending free influenza vaccination voucher and expanding vaccination sites.

(DOCX)

Click here for additional data file.

We thank Sichuan, Hunan and Shandong provincial CDC and sentinel surveillance hospitals for providing assistance on economic data collection; and the Office for Respiratory Infection Disease Control and Prevention, Division of Infectious Disease, and the China CDC for providing assistance on epidemiological data collection. We would like to thank Dr. Rebekah H. Borse formerly employed at U.S. CDC Atlanta, currently working at Merck Pharmaceuticals for advice on the development of model and manuscript draft preparation. We would like to thank Dr. Manjunath Shankar at the U.S. CDC Atlanta for his advice on certain aspects of the model. We would also thank Jeffery McFarland and Song Ying in U.S. CDC China for providing valuable contributions during the course of the project and Carrie Reed from the Influenza Division at the U.S. CDC Atlanta for helping with the influenza vaccine effectiveness data collection. Lastly, we acknowledge Serena Fuller in U.S. CDC for helping with the manuscript editing.

ReferencesWorld Health Organization. Vaccine use: WHO recommends annual vaccination for (in order of priority). Available: http://www.who.int/influenza/vaccines/use/en/ Accessed 14 June 2013.Centers for Disease Control and Prevention. Seasonal Influenza (Flu): Recommendations of the Advisory Committee on Immunization Practices (ACIP). Available: http://www.cdc.gov/flu/professionals/acip/index.htm Accessed 14 June 2013.van EssenGA, PalacheAM, ForleoE, FedsonDS (2003) Influenza vaccination in 2000: recommendations and vaccine use in 50 developed and rapidly developing countries. Vaccine21: 1780–178512686094Ministry of Health of People's Republic of China. Guideline on seasonal influenza vaccination. Available: http://www.moh.gov.cn/publicfiles/business/htmlfiles/mohbgt/pw10303/200804/18615.htm Accessed 14 June 2013.Chinese Center for Disease Control and Prevention (2007) Guideline on seasonal influenza vaccination during the 2007–2008 season in China; 2007. Zhong Hua Liu Xing Bing Xue Za Zhi28: 1144–1145Chinese Center for Disease Control and Prevention(2008). Guideline on seasonal influenza vaccination during the 2008–2009 season in China; Available: http://www.hbzjcdc.com/main/guifanfangan/200810/641.htmAccessed 14 June 2013.Chinese Center for Disease Control and Prevention(2009) Guideline on seasonal influenza vaccination during the 2009–2010 season in China; Available: http://www.gszhuanglang.gov.cn/jkzx/wzgg/content_4567_13689Accessed 14 June 2013.Chinese Center for Disease Control and Prevention(2010)Guideline on seasonal influenza vaccination during the 2010–2011 season in China. Available: http://www.chinacdc.cn/tzgg/201011/t20101124_40513.htm Accessed 14 June 2013.FengL, MountsAW, FengY, LuoY, YangP, et al (2010) Seasonal influenza vaccine supply and target vaccinated population in China, 2004-2009. Vaccine28: 6778–6782doi: 10.1016/j.vaccine.2010.07.064. Epub 2010 Aug 320688038National Bureau of Statistics of China (2010) China statistical yearbook 2010. Beijing: China Statistics Press.LiangW, FengL, XuC, XiangN, ZhangY, et al (2012) Response to the first wave of pandemic (H1N1) 2009: Experiences and lessons learnt from China. Public Health126: 427–436doi: 10.1016/j.puhe.2012.02.008. Epub 2012 Apr 1822516790Ministry of Health of People's Republic of China (2008) The 4th National Health Service Survey.ZhouL, SituS, HuangT, HuS, WangX, et al (2013) Direct Medical Cost of Influenza-Related Hospitalizations among Severe Acute Respiratory Infections Cases in Three Provinces in China. PLoS ONE8(5): e63788doi:10.1371/journal.pone.006378823717485Chinese Center for Disease Control and Prevention (2011). SARI surveillance protocol [in Chinese]. Available: http://www.chinacdc.cn/jkzt/crb/lxxgm/jszl_2251/201111/t20111117_54776.htm Accessed 31 January 2013.ZhouL, SuQ, XuZ, FengA, JinH, et al (2013) Seasonal Influenza Vaccination Coverage Rate of Target Groups in Selected Cities and Provinces in China by Season (2009/10 to 2011/12). PLoS ONE8(9): e73724doi:10.1371/journal.pone.007372424040041MontoAS, OhmitSE, PetrieJG, JohnsonE, TrusconR, et al (2009) Comparative Efficacy of Inactivated and Live Attenuated Influenza Vaccines. N Engl J Med361: 1260–1267doi: 10.1056/NEJMoa080865219776407SkowronskiDM, De SerresG, DickinsonJ, PetricM, MakA, et al (2009) Component-specific effectiveness of trivalent influenza vaccine as monitored through a sentinel surveillance network in Canada, 2006–2007. J Infect Dis199: 168–179doi: 10.1086/59586219086914Skowronski DM, Masaro C, Kwindt TL, Mak A, Petric M, et al. (2007) Estimating vaccine effectiveness against laboratory-confirmed influenza using a sentinel physician network: Results from the 2005–2006 season of dual A and B vaccine mismatch in Canada. Vaccine 25: :2842–2851. Epub 2006 Oct 16.HakE, HermensRP, HoesAW, VerheijTJ, KuyvenhovenMM, et al (2000) Effectiveness of a co-ordinated nation-wide programme to improve influenza immunisation rates in the Netherlands. Scand J Prim Health Care18: 237–24111205093Steens A, van der Hoek W, Dijkstra F, van der Sande M. (2011) Influenza vaccine effectiveness, 2010/11. Euro Surveill16(15): :pii = 19843. Available online: http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=19843YuW, YuJ, CuiG, JinS, WangJ, et al (2006) Study on the reasonable cost of national immunization program in some regions of China. Chinese J of Vaccines and Immunization4: 280–284Beijing Center for Disease Control and Prevention. News: Elder people and school children can receive free influenza vaccination in Beijing. Available: http://www.bjcdc.org/news.php?id=36641 Accessed 14 June 2013.RancéF, ChaveC, de BlicJ, DeschildreA, DonatoL, et al (2008) Influenza vaccination coverage in asthmatic children in Fance in 2006–2007 (article in French). Arch Pediatr11: 1724–172819090033DaleyMF, BarrowJ, PearsonK, CraneLA, GaoD, et al (2004) Identification and Recall of Children With Chronic Medical Conditions for Influenza Vaccination. Pediatrics113: e26–e3314702491BrittoMT, SchoettkerPJ, PandzikGM, WeilandJ, MandelKE (2007) Improving influenza immunisation for high-risk children and adolescents. Qual Saf Health Care16: 363–368doi:10.1136/qshc.2006.01938017913778MeltzerMI, NeuzilKM, GriffinMR, FukudaK (2005) An economic analysis of annual influenza vaccination of children. Vaccine23: 1004–101415620473ProsserLA, BridgesCB, UyekiTM, HinrichsenVL, MeltzerMI, et al (2006) Health benefits, risks, and cost-effectiveness of influenza vaccination of children. Emerg Infect Dis12: 1548–1558http://dx.doi.org/10.3201/eid1210.05101517176570ZhangT, ZhuQ, ZhangX, DingY, SteinhoffM, et al (2012) The Clinical Characteristics and Direct Medical Cost of Influenza in Hospitalized Children: A Five-Year Retrospective Study in Suzhou, China. PLoS ONE7(9): e44391doi:10.1371/journal.pone.004439122957069Szucs T (1999) The socio-economic burden of influenza J Antimicrob Chemother 44 Suppl B:11–15.