Presented in part: MMWR Morb Mortal Wkly Rep 2013; 62:32–5; Options for the Control of Influenza VIII, Cape Town, South Africa, 5–10 September 2013.
Seasonal influenza vaccine effectiveness (VE) has been estimated every season since 2004–2005 in the United States [
Details of the US Flu VE Network design, sites, and enrollment procedures have been described previously [
Consenting patients or their parents/guardians completed an enrollment interview to ascertain patient demographic characteristics, symptoms, onset date, and subjective assessments of general health and current health status. History of chronic medical conditions was determined on the basis of
Nasal and throat specimens (for children age <2 years, only nasal specimens were obtained) were collected by swabbing and combined for influenza testing at network laboratories, using real-time reverse transcription polymerase chain reaction (RT-PCR) as previously described [
Influenza VE was assessed using a test-negative case-control design [
The primary exposure of interest was medical record/registry documented receipt of current-season influenza vaccine. Persons aged ≥9 years were considered vaccinated, given documented receipt of at least 1 dose of current-season (2012–2013) vaccine ≥14 days before illness onset. Children aged 6 months through 8 years were considered vaccinated if they received the number of doses recommended by the Advisory Committee on Immunization Practices (ACIP) for 2012–2013, based on their documented vaccination history [
We also estimated VE for all combinations of vaccine exposure in the current and prior season (2012–2013 and 2011–2012, respectively) among patients aged ≥9 years who have been in their current health system for at least the past year. We excluded children aged <9 years from this analysis because the criteria for being considered appropriately vaccinated in this age group were based on influenza vaccination history in prior seasons. The 4 vaccine exposure groups were (1) vaccinated in both the current and prior season, (2) vaccinated in the current season only, (3) vaccinated in the prior season only, and (4) not vaccinated in either the current or prior season (reference group). Patients vaccinated with unknown vaccine types or vaccine types other than trivalent inactivated influenza vaccine (IIV3) in the current season were excluded from analyses that included prior season vaccination.
Logistic regression models were used to estimate odds ratios (ORs) comparing vaccinated (including joint current and prior vaccine exposure) and unvaccinated subjects; VE was calculated as 100% × [1 − OR]. We generated separate VE estimates for influenza overall, influenza A(H3N2), influenza B/Yamagata, and influenza B/Victoria outcomes. VE estimates were generated for all licensed vaccines, IIV3, and trivalent live attenuated influenza vaccine (LAIV3). VE was not calculated for 2009 pandemic influenza A(H1N1) strain (A[H1N1]pdm09) because of the low number of cases (n = 52). Estimates for LAIV3 VE were restricted to children aged 2–17 years because LAIV3 use was low in adults.
Age, network site, high-risk health status, and calendar time (modeled as a series of dichotomous variables representing 2-week intervals) were included in all adjusted VE models a priori. Age in years was modeled using linear tail-restricted cubic spline functions with 5 knots based on percentiles. Other potential confounders (eg, sex, race/ethnicity, reported general health, and number of children in the household) were assessed but were not included in the adjusted (simple) model because the covariate did not change the VE estimate by >5% [
To better understand the relationship between age and VE, we calculated VE by single year of age. In these models, we used data from ages 1 through 75 years and included an interaction term between the age and current-season vaccination status. Ages of <1 and >75 years were not included in this analysis because of the sparse data. Age was represented as a restricted cubic spline function with 5 knots based on percentiles.
VE was also estimated using 2 alternative means of representing vaccination status: by incorporating self-reported status with medical record/registry documentation and by using self-report only.
Statistical analyses were conducted using SAS statistical software (version 9.3; SAS Institute, Cary, North Carolina).
From December 2012 through early April 2013, we enrolled 6766 patients with medically attended ARI; the peak enrollment of cases occurred in January. Among those enrolled, 314 (5%) were excluded from analysis of VE because of inconclusive RT-PCR test results (n = 16), negative results with illness onset outside the period when cases were identified at each site (n = 43), receipt of vaccine <14 days from onset (n = 68), receipt of an invalid vaccine dose (n = 1), and incomplete vaccination status, based on ACIP recommendations for children <9 years old (n = 186).
Of the 6452 patients included in the analysis, 2307 (36%) were influenza virus positive, including 1381 (60%) infected with influenza A virus and 933 (40%) infected with influenza B virus. Among cases where influenza virus subtype/lineage could be determined, 1292 were influenza A(H3N2), 52 were A/H1N1pdm09, 582 were influenza B/Yamagata, and 303 were influenza B/Victoria. Ten patients had virus coinfections: 7 were positive for both influenza A and B virus, and 3 were positive for both B virus lineages.
Median age was 28 years (interquartile range [IQR], 9–50 years) for case patients and 30 years (IQR, 10–51 years) for control patients ( Descriptive Characteristics of Enrolled Patients With Medically Attended Acute Respiratory Illness, by Case Status Data are no. (%) of patients or median value (interquartile range). Abbreviations: ACIP, Advisory Committee on Immunization Practices; BMI, body mass index; IIV3, trivalent inactivated influenza vaccine; LAIV, trivalent live attenuated influenza vaccine. a Includes 52 cases infected with 2009 pandemic influenza A(H1N1), 36 infected with influenza A for which subtype data were not available, and 50 infected with influenza B for which lineage data were not available. b Includes 5 cases coinfected with influenza A(H3N2) and influenza B/Yamagata. c Includes 1 case coinfected with influenza A(H3N2) and influenza B (lineage not available). d Includes 1 case coinfected with influenza A (subtype not available) and influenza B/Yamagata. e Includes 3 cases coinfected with influenza B/Yamagata and influenza B/Victoria. f Presence of ≥1 medical-record-documented high-risk codes in prior year, as defined by the ACIP guidance for conditions that increase the risk for complications from influenza. g Medical record and/or immunization registry documentation of receipt of ≥1 dose of 2012–2013 influenza vaccine (for persons aged ≥9 years) or receipt of the number of doses of 2012–13 influenza vaccine recommended by the ACIP (for persons aged 6 months through 8 years) ≥14 days before illness onset. h Medical record and/or immunization registry documentation of receipt of ≥1 dose of 2011–2012 influenza vaccine. i The validated EQ-5D health ruler [Characteristic Any Influenza Virus Detecteda,b,c,d,e (n = 2307) Influenza A(H3N2) Detectedb,c (n = 1292) Influenza B/Yamagata Detectedc,d,e (n = 582) Influenza B/Victoria Detectede (n = 303) No Influenza Virus Detected (n = 4145) Site Michigan 527 (23) 255 (20) 232 (40) 19 (6) 781 (19) Pennsylvania 371 (16) 267 (21) 48 (8) 28 (9) 752 (18) Texas 432 (19) 220 (17) 154 (26) 43 (14) 930 (22) Washington 219 (9) 174 (13) 6 (1) 6 (2) 913 (22) Wisconsin 758 (33) 376 (29) 142 (24) 207 (68) 769 (19) Age 6 mo–8 y 555 (24) 242 (19) 177 (30) 118 (39) 954 (23) 9–17 y 420 (18) 178 (14) 146 (25) 72 (24) 561 (14) 18–49 y 739 (32) 478 (37) 143 (25) 73 (24) 1528 (37) 50–64 y 370 (16) 228 (18) 91 (16) 20 (7) 670 (16) ≥65 y 223 (10) 166 (13) 25 (4) 20 (7) 432 (10) Sex Female 1290 (56) 752 (58) 293 (50) 161 (53) 2508 (61) Male 1017 (44) 540 (42) 289 (50) 142 (47) 1637 (39) Race/ethnicity White, non-Hispanic 1754 (76) 1006 (78) 387 (66) 256 (84) 3112 (75) Black, non-Hispanic 189 (8) 94 (7) 80 (14) 5 (2) 323 (8) Hispanic 175 (8) 83 (6) 58 (10) 28 (9) 366 (9) Other, non-Hispanic 185 (8) 106 (8) 56 (10) 14 (5) 335 (8) Unknown 4 (0.1) 3 (0.2) 1 (0.2) 0 9 (0.2) High-risk conditionf Any 737 (32) 467 (36) 163 (28) 76 (25) 1452 (35) Asthma/pulmonary 387 (17) 243 (19) 79 (14) 48 (16) 872 (21) Cardiovascular 202 (9) 146 (11) 32 (6) 13 (4) 409 (10) Diabetes 168 (7) 113 (9) 33 (6) 16 (5) 310 (7) Other 232 (10) 150 (12) 51 (9) 18 (6) 469 (11) None 1570 (68) 825 (64) 419 (72) 227 (75) 2693 (65) Morbid obesity, BMI ≥40 Yes 153 (7) 102 (8) 31 (5) 12 (4) 281 (7) No 2077 (90) 1147 (89) 527 (91) 288 (95) 3678 (89) Missing 77 (3) 43 (3) 24 (4) 3 (1) 186 (4) Influenza vaccination status 2012–2013g Received IIV3 667 (29) 444 (34) 111 (19) 83 (27) 1735 (42) Received LAIV 65 (3) 29 (2) 19 (3) 10 (3) 157 (4) Received other/unknown type 63 (3) 45 (3) 8 (1) 5 (2) 190 (5) None 1512 (66) 774 (60) 444 (76) 205 (68) 2063 (50) 2011–2012h Received any 808 (35) 500 (39) 164 (28) 104 (34) 1860 (45) Received none 1499 (65) 792 (61) 418 (72) 199 (66) 2285 (55) Interval from onset to enrollment <3 d 977 (42) 565 (44) 245 (42) 119 (39) 1354 (33) 3–4 d 912 (40) 498 (39) 232 (40) 126 (42) 1728 (42) 5–7 d 418 (18) 229 (18) 105 (18) 58 (19) 1063 (26) Reported general health status Excellent 903 (39) 455 (35) 256 (44) 143 (47) 1336 (32) Very good 801 (35) 458 (35) 202 (35) 100 (33) 1510 (36) Good 479 (21) 301 (23) 100 (17) 45 (15) 986 (24) Fair/poor 124 (5) 78 (6) 24 (4) 15 (5) 309 (7) Missing 0 0 0 0 4 (0.1) Household exposure to smoke Yes 250 (11) 142 (11) 62 (11) 37 (12) 464 (11) No 2042 (89) 1141 (88) 516 (89) 264 (87) 3665 (88) Missing 15 (0.7) 9 (0.7) 4 (0.7) 2 (0.7) 16 (0.4) Household members, no. 4 (2–5) 3 (2–4) 4 (3–5) 4 (3–5) 3 (2–4) Children aged <12 y in household, no. 0 1075 (47) 709 (55) 199 (34) 95 (31) 2146 (52) 1 499 (22) 243 (19) 166 (29) 67 (22) 877 (21) ≥2 733 (32) 340 (26) 217 (37) 141 (47) 1122 (27) Reported current health assessmenti 50 (40–70) 50 (40–70) 50 (40–70) 50 (40–70) 60 (45–75)
There were 2877 patients (45%) with documented current-season influenza vaccine receipt ≥14 days before symptom onset. Of these, 83% received IIV3, 8% received LAIV3, <1% received intradermal or intramuscular high-dose vaccine, and 8% had an unknown vaccine type. LAIV3 accounted for 126 vaccines (19%) administered to enrolled children aged <9 years. Vaccine coverage was lowest among adolescents and among adults aged <50 years old and highest among adults aged ≥65 years (Table Descriptive Characteristics of Enrolled Patients With Medically Attended Acute Respiratory Illness, by Vaccination Status for the Current (2012–2013) and Previous (2011–2012) Influenza Seasons Data are no. (%) of patients or median value (interquartile range), unless otherwise indicated. Abbreviations: ACIP, Advisory Committee on Immunization Practices; BMI, body mass index. a Medical record and/or immunization registry documentation of receipt of ≥1 dose of 2012–2013 influenza vaccine (for persons aged ≥9 years) or receipt of the number of doses of 2012–13 influenza vaccine recommended by the ACIP (for persons aged 6 months through 8 years) ≥14 days before illness onset. b Medical record and/or immunization registry documentation of receipt of ≥1 dose of 2011–2012 influenza vaccine. c Presence of ≥1 medical record-documented high-risk codes in prior year, as defined by the ACIP guidance for conditions that increase risk for complications from influenza. d The validated EQ-5D health ruler [Characteristic Patients, No. Current Season Current and Previous Seasonsa,b Vaccinateda Not Vaccinated Vaccinated Both Seasonsa,b Vaccinateda Current Season Only Vaccinatedb Previous Season Only Not Vaccinated
Either Season Site Michigan 1308 514 (39) 794 (61) 364 (28) 150 (11) 152 (12) 642 (49) Pennsylvania 1123 542 (48) 581 (52) 300 (27) 242 (22) 111 (10) 470 (42) Texas 1362 484 (36) 878 (64) 296 (22) 188 (14) 118 (9) 760 (56) Washington 1132 618 (55) 514 (45) 465 (41) 153 (14) 115 (10) 399 (35) Wisconsin 1527 719 (47) 808 (53) 578 (38) 141 (9) 169 (11) 639 (42) Age 6 mo–8 y 1509 674 (45) 835 (55) 529 (35) 145 (10) 228 (15) 607 (40) 9–17 y 981 328 (33) 653 (67) 213 (22) 115 (12) 117 (12) 536 (55) 18–49 y 2267 844 (37) 1423 (63) 482 (21) 362 (16) 195 (9) 1228 (54) 50–64 y 1040 552 (53) 488 (47) 378 (36) 174 (17) 80 (8) 408 (39) ≥65 y 655 479 (73) 176 (27) 401 (61) 78 (12) 45 (7) 131 (20) Sex Female 3798 1786 (47) 2012 (53) 1220 (32) 566 (15) 393 (10) 1619 (43) Male 2654 1091 (41) 1563 (59) 783 (30) 308 (12) 272 (10) 1291 (49) Race/ethnicity White, non-Hispanic 4866 2284 (47) 2582 (53) 1604 (33) 680 (14) 458 (9) 2124 (44) Black, non-Hispanic 512 160 (31) 352 (69) 101 (20) 59 (12) 61 (12) 291 (57) Hispanic 541 202 (37) 339 (63) 130 (24) 72 (13) 73 (13) 266 (49) Other, non-Hispanic 520 229 (44) 291 (56) 167 (32) 62 (12) 72 (14) 219 (42) Unknown 13 2 (15) 11 (85) 1 (8) 1 (8) 1 (8) 10 (77) High-risk conditionc Any 2189 1284 (59) 905 (41) 970 (44) 314 (14) 200 (9) 705 (32) Asthma/pulmonary 1259 732 (58) 527 (42) 539 (43) 193 (15) 119 (9) 408 (32) Cardiovascular 611 415 (68) 196 (32) 328 (54) 87 (14) 44 (7) 152 (25) Diabetes 478 309 (65) 169 (35) 247 (52) 62 (13) 43 (9) 126 (26) Other 701 467 (67) 234 (33) 369 (53) 98 (14) 56 (8) 178 (25) None 4263 1593 (37) 2670 (63) 1033 (24) 560 (13) 465 (11) 2205 (52) Morbid obesity, BMI ≥40 Yes 434 201 (46) 233 (54) 141 (32) 60 (14) 39 (9) 194 (45) No 5755 2577 (45) 3178 (55) 1793 (31) 784 (14) 602 (10) 2576 (45) Missing 263 99 (38) 164 (62) 69 (26) 30 (11) 24 (9) 140 (53) Interval from onset to enrollment <3 d 2331 1013 (43) 1318 (57) 674 (29) 339 (15) 224 (10) 1094 (47) 3–4 d 2640 1165 (44) 1475 (56) 823 (31) 342 (13) 291 (11) 1184 (45) 5–7 d 1481 699 (47) 782 (53) 506 (34) 193 (13) 150 (10) 632 (43) Reported general health status Excellent 2239 906 (40) 1333 (60) 649 (29) 257 (11) 264 (12) 1069 (48) Very good 2311 1033 (45) 1278 (55) 698 (30) 335 (15) 208 (9) 1070 (46) Good 1465 714 (49) 751 (51) 495 (34) 219 (15) 147 (10) 604 (41) Fair/poor 433 222 (51) 211 (49) 160 (37) 62 (14) 45 (10) 166 (38) Missing 4 2 (50) 2 (50) 1 (25) 1 (25) 1 (25) 1 (25) Household exposure to smoke Yes 714 263 (37) 451 (63) 179 (25) 84 (12) 67 (9) 384 (54) No 5707 2599 (46) 3108 (54) 1814 (32) 785 (14) 596 (10) 2512 (44) Missing 31 15 (48) 16 (52) 10 (32) 5 (16) 2 (6) 14 (45) Children aged <12 y in household, no. 0 3221 1547 (48) 1674 (52) 1083 (34) 464 (14) 261 (8) 1413 (44) 1 1376 542 (39) 834 (61) 358 (26) 184 (13) 158 (11) 676 (49) ≥2 1855 788 (42) 1067 (58) 562 (30) 226 (12) 246 (13) 821 (44) Reported current health assessmentd 6445 60 (45–75) 60 (40–70) 60 (45–75) 60 (45–75) 60 (45–75) 55 (40–70)
Current and prior season vaccination statuses were highly correlated. Among patients who received current-season vaccination, 70% were also vaccinated during the prior season. Among patients who did not receive current-season vaccination, 81% were not vaccinated during the prior season. Approximately 60% of adults aged ≥65 years were vaccinated during both the current and prior seasons. In contrast, 22% of patients aged 9–17 years and 21% aged 18–49 years were vaccinated during both seasons.
Overall adjusted VE was 49% (95% CI, 43%–55%) against all outpatient influenza illness. VE was 39% against influenza A(H3N2) (95% CI, 29%–47%), 66% against the vaccine lineage influenza B/Yamagata (95% CI, 58%–73%), and 51% against the nonvaccine lineage influenza B/Victoria (95% CI, 36%–63%; Overall and Influenza A(H3N2)–Specific Unadjusted and Adjusted Vaccine Effectiveness (VE), by Age Group and Vaccination Status Data are for all vaccine types. Abbreviation: CI, confidence interval. a Adjusted for network site, subject age, presence of high-risk health conditions, and calendar time (2-week intervals). Influenza B Lineage–Specific Unadjusted and Adjusted Vaccine Effectiveness (VE), by Age Group and Vaccination Status Data are for all vaccine types. Influenza B/Yamagata was the vaccine strain. Abbreviations: CI, confidence interval; NR, not reported because estimates were unstable in adjusted models. a Adjusted for network site, subject age in months, presence of high-risk health conditions, and calendar time (2-week intervals). Trivalent inactivated influenza vaccine effectiveness (VE) against influenza A(H3N2) (Age, Vaccination Status Any Influenza Virus Detected Influenza A(H3N2) Detected Cases/Total (%) Unadjusted VE (95% CI) Adjusteda VE (95% CI) Cases/Total (%) Unadjusted VE (95% CI) Adjusteda VE (95% CI) All ages Vaccinated 795/2877 (28) 48 (42–53) 49 (43–55) 518/2600 (20) 34 (25–42) 39 (29–47) Unvaccinated 1512/3575 (42) Reference Reference 774/2837 (27) Reference Reference 6 mo–8 y Vaccinated 170/674 (25) 61 (51–68) 57 (45–67) 84/588 (14) 53 (36–65) 51 (32–64) Unvaccinated 385/835 (46) Reference Reference 158/608 (26) Reference Reference 9–17 y Vaccinated 114/328 (35) 40 (21–54) 39 (18–54) 55/269 (20) 27 (−4 to 49) 24 (−12 to 49) Unvaccinated 306/653 (47) Reference Reference 123/470 (26) Reference Reference 18–49 y Vaccinated 219/844 (26) 39 (27–50) 39 (26–50) 150/775 (19) 34 (18–47) 34 (16–48) Unvaccinated 520/1423 (37) Reference Reference 328/1231 (27) Reference Reference 50–64 y Vaccinated 139/552 (25) 63 (51–71) 65 (54–74) 106/519 (20) 46 (27–60) 52 (33–65) Unvaccinated 231/488 (47) Reference Reference 122/379 (32) Reference Reference ≥65 y Vaccinated 153/479 (32) 29 (−2 to 50) 26 (−10 to 50) 123/449 (27) 7 (−40 to 38) 11 (−41 to 43) Unvaccinated 70/176 (40) Reference Reference 43/149 (29) Reference Reference Age, Vaccination Status Influenza B/Yamagata Detected Influenza B/Victoria Detected Cases/
Total (%) Unadjusted VE (95% CI) Adjusteda VE (95% CI) Cases/
Total (%) Unadjusted VE (95% CI) Adjusteda VE (95% CI) All ages Vaccinated 138/2220 (6) 69 (62–75) 66 (58–73) 98/2180 (5) 53 (39–63) 51 (36–63) Unvaccinated 444/2507 (18) Reference Reference 205/2268 (9) Reference Reference 6 mo–17 y Vaccinated 69/787 (9) 70 (60–77) 68 (57–76) 63/781 (8) 45 (24–60) NR Unvaccinated 254/1051 (24) Reference Reference 127/924 (14) Reference Reference ≥18 y Vaccinated 69/1433 (5) 66 (55–75) 65 (53–75) 35/1399 (3) 58 (37–72) 58 (35–73) Unvaccinated 190/1456 (13) Reference Reference 78/1344 (6) Reference Reference
In analyses incorporating self-reported vaccination status, VE estimates were similar to estimates determined using medical record/registry data only (
The effectiveness of IIV3 was calculated with persons who were unvaccinated in both the current (2012–2013) season and the prior (2011–2012) season as the reference group. Protection against influenza A(H3N2) in the current season was similar for participants aged ≥9 years old who received vaccine in both the current and previous seasons, the current season only, and the previous season only (Figure Age-specific trivalent inactivated influenza vaccine effectiveness (VE) of current and prior vaccination against influenza A(H3N2) among persons age ≥9 years, in which persons not vaccinated in either the current or prior season served as the reference group. VE data are adjusted for network site, subject age, presence of high-risk health conditions, and calendar time (2-week intervals). *
Overall VE against influenza B was similar across all combinations of current- and prior-season vaccination and for all age categories (Figure Age-specific trivalent inactivated influenza vaccine effectiveness (VE) of current and prior vaccination against influenza B/Yamagata among persons age ≥9 years, in which persons not vaccinated in either the current or prior season served as the reference group. VE data are adjusted for network site, subject age, presence of high-risk health conditions, and calendar time (2-week intervals). Abbreviation: CI, confidence interval.
Antigenic characterization demonstrated that influenza A(H3N2) viruses from 226 participants were antigenically similar to the cell-propagated A/Victoria/361/2011 reference virus (data not shown). Among the 44 viruses sequenced, 42 (95%) belonged to HA clade 3C and were similar to the majority of circulating influenza A(H3N2) viruses in the United States (
The widespread circulation of influenza A(H3N2) and both influenza B-lineage viruses in 2012–2013 in the United States provided an opportunity to compare the age-specific VE of (IIV3) by influenza virus subtype. Influenza vaccination provided significant protection against medically attended influenza A(H3N2) and influenza B illness; significant protection was also observed in all age groups except individuals ≥65 years old. Cocirculation of both influenza B lineages during this season provided a unique opportunity to directly compare the VE for the vaccine lineage and the nonvaccine lineage.
We found that vaccination with a trivalent vaccine containing influenza B/Yamagata was effective against infection caused by influenza B/Victoria, indicating significant cross-lineage protection. Cross-lineage protection was also observed in Canada during 2012–2013 [
The VE estimate for influenza A(H3N2) in the United States was consistent with other reports estimating the VE against influenza A(H3N2) during 2012–2013 [
Although we identified >2300 cases of influenza during this season, comparison of VE by vaccine type, virus subtype, and age was challenging because of sparse numbers in some strata. The low VE estimate against influenza A(H3N2) among adults aged ≥65 years has also been noted by others [
Our large sample size allowed age-specific analysis of the effects of current and prior season vaccination, the first time this was possible for an observational study. Overall, we found minimal differences in effectiveness against influenza A(H3N2) and influenza B for each of the 3 current and prior season vaccination exposure groups, suggesting some residual effect of prior vaccination on current-season VE. This was generally consistent when data were stratified by age. Residual protection of prior season vaccination may have also affected overall estimates. Estimates were lower among those aged 9–17 years and 18–49 years, in whom residual protection from prior-season vaccination only was observed, compared with adults aged 50–64 years, in whom protection from prior-season vaccination only was not observed. These results may give some insight into the lower VE in certain age groups this season. The immunologic effects of repeated vaccination are not well understood, and additional studies are needed to understand the impact of past infections, past vaccinations, and antigenic variability on the risk of illness [
The absolute difference in the interim VE estimate (based on early season data) [
In the United States, the ACIP recommends that all persons aged ≥6 months receive routine annual influenza vaccination, and vaccine antigens are changed on a regular basis [
All authors have submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Conflicts that are considered relevant to the content of the manuscript have been disclosed.