Emerg Infect DisEmerging Infect. DisEIDEmerging Infectious Diseases1080-60401080-6059Centers for Disease Control and Prevention22709741337681812-024910.3201/eid1807.120249DispatchDispatchTimeliness of Nongovernmental versus Governmental Global Outbreak CommunicationsTimeliness of Outbreak CommunicationsMondorLukeBrownsteinJohn S.ChanEmilyMadoffLawrence C.PollackMarjorie P.BuckeridgeDavid L.BrewerTimothy F.McGill University, Montreal, Quebec, Canada (L. Mondor, D.L. Buckeridge, T.F. Brewer);Harvard–Massachusetts Institute of Technology, Boston, Massachusetts, USA (J.S. Brownstein, E. Chan);Children’s Hospital Boston, Boston (J.S. Brownstein, E. Chan);International Society for Infectious Diseases, Brookline, Massachusetts, USA (L.C. Madoff, M.P. Pollack, T.F. Brewer);University of Massachusetts, Worcester, Massachusetts, USA (L. Madoff);and Harvard Medical School, Boston (J.S. Brownstein)Address for correspondence: Timothy F. Brewer, 1020 Pine Ave West, Montreal, Quebec, H3A 1A2, Canada; email: timothy.brewer@mcgill.ca7201218711841187

To compare the timeliness of nongovernmental and governmental communications of infectious disease outbreaks and evaluate trends for each over time, we investigated the time elapsed from the beginning of an outbreak to public reporting of the event. We found that governmental sources improved the timeliness of public reporting of infectious disease outbreaks during the study period.

Keywords: outbreak reportingpandemic preparednessinformal sourcesemerging infectious diseasesProMED-mailnongovernmentalgovernmentalglobaloutbreakscommunications

Rapid public communication of incipient disease threats, even with incomplete information, might enable quicker response measures, including enhanced disease surveillance and initiation of protective measures, for those at risk (1). Traditionally, public notifications are communicated through a hierarchical infrastructure from which local, provincial or state, and national health authorities obtain information by interacting with health care providers and diagnostic laboratories (2). However, many health authorities now rely on informal outbreak-reporting systems, such as ProMED-mail, for timely signals of infectious threats (3,4), as encouraged by the revised WHO International Health Regulations (5). Research has suggested that globally, informal sources provide outbreak warnings faster than traditional governmental reporting mechanisms (6). However, existing research of this assertion has been limited to disease-specific evaluations (7) or descriptive summaries (8). We compared the timeliness of initial outbreak communications cited by nongovernmental sources to those of governmental sources and examined temporal trends in the time from outbreak onset to public communication for outbreaks communicated by each source, independently.

The Study

The study database consisted of 398 unique human infectious disease outbreak events collected from Disease Outbreak News, published online by the World Health Organization during 1996–2009 (9). For each outbreak, we defined the initial source or sources of the first public communication as the individual, organization, or website that first publicly communicated information regarding the disease threat (locally or internationally, orally or in writing). The corresponding date of communication was identified by using outbreak reports disseminated by ProMED-mail (10). All outbreaks were categorized as having been first communicated by >1 nongovernmental or governmental source, or simultaneously by both types of sources. When an outbreak was simultaneously first communicated by nongovernmental and governmental sources (n = 5), the outbreak was repeated in the dataset and each source was given credit. This adjustment increased the number of outbreak events to 403.

To characterize the timeliness of outbreak communications, for each reporting source of an event, we calculated the median time in days, and bootstrapped 95% CI, from outbreak start to public communication (Table 1). Median reporting times were calculated for the entire study period (1996–2009), before and after public recognition of severe acute respiratory syndrome (SARS) (March 12, 2003), and for each WHO-defined geographic region. The effect of the initial reporting source on the timeliness of outbreak communication was quantified by using negative binomial regression after adjusting for geographic region and whether the outbreak occurred before or after SARS. These variables were included in the model on the basis of a priori assumptions that public health infrastructure can vary by geographic and political region and that new pandemic preparedness strategies, including use of informal information to initiate public health responses, were developed in response to the SARS epidemic (11). Interaction terms between each variable were examined but were not included in the final model because none reached statistical significance (p>0.05). Temporal trends were assessed by using univariate negative binomial regression models, stratified by source category. These models included 1 covariate for the year of outbreak start.

Time from the estimated start of an outbreak to its earliest communication by source*
VariableGovernmental sources
Nongovernmental sources
p value
No. outbreaksMedian no. days (95% CI)No. outbreaksMedian no. days (95% CI)
Period
1996–200916333.0 (30–44)10323.0 (20–32)0.200
Pre-SARS9039.5 (31–51)6129.0 (20–50)0.161
Post-SARS7329.0 (25–37)4221.5 (17–32)0.613
Geographic location
Africa8537.0 (29–51)4131.0 (23–57)0.733
Americas1330.0 (21–63)1225.0 (20–34)0.568
Eastern Mediterranean2441.0 (23–51)931.0 (16–82)0.903
Europe1131.0 (23–79)920.0 (13–184)0.909
Southeast Asia828.0 (10–62)1114.0 (11–51)0.431
Western Pacific2226.0 (12–52)2118.0 (13–33)0.789

*Bootstrapping with 10,000 replicates was used to calculate 95% CIs for median values. SARS, severe acute respiratory syndrome.

Of all initial outbreak reports identified, 137 were excluded from analysis for ≥1 of the following reasons (Figure 1): 117 (85%) of the excluded reports were missing information on the estimated outbreak start date; 20 (15%) were not found in the ProMED-mail archives; and 1 (1%) outbreak estimated start date occurred after the date of public communication of the outbreak. Of the 266 (66%) outbreaks included in analysis, 163 (61%) were first publicly communicated by governmental sources, and 103 (39%) were first communicated by nongovernmental sources. Chi-square tests showed no significant differences in the proportions of governmental and nongovernmental sources included in the analysis versus those excluded (p = 0.315).

Exclusion criteria applied to database of 398 outbreak events publicly reported through the World Health Organization (WHO) Disease Outbreak News during 1996–2009 and breakdown of nongovernmental and governmental sources used to compare the timeliness of outbreak communications. UN, United Nations. *More than one source may be identified for a given outbreak; †categories for exclusion are not mutually exclusive; ‡health officials, ministries of health, laboratories, hospitals, etc.; §included in sensitivity analysis; ¶includes nongovernmental organizations, individual accounts, ProMED requests for information, and multiple sources.

The median time from estimated outbreak start to initial public communication was 10 days shorter for nongovernmental sources (23 days, 95% CI 20–32) than for governmental sources (33 days, 95% CI 30–45), although this difference was not significant according to the Wilcoxon rank-sum test (p = 0.200) (Table 1). Additionally, multivariate modeling showed no significant difference after covariates were adjusted for (incidence rate ratio [IRR] 0.95, 95% CI 0.77–1.18) (Table 2). The effect of missing data was assessed in sensitivity analyses for all outbreaks for which we had an estimated outbreak start date (17 of 20). When we used the WHO Disease Outbreak News communication date, our results did not change when crediting either governmental sources (IRR = 0.88, 95% CI 0.71–1.09) or nongovernmental sources (IRR = 1.086, 95% CI 0.882–1.336).

Comparison of the timeliness of outbreak communications by nongovernmental and governmental sources*
VariableIRR (95% CI)p value
Source
GovernmentalRef
Nongovernmental0.950 (0.765–1.180)0.645
Chronological order
Pre-SARSRef
Post-SARS0.713 (0.576–0.884)0.002
Geographic location
AfricaRef
Americas0.773 (0.531–1.126)0.180
Eastern Mediterranean0.912 (0.654–1.272)0.587
Europe1.100 (0.731–1.669)0.637
Southeast Asia0.602 (0.394–0.918)0.019
Western Pacific0.780 (0.577–1.054)0.106

*Methods: The multivariate negative binomial regression model compared the timeliness of outbreaks first communicated by nongovernmental sources to those by governmental sources, while adjusting for geographic region and whether the outbreak occurred before or after public recognition of SARS. IRR, incidence rate ratio; SARS, severe acute respiratory syndrome; ref, reference value = 1. Reference categories: (1) source: governmental, (2) SARS: pre-SARS, (3) geographic region: Africa.

Examination of temporal trends over the study period (Figure 2) showed that nongovernmental sources generally communicated outbreak signals to the public faster after 1996, although the trend did not reach statistical significance (IRR = 0.96, 95% CI 0.91–1.01). Governmental sources, in contrast, made significant improvements in lessening the time in which they publicly communicated initial outbreak signals (IRR = 0.94, 95% CI 0.91–0.97).

Median time (days) from the estimated start of an outbreak to its public communication for outbreaks reported by nongovernmental sources (A) and governmental sources (B), 1996–2009. Trendlines show average improvements over the study period.

Conclusions

Our data suggest that, from 1996 through 2006, outbreaks reported initially by nongovernmental sources were communicated publicly an average of 10 days earlier than those reported initially by governmental sources. Though the differences varied, nongovernmental sources tended to report outbreaks faster than governmental sources when we compared outbreaks before and after SARS, or by WHO-defined region. The lack of statistically significant differences in initial communication timeliness by source is probably attributable to a lack of statistical power rather than a lack of effect.

Our results also provide support for the International Health Regulations 2005 revisions that allow WHO to use unofficial information to request verification from member states. Slightly more than one-third of all unique infectious disease outbreaks in the WHO Disease Outbreak News during this 14-year period were initially reported by informal information sources.

Traditional governmental public health reporting mechanisms remain an integral source for outbreak information, accounting for almost two-thirds of all initial reports over this period. Our results also show that these sources made statistically significant improvements in reporting early warnings of outbreak threats more rapidly to the public, which might result in part from a shift toward automated, electronic methods that improve the timeliness of communication (12,13). It is possible that enhancements in nongovernmental outbreak reporting systems also contributed to improvements in governmental outbreak reporting timeliness over the study period, but we were unable to test this assumption with the current data.

This study has potential limitations. We encountered difficulty in selecting and consistently applying criteria to determine the initial source of public communication from ProMED-mail reports, which could have resulted in misclassification bias. Although other reporting systems that use informal information exist, they either lack a publicly available archive (for example, Global Public Health Intelligence Network) (14) or their database did not cover the entire study period (for example, HealthMap) (15). According to Heymann, et al., 65% of outbreaks recognized by WHO are first identified by informal sources (4), a proportion we did not find. Some outbreak reports were excluded because of missing data. We were able to internally validate the data that remained, but these exclusions limited the study’s statistical power. Finally, use of outbreak reports collected from the WHO Disease Outbreak News might limit the generalizability of our findings to all infectious disease outbreaks. Despite these limitations, our data highlight the value of nongovernmental sources as an integral resource for providing timely information about global infectious disease threats, and demonstrate the significant improvements in the timeliness of outbreak reporting made by governmental sources.

Suggested citation for this article: Mondor L, Brownstein JS, Chan E, Madoff LC, Pollack MP, Buckeridge DL, et al. Timeliness of nongovernmental versus governmental global outbreak communications. Emerg Infect Dis [serial on the Internet]. 2012 Jul [date cited]. http://dx.doi.org/10.3201/eid1807.120249

This research was supported by a grant from Google.org and by the National Institutes of Health grants R01 LM010812 and G08 LM009776.

Mr Mondor is a research assistant in The Surveillance Lab at McGill University’s Clinical and Health Informatics Research Group. His research interests include timely disease detection, infectious disease epidemiology, and health care data analysis.

ReferencesWorld Health Organization The world health report—a safer future: global public health in the 21st century. Geneva: The Organization; 2007 p. 1–96. Jajosky RA, Groseclose SL Evaluation of reporting timeliness of public health surveillance systems for infectious diseases. BMC Public Health. 2004;4:29 10.1186/1471-2458-4-2915274746Brownstein JS, Freifeld CC, Madoff LC Digital disease detection—harnessing the Web for public health surveillance. N Engl J Med. 2009;360:21537 10.1056/NEJMp090070219423867Heymann DL, Rodier GR; WHO Operational Support Team to the Global Outbreak Alert and Response Network Hot spots in a wired world: WHO surveillance of emerging and re-emerging infectious diseases. Lancet Infect Dis. 2001;1:34553 10.1016/S1473-3099(01)00148-711871807World Health Organization International Health Regulations, 2nd ed. Geneva: The Organization; 2005Wilson K, Brownstein JS Early detection of disease outbreaks using the Internet. CMAJ. 2009;180:8293119364791Brownstein JS, Freifeld CC, Chan EH, Keller M, Sonricker AL, Mekaru SR, Information technology and global surveillance of cases of 2009 H1N1 influenza. N Engl J Med. 2010;362:17315 10.1056/NEJMsr100270720445186Grein TW, Kamara KB, Rodier G, Plant AJ, Bovier P, Ryan MJ, Rumors of disease in the global village: outbreak verification. Emerg Infect Dis. 2000;6:97102 10.3201/eid0602.00020110756142Chan EH, Brewer TF, Madoff LC, Pollack MP, Sonricker AL, Keller M, Global capacity for emerging infectious disease detection. Proc Natl Acad Sci U S A. 2010;107:217016 10.1073/pnas.100621910721115835Madoff LC ProMED-mail: an early warning system for emerging diseases. Clin Infect Dis. 2004;39:22732 10.1086/42200315307032Heymann DL, Rodier G Global surveillance, national surveillance, and SARS. Emerg Infect Dis. 2004;10:1735 10.3201/eid1002.03103815040346Overhage JM, Grannis S, McDonald CJ A comparison of the completeness and timeliness of automated electronic laboratory reporting and spontaneous reporting of notifiable conditions. Am J Public Health. 2008;98:34450 10.2105/AJPH.2006.09270018172157Ward M, Brandsema P, van Straten E, Bosman A Electronic reporting improves timeliness and completeness of infectious disease notification, the Netherlands, 2003. Euro Surveill. 2005;10:273015701937Mykhalovskiy E, Weir L The Global Public Health Intelligence Network and early warning outbreak detection: a Canadian contribution to global public health. Can J Public Health. 2006;97:42416512327Freifeld CC, Mandl KD, Reis BY, Brownstein JS HealthMap: global infectious disease monitoring through automated classification and visualization of Internet media reports. J Am Med Inform Assoc. 2008;15:1507 10.1197/jamia.M254418096908