Conceived and designed the experiments: MAS YZ. Performed the experiments: MAS YZ. Analyzed the data: MAS YZ. Contributed reagents/materials/analysis tools: MAS YZ HLG CAA. Wrote the paper: MAS YZ HLG.
The 2009 H1N1 outbreak provides an opportunity to identify strengths and weaknesses of disease surveillance and notification systems that have been implemented in the past decade.
Drawing on a systematic review of the scientific literature, official documents, websites, and news reports, we constructed a timeline differentiating three kinds of events: (1) the emergence and spread of the pH1N1 virus, (2) local health officials’ awareness and understanding of the outbreak, and (3) notifications about the events and their implications. We then conducted a “critical event” analysis of the surveillance process to ascertain when health officials became aware of the epidemiologic facts of the unfolding pandemic and whether advances in surveillance notification systems hastened detection.
This analysis revealed three critical events. First, medical personnel identified pH1N1in California children because of an experimental surveillance program, leading to a novel viral strain being identified by CDC. Second, Mexican officials recognized that unconnected outbreaks represented a single phenomenon. Finally, the identification of a pH1N1 outbreak in a New York City high school was hastened by awareness of the emerging pandemic. Analysis of the timeline suggests that at best the global response could have been about one week earlier (which would not have stopped spread to other countries), and could have been much later.
This analysis shows that investments in global surveillance and notification systems made an important difference in the 2009 H1N1 pandemic. In particular, enhanced laboratory capacity in the U.S. and Canada led to earlier detection and characterization of the 2009 H1N1. This includes enhanced capacity at the federal, state, and local levels in the U.S., as well as a trilateral agreement enabling collaboration among U.S., Canada, and Mexico. In addition, improved global notification systems contributed by helping health officials understand the relevance and importance of their own information.
In the past decade, many new advanced systems for disease surveillance and notification have been developed and implemented throughout the world
The outbreak of a novel strain of A(H1N1) influenza virus, A/California/7/2009, now referred to as pH1N1, provides an opportunity to see how well these systems functioned in practice as an integrated public health surveillance system. The epidemiology of pH1N1 has been well described elsewhere
As a secondary objective, this analysis illustrates the use of “critical event analysis,” part of the toolkit for systematic quality improvement (QI), a perspective called for in the U.S. National Health Security Strategy
This analysis is an in-depth case study drawing on information from a systematic review of the scientific literature, official documents, websites, and news reports. In particular, we constructed a time line (
Note: Numbers in parentheses correspond to manuscript page where the event is described. Epidemiological events are indicated in light shades (green for Mexico and blue for the United States), local awareness and understanding of these events in dark shades (green for Mexico and blue for the United States), and global notifications and awareness of these events in yellow.
With the events classified in this way, we then conducted a “critical event analysis” focused on the surveillance process rather than the epidemiologic facts. Specifically, we first identified critical events, incidents that advanced the recognition of what we now know as a global pandemic. These events are points in time when the public health system might have responded sooner or later than it did, depending on the system’s capabilities. We then tried to identify the factors that allowed the events to occur when they did, rather than earlier or later, as in a root cause analysis. In particular, we asked (1) when health officials in Mexico, the United States, and at the global level became aware of the epidemiologic facts of the unfolding pandemic, (2) whether an earlier recognition could have been possible, (3) whether advances in surveillance notification systems seem likely to have hastened the detection of the outbreak, and (4) whether there are further improvements that might be possible through enhanced practices, procedures, or new systems. We sought to analyze decisions based on the information that was available, or could have been available, to the decision-makers at the time. Because illustrating the strengths and weaknesses of this approach is one of our objectives, we discuss the challenges, limitations, and opportunities presented by this approach in detail in the conclusions section.
The exact location of the first human cases of pH1N1 infection is not known, however retrospective analyses have identified cases dating back to February and March, 2009 in at least three locations throughout Mexico,
On March 27 a 39-year-old woman with newly onset diabetes mellitus in Oaxaca developed severe respiratory illness and eventually died of this illness on April 13
On March 13, the Mexican Directorate General of Epidemiology had issued an alert about the outbreak of influenza-like illness in pre-school children in the previous week in Tlaxcala
The clinical and epidemiological characteristics of the cases that had come to light by mid-April varied, and respiratory illness during the winter could easily have been regarded as seasonal influenza. Many of the cases were determined to have influenza B, a trend that was also being observed in the United States
On April 15, Veracruz officials briefed the Directorate General of Epidemiology regarding La Gloria outbreak investigation, with Pan American Health Organization (PAHO) officers in attendance. Two days later, authorities conducted a press conference to warn about atypical influenza season with increasing morbidity trend and excess mortality. Following notification about the emergence of novel H1N1 in the United States and interactions with Canadian health officials and the U.S. Centers for Disease Control and Prevention (CDC) as described below, Mexico notified PAHO (the WHO regional office for the Americas) of a potential atypical pneumonia outbreak on April 22, closed schools in Mexico City on April 24 and throughout Mexico on April 28, and did not open high schools and universities until May 7. On May 1, non-essential government and private sector business services were suspended. The number of confirmed cases peaked shortly afterwards, but rebounded for a second peak in June and July, by which time the entire country was affected
In late March, a 9-year old girl and a 10-year old boy in southern California became ill with influenza (
Between April 10 and 19, 14 students from a high school in Queens, New York travelled to Mexico (all but one to Cancun) during their Spring recess, and developed flu symptoms in the week of April 19. On April 23, two days after the CDC alert, the school nurse notified the New York City Department of Health and Mental Hygiene (DHMH) that approximately 100 students were being sent home with flu symptoms. DHMH notified CDC that afternoon and began an investigation on April 24. The following day, DHMH reported that most laboratory specimens from these students tested positive by rt-PCR for influenza A with no human H1 or H3 subtypes detected, indicating that the virus was probably pH1N1. On April 29 CDC confirmed by rt-PCR that most specimens were positive for pH1N1
On April 26, aware of the New York outbreak, as well as 20 cases from California and Texas, U.S. Department of Health and Human Services (HHS) declared a public health emergency in the United States
Health officials outside of Mexico were potentially aware of what was eventually determined to be the 2009 H1N1 pandemic as early as April 1, when HealthMap first disseminated local media reports about a “mysterious” influenza-like illness in La Gloria (
On April 6, Veratect, a private firm based in Kirkland, Washington that conducts disease surveillance, issued an alert based on information from La Gloria and other sources of "strange" outbreak of acute respiratory infection, which led to bronchial pneumonia in some pediatric cases. This alert was available to CDC, WHO, PAHO and several US city and state public health officials that subscribe to Veratect’s service, and records indicate that PAHO accessed it on April 9 and 10 (Wilson, personal communication, December 3, 2009).
On April 10, GPHIN notified WHO of acute respiratory illness in La Gloria
On April 17, InDRE director Celia Alpuche contacted the Canadian National Microbiology Laboratory (NML), part of the Public Health Agency of Canada (PHAC), for help in dealing with the situation that was developing. Dr. Alpuche knew NML’s director, Frank Plummer, through the Global Health Security Action Group and other international collaborations, and valued his expertise dealing with SARS and other unknown pathogens. In a teleconference the following day InDRE and NLM officials concluded that the outbreak was likely to be a novel agent, unrelated to influenza. Following a conference call between Mexico, Canada, the United States, and PAHO, Mexican samples were sent to NML and CDC, and on April 23, both labs identified the viral subtype as the novel H1N1. This collaboration was possible because of the Security and Prosperity Partnership of North America (SPP), a trilateral agreement between the United States, Canada, and Mexico launched in March 2005. The CDC MMWR report on two California children confirmed with Swine influenza A were posted on the ProMED website on April 21, which was the first report regarding the novel H1N1 influenza virus
Aware of the developments in Mexico and Canada, Veratect attempted to contact CDC, California, and Texas officials on April 16 and 17. On April 20, Veratect urgently attempted to contact CDC. James Wilson, Veratect’s medical director, said in December, 2009 that he had been more concerned about this situation than any other in many years of surveillance work (Wilson, personal communication, December 3. 2009). However Dr. Wilson was quoted in the
On April 22, Mexico’s IHR focal point alerted PAHO about an unusual outbreak of atypical pneumonia in young adults and indicated a probable relation of these events to the outbreak in La Gloria
A/California/7/2009, now known as pH1N1, was circulating in Mexico and the United States in March 2009 and perhaps earlier. That it was a novel pathogen came to the world’s attention in April because of three critical events: the recognition that multiple apparently disparate disease outbreaks throughout Mexico were connected, the identification of novel pH1N1 in two California children and its subsequent connection to the Mexican cases, and the recognition that an outbreak in New York City was connected to the Mexican and California cases.
The first critical event was the identification of pH1N1 in two California children through the NHRC’s surveillance research program. Because the epidemiologic information suggested human-to-human transmission, this triggered a series of events involving three laboratories (the Marshfield Clinic, the Wisconsin State Laboratory of Hygiene, and eventually the CDC, which identified the pathogen). Although the first child became ill on March 28, CDC did not identify pH1N1, a potential public health emergency of international importance under the IHR, until the second child was determined to also have pH1N1 on April 17, three weeks later and five days after Mexico had notified a potential PHEIC regarding the La Gloria outbreak. In retrospect, one might ask whether this identification could have occurred earlier. A review of the timing of the events suggests that it could have, but only if health officials in California, Wisconsin, and the CDC knew it was a novel pathogen, which of course they did not know. To find two children with unsubtypable influenza at the end of the flu season is not remarkable, and indeed it is only because of the research being conducted at NHRC that these cases came to light at all.
The second critical event (which actually started earlier than the first) was the recognition that a number of disease outbreaks throughout Mexico with apparently different epidemiological characteristics represented a single phenomenon and thus were a potential public health event of international concern. Health authorities in Veracruz and Tlaxcala were aware of outbreaks with an unusual high frequency of severe pneumonia in otherwise healthy young people in March, and in the week of April 5 national authorities came to realize that the outbreaks were related, resulting in the first international alert on Sunday, April 12. However it was not recognized that the responsible pathogen was pH1N1 until April 23, two days after CDC identified the new virus strain and published its alert about pH1N1 in the California children. Two labs in Canada and the United States were able to test samples from Mexico and determine that pH1N1 was the pathogen quickly, in only two days.
Although the samples were sent earlier than the established protocol in response to Mexican authorities growing concerns, one might ask whether samples could or should have been sent for testing earlier. As indicated in
The final critical event was the recognition, on April 24, of an outbreak of pH1N1 in New York City high school students who had travelled to Cancun, Mexico during their Easter recess the previous week. This recognition, only days after the first student became ill, was possible because a school nurse and New York City health officials were aware of pH1N1 and the Mexican situation through alerts and the news media earlier in the week of April 19. Although the New York Department of Health and Mental Hygiene would have definitely investigated an event of this magnitude, knowledge of the CDC and Mexican alerts a few days earlier added urgency to the situation (Fine, personal communication, Feb. 5, 2011). This in turn contributed to understanding the outbreak’s epidemiology and presumably helped trigger the declaration of a health emergency in the United States on April 26 as well as the WHO’s alert the previous day. Since the report was filed immediately after the students became ill, and immediately acted upon, it seems unlikely that this could have happened any earlier.
In retrospect, considering the chain of critical events, if the California samples been tested with more urgency in the week of April 5 rather than April 12 and the results reported to Mexican authorities earlier, it seems possible that global alerts about pH1N1 could have been advanced by about one week to April 18. By this time, however, the virus had spread throughout Mexico and the United States, especially because of Easter travel. So even with the earliest possible recognition of the emerging pandemic, it seems unlikely that world-wide spread could have been contained. And of course what now seems clear in retrospect was far from clear in April, 2009. Indeed, coming at the end of the normal flu season, no single Mexican or American surveillance finding was exceptional, so without the international communication that occurred in 2009 the pandemic could have taken longer to detect and to characterize than it did.
Although it is impossible to quantify the effect, it could have taken much longer for the world to become aware that a new pandemic subtype had emerged. One must only consider the years of effort it took to identify and characterize HIV three decades ago, and the resulting confusion
Analysis of these critical events shows how global investments in disease surveillance and notification, coupled with a heightened awareness of pandemic influenza, contributed to an enhanced public health response to pH1N1. First, enhanced laboratory capacity in the United States and Canada led to earlier identification and characterization of the novel H1N1 strain. Among other things, this recognition triggered national and global pandemic plans, PCR-based tests were quickly developed to aid in surveillance and clinical decision-making, and a vaccine seed strain was quickly developed that led to the development of pandemic vaccine in time to be used during the second pandemic wave in the Fall of 2009 (although not before that wave began), in which the CDC had been taking a leading role. In particular, the early detection was due in large part to the existence of an experimental influenza surveillance system developed and operated by the U.S. Navy’s NHRC in Southern California, which identified the first two cases. Laboratory response networks initiated or enhanced in recent years were also critical because they enabled the involvement of CDC and Canada’s NLM, which had the capacity to recognize pH1N1 as novel. This includes the collaboration among Mexico’s InDRE, the NLM, and the CDC that was possible because of the Security and Prosperity Partnership of North America (SPP) agreement as well as protocols and relationships that facilitated collaboration among the NHRC, the Marshfield Clinic, the Wisconsin State Laboratory of Hygiene, the New York City Department of Health and Mental Hygiene, and the CDC.
Second, enhanced global notification systems led to earlier detection and characterization of the outbreak by helping to “connect the dots between cases in California, Mexico, and New York City.” Through SINAVE and other sources, Mexican officials were aware, for instance, of a serious problem in the week of April 12, but it was not until CDC’s publication regarding pH1N1 in California the following week that they sent samples and realized that the two outbreaks were the same. After the pandemic and with the support of the US and Canada, Mexico has also developed its own capabilities for rt-PCR testing throughout the country, facilitating much faster diagnosis. Similarly, without the awareness that the same virus that was making children ill in California and circulating widely – and seriously affecting young people – in Mexico, during the week of April 19, the school nurse in Queens and New York City health officials might not have taken the outbreak in students who had travelled to Mexico the previous week as seriously. The notification systems that contributed to these results include the International Health Regulations, voluntary reporting systems such as ProMED, as well as active searching activities GPHIN, HealthMap, Argus, and Veratect. In addition, some have speculated that countries’ awareness that outbreaks within their borders will soon come to light through these channels, increases the likelihood that they will report themselves
The early events in the 2009 H1N1 pandemic thus illustrate the important contribution of the 2005 IHR and the paradigm shift that accompanied it. This includes, the definition of a PHEIC as a comprehensive and flexible representation of health hazards, the algorithm for risk assessment (Annex 2 of the IHR), and the existence of National Focal Points that can (and are mandated to) communicate directly with the WHO rather than go through diplomatic channels. In this experience, the IHR system was also instrumental to speeding two-way communications between Mexico and PAHO and between the US and PAHO. Similarly, the North American Plan for Avian and Pandemic Influenza (NAPAPI) facilitated communication among Mexican, U.S., and Canadian health authorities. On the other hand, Mexico, Canada, and the U.S. currently have no official protocols for sharing information from event-based surveillance sources such as GPHIN, HealthMap and Veratect. The second edition of the North American Plan for Animal (formerly Avian) and Pandemic Influenza (NAPAPI), published in April 2012, seeks to develop a more effective international sharing mechanism based on the lessons from the 2009 pandemic.
Syndromic surveillance systems played an important role in detecting the pH1N1outbreak, but a different the role that is commonly used to justify them – that such systems can detect outbreaks before conventional surveillance systems and enable a rapid public health response
An analysis of this sort is clearly limited in two important respects. First, since public health experts in the midst of puzzling out the facts of a disease outbreak rarely take notes – indeed it is often not clear until days or weeks into an outbreak that there is anything worth recording – any retrospective analysis is subject to recall bias colored by the epidemiological data and explanations that eventually emerged
Despite these limitations, a systematic analysis of three critical events that occurred during March and April 2009– identification of pH1N1 in samples from two children from California, the recognition that multiple apparently disparate disease outbreaks throughout Mexico represented a single phenomenon related to the California cases, and the recognition that an outbreak of influenza in New York City high school students were part of the same picture – shows that both enhanced laboratory-based surveillance, coupled with improved global notification systems, did seem to have improved the global public health response to pH1N1. The surveillance enhancements that made this possible include an experimental influenza surveillance system operated by the NHRC in Southern California as well as laboratory response networks linking Mexico’s InDRE, Canada’s NLM, and the CDC, as well as private and public health laboratories in the United States. The global notification systems that contributed to these results include formal and informal channels as well as activities such as GPHIN, HealthMap, ProMED Mail, Argus, and Veratect, which actively search the Internet for evidence of disease outbreaks. At the national level, starting in May, 2008, Mexican authorities held a weekly meeting, named “Epidemiologic Pulse,” to scan and assess epidemiological events in Mexico and the world. This session played a key role in integrating the information from formal and informal sources that emerged nearly a year later. PAHO officials attended the April 15 session at which the La Gloria situation was discussed. The trilateral teleconference the following day was enabled by the North American Plan for Avian and Pandemic Influenza (NAPAPI), a non-legally-binding agreement prepared under the Security and Prosperity Partnership of North America treaty. Since most of this did not exist a decade earlier, is seems likely that the investments in building these systems, together with a heightened awareness of pandemic influenza, enabled a more rapid and effective global public health response to H1N1.
Considering the chain of critical events, it is possible that global alerts about pH1N1 could have been advanced by about one week to April 18. But since the virus had already spread throughout Mexico and the United States and elsewhere by this time, it seems unlikely that this would have made a difference in containing the world-wide spread of the virus. Rather, recognizing that there are many false positives in epidemiology, and what now seems clear in retrospect was far from clear in April, 2009, the picture that emerges from this analysis is a global public health system, and particularly public health agencies in Mexico, Canada, and the United States, that worked together effectively to solve a challenging epidemiologic puzzle in a reasonably timely fashion.
This analysis also illustrates the challenges of early detection and characterization in public health emergencies. First, although in retrospect the events described in this analysis clearly add up to tell the story of the emergence of a new pandemic viral subtype, many of the events – even large numbers of respiratory illness cases at the end of the winter flu season – taken in isolation were not sufficient to cause alarm. Given the number of such “signals” that truly are isolated events, it is not useful or appropriate for local, national, or international public health agencies to react with alarm on every such occasion. Second, as with most novel pathogens, the emergence of pH1N1 was characterized by uncertainty that took weeks to months to resolve. Many emergency preparedness professionals, however, still think in terms of single cases triggering a response in hours or at most days and this thinking is reflected in such key public health preparedness documents as CDC’s 2011
Epidemiologists familiar with the emergence of novel pathogens rightly compare the rapidly evolving facts and scientific knowledge to the “fog of war,”
More broadly, this recognition means that it is important to expect and plan for uncertainty in preparing for the emergence of a new pathogen. This requires attention to response
Finally, this analysis illustrates the potential of the critical events approach for collecting, analyzing, and understanding the policy implications of data from real incidents on public health system’ emergency response capabilities. There are three critical components of this approach; each requires knowledge of public health systems and professional judgment.
First, the analyst must prepare a timeline describing key events in both the epidemiology and the public health response, such as the one in
Second, based on this timeline, one must identify the critical events. These are events of more complexity than the recognition of a cluster of cases, but less than the emergence of a new pathogen. They represent opportunities when the response might have occurred sooner or later than it did, depending on the public health system’s capabilities. This is comparable, in a standard root cause analysis (RCA) to the choke points in the process map when errors occur. For this analysis, for instance, we choose incidents that advanced the recognition of, and enabled a response to, the global pandemic. Identifying these events was challenging, but the creation and careful of a timeline was an essential first step.
Finally, the analyst must identify the factors that allowed the events to occur when they did, rather than earlier or later. In a standard RCA, these are the “root causes.” This requires knowledge of how public health systems are supposed to perform and the factors that can degrade this performance. It is also useful to consider what might have happened had the critical events turned out differently, an approach that March and colleagues describe as “simulating experience”
Learning about public health systems’ emergency response capabilities is challenging because actual events are unique, and both the epidemiological facts and the context varies from one community to another. In other words, there is no replication, a centerpiece of the scientific method. In this context, our analysis of the global public health system’s ability to detect the pH1N1 pandemic gains rigor not by statistical analysis of repeated events but rather by a detailed analysis of the timing of events in Mexico, the United States, and the rest of the world. The kind of analysis described here is far more extensive and probing than is commonly seen in the After Action Reports (AARs) prepared by health departments after exercises or actual events
The authors are grateful for comments on earlier drafts from John Brownstein, Gerardo Chowell-Puente, Mauricio Hernández Avila, Melissa Higdon, Tamar Klaiman, John Kraemer, Larissa May, Chris Nelson, Hilary Placzek, Lone Simonsen, Cécile Viboud, Ellen Whitney, the staff of the CDC Public Health Surveillance Program Office, and others who commented on presentations of this material.