Disasters often set the stage for scientific inquiry within the field of occupational safety and health. This is especially true when the long-term consequences of exposures associated with a particular disaster are unclear. However, a responder research study can be costly and difficult to design, and researchers must consider whether the proposed study will produce useful, reliable results and is a prudent public health investment.
Senior NIOSH scientists, experienced with disaster response and representing the disciplines of epidemiology, occupational medicine and psychiatry, and industrial hygiene, were convened at the request of the NIOSH Director to develop a decision process to help determine when to conduct responder health research following disasters.
The decision process can be broken down into various components, including scientific rationale that should be formally recognized as critical to efficiently and effectively determine whether a research study is warranted. The scientific rationale includes certain controlling or “gatekeeper” factors that should be present to proceed with research. Providing the foundation for responder disaster research also requires strategizing before an event occurs, so that critical baseline and comparison data can be collected.
The recommended framework should ensure that research that is most needed and justified will be identified and prioritized.
Disasters often set the stage for scientific inquiry that could help mitigate potential short- and long-term health effects among responders, as well as improve capabilities for responding to future events. However, the disaster environment presents many challenges for the conduct of research, including the immediate emphasis on critical response activities, limited access to incident leadership, inability to engage response personnel in scientific research activities not immediately pertinent to the event response, marshalling of necessary resources in an expeditious manner, and timely situational awareness of important occupational safety and health events during the response or recovery operation. The disaster environment is typically dynamic and often hazardous, chaotic, and highly charged with conflicting scientific opinions, political pressures, and disparities in knowledge or the capability to safely perform the required work.
Emergency response workers and others involved in response, remediation, and recovery efforts (referred to herein as “responders”) are often engaged in non-routine activities in uncharacterized, potentially hazardous environments and may encounter novel or unique exposures or experience unexpected health effects. As such, there is frequently a pressing public health need to conduct research to answer critical questions regarding the health impact of these exposures and/or determine the factors that are responsible for any adverse health effects experienced in both the short- and long-term. Issues related to conducting research during and following disasters have gained increasing attention following the World Trade Center disaster in 2001 and, more recently, the Deepwater Horizon disaster.
Providing the foundation for responder health research within the context of a disaster and subsequently determining the need to pursue a study requires careful consideration and planning before an event occurs. Unless the potential for such a study is anticipated, the ability to collect critical baseline data can be lost. Research studies need to address clearly stated, important questions or hypotheses, and be appropriately designed to maximize the likelihood of producing a meaningful study. However, the factors and decision-making processes relevant to determining whether to conduct responder health research, or how to best perform such research, have been relatively unexplored.
For the purposes of this paper, health studies conducted in conjunction with the response to emergency events are divided into four basic types: (1) those that involve routine or baseline health monitoring, health surveillance, industrial hygiene or environmental assessments, responder interviews/focus groups, and roster/registry activities (discussed in detail later), optimally planned in a generic way prior to an event (termed
Upon review of the response activities related to the Deepwater Horizon oil release in the Gulf of Mexico in 2010, a need was identified for a systematic decision-making process to determine if post-disaster responder health research should be initiated. In response to this need, the Director of NIOSH convened a work group consisting of senior NIOSH scientists experienced with disaster response and representing the disciplines of epidemiology, occupational medicine and psychiatry, and industrial hygiene, and that included former directors of the NIOSH emergency preparedness and response program, medical staff involved in the World Trade Center Health Program, and epidemiologists involved in industry-wide studies. Drawing on direct experience in multiple large emergency/disaster responses, including the terrorist attacks of September 11, 2001, anthrax events, severe acute respiratory syndrome (SARS), Hurricane Katrina, and the Deepwater Horizon oil release, the workgroup collaborated to devise a comprehensive rationale for determining when to conduct responder health research studies.
An extensive literature search, including MEDLINE,®EMBASE,® Cumulative Index to Nursing and Allied Health Literature (CINAHL®), Health and Safety Science Abstracts, and NIOSHTIC, yielded no publications directly addressing this topic. Search terms including “emergency responder, disaster worker, emergency worker, first responder” and “long-term study, post-disaster study, surveillance, health monitoring” yielded numerous studies that investigated the health status of emergency response workers in various response scenarios; however, none of these studies addressed the thought processes or criteria involved in the decision to conduct such a study, and no general treatments of this issue were identified. The Agency for Toxic Substances and Disease Registry (ATSDR), however, has developed guidance for determining if an environmental assessment should be conducted in a non-emergency situation.
After defining the types of responder health studies and activities pertinent to a disaster response, the work group discussed previous emergency response studies as well as current trends in emergency response research methodologies. While considering various criteria potentially necessary for determining the need for a study, it became clear that developing a focused hypothesis (or hypotheses) based on varying pre-existing information would be a critical component of an effective decision-making process. The work group then discussed factors that should be evaluated to assess whether a study was warranted, including issues such as feasibility and research significance. Using these considerations, the group conducted a table top exercise (described later in the paper) to test the validity of this decision-making process.
This paper summarizes the Work Group's recommendations for determining when a responder health research study should be initiated, including the critical factors that need to be considered when making the decision to carry out research.
As described above, a responder health research study is designed to address a specified scientific query, which is often expressed as a hypothesis or set of hypotheses. Hypotheses may arise from the results of recently concluded or on-going public health investigations begun during or just after an emergency response. Hypotheses may also be derived from data produced by health surveillance, individual worker health monitoring efforts, pilot studies, or previous research. An ideal scientific hypothesis should be testable and precise in its construction, make specific and unambiguous predictions, and clearly define the intent of the research study. Research studies should be designed to address potential confounders and have sufficient statistical power to detect a meaningful effect.
The hypothesis or set of hypotheses under study may be expressed or operationalized in different ways, and tends to vary in a manner consistent with a given scientific discipline. Additional discussions on hypothesis development and research project design are available elsewhere.
Improperly formulated hypotheses or inappropriately applied theory can be detrimental to the overall research initiative. For example, when broad concerns are voiced about potential health effects in a disaster, a research organization may translate the problem into one that can be investigated with available resources. While the translation often narrows and simplifies the focus to something manageable and potentially resolvable, researchers need to be vigilant to ensure that the hypothesis is constructed so that it remains capable of evaluating the original health concerns. If the research is capable of only addressing a narrow aspect of the original health concern, or if it can only address a tangential issue, then serious consideration is necessary as to whether it is prudent to proceed with the research. Alternatively, a research organization may attempt to initiate research around an overly expansive or complex hypothesis in an attempt to satisfy the original broad health concerns. This may result in research that is unfocused, inefficient, subject to constant
The various factors to be considered when determining if a responder health research study should be conducted are presented below. These factors can be broadly organized into six categories: 1) exposure-related, 2) observed adverse health events, 3) public health significance and scientific importance, 4) societal considerations, 5) feasibility, and 6) level of research interest. Several of these factors were adapted to an occupational context from the previously referenced ATSDR guidance document.
Exposure-related factors –
Presence of actual exposures to hazardous substances, conditions, trauma, etc. Existence of unique, novel, or unusual exposures Presence of complex environments or combined exposures Potential implications of exposures on worker health Types of science/research methodologies necessary to address/answer exposure questions
Adverse health event-related factors –
Observance or anticipation of unique, novel, particularly serious, or unusual adverse health events Presence of unexpected or unforeseen occupational health issues that are observed or may manifest during an event Presence of higher than expected numbers or rates of a specific adverse health event – or of overall events Occurrence of adverse health problems associated with exposures below applicable occupational limits
Public health significance and scientific importance –
Ability to provide new knowledge or information about an exposure-outcome relationship Ability to evaluate specific exposures or outcomes that have not been adequately studied Ability to generalize to other situations or populations Ability to confirm or refute a preliminary or pre-existing hypothesis or theory Ability to answer questions that need to be answered and cannot be answered in any other way Ability to contribute to or directly improve the public health response to disasters Magnitude of event, for example, a large number of workers exposed or considered at risk
Societal factors –
High profile or traumatic event Beliefs about harm or resource disparities, particularly among high-risk groups Unique vulnerability of the worker population Socioeconomic, legal, political, and psychological implications of the event
Feasibility factors –
Access to the work site(s) Ability to quickly collect reliable data, particularly if data could be lost if not collected immediately Ability to document or validate human health outcomes Ability to reasonably estimate or document individual exposure Ability to assign workers into exposure categories to permit exposure-response assessment Adequate study size and statistical power Ability to identify and locate subjects and records Availability of an appropriate control or comparison population Ability to address potential confounding factors Ability to measure and disentangle the relevant environmental, behavioral, or other factors Adequacy of resources to support, conduct, and complete the study Adequacy of support from employers and unions or other relevant stakeholders (e.g., other federal agencies, state or local agencies or components, trade groups, etc.) Ability to provide participants with necessary confidentiality (for instance, in research psychology) Ability to address potential ethical issues and obtain expeditious Institutional Review Board (IRB) approval for time-sensitive research For federal agencies, ability to obtain timely emergency clearance from the Office of Management and Budget (OMB) for survey instruments that fall under the jurisdiction of the Paperwork Reduction Act Adequacy of preliminary or baseline data to support the study (this is implied in some of the above bullets)
Level of research interest –
Research arising from academic/research areas of interest Contribution to established institutional program goals, such as emergency response research priority areas
The Work Group conducted a tabletop exercise to test and refine the above factors and assess their utility to adequately inform the decision to conduct a responder health research study. The March 11, 2011, earthquake and tsunami that devastated northeastern Japan and damaged the Fukushima Daiichi nuclear power facility was the example used for this exercise. The Work Group focused specifically on the release of radioactive contamination from the severely damaged Fukushima Daiichi facility into the surrounding environment and the ensuing potential for radiation exposures to workers during efforts to contain the damage. Health Physicist subject matter experts participated in the exercise to assist with defining the research needs associated with worker exposure to ionizing radiation. The exercise revealed that the above set of factors/questions served as a useful tool in determining priority research questions resulting from the incident, helping to elucidate various information, exposure, and resource needs, as well as public health significance. For example, it was determined that this event would provide a unique opportunity to address a number of questions of significant public health importance, including the adequacy of current exposure standards, issues regarding chronic exposure, impact of work involving long-term decontamination, utility of chromosome and biomarker data for evaluating effects on different exposure cohorts, and psychological effects on responders. The exercise thus suggested that research could readily be justified, but the group did not have access to information that would have allowed it to consider other factors, such as feasibility.
This exercise further illuminated the need to conduct pre-planning in order to provide a timely science response to a large-scale disaster. For example, such pre-planning could focus on predictable logistical needs, resource identification, interagency coordination, mechanisms for the systematic collection of data, etc. for a variety of possible disaster scenarios. All of these are fundamental requirements for conducting a research study, and waiting to address these issues until post–event can result in significant delays, inefficiency, and affect the likelihood of a successful study.
The process for determining whether to conduct a research study is informed by multiple inputs and considerations, as illustrated in
The hypotheses will be informed by the “factors to consider” that were described in the preceding section. This is a complex process entailing considerable expert scientific judgment and should be conducted by a science planning team (described later). The process, however, should be thorough, deliberative, systematic, and transparent, considering as many of the factors as possible based on available information.
Although consideration of the factors generally occurs after hypotheses have been generated, it may be necessary to evaluate some or all at earlier stages, and many of the factors can be evaluated in parallel. Thus, for example, exposures measured or inferred during the event or observed adverse outcomes (e.g., a cluster of cases) may identify significant knowledge gaps, question current understanding, and inform the need for a responder research study. Feasibility issues, such as access, support from workers and agencies, etc., are other examples of factors that can be considered prior to committing resources for more extensive studies.
While there are no predetermined thresholds for these factors, such as a particular level of increased incidence of adverse outcomes or degree of excessive exposure that necessarily trigger a decision for or against conducting a research study, it is evident that there are a several controlling (or “gatekeeper”) factors that must be satisfied for post-disaster responder research to proceed (see
A critical gatekeeper factor that significantly affects the feasibility of responder research following a large-scale disaster is the ability to identify and locate subjects and records. Thus, development of a responder registry or roster is particularly important, especially when the proposed research involves large numbers of responders. The absence of a registry or roster makes research studies difficult to conduct and possibly less accurate, because identifying the universe of response and remediation workers after the response can be very difficult, if not impossible. If only a subset of workers is identified and recruited as participants, they may not be representative of the entire workforce, and the study results will likely be skewed.
Because of the many complexities associated with both the decision to conduct responder research and the actual conduct of responder research, analyzing a prioritized set of potential disaster scenarios could help identify research opportunities. For example, it could be useful to evaluate research questions and knowledge gaps likely to arise and be amenable to study during a variety of incident types, including those foreseen in Federal Emergency Management Agency (FEMA) National Planning Scenarios.
To facilitate the decision process, the organization or agency contemplating research should, as part of its pre-planning efforts, create a science planning team of experienced subject matter experts from diverse scientific disciplines (e.g., occupational medicine, industrial hygiene, toxicology, epidemiology, psychology, emergency response). The team should be substantially separate from those primarily responsible for coordinating the immediate response. Once a disaster commences, the science planning team should be rapidly convened to review, refine, and prioritize any previously developed generic research plans to identify potential research needs, including a statement of rationale and importance. Scope of the effort (including approximate numbers of staff and potential costs) should also be estimated. This information should be reviewed and a determination made as to whether the research should be pursued. In some cases, the level of research interest may inform determinations. A pre-determined level of research interest may be reflected in an agency or institution's research agenda.
The science planning team, which can be supplemented by specific subject matter experts depending on the type of disaster, should be able to evaluate the information available and come to a consensus on whether there are valid, testable, and relevant hypotheses or appropriate theoretical foundations, and whether a responder research study can feasibly be conducted. The team should also be required to periodically reassess the need for conducting responder research because of the rapidly evolving nature of disasters and worker exposures.
Disaster events, particularly those where responder health research is anticipated, should routinely include collection of a core set of baseline data, such as exposure data, rosters of exposed individuals, and baseline health status. Failure to begin collecting critical data as soon as possible can result in data that are unavailable, lost, or cannot be reconstructed, which can significantly affect study feasibility. Research plans as described above should include provisions for anticipatory data collection, including standard instruments for emergency or generic OMB clearance (in the case of federally sponsored research) and advance preparations for IRB approval, even if it is ultimately decided not to move forward with a research study.
As part of planning efforts for research initiatives, strong interagency communication and cooperation will be needed among federal, state, and local governmental agencies (e.g., health departments, workers compensation bureaus, labor departments, Federal Emergency Management Agency) in the jurisdiction of the disaster. These discussions may be expedited prior to an event through discussions with relevant umbrella organizations, such as the Council of State and Territorial Epidemiologists, Association of State and Territorial Health Officials, and National Association of County and City Health Officials.
Finally, discussions with other public safety, public service, and nongovernmental organizations, including labor unions and educational institutions, are necessary to establish expectations, roles, and responsibilities related to research that may be considered during or following a disaster. In order for research projects—especially those requiring data collection from a large number of people—to go forward efficiently, it is imperative that workers and other participants understand the importance of the work, trust that it is being carried out for their or for society's benefit (and not solely to fulfill institutional needs), and understand that the results will be shared with them when the data are collected and analyzed. Moreover, the affected workers themselves will be an asset in many projects, supplying specific knowledge and skills, including appropriate language and cultural sensitivities, which can strengthen data collection efforts.
The decision process on whether to proceed with a responder health research study can be broken down into various components that should be formally recognized as critical to determining whether a research study of responder health is warranted. As described in this paper, the decision process should be formalized to ensure the best possible judgment and recommendation, and may benefit from advanced planning in anticipation of possible events. Several critical gatekeeper factors are provided that must be satisfied if a research study is to be initiated. A determination to conduct a study without sufficient information to develop the exposure-outcome relationship or without an initial hypothesis is not generally recommended and may be subject to ethical concerns. In the current austere fiscal environment, the recommended framework should ensure that research that is most needed and justified will be identified and prioritized.
Protection of Human Subjects, 45 Code of Federal Regulations, part 46.
Process for determining whether to conduct responder research utilizing expert opinion.
| Critical Gatekeeper Factors | |
|---|---|
| Scientific Query |
Scientific queries must be based on sound theoretical foundations—the hypothesis (or set of hypotheses) must be testable and precise in construction, makes specific and unambiguous predictions, and clearly defines the research questions that the study will address. |
| Exposure-Related |
Actual exposures must be present, as well as a mechanism to characterize and document exposures. Without exposure, or exposure data, the research has a low probability of providing useful public health information. The proposed research should result in information about an exposure-outcome relationship |
| Study Design |
Critical questions cannot be answered through any other less-costly or simpler way than through a responder research study. The research has sufficient scientific validity and the ability to answer questions that need to be answered. Confounders can be successfully addressed. |
| Feasibility Factors |
Identification and location of subjects and records are possible. Funding, other resources, and available expertise are sufficient to conduct the study through to its conclusion. Data-related logistic hurdles, including those related to study size, statistical power, availability of exposure-outcome data, etc., can be overcome. Regulatory-related clearances can be expeditiously obtained (i.e., OMB approval for federal agencies and Institutional Review Board (IRB) clearance). |
| Critical Gatekeeper Factors | |
|---|---|
| Scientific Query |
Scientific queries must be based on sound theoretical foundations—the hypothesis (or set of hypotheses) must be testable and precise in construction, makes specific and unambiguous predictions, and clearly defines the research questions that the study will address. |
| Exposure-Related |
Actual exposures must be present, as well as a mechanism to characterize and document exposures. Without exposure, or exposure data, the research has a low probability of providing useful public health information. The proposed research should result in information about an exposure-outcome relationship. |
| Study Design |
Critical questions cannot be answered through any other less-costly or simpler way than through a responder research study. The research has sufficient scientific validity and the ability to answer questions that need to be answered. Confounders can be successfully addressed. |
| Feasibility Factors |
Identification and location of subjects and records are possible. Funding, other resources, and available expertise are sufficient to conduct the study through to its conclusion. Data-related logistic hurdles, including those related to study size, statistical power, availability of exposure-outcome data, etc., can be overcome. Regulatory-related clearances can be expeditiously obtained (i.e., OMB approval for federal agencies and Institutional Review Board (IRB) clearance). |