Three decades of research findings have documented the health effects of handling hazardous drugs. Oncology nurses are vulnerable due to frequent administration of antineoplastics, low adherence to equipment use, reported barriers to use, and perceived low risk of health effects. No interventions have been tested in a controlled, multi-site trial to increase nurses’ use of protective equipment when handling hazardous drugs. The Drug Exposure Feedback and Education for Nurses’ Safety (DEFENS) study will compare the efficacy of education (control) versus an audit and feedback intervention (treatment) on nurses’ self-reported use of personal protective equipment when handling hazardous drugs. The treatment intervention will include tailored messages based on nurses’ reported barriers to protective equipment use.
The DEFENS Study is a cluster randomized controlled trial. We are enrolling cancer centers and will recruit nurse participants in April 2015. Eligible cancer centers employ at least 20 eligible registered nurses in the chemotherapy infusion setting and have on-site phlebotomy resources. Eligible participants are nurses who work at least 0.40 full-time equivalent hours in the chemotherapy infusion setting and have not received an antineoplastic drug for a health problem in the past year. An encrypted, user-authenticated website will administer surveys and deliver control and treatment interventions. The primary endpoint is the change in score on nurses’ reports of the Revised Hazardous Drug Handling Questionnaire between baseline and approximately 18 months later. A baseline survey is completed after informed consent and is repeated 18 months later. Nurses in all sites who experience a drug spill will also report incidents as they occur; these reports inform the treatment intervention. Plasma will be obtained at baseline, approximately 18 months later (the primary endpoint), and with drug spill occurrences to measure hazardous drugs levels and to inform the treatment intervention. Potential mediators include knowledge of hazardous drug handling and perceived risk of drug exposure. We will examine whether personal factors and organizational factors moderate the intervention effects.
Clinicaltrials.gov
The online version of this article (doi:10.1186/s13063-015-0674-5) contains supplementary material, which is available to authorized users.
For over three decades, scientists have documented the pernicious effects of handling hazardous drugs such as antineoplastics [
Published guidelines include the use of personal protective equipment (PPE), comprised of two pairs of chemotherapy-tested gloves, single-use disposable gowns, eye protection during specific activities, and respiratory protection when vapor exposure is possible. However, adoption of these guidelines is suboptimal in clinical settings [
Audit and feedback is an established intervention to support clinician practice change. Successful audit and feedback interventions include education and periodic reminders [
In this context, this paper reviews the design of a cluster, randomized controlled trial to evaluate the efficacy of an audit and feedback intervention to improve nurses’ use of personal protective equipment when handling hazardous drugs. The overall objective of this research program is to measure and improve the safety of chemotherapy administration in ambulatory oncology settings. The trial has three specific aims: Evaluate the efficacy of an audit and feedback intervention to improve recommended use of PPE. Determine whether the intervention effects on PPE use are mediated by knowledge about PPE use and perceived risk of hazardous drug exposure. Determine whether the intervention effects on PPE use are moderated by personal (experience, education, and certification) and organizational factors (workloads, practice environments, and safety organizing behaviors).
Study results will inform practicing nurses, cancer center administrators, and policymakers on optimal approaches to protect workers who handle potentially hazardous drugs.
A cluster randomized controlled trial design was chosen to compare an educational module on hazardous drug handling with the same educational module plus feedback from survey and biological data obtained from participants. Specifically, a clustered design reduces the likelihood for contamination bias between participants and facilitates measurement of the organizational context that we hypothesize will moderate the effects of the proposed intervention. Participants will provide baseline data upon study enrollment. After evaluation for the primary endpoint is complete, all participants will receive the feedback materials for the remainder of the 4-year study. These materials and study questionnaires will be located on a user-authenticated website maintained by the investigative team. Table
PPE: Personal protective equipment.
TIMEPOINT (Month) 1-5 6 7 9 12 15 18 21 24 25-30
Eligibility screen X Informed consent X Site Coordinator Training X Cluster Allocation X
Control: Web-based educational module X Intervention: Audit and Feedback X X (both arms) X X Quarterly Reminders X X X X X X X
Baseline Survey Demographics, PPE use, Plasma levels, PPE Knowledge, PPE Barriers, Moderators X Primary Endpoint PPE use, Plasma levels X Spill Assessments PPE use, Plasma levels X X X X X X X X
The University of Michigan Institutional Review Board has approved the study (HUM00086541, date of last approval: 16 March 2015). All participants will complete informed consent on the study website. Of the 11 participating sites, 4 have reviewed study procedures and determined their staff to be 'not engaged' in the conduct of the research. Another three sites have ceded authority to the University of Michigan and the remaining four sites have pursued full protocol review. Recruitment will not begin at each site until local approvals have been obtained, as appropriate. A complete listing of human subjects approval is available (see Additional file
The study’s conceptual framework integrates theoretical, empirical, and pilot work that spans occupational health, health promotion, and organizational studies (Figure Conceptual framework. NIOSH: National Institute for Occupational Safety and Health. ONS: Oncology Nursing Society.
Site inclusion criteria are ambulatory oncology infusion settings with at least 20 employees who meet the eligibility criteria listed below. In addition, the chief nursing executive for cancer services in each facility provided endorsement of the study. Exclusion criteria are infusion areas that are not within easy access to the on-site study coordinator’s office or lack on-site phlebotomy services.
Primary inclusion criteria include registered nurses employed 16 hours or more per week in the ambulatory infusion area. To eliminate the chance of contaminated results in accordance with a previous protocol [
The principal investigator will visit each site and offer a live presentation that reviews study procedures. The presentation will be recorded so off-shift workers may view the material at their convenience. Our recruitment strategy incorporates procedures supported by Dillman’s Tailored Design Method [
To promote retention, we plan quarterly electronic updates to all sites through personalized Email messages from the coordinating center. The study website was developed by a professional vendor with expertise in user-centered design [
Randomization will occur after participants have enrolled and completed the baseline survey. Randomization will occur at the site, rather than the participant level, to reduce the likelihood of contamination across study arms within one cancer center. We recognize the sites vary by size. To address this, sites will be ordered by number of participants in decreasing order. The .ralloc command in Stata 12 (StataCorp, College Station, TX, USA) will perform random allocation in blocks of two so that one of the first two sites is in each condition. This will help ensure fairly equal sample size in the two groups.
Both the control and treatment interventions are delivered to individual nurse participants. Table
NIOSH: National Institute for Occupational Safety and Health; PPE: personal protective equipment.
Format Web-based Web-based Duration Forty-five minutes of audio/video content Sixty minutes of audio/video content Content Review of 2004 NIOSH alert and recommendations for practice Content from control video + video messages from practicing nurses on strategies to reduce barriers to PPE use Tailored Messaging No Yes: tailoring variables are barriers to PPE use measure obtained at baseline Fidelity Assessment Completion of post test Completion of post test; paradata to track that video messages were viewed Reminders Email reminders every 3 months of content Email messages every 3 months with updates on spill data collected
Participants will view a 1-hour web-based educational module on safe handling procedures. Our study consultant will present a 1-hour informational webinar on principles of hazardous drug handling, consistent with Oncology Nursing Society chemotherapy guidelines [
For the tailored educational module, participants view the 1-hour module on safe handling procedures plus additional short videos tailored on the barriers to PPE use they reported in the baseline survey [
Fidelity of the control intervention will be assessed through the quiz required to receive a continuing education certificate. Fidelity of both treatments is expected to be high because delivery of content via a secure website assures consistent presentation. This mode of delivery offers greater fidelity than interventions delivered by a person, which can vary over time and with the person offering the intervention. Prior to accessing the site, participants will log on using their unique study identifier, allowing the study team to track the number of times each user accesses the site. Access (number of times) and duration (minutes viewed, longest time between keystrokes) data will be used in the analyses to assess intervention effects. Because randomization occurs at the site rather than the individual, there is minimal opportunity for crossover contamination bias. The use of unique, secure user logins and passwords limits access to the intended recipients only.
Measures were selected for their fit to the conceptual framework of the study, their performance in previous studies, and documented validity and reliability (see Table
AOCN: Advanced Oncology Certified Nurse; OCN: Oncology Certified Nurse; ONS: Oncology Nursing Society; PES-NWI: Practice Environment Scale of the Nursing Work Index. Note. Baseline assessment begins in Year 1 of the study; the Primary endpoint is assessed approximately 18 months later.
Outcome Revised Drug Handling Questionnaire Five items, 0 to 5 (never to always) use selected PPE items Baseline Primary endpoint Mediator: Knowledge Knowledge questionnaire Twelve items, multiple choice, true/false about 2004 NIOSH alert and recommendations Baseline After viewing module Primary endpoint Mediator: Perceived Risk Three items from Geer’s dermal exposure survey Three items, score 1 to 4 (strongly disagree -strongly agree) about health risks from exposure Baseline Primary endpoint Personal Factor Experience Number of years in nursing, oncology nursing, and in current position Baseline Personal Factor Highest education degree completed Diploma, Associates’ Bachelors, Masters, or Doctorate Baseline Personal Factor Completed certifications ONS Chemotherapy certification, OCN, AOCN Baseline Organizational Factor Workload Number of patients cared for on shift Baseline With a spill report Primary endpoint Organizational Factor Revised PES-NWI Six subscales, 23 items, score range 0 to 5 (strongly disagree - strongly agree) about presence of favorable work features Baseline Primary endpoint Organizational Factor Safety Organizing Scale Nine items, score range 1 to 7 (not at all - to a very great extent) team performance of safety behaviors Baseline Primary endpoint
The study’s primary endpoint is optimal use of PPE, and it will be measured at the individual participant level using the Revised Hazardous Drug Handling Questionnaire originally developed by Martin and Larson [
Both knowledge of PPE and perceived risk of hazardous drug exposure are hypothesized to mediate the potential effects of the intervention on PPE use. These measures will be obtained at baseline at the individual participant level, after the educational module has been viewed, and at the post-intervention assessment. The mediator analysis will use the measures obtained after the intervention has been delivered. Both measures were validated by expert panel review and discussion with two focus groups of at-risk workers. In prior work, both measures achieved a content validity index of 1 from 3 experts [
Knowledge of PPE will be measured using a 10-item chemotherapy exposure questionnaire that assesses knowledge of the 2004 NIOSH alert. The measure was developed by a content expert and study consultant. Each item provides four answer choices with one correct answer for each question. The scale range is 0 to 10, with higher scores reflecting increased knowledge. Perceived risk of drug exposure will be measured using a 3-item subscale from Geer’s Occupational Dermal Survey [
Three organizational factors (workloads, practice environments, and safety organizing) and three personal factors (experience, education, and certification) are proposed moderators. These measures will be obtained on the web-based survey at baseline and the post-intervention assessment. In contrast to our outcomes and potential mediators, the moderators will be obtained from participants and aggregated to the cluster level.
Workloads will be measured by asking participants: 'How many patients did you assume primary responsibility for on your last shift?' For spill reporting, the time referent will be changed to 'the shift the drug spill occurred'. Workload measures correlate significantly with administratively-derived staffing levels and perceived staffing adequacy [
Practice environments are workplace features that enable nurses to deliver high-quality care [
The Safety Organizing Scale [
Congruent with prior studies, the three potential moderators described above will be aggregated to the cluster level. In this study, a cluster is considered each of the 11 participating cancer centers. For each cluster, the mean value for these three measures will be calculated from the individual responses from each nurse in the cluster.
Three personal factors will be collected from each participant with the baseline survey: oncology nursing experience (years), education (diploma, associate’s degree, bachelor’s degree, master’s degree, post-master’s degree), and certification (Oncology Nursing Society chemotherapy certification, Oncology Certified Nurse, Advanced Oncology Certified Nurse, other certification).
After informed consent is obtained, participants will complete a baseline questionnaire online at the secure study website. Baseline blood draws will be performed on-site at the conclusion of a participant’s scheduled work shift. All plasma samples will be shipped to the University of Michigan for processing and analyses for the detection of 20 commonly-used chemotherapy drugs.
If a spill occurs in the ambulatory oncology infusion center throughout the 4-year study period, participants will return to the secure study website and complete a brief spill report. They will also have blood drawn at the end of the shift to obtain drug levels. A second blood draw will be performed 24 hours after the first one (or the next available business day) to obtain estimated peak and trough values, respectively.
Participants will provide blood for plasma sampling at the baseline and post-intervention assessment, as well as with the occurrence of any reported drug spill during the study. The procedures below are used for all obtained samples. At the end of a nurse’s shift, the nurse will report to the participating site’s designated phlebotomy area. Trained and credentialed phlebotomy staff will perform venipuncture using standard technique and place whole blood into 5-mL heparinized tubes. Cells will be removed from plasma by centrifugation for 10 minutes at 1,000 to 2,000 × g using a refrigerated centrifuge. Plasma will then be pipetted into a clean polypropylene tube and stored in a −20°C or lower freezer. After plasma samples are frozen, they will be shipped by next-day air and on dry ice to the University of Michigan.
To measure levels of potentially hazardous drugs from the obtained samples, a specific and highly sensitive liquid chromatography-electrospray ionization-mass spectrometry (LC-ESI-MS) method will be established. We will focus our efforts on the 20 drugs that are the most commonly administered agents in ambulatory oncology settings with chemical properties suitable for analysis. However, as methods emerge for the measurement of other drugs, we will consider these as nurses report exposure outside of our original list of drugs. Signals from the test drug will be monitored under the multiple reaction monitoring mode of the LC-ESI-MS for quantification [
Drugs with similar properties and similar measurement methods (using the same column, same mobile phase, and similar extraction conditions) will be grouped into one method to simultaneously detect several drugs in one injection. This technique will greatly enhance the screening throughput. Each sample batch processed will include plasma samples from healthy, unexposed volunteers to ensure calibration. The established method for detecting multiple test drugs in one injection will be evaluated for linearity, specificity, and sensitivity according to guidance from the Food and Drug Administration [
Survey data will be stored on the password-protected, user-authenticated encrypted server behind a firewall. Our hypotheses are focused on the efficacy of an audit and feedback intervention to nurse participants. A total of 382 nurses are expected to be sampled from 11 sites. Each site is randomized into either control or intervention condition. Because the nurses within the same site are likely to show correlated outcomes, we will use linear mixed-effects models to account for the intraclass correlation for the proposed cluster randomized trial [
Aim 1 evaluates the efficacy of audit and feedback to improve recommended PPE use (compared with an educational video). The outcome variable of the fixed-effect structure is the PPE use scores. The predictor of the fixed effect is the intervention indicator variable. The data from the PPE use questionnaire and demographics variables that are included in the fixed-effect structure to increase the precision of estimates. The random effect in the model is the
Aim 2 will determine whether knowledge about PPE use and perceived risk of drug exposure mediate the effect of the treatment intervention on PPE use. The hypothesis is that the effect of the treatment on PPE use will be at least partially mediated by knowledge and perceived risk. To measure the mediation effect, we fit two linear mixed models. The first model is the same model we use in Aim 1. The second model adds the two potential mediators in the first model. The mediator effect is measured as the difference in the coefficients of the intervention variable between the two models. A 95% confidence interval is calculated for the estimate. If the confidence interval does not cross zero, it shows that mediation effect is statistically significant.
Aim 3 will determine whether the treatment intervention effect on PPE use is moderated (strengthened or weakened) by personal (experience, education, certification) and organizational factors (workloads, practice environments, safety organizing). We will use mixed model analyses that include receipt of the treatment intervention, the moderator variables, and the products of treatment intervention receipt with the moderator variables as predictors of PPE use. Significance tests of the product terms between moderator and intervention variables will indicate whether moderation is present [
The design and sample size for this study were determined in part by power analysis conducted by Optimal Design software [
Potential participants will be invited to the study website using their unique assigned study identifier and will also complete informed consent. During the consent process, they will have a yes/no option of providing additional plasma and whole blood samples for our biorepository. A data safety monitoring board comprised of three faculty members not involved in the project will review study progress and human subjects concerns on a quarterly basis. Study withdrawals and potential adverse events will also be reviewed at this meeting and reported to our Institutional Review Board.
Despite three decades of data to suggest that nurses face health risks from suboptimal use of personal protective equipment when handling hazardous drugs, we have identified an alarming absence of tested interventions to improve practice. This cluster, randomized controlled trial will compare two interventions: an educational module with an educational module plus feedback that will improve nurses’ knowledge and reduce barriers to PPE use.
A key limitation to the project is the reliance on a self-report measure of PPE use as the primary endpoint. Resource constraints and the frequent application of PPE prohibit us from measuring PPE use through direct observation. However, the primary endpoint was validated in the original study with direct observation. A second limitation is our selection of elite cancer centers, as opposed to community-based oncology settings, will bias our results toward conservative exposure rates. The participating facilities are high-volume cancer centers that currently provide training and PPE to their staff. For an efficacy trial, larger samples of participants per cluster are needed. It is our goal to move from efficacy to effectiveness in a larger, more diverse sample of oncology practices that includes nurses and other health care workers who are at risk for drug exposure.
Drug Exposure Feedback and Education for Nurses’ Safety
Health Insurance Portability and Accountability Act
Intraclass correlation coefficient
Liquid chromatography-electrospray ionization-mass spectrometry
National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, United States
Personal protective equipment
The authors declare that they have no competing interests.
BW and DS developed the pharmacokinetic analysis approach. KMV participated in protocol development and coordinated study logistics. DR and JY participated in the design of the study and will perform the statistical analysis. MM and KS participated in study design. CF conceived of the study, and participated in its design and coordination and drafted the manuscript. All authors read and approved the final manuscript.
We thank the Research Development Core at the University of Michigan Institute for Clinical and Health Research 2UL1TR000433 and Dr. Sally Lusk, Dr. Thomas Connor, and Dr. Martha Polovich for their suggestions on the study protocol. We thank Dr. J Scott Roberts, Dr. Anne E Sales, and Dr. Ellen Lavoie-Smith for their service on the Data Safety Monitoring Board.
We wish to also acknowledge the DEFENS Study Investigators as collaborators:
Arthur G James Cancer Hospital; Penny Moore, MSN, RN, OCN.
Fox Chase Cancer Center-Temple Health; Susan Cobb, PhD, RN-BC.
Froedtert Hospital; Theresa Rudnitzki, MS, RN, ACNS-BC, AOCNS.
H Lee Moffitt Cancer Center & Research Institute; Susan R Hartranft, PhD, ARNP, CNL.
Karmanos Cancer Center; Clara Beaver, MSN, RN, AOCNS, ACNS-BC.
Memorial Sloan-Kettering Cancer Center; Pamela Ginex, EdD, RN, OCN.
Roswell Park Cancer Institute; Judy Delmonte, MS, CSSGB, CPHQ.
Smilow Cancer Hospital at Yale-New Haven; Catherine A Lyons, RN, MS, MEA-BC.
Stanford Healthcare; D Kathryn Tierney, RN, PhD.
University of Kansas Cancer Center; Catherine Glennon, RN, MHS, OCN, NE-BC.
University of Kentucky Health Care; Robyn Cheung, PhD, RN.
This paper was supported by Grant Number, 1 R01 OH 010582–01, funded by the National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention or the Department of Health and Human Services.