Novel low-cost approaches for conducting rapid health assessments and health promotion interventions among underserved worker groups are needed. Recruitment and participation of construction workers is particularly challenging due to their often transient periods of work at any one construction site, and their limited time during work to participate in such studies. In the present methodology report, we discuss the experience, advantages and disadvantages of using touch screen handheld devices for the collection of field data from a largely underserved worker population.
In March 2010, a workplace-centered pilot study to examine the feasibility of using a handheld personal device for the rapid health assessment of construction workers in two South Florida Construction sites was undertaken. A 45-item survey instrument, including health-related questions on tobacco exposure, workplace safety practices, musculoskeletal disorders and health symptoms, was programmed onto Apple iPod Touch® devices. Language sensitive (English and Spanish) recruitment scripts, verbal consent forms, and survey questions were all preloaded onto the handheld devices. The experience (time to survey administration and capital cost) of the handheld administration method was recorded and compared to approaches available in the extant literature.
Construction workers were very receptive to the recruitment, interview and assessment processes conducted through the handheld devices. Some workers even welcomed the opportunity to complete the questionnaire themselves using the touch screen handheld device. A list of advantages and disadvantages emerged from this experience that may be useful in the rapid health assessment of underserved populations working in a variety of environmental and occupational health settings.
Handheld devices, which are relatively inexpensive, minimize survey response error, and allow for easy storage of data. These technological research modalities are useful in the collection and assessment of environmental and occupational research data.
The construction industry is one of the largest industries in the United States, employing over eleven million persons representing 8% of the total labor force [
Tailored health promotion interventions and workplace health assessments are powerful tools that increase the relevance and salience of health information by making it workplace and personally relevant [
Technical devices, such as handheld computers and text messaging, have been suggested as convenient methods for survey data collection and participant engagement due to the fact that they allow for rapid assessment and information sharing at a relatively low cost [
In the present methodology report, we describe and discuss the experience, advantages and disadvantages of using touch screen handheld devices for the collection of field data from an underserved transient worker population.
A research team comprised of graduate public health students and their faculty mentors undertook a workplace-centered pilot study to examine the feasibility of using a handheld personal device for the rapid health assessment of construction workers. The 45-item survey instrument, which included health-related questions (such as tobacco exposure, workplace safety practices, musculoskeletal disorders and health symptoms), was programmed onto Apple iPod Touch® devices using Touch Metric's Surveyor® software (Figure
Language sensitive (English or Spanish) recruitment scripts, verbal consent forms, and survey questions were all preloaded onto the handheld devices. These forms and survey instruments were also made available on-site in paper format in the event a handheld device failed and for researchers who preferred to use paper. In collaboration and conjunction with visitation by a local lunch truck service, the research team recruited participants at two construction sites in South Florida either in the morning during the construction workers 15-minute breakfast break, or at noon during their designated 45-minute lunch break. Bilingual student interviewers approached construction workers congregating around the lunch truck armed only with their handheld devices to provide the construction worker a description of the study, an invitation to participate, verbal consent, and interview administration (Figure
Across the two construction sites, we approached a total of 57 construction workers that walked to the lunch trunk; 54 enrolled and completed the workplace health assessment pilot study of which 91% self-reported being Hispanic (n = 49). Among the completed assessments, 32 were completed by handheld device, and 22 by traditional paper method. Eleven assessments were administered in English (7 on handhelds and 4 by paper) and 43 in Spanish (25 on handhelds and 18 by paper). For workplace assessments conducted using the handheld devices, it took an average of 9 minutes and 37 seconds to complete the questionnaire; 11 minutes and 8 seconds for the Spanish version, and 9 minutes and 4 seconds for the English version. We did not collect the amount of time needed to administer the paper questionnaires. In terms of data validation, there were no missing or incorrectly entered questionnaire items among all handheld device user entries, while on average 2 items were not intelligibly circled or clearly printed on the paper version of the questionnaire.
Overall, construction workers were very receptive to the recruitment, interview and assessment processes conducted through the handheld devices. Some workers even welcomed the opportunity to complete the questionnaire themselves using the touch screen handheld device, although ultimately all interviews conducted with handhelds were completed solely by trained study personnel. A list of advantages and disadvantages emerged from this experience that may be useful in the rapid health assessment of underserved populations working in a variety of field settings is displayed in Table
Advantages and disadvantages of using touch screen handheld devices in conducting field workplace health assessments
| Advantages | |
|---|---|
| No papers (recruitment script, verbal consent form) or pens needed, just the handheld device | |
| No missing data in the handheld devices, while missing and sometimes unintelligible data on the paper-based option | |
| Data easily downloaded from device and automatically loaded into Excel spreadsheet | |
| Clear audit trail of which interviewer administered the protocol and timing of administration | |
| More usable in inclement weather (using a suitable covering) than paper-based recording system | |
| Enhanced security features relative to paper data-collection forms (data confidentiality protection) | |
| Electronic data requires less physical space to store than signed consent or data forms | |
| Devices are easy to program with web-interface, especially for multiple, simultaneous interview scripts | |
| No-data entry costs (versus paper-option) | |
| Construction workers may be interested and willing to complete the interviews themselves using the handheld devices | |
| Devices must be powered overnight prior to field data collection | |
| Keyboard initially cumbersome for some interviewers | |
| Periodic reviews for residual data remaining on devices and for proper data transmission | |
| Potential loss of data due to device malfunction | |
| Lack of acceptance by some researchers | |
| Initial cost of each handheld device may be moderately high | |
Some disadvantages should be noted. Senior study interviewers were reluctant to embrace use of the handheld device, citing difficulties with seeing the screens outside in bright light and in pressing the screen question options. In addition, while the devices have very long battery life (~30 hours) between charges, quality checks for battery life were necessary to ensure workability and function in the field. Although the initial start up cost may appear high for each device (~$200), data entry costs were eliminated, making use of handheld devices particularly attractive for researchers conducting multiple, ongoing field assessments. Finally, the relative ease of use combined with the low long-term cost (e.g. monthly subscription fee of $20/month to access web-based Touch Metric's Surveyor® software) of using handheld devices may be one strategy for expanding capacity building within the context of community-based participatory research partnerships [
In this pilot study, we found that construction workers were willing to participate in our workplace health assessment study using handheld devices. The speed, flexibility and accuracy of using the handheld devices (as compared to traditional paper-based methods) during the construction workers breakfast and lunch breaks at the lunch truck may reduce commonly encountered barriers to real-time workplace assessments. Future research in the application of these devices among time-constrained worker groups could improve engagement and retention in workplace health promotion programs for occupational groups that do not have a formal workplace setting. Furthermore, the interest and acceptance of these devices expressed by the workers in this study might lead to the use of self-administered questionnaires on handheld personal devices in future studies.
From our field experience, we concluded that the use of a handheld personal device designed for time-pressed and hard to reach workers is a cost-effective and flexible modality for data collection that can assist with the rapid engagement of a traditionally difficult-to-reach vulnerable worker population. This methodology report adds to the extant literature on the advantages and disadvantages of using handheld devices in among hard to reach worker populations. Public health practitioners are encouraged to embrace informatics tools that enhance public health practice.
US: United States; NHIS: National Health Interview Survey
The authors declare that they have no competing interests.
AJCM was responsible for conception, acquisition of funding, and general supervision of the research group. AJCM, TCC, EPD, LEF, and DJL made substantial contributions to data collection and study design. AJCM, TCC, EPD, LEF, and DJL contributed to analysis and interpretation of data; AJCM, TCC, EPD, LEF, and DJL were involved in drafting the manuscript or revising it critically for intellectual content. All authors read and approved the final manuscript.
The study authors have obtained and keep on file photographic consent for Figure
This study was supported in part by the National Institute for Occupational Safety and Health (NIOSH)'s Deep South Educational Research Center at the University of Alabama (sub-contract: 288477-10) as a Graduate Student Pilot Grant Award; the National Institute of Arthritis and Musculoskeletal and Skin Diseases (NIAMS) grant F31AR057687 and the National Institute for Occupational Safety and Health (NIOSH) grant R01 OH003915.