The Community Cancer Control Outreach Program (CCCOP) is a community-academic partnership aimed at developing and implementing a cancer control outreach, research, and training program in Puerto Rico. The CCCOP surveyed 56 partners to assess their awareness, training needs, and use of resources related to evidence-based programs (EBPs). Despite relatively high levels (70%) of confidence in adopting EBPs, there were low levels of awareness (37%) and use (25%) of existing EBPs resources. Respondents’ who had used EBPs resources were more likely to have positive beliefs about EBPs than nonusers (p<0.05). Training needs were high among respondents and no significant differences were found between those who had and had not used existing EBPs resources. These findings can guide the development of training tools and technical assistance to increase the use of EBPs for Latino audiences.
Dissemination and implementation of evidence-based programs (EBPs) for cancer prevention and control is essential to achieve public health outcomes [
The Puerto Rico Community Cancer Control Outreach Program (CCCOP) was funded by the National Cancer Institute to develop and implement a cancer control outreach, research, and training program guided by community-based participatory research methods [
As such, the CCCOP surveyed Network partners to assess their awareness of and experience using EBPs resources, as well as any type of training that might be needed to increase the use of EBPs in communities. Thus, the study goal was to identify gaps in EBPs awareness, use, and capacity to inform the further development of EBPs training tools and technical assistance to accelerate and expand the use of EBPs in Puerto Rico.
The Network’s cancer control partners included government agencies, healthcare delivery organizations, research and higher-education institutions, health-related organizations, and community-based organizations. Some partner organizations had more than one representative in the Network primarily because they had multiple areas of cancer focus within their organizations. All Network partner’s representatives were invited to complete the survey.
A survey developed by the Cancer Prevention and Control Research Network (CPCRN) was adapted for use in Puerto Rico. This survey measured cancer control planners’ awareness of and willingness to use EBPs [
The survey was conducted during February 2009 to January 2010. The CCCOP staff contacted Network partners by e-mail, telephone, and in-person. An initial e-mail was sent to all Network partners’ representatives that included: 1) an invitation to complete the survey, 2) information explaining the purpose of the survey, 3) information about how to access the survey on-line or to request a paper version, and 4) a statement about the confidentiality of their responses. Five weeks later, a second e-mail was sent and a follow-up call was made as a reminder to those representatives who had not yet responded. Paper copies of the survey were sent out by mail upon request. Partners were also encouraged to respond to the survey during the CCCOP face to face meetings held during the data collection time period. No monetary incentive was offered to complete the survey. The study was approved by the Institutional Review Board of the University of Puerto Rico, Medical Sciences Campus.
Descriptive statistics were used to describe partner organization and respondents’ characteristics, awareness and use of existing web-based resources for EBPs, organization’s current cancer control development processes, and beliefs about the importance of using EBPs, and perceived training needs related to EBPs. To assess whether previous experience using existing EBPs resources was associated with beliefs about EBPs, responses of respondents who had never used EBPs resources were compared to those who had used EBPs. We also assessed whether prior EBPs use was associated with 1) respondents’ perceived importance of program characteristics when choosing such programs, and 2) perceived training needs.
Respondents reported low levels of awareness and use of existing resources for EBPs (
Approximately 60% of respondents reported having developed a new program in the past 12 months and using a program developed by someone else; less than a half reported adapting a cancer control program (
Compared to respondents who had not used EBPs resources, respondents who had used EBPs reported greater agreement with statements indicating that EBPs are “easy to implement” and “easy to find and get” (p<0.05) (
This is the first study to assess awareness of and experience using EBPs among cancer control planners in Puerto Rico. The study yielded several important findings. First, despite relatively high levels of confidence in adapting EBPs, there were low levels of awareness and use of existing resources for EBPs. Second, respondents’ prior use of EBPs resourceswas associated with several positive beliefs about EBPs and with their ratings for several program characteristics when choosing cancer control programs. Third, although prior use of EBPs resources was not associated with the need for any given training topic, perceived training needs across topics were high among all respondents. These findings underscore the importance of providing such training to address cancer control planners’ needs for finding, adapting, and implementing EBPs in communities in PR.
The high levels of confidence in adapting a program to fit local needs reported in this study could be the result of a misconception that adaptation simply means the translation of materials from English to Spanish rather than a systematic process using information from the community and available needs assessment data [
Among those respondents who had adopted or adapted a program in the last year, scientific evidence saying that the program works was the most cited reason for choosing such programs. Nonetheless, among all respondents (EBPs users and non-users) the percentage of who noted that scientific evidence of effectiveness was an important consideration was much lower than the percentage who endorsed this characteristic among CPCRN cancer control planners [
Compared to EBPs users, non-users placed a higher value on program innovation and compatibility with the organization’s mission when choosing cancer control programs. Noonan and colleagues [
Consistent with data from the CPCRN study [
Current research on dissemination and implementation of EBPs has suggested the need for interactive training programs and technical assistance to guide cancer control planners through the process of finding, choosing, adapting, implementing, and evaluating EBPs [
Finally, research has shown a widening gap between the skills necessary to effectively deliver cancer control interventions and the current set of skills that public health practitioners have [
An important strength of this study is that it captured a broad and diverse community-based perspectives related to cancer-related EBPs use in Puerto Rico. The findings from this study can help the cancer control movement in Puerto Rico develop training tools and to offer technical assistance to accelerate and expand the use of EBPs. A limitation of this study is that the sample size was too small to perform additional statistical analysis for some variables such as organizational and representative characteristics. Another limitation is that the findings are based on self-reported data. Due to the relationship of the partner organizations with the CCCOP Network; there is a possibility that current awareness and use of, and beliefs about EBPs were overestimated if respondents were influenced by social desirability [
Although the survey did not measure the influence of language as a potential barrier for accessing EBPs resources, since the majority of these resources are in English, Spanish-speaking cancer control planners may face additional challenges in identifying and adapting EBPs. Thus, existing and new resources for promoting EBPs must be developed in different languages to increase their penetration and acceptance among communities whose primary language is not English such as Puerto Ricans.
An understanding of current awareness and use of EBPs among cancer control planners in Puerto Rico is necessary to accelerate the use of effective cancer control programs in PR. Although current awareness and use of EBPs was low, respondents had some positive beliefs for EBPs and expressed the need for training. These results underscore the need for a robust training program and the offering of technical assistance to enhance the capacity of both individuals and organizations to successfully adopt and implement cancer control EBPs in their communities.
We thank the CCCOP Network for its collaboration throughout all the phases of this study. Research for this publication was supported by the National Cancer Institute and the Center for Disease Control and Prevention cooperative agreements for the Cancer Prevention and Control Research Networks at The University of Texas School of Public Health (1-U48-DP-000057), the University of Puerto Rico Cancer Center / MD Anderson Cancer Center, Partners for Excellence in Cancer Research (U54CA96297), and The University of Texas School of Public Health, Cancer Education and Career Development Program (2R25-CA057712).
Respondents’ awareness and use of EBPs resources
Partner organization and respondent characteristics
| Characteristics | Frequency (N) | % |
|---|---|---|
| Partner organization type | ||
| Charitable organizations | 22 | 39.3 |
| Government agency | 14 | 25.0 |
| Healthcare delivery and for profit organizations | 9 | 16.0 |
| Universities or research center | 8 | 14.3 |
| Community/state coalitions and others | 3 | 5.4 |
| Respondents’ position in partner organization | ||
| Program planner or manager | 17 | 30.4 |
| Healthcare provider, non-physician | 12 | 21.4 |
| Health educator | 12 | 21.4 |
| Physician | 6 | 10.7 |
| Researcher or program evaluator | 3 | 5.4 |
| Other | 6 | 10.7 |
| Health promotion offered on | ||
| Tobacco prevention and control | 43 | 76.8 |
| Breast cancer screening | 28 | 50.0 |
| Pap test screening | 21 | 37.5 |
| HPV vaccination | 19 | 33.9 |
| Health services offered on | ||
| Tobacco prevention and control | 18 | 32.1 |
| Breast cancer screening | 23 | 41.1 |
| Pap test screening | 16 | 28.6 |
| HPV vaccination | 10 | 17.9 |
| Access to internet at work | ||
| Yes | 44 | 78.6 |
| No | 12 | 21.4 |
| Participate in the Comprehensive Cancer Control Plan | ||
| Yes | 26 | 48.1 |
| No | 30 | 51.9 |
| Confidence level to adopt EBPs | ||
| Confident | 39 | 69.6 |
| Neutral | 5 | 9.0 |
| Not confident | 12 | 21.4 |
Respondents could select more than one health promotion and service activity, so percentages sum to more than 100%
Characteristics of the cancer control programs chosen
| Frequency (N) | % | |
|---|---|---|
| Respondent developed own program | 35 | 62.5 |
| Respondent used a program someone else developed | 34 | 60.7 |
| Respondent adapted a program that someone else developed | 24 | 42.9 |
| There was scientific evidence saying the program works | 15 | 42.9 |
| We had used it (or something like it) before | 11 | 31.4 |
| We felt it was better than the alternatives | 10 | 28.6 |
| Our funding agency encouraged us to use this program | 8 | 22.9 |
| People in our community requested this type of program | 8 | 22.9 |
| The program fit our budget | 7 | 20.0 |
| It was available for free or low cost | 7 | 20.0 |
| It was easy to implement | 8 | 22.9 |
| Other organizations like ours are using this program | 7 | 20.7 |
| Technical assistance was available to help us with this program | 4 | 11.4 |
| We did not know of any alternatives | 3 | 8.6 |
N=56; respondents could select more than one source of cancer control programs, so percentages sum to more than 100%
Analysis restricted to respondents who had used or adapted a program someone else developed (combined n=35). Respondents could select more than one reason for choosing a program, so percentages sum to more than 100%
Respondents’ perceived importance of program characteristics when choosing them
| The Program is | Used any resource, Mean (SD) | Never used resources, Mean (SD) |
|---|---|---|
| Cost-effective | 4.2 (0.7) | 4.4 (0.8) |
| Available for free | 4.2 (1.0) | 3.8 (1.2) |
| Addresses our organization’s needs | 4.1 (1.4) | 4.5 (0.8) |
| Easy to use | 4.1 (1.1) | 3.9 (1.0) |
| Consistent with our organization’s image | 4.0 (1.4) | 4.5 (0.8) |
| Technical assistance available | 4.0 (1.4) | 3.8 (1.2) |
| Used in population like ours | 3.9 (1.3) | 4.2 (1.0) |
| Consistent with our organization’s mission | 3.8 (1.7) | 4.6 (0.8) |
| Easy to evaluate | 3.8 (1.4) | 3.9 (1.1) |
| Other organizations are using it | 3.5 (1.5) | 3.4 (1.2) |
| Innovative | 3.3 (1.7) | 4.2 (0.9) |
Items were rated on a 5-point scale from 1 =
p < 0.05
Respondents’ beliefs about EBPs
| Beliefs about EBPs | Used any resource, Mean (SD) | Never used resources, Mean (SD) |
|---|---|---|
| I know where to find EBPs | 3.7 (1.1) | 2.7 (1.7) |
| The research that shows that an EBPs works is reassuring | 3.6 (1.2) | 2.7 (1.9) |
| Our funding agency encourages us to use EBPs | 3.5 (1.7) | 2.3 (2.0) |
| EBPs are easy for us to adapt for use in our community | 3.4 (1.0) | 2.6 (1.6) |
| EBPs are easy to implement | 3.2 (0.9) | 2.1 (1.5) |
| EBPs are easy to find and get | 3.0 (1.2) | 2.0 (1.5) |
| People in our community have more confident in a program that has worked somewhere else | 2.8 (1.2) | 3.1 (1.6) |
| EBPs don’t come with very much information about how to implement them | 2.7 (0.9) | 1.8 (1.4) |
| People in our community would not respond well to an EBPs developed somewhere else | 2.6 (1.0) | 2.2 (1.6) |
| EBPs require more resources than other programs | 2.4 (1.1) | 2.3 (1.6) |
| EBPs are too costly | 2.4 (1.2) | 2.1 (1.6) |
| Considering the time it takes to adapt an EBPs for our service population, we might as well develop our program | 2.2 (1.0) | 2.0 (1.4) |
| EBPs will not work better than what we are doing already | 2.1 (0.9) | 1.5 (1.3) |
| EBPs lack real world evidence | 2.0 (1.4) | 1.5 (1.2) |
| Using an EBPs keeps our organization form getting the credit we could get for a new program | 1.6 (1.0) | 1.8 (1.4) |
| Scientists don’t agree about what is evidence-based | 1.6 (1.0) | 1.7 (1.2) |
Items were rated on a 5-point scale from 1 =
p < 0.05
Perceived training needs for implementing EBPs
| Training needs | Used any resource, N=14 (%) | Never used resources, N=42 (%) |
|---|---|---|
| How to assess and utilize current available resources | 10 (71.4) | 31 (73.8) |
| How to obtain program materials | 9 (64.3) | 28 (66.7) |
| How to find and secure additional resources | 10 (71.4) | 25 (59.5) |
| How to identify what program aspect can and cannot be changed | 8 (57.1) | 27 (64.3) |
| How to develop an implementation and evaluation plan | 7 (50.0) | 27 (64.3) |
| How to involve other stakeholders/partners | 9 (64.3) | 25 (59.5) |
| How to adapt a program/materials for cultural appropriateness | 8 (57.1) | 26 (61.9) |
| How to implement and evaluate a program | 8 (57.1) | 27 (64.3) |
| How to pilot test a program with the intended audience | 8 (57.1) | 25 (59.5) |
| How to recruit participants | 7 (50.0) | 16 (38.0) |
Respondents could select more than one training need, so percentages sum to more than 100%