Washington State's
Public health practitioners are increasingly being asked to partner with people in nonhealth sectors of the community to develop policies and build environments that will support health-promoting nutrition and physical activity behaviors (
Critical factors for successful policy and environmental change include collaboration, support from community decision makers, and data that favor the intervention, in addition to funding, other resources, and skilled staff (
Community partnerships are part of social capital. Understanding characteristics of a community partnership provides insight into how an active partnership is functioning and how this functioning affects project implementation. Public health practitioners typically evaluate community partnership projects by identifying actions and outputs that measure whether a project is meeting its objectives and goals. Equally important but perhaps more difficult to evaluate is the nature of the partnership itself — the ways that members come together and interact and how the work of the project is accomplished. Public health practitioners need to understand community partnerships as social capital to provide guidance for setting goals and objectives and to give appropriate technical assistance. In this article, we describe the evolution of methods and tools that were used to identify and understand the characteristics, structures, and processes of a community partnership for health improvement in Washington State.
The Washington State Department of Health (DOH) has lead efforts to prevent obesity and overweight on both the state and community policy levels. Community efforts have been organized as
Initial planning for the Moses Lake pilot project was conducted by an advisory committee composed of leaders and representatives of civic organizations, city and county agencies, businesses, and interest groups as well as community residents. Members of the advisory committee identified three initial strategies from the state plan and created and formalized an action plan for their implementation. In the next phase, activity shifted from the advisory committee to the three project teams: 1) trails and paths, 2) breastfeeding, and 3) community garden. Many members of the advisory committee served on a project team and recruited new members. During this phase, the advisory committee as a whole met less frequently. The leadership group (planning team), including the project coordinator, advisory committee, three team leaders, and DOH staff, continued to meet to coordinate the subprojects and monitor overall progress.
The evaluation team for
Mount Vernon was selected as the second pilot city in 2003. The Mount Vernon project's assessment, planning, and project team organizational phases were similar to those of Moses Lake, although the projects and composition of committee partnerships were different. DOH and the pilot project communities also had distinct objectives and deadlines according to their interests.
Data collected in the first 2 years of the
The UW evaluation staff invited
The purposes of the first Moses Lake project survey, conducted in December 2002, were to 1) provide feedback to the project leadership team so that the community development process could be improved and 2) gather ongoing needs assessment data from new stakeholders in Moses Lake. The survey consisted of 14 scaled questions that asked members of the advisory committee to evaluate the committee structure and function, leadership facilitation, technical assistance that was provided, their commitment and personal values, and their understanding of the project's purpose and goals. Open-ended questions asked about partnership values as well as barriers to and motivators for participation; these questions also provided an opportunity to identify other people who might want to be involved in the project.
A survey of Moses Lake advisory committee members was conducted again in January 2004. This survey was similar to the December 2002 survey except that it included new questions to identify partnerships that had been formed among committee members and new questions to measure the degree of integration of
In the second year, the focus of
The survey results provided feedback about how the project was progressing and how the partnership was functioning, and the new set of open-ended questions added qualitative information about members' experiences. However, the data did not systematically integrate the reported experiences with other reports (
At this time, the evaluation team began to use the CHG model (
Eleven of the scaled questions in the two Moses Lake surveys touched on components of the CHG model, including individual empowerment, bridging social ties, synergy, critical characteristics of who was involved and how they were involved, the scope of the process, and leadership and management parameters, including promoting participation and facilitation. However, the survey questions did not provide adequate data to apply an integrated overview of the CHG model, and the survey was substantially revised to include additional CHG constructs (
The second
The evaluation team used published studies of community partnership functioning and related survey tools to create the new survey (
The survey was easy to administer and score, and conducting the survey by telephone permitted evaluation staff to clarify questions and take notes of comments and feedback. Most of the UW staff who administered the survey reported that the questions seemed to be readily understood. The survey took 20 to 25 minutes to complete.
For all of the surveys, triangulation was an integral part of data analysis. Results of the surveys were compared with objective observations of the project, including community involvement, attendance and participation at meetings, and progress toward project objectives and goals (
Results were used for further planning. For instance, responses to questions about
Other survey results also affected future plans. Responses to questions about
The
Integral to the CHG model is the assumption that processes of community participation are crucial to effective solutions for community health problems (
Similarly, the CHG model affects program evaluation. Rather than focusing only on behavior change and long-term health outcomes as measures of health promotion interventions, the CHG model provides a framework for examining the intermediate processes of the partnership as proximal outcomes. Use of the CHG model to organize information can aid in assessing processes in which individuals and organizations work together to identify and address health problems at the community level. The model can also help to guide public health workers in project management. A well-designed process evaluation guides the use of limited staff time and project funding and thus can improve efficiency and effectiveness.
The CHG model shows how the dynamic and complex interactions of community partners using community resources can lead to improved community health. The model identifies markers that can reinforce partnership activities. The markers, such as representation of community diversity and mechanisms for accountability within a collaborative process, are not ends in themselves, but the presence and strength of these markers become guides for public health practitioners in promoting community-based interventions.
The CHG model served as a guide for evaluating the
This work was supported by funding from CDC's Division of Nutrition and Physical Activity, Cooperative Agreement U58/CCU022819. The authors thank Ruth Abad, Charlotte Claybrooke, Sally Goodwin, Liz McNett Crowl, Kyle Unland, and Caroline Tittel. We also acknowledge the advisory committees and community members in Moses Lake and Mount Vernon who generously shared their time and thoughts about their
The opinions expressed by authors contributing to this journal do not necessarily reflect the opinions of the U.S. Department of Health and Human Services, the Public Health Service, Centers for Disease Control and Prevention, or the authors' affiliated institutions. Use of trade names is for identification only and does not imply endorsement by any of the groups named above.
Events and Actions of Washington State's
| April 2002 | Moses Lake selected as pilot community for implementing Washington State Nutrition and Physical Activity Plan objectives |
| June–September 2002 | Moses Lake advisory committee planning meetings held, community environmental inventory conducted, and action plan developed |
| September 2002 | Moses Lake project work teams formed for trails and paths, breastfeeding, and community garden |
| November 2002 | |
| December 2002 | First survey of Moses Lake advisory committee conducted |
| January 2003–present (ongoing) | Project work teams meetings held regularly and project plans implemented |
| November 2003 | Mount Vernon selected as second pilot community for implementing state plan objectives |
| January–June 2004 | Mount Vernon advisory committee planning meetings held, community environmental inventory conducted, and action plan developed |
| June 2004 | Second survey of Moses Lake project teams and selected advisory committee members conducted |
| June–September 2004 | Mount Vernon project work teams formed for urban trails, school district nutrition and physical activity policy, and healthy schools pilot project |
| September 2004 | Revised survey of Mount Vernon advisory committee conducted |
Sources of Data for Process Evaluation of Washington State's
| Community inventory feedback survey | Community participants who conducted the inventory | Feedback on inventory process and findings |
| Meeting minutes | Advisory committee and project group meeting minutes included in quarterly progress reports | List of attendees, project updates, discussion topics, and presenters |
| Planning team meeting minutes for Moses Lake pilot project planning | Washington State Department of Health (DOH) staff, University of Washington, and National Park Service partners; Moses Lake leadership representative | Pilot project planning and evaluation planning discussion |
| Meeting evaluation surveys | Attendees at each advisory committee meeting | Logistics, format, and comments |
| Activity logs, interviews, staff debriefings | DOH staff and technical advisors, community leadership, and staff | Observations about project progress and partnership functions |
Questions in Revised Survey for
| Individuals are empowered | 5 | By participating in the Mount Vernon |
| Bridge social ties: social networks increase and are strengthened | 6 | As a result of participating in this |
| Synergy: collaborations are creative and effective | 5 | The advisory committee worked together to identify new and creative ways to solve problems. |
| Who: wide spectrum of community individuals and organizations are involved | 2 | The diversity of Mount Vernon's population is well represented by the array of people and organizations who are members of the advisory committee. |
| How involved: participation in all capacities is feasible | 2 | I feel that my responsibilities to the advisory committee were well suited to my interests and skills. |
| Scope of the process: ongoing planning and actions address multiple issues | 5 | In the planning phase, the advisory committee explored an array of issues and prioritized them based on community assessments. |
| Encourage broad and active participation | 8 | The advisory committee is effective at providing orientation to new partners as they join the committee. |
| Ensure influence and control are broadly based | 4 | I have been included in the decision-making process of the advisory committee. |
| Facilitate group processes | 4 | In advisory committee discussions, members used language that was common to everyone and easy to understand. |
| Scope of process expands incrementally, remains integrated | 4 | As a group, we are building skills and expertise to carry out the objectives and meet the goals of the Mount Vernon |
Resources for Design of Survey Tool to Evaluate Community Partnerships for Health Promotion Projects
| Social capital index ( | Model for measuring social capital based on indicators of trust, involvement, and reciprocity |
| Evaluating partnerships ( | Outline of criteria applied to index partnership management and perceived costs and benefits |
| Measuring perceptions of multiple levels of control ( | Statements applied to index individual and community levels of empowerment |
| Assessing principles of partnership ( | Survey questions based on 10 principles of community–campus partnership |
| Partnership synergy self-assessment tool ( | Online tool based on elements outlined in community healthy governance model ( |
| Community partnership stakeholders questionnaire ( | Survey questions addressing stakeholder view of participation and outcomes based on a study of a community partnership for healthy personnel education |
| Community coalition action theory ( | Model includes elements of coalition membership and processes that create synergy for community capacity and change outcomes |