<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article"><?properties manuscript?><front><journal-meta><journal-id journal-id-type="nlm-journal-id">9505213</journal-id><journal-id journal-id-type="pubmed-jr-id">21279</journal-id><journal-id journal-id-type="nlm-ta">J Public Health Manag Pract</journal-id><journal-id journal-id-type="iso-abbrev">J Public Health Manag Pract</journal-id><journal-title-group><journal-title>Journal of public health management and practice : JPHMP</journal-title></journal-title-group><issn pub-type="ppub">1078-4659</issn><issn pub-type="epub">1550-5022</issn></journal-meta><article-meta><article-id pub-id-type="pmid">29481545</article-id><article-id pub-id-type="pmc">6650371</article-id><article-id pub-id-type="doi">10.1097/PHH.0000000000000734</article-id><article-id pub-id-type="manuscript">HHSPA1020441</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>Beyond Research Ethics: Novel Approaches of 3 Major Public Health Institutions to Provide Ethics Input on Public Health Practice Activities</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Klingler</surname><given-names>Corinna</given-names></name><degrees>MSc</degrees><aff id="A1">Institute of Ethics, History &#x00026; Theory of Medicine, Ludwig-Maximilians-Universit&#x000e4;t M&#x000fc;nchen, Munich, Germany</aff></contrib><contrib contrib-type="author"><name><surname>Barrett</surname><given-names>Drue H.</given-names></name><degrees>PhD</degrees><aff id="A2">Public Health Ethics Unit, Office of Scientific Integrity, Office of the Associate Director for Science, Office of the Director, Centers for Disease Control and Prevention, Atlanta, Georgia, USA</aff></contrib><contrib contrib-type="author"><name><surname>Ondrusek</surname><given-names>Nancy</given-names></name><degrees>PhD</degrees><aff id="A3">Science Office, Public Health Ontario, Toronto, Ontario, Canada</aff></contrib><contrib contrib-type="author"><name><surname>Johnson</surname><given-names>Brooke R.</given-names><suffix>Jr</suffix></name><degrees>PhD</degrees><aff id="A4">Department of Reproductive Health and Research &#x00026; UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction, World Health Organization, Geneva, Switzerland</aff></contrib><contrib contrib-type="author"><name><surname>Saxena</surname><given-names>Abha</given-names></name><degrees>MD</degrees><aff id="A5">Global Health Ethics Unit, Health Systems and Innovation Cluster, World Health Organization, Geneva, Switzerland</aff></contrib><contrib contrib-type="author"><name><surname>Reis</surname><given-names>Andreas A.</given-names></name><degrees>MD, MSc</degrees><aff id="A6">Global Health Ethics Unit, Health Systems and Innovation Cluster, World Health Organization, Geneva, Switzerland</aff></contrib></contrib-group><author-notes><fn fn-type="con" id="FN1"><p id="P1">All authors contributed to conceptualizing the paper and developing the argumentation; C.K., D.H.B., and N.O. wrote the first draft of the manuscript; all authors critically revised and approved the final manuscript.</p><p id="P2">The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.</p><p id="P3">The views and opinions expressed in this article are those of the authors and do not necessarily represent those of, or reflect, the official position of Public Health Ontario.</p><p id="P4">B.R.J., A.S., and A.A.R. are staff members of the World Health Organization. The authors alone are responsible for the views expressed in this article and they do not necessarily represent the decisions, policy, or views of the World Health Organization.</p></fn><corresp id="CR1"><bold>Correspondence:</bold> Corinna Klingler, MSc, Institute of Ethics, History &#x00026; Theory of Medicine, Ludwig-Maximiiians-Universit&#x000e4;t M&#x000fc;nchen, Lessingstr. 2, 80336 Munich, Germany (<email>corinna.klingler@med.uni-muenchen.de</email>).</corresp></author-notes><pub-date pub-type="nihms-submitted"><day>22</day><month>5</month><year>2019</year></pub-date><pub-date pub-type="epub"><day>23</day><month>2</month><year>2018</year></pub-date><pub-date pub-type="pmc-release"><day>23</day><month>8</month><year>2019</year></pub-date><elocation-id>10.1097/PHH.0000000000000734</elocation-id><abstract id="ABS1"><p id="P5">Public health institutions increasingly realize the importance of creating a culture in their organizations that values ethics. When developing strategies to strengthen ethics, institutions will have to take into account that while public health research projects typically undergo thorough ethics review, activities considered public health practice may not be subjected to similar oversight. This approach, based on a research-practice dichotomy, is increasingly being criticized as it does not adequately identify and manage ethically relevant risks to those affected by nonresearch activities. As a reaction, 3 major public health institutions (the World Health Organization, US Centers for Disease Control and Prevention, and Public Health Ontario) have implemented mechanisms for ethics review of public health practice activities. In this article, we describe and critically discuss the different modalities of the 3 approaches. We argue that although further evaluation is necessary to determine the effectiveness of the different approaches, public health institutions should strive to implement procedures to ensure that public health practice adheres to the highest ethical standards.</p></abstract><kwd-group><kwd>ethics review</kwd><kwd>public health ethics</kwd><kwd>research-practice distinction</kwd></kwd-group></article-meta></front><body><p id="P6">Public health institutions increasingly realize that creating a culture that values ethics in their organizations is important to ensure public trust and effectiveness of implemented policies and programs. This is reflected, for example, by the adoption of a revised set of accreditation standards by the Public Health Accreditation Board overseeing the accreditation process for health departments in the United States. The 2013 revised set of standards requires documentation of a health department&#x02019;s ability to identify, analyze, and resolve ethical issues.<sup><xref rid="R1" ref-type="bibr">1</xref>,<xref rid="R2" ref-type="bibr">2</xref></sup> When developing strategies to strengthen ethics, institutions will have to take into account the long-established differences in dealing with public health practice and research. Describing an activity as research or practice has considerable normative, procedural,and regulatory implications. Research activities are typically subject to regulatory oversight and external review by research ethics boards/committees in order to ensure that the research is conducted in accordance with ethical principles and regulations. This regulatory oversight is typically not applied to activities considered public health practice.</p><p id="P7">Increasingly, the ethical appropriateness of making determinations regarding review activities based on the research practice divide has been drawn into question. Many public health activities traditionally not considered research&#x02014;such as public health surveillance or program evaluation activities&#x02014;involve extensive data collection and employ some of the same methods as research projects. They also exhibit ethically relevant risks to participants. We consider these risks to include not only potential for incurring harm, but also instances of disrespecting other relevant normative principles, such as autonomy or justice. For example, privacy concerns have been raised about collecting and using data for public health surveillance without obtaining informed consent.<sup><xref rid="R3" ref-type="bibr">3</xref>,<xref rid="R4" ref-type="bibr">4</xref></sup> It has been recognized in academic debates that ethics review or consultations might be important to ensure accountability and adequate management of relevant risks for many nonresearch activities in public health.<sup><xref rid="R5" ref-type="bibr">5</xref>&#x02013;<xref rid="R11" ref-type="bibr">11</xref></sup> The same has been noted for the clinical context.<sup><xref rid="R12" ref-type="bibr">12</xref>,<xref rid="R13" ref-type="bibr">13</xref></sup></p><p id="P8">While the need for ethics review of practice activities is increasingly being recognized, best practices and modalities for conducting this review, especially in the context of public health, are in the early phases of development and have&#x02014;to the best of our knowledge&#x02014;not been subjected to a comprehensive critical review or evaluation. Some authors have warned that subjecting all public health practice activities to full review by ethics committees might be unfeasible because of limited resources, competencies, or even becoming an unnecessary bureaucratic hurdle.<sup><xref rid="R6" ref-type="bibr">6</xref>,<xref rid="R8" ref-type="bibr">8</xref>,<xref rid="R14" ref-type="bibr">14</xref></sup> In the research context, ethics review has sometimes been shown to be a barrier, creating risks instead of averting them, by delaying or precluding important studies.<sup><xref rid="R12" ref-type="bibr">12</xref>,<xref rid="R15" ref-type="bibr">15</xref>,<xref rid="R16" ref-type="bibr">16</xref></sup></p><p id="P9">Currently, only a few major public health institutions have developed and implemented mechanisms that offer ethics review/consultations for practice activities. The World Health Organization (WHO), the US Centers for Disease Control and Prevention (CDC), and Public Health Ontario (PHO) in Canada were among the first to implement initiatives of this kind. In the United States, additional examples at the local health department level include Clark County, Washington,<sup><xref rid="R17" ref-type="bibr">17</xref></sup> and Mahoning County, Ohio,<sup><xref rid="R18" ref-type="bibr">18</xref></sup> which have established public health ethics committees [PHECs]; and many more health departments are seeking guidance on establishing an ethics committee because of the revised health department accreditation standards. In Canada, the Comit&#x000e9; d&#x02019;&#x000e9;thique de sant&#x000e9; publique was established in Qu&#x000e9;bec<sup><xref rid="R19" ref-type="bibr">19</xref></sup> to provide ethics review and recommendations on new provincial plans for surveillance or health/social issues surveys, but there are probably more initiatives that the authors are not aware of. To advance the critical evaluation of the ethics review and consultation process for public health practice, we share information about the modalities and underlying rationale of the WHO, CDC, and PHO approaches. With this, we hope to enrich the discussions of possible strategies to ensure ethical conduct in public health practice activities and to identify promising ways to move forward.</p><sec disp-level="2" id="S2"><title>The 3 Initiatives</title><sec id="S3"><title>WHO Public Health Ethics Consultation Service</title><p id="P10">Through the WHO Public Health Ethics Consultation Service (ECS), ethics advice is offered to WHO staff members who support public health activities that are not considered research and are, therefore, not required to undergo ethics review from the research ethics review committee. Staff dealing with ethically sensitive issues in their practice activities can request an ethics consultation with the ECS on a voluntary basis, regardless of whether interventions are in the development or implementation stages.</p><p id="P11">The Public Health Ethics Consultative Group was established in 2015 to address the growing need for advice and guidance on ethical issues that arise in WHO&#x02019;s nonresearch projects. The ECS was initiated to supplant the informal discussions with the WHO Global Health Ethics Unit that were sought by staff. The Consultative Group comprised WHO staff members from different departments and with diverse professional expertise, gender, and geographical representation. Training in public health ethics is periodically offered to all members. The WHO Global Health Ethics Unit serves as secretariat and coordinates the work of the group. Projects are discussed during in-person meetings with the staff member(s) responsible for the project. The secretariat invites members of the ECS to consultations according to their expertise and availability.</p><p id="P12">Ethics consultations are guided by a review template based on a comprehensive review of public health ethics frameworks.<sup><xref rid="R20" ref-type="bibr">20</xref>-<xref rid="R30" ref-type="bibr">30</xref></sup> The tool identifies normative <italic>substantive criteria</italic> that should be understood as <italic>prima facie obligations</italic> (action-guiding duties as long as they do not conflict with further obligations) for public health practitioners. Questions relating to those obligations are formulated to guide the reviewer through the analysis, for example:</p><list list-type="bullet" id="L2"><list-item><p id="P13">What harms are perceived as potential consequences of the proposed activity?</p></list-item><list-item><p id="P14">Is solidarity among members of the community undermined by the proposed activity?</p></list-item><list-item><p id="P15">Is information about the proposed intervention adapted to the informational needs of the affected population?</p></list-item></list><p id="P16">Those reviewing the planned activity check whether those obligations are sufficiently addressed in the supplied protocol. Sometimes aspects of a planned activity that appear problematic can be easily changed to fulfill existing obligations. Sometimes they cannot because of particular barriers (eg, limited resources) or because certain benefits can only be realized to the detriment of other obligations (eg, health benefits realized only when accepting privacy breaches). For the later cases, the tool identifies <italic>deliberative criteria</italic> (eg, necessity, proportionality) to guide weighing and balancing of principles to make justifiable trade-offs and to give reasonable recommendations regarding project design or implementation. The template additionally identifies <italic>procedural criteria</italic> (eg, transparency, community participation) for the implementation of a planned activity. Although an intervention might be considered ethically adequate, moral controversy between project teams and communities might arise and it is important to ensure buy-in from communities. The procedural criteria ensure that attitudes and values of affected communities are adequately considered. They cannot be traded against substantive criteria.</p><p id="P17">The secretariat provides a written summary of the discussion during in-person meetings including non-binding recommendations to the technical team requesting advice. If needed, the secretariat can invite external experts to conduct further ethical analyses. The costs for the service to the organization are difficult to measure as it is provided by internal experts alongside their other tasks.</p><p id="P18">In 2015 and 2016, 10 projects were reviewed at the request of technical units. They were mostly concerned not only with surveillance and data collection but also with resource allocation, rationing, and patient safety issues. One ethical issue that has repeatedly come up in deliberations is whether setting up a surveillance system and corresponding database on sensitive issues could endanger the subjects in case of a leak and how this risk should be dealt with.</p></sec><sec id="S4"><title>CDC&#x02019;s Public Health Ethics Consultation Service</title><p id="P19">In 2005, the CDC established the Public Health Ethics Committee (PHEC) to provide leadership in public health ethics within the agency. The creation of the committee was influenced by the need for CDC to have a systematic process for addressing ethical issues that arise in the practice of public health. The importance of this was highlighted by the shortage of the 2004&#x02013;2005 seasonal influenza vaccine that required public health officials to make decisions regarding who would receive the limited supply of the vaccine. Following this incident, the CDC created the committee that is composed of CDC staff who have been designated as public health ethics leads and their alternates from each of the agency&#x02019;s centers. However, any CDC staff member who has an interest in public health ethics is welcome to join. Leadership for the committee is provided by the public health ethics unit within the office of the associate director for science.</p><p id="P20">The PHEC provides a Public Health Ethics Consultation Service (ECS) to assist program leaders in addressing ethical concerns that arise in public health practice. A consult subcommittee made up of PHEC members assists with the consultation function. There are separate offices within CDC for the ethical review of public health research activities and for compliance with ethical standards and policies governing the behavior of CDC employees. Costs for the service have not been measured, but the public health ethics unit is staffed by 2 employees (a health scientist and an ethicist) who work full time on public health ethics issues. Other members of the committee participate in PHEC as an additional activity to their other work duties.</p><p id="P21">At CDC, public health ethics consults involve a systematic approach to clarifying issues, determining pertinent ethical principles and values, and identifying possible alternative courses of action. The process of an ethics consult can be categorized into 3 actions&#x02014;to identify, analyze, and resolve. The &#x0201c;identification phase&#x0201d; is used to gather relevant information from program staff, to identify the stakeholders and consider their values, and to clarify the public health ethics question. The &#x0201c;analyze phase&#x0201d; is used to evaluate the collected information, to consider different ethical perspectives, and to critically weigh the various factors that have been discussed. This includes a discussion of the public health goals, the possible risks and harms, the historical context, and whether there are potential legal authorities or ethics frameworks that can provide guidance. The &#x0201c;resolution phase&#x0201d; is used to identify alternatives, to weigh options, and to develop recommendations. The consult subcommittee identified a series of questions for each of the phases to stimulate discussion. For example, during the &#x0201c;analyze phase,&#x0201d; relevant questions include the following:</p><list list-type="bullet" id="L4"><list-item><p id="P22">What ethical principles and theories are related to the issue (eg, duty-based concerns, professional obligations, utilitarian concerns for protecting the public)?</p></list-item><list-item><p id="P23">What harms and benefits of the public health action have been identified? Have the burdens and benefits been distributed fairly?</p></list-item><list-item><p id="P24">Does the public health action represent use of the least intrusive or restrictive means?</p></list-item></list><p id="P25">No formal training in ethics is required for CDC staff to join PHEC; however, monthly PHEC meetings are devoted to educating members about the process of ethical analysis and the application of this process to public health decision making, often using case studies. Case studies are a mechanism for illustrating the types of ethical concerns that may arise in the practice of public health and they provide opportunities to practice the ethical analysis process using realistic scenarios. For example, the CDC has developed cases on ethical considerations for allocating scarce medical counter measures, decision making regarding restricting use of electronic nicotine delivery systems in indoor public spaces, and obligations regarding notifying individuals who may have been exposed to unsafe health care practices, which include respecting patient autonomy, minimizing harm, and engaging relevant stakeholders. In addition, the public health ethics unit maintains Internet and intranet Web-sites listing various public health ethics resources for ongoing training. The PHEC members are also encouraged to become familiar with the <italic>Principles for the Ethical Practice of Public Health.</italic><sup><xref rid="R30" ref-type="bibr">30</xref></sup></p><p id="P26">The CDC program staff can request a consult by contacting either their center&#x02019;s public health ethics lead or the public health ethics unit. The consult may proceed in a relatively informal manner that involves discussion of the issue between the requestor, the center&#x02019;s public health ethics lead, and public health ethics unit staff. No formal written request or approval of this type of consult is required. The product of this type of consult typically includes an e-mail to the requestor containing a summary of the discussion, including a list of nonbinding recommendations.</p><p id="P27">A second approach involves a more formal consult request procedure and the convening of the PHEC consult subcommittee. This formal approach requires the approval of the center&#x02019;s public health ethics lead and appropriate science leadership within the center. This more formal consult approach results in a written report detailing the background of the ethics question, actions taken by the PHEC consult subcommittee, a summary of the discussion of the issues, and the conclusions and nonbinding recommendations. One additional resource at the CDC for addressing ethical issues is the emergency operations center ethics desk. The ethics desk is staffed by the public health ethics unit and members of PHEC, and provides ethics input on issues that arise during emergency responses. Furthermore, public health ethics unit staff provide ethics input and consultation through a variety of other activities (eg, participation on CDC programmatic planning and policy work groups).</p><p id="P28">In 2015 and 2016, 22 consults were provided, all using the informal process. In addition, ethics input was provided by participation on 8 CDC work groups and through the CDC emergency operations center&#x02019;s ethics desk for 3 emergency responses (Ebola, Flint water crisis, and Zika).</p></sec><sec id="S5"><title>PHO&#x02019;s Ethics Consultation and Review Model</title><p id="P29">Public Health Ontario provides scientific and technical advice and support to clients working in government, public health, health care, and related sectors across Ontario, Canada&#x02019;s largest province with approximately 14 million people. In 2013, PHO established an integrated system of ethics consultation and review for new evidence-generating initiatives, whether or not they meet a particular definition of &#x0201c;research.&#x0201d; Ethics review is mandatory for new projects unless they meet the criteria for exemption as a result of being classified as routine business (eg, outbreak investigation). Ethics consultation is available upon request, whether or not formal ethics review is required. All projects involving PHO staff or resources are eligible for ethics consultation or review. Public Health Ontario adopted this expanded scope of mandatory ethics review to ensure appropriate protections for participants and others affected by evidence-generating public health initiatives not classified as research.</p><p id="P30">The ethics program is delivered by the equivalent of 2.7 ethics office staff. The coordinator and ethics officer work full time on the program, and a manager and ethics review board (ERB) chair contribute approximately 50% and 20%, respectively, of their time to the program. Volunteer ERB members meet approximately 6 times per year, with travel costs covered for out-of-town members to attend the meetings.</p><p id="P31">The PHO model includes a range of options for ethics review, proportionate to project risk. The risk level of new evidence-generating initiatives is assessed using the PHO Risk Screening Tool.<sup><xref rid="R31" ref-type="bibr">31</xref></sup> The Risk Screening Tool generates a score of 0, 1, 2, or 3, corresponding, respectively, to no further review required, review by the research ethics officer (REO, a member of the ethics office staff) or an ERB member, delegated review by 1 or 2 PHO ERB members, or full board review at a convened meeting. Public Health Ontario has also developed a number of fast-track checklists (FTCs), which include conditions or parameters for several types of commonly conducted low-risk projects (eg, secondary data analysis using anonymized data). The FTC conditions describe limits on project details, which must be adhered to for the project to be acceptable without further ethics review (eg, data collected will contain no identifiers). Fast-track checklists are developed in consultation with project teams and reviewed and approved by the full ERB. Projects that meet all of the conditions specified in an FTC are considered approved and do not require further review.</p><p id="P32">Ethics review board composition is consistent with national guidelines for institutional research ethics boards.<sup><xref rid="R32" ref-type="bibr">32</xref></sup> Ethics review board members are selected to provide expertise across a broad range of disciplines, research methods, and public health roles&#x02014;including community representation. Community members are not affiliated with the organization and have experience as a participant in public health studies or are members of a community that might be targeted for public health study or intervention. Ethics review board members are required to complete the nationally endorsed Tri-Council Policy Statement 2 online research ethics training module (<ext-link ext-link-type="uri" xlink:href="http://pre.ethics.gc.ca/eng/education/tutorial%20didacticiel/">http://pre.ethics.gc.ca/eng/education/tutorialdidacticiel/</ext-link>), become knowledgeable about PHO&#x02019;s ethics guidance documents,<sup><xref rid="R11" ref-type="bibr">11</xref>,<xref rid="R26" ref-type="bibr">26</xref></sup> and receive additional training at full board review meetings and special events (eg, retreats). Ethics consultation and review of minimal risk projects are provided by the REO, who has advanced training and experience in research ethics. As needed, the REO will seek input from the ERB chair or other ERB members.</p><p id="P33">All levels of ethics review and consultation are guided by PHO&#x02019;s ethics framework, which interprets the research ethics principles of respect for persons, welfare, and justice,<sup><xref rid="R32" ref-type="bibr">32</xref></sup> through a public health lens. The framework includes 10 questions to guide the ethical assessment of public health initiatives, for example:</p><list list-type="bullet" id="L6"><list-item><p id="P34">Are burdens and potential harms justified in light of the potential benefits to participants and/or to society?</p></list-item><list-item><p id="P35">Is community engagement warranted? Is it feasible? What level of engagement is appropriate?</p></list-item><list-item><p id="P36">What are the social justice implications of this initiative?</p></list-item></list><p id="P37">A form developed from the 10 questions is used for all levels of ethics review to help ensure consistency. Ethical concerns or need for additional information is communicated in writing to the project team members who are required to address the concerns prior to approval. Project teams are encouraged to consult with the REO, ERB chair, and ethics office staff to discuss concerns and possible solutions.</p><p id="P38">Voluntary consultation at any point in the life cycle of a project is encouraged. Ethics consultation is also available upon request for activities that do not require ethics review. Consultations may occur through informal phone conversations or e-mail, or more formally at a face-to-face meeting, depending on the nature of the request. Ethics input from consultations is provided as a written recommendation to be used at the discretion of the requestor.</p><p id="P39">Eighty-one projects were reviewed in 2015 and 63 in 2016. Projects captured by our approach that would likely not be reviewed by a traditional research ethics committee include program and product evaluations, new surveillance activities, expanded data collection as a part of routine outbreak investigations, and projects for which the classification of research or &#x0201c;other&#x0201d; activity was unclear.</p><p id="P40">The risks identified with these projects are similar to those with public health research projects including potential stigmatization of participants or communities during recruitment or dissemination of results, consent form or process deficiencies, and lack of community consultation during study design to ensure minimization or mitigation of risks.</p></sec></sec><sec id="S6"><title>Discussion</title><sec id="S7"><title>Comparing the 3 approaches</title><p id="P41">The 3 approaches described previously differ with regard to various aspects (see <xref rid="T1" ref-type="table">Table 1</xref>). However, the main difference in the 3 approaches is the categorization of activities into &#x0201c;research&#x0201d; and &#x0201c;nonresearch&#x0201d; or &#x0201c;practice,&#x0201d; with mandatory ethics review for the former and voluntary consultation for the latter (although at CDC additional voluntary consultations are available for research projects as well), versus a single mandatory process for all activities whether or not they are &#x0201c;research,&#x0201d; with ethics review level determined by degree of risk. The WHO and the CDC have taken the first approach while PHO has introduced a uniform review process for all evidence-generating initiatives (although not for PHO programs and services like health promotion programs).There are advantages and disadvantages associated with both approaches. One advantage of the WHO and CDC approach is potentially higher staff acceptance of a system of voluntary consultation and, therefore, possibly less opposition to its introduction. Other advantages include ease of implementation as the approach can be added on as a new service without impacting existing processes and consistency with the current research ethics paradigm that differentiates research from practice activities.</p><p id="P42">A key challenge for approaches that treat practice and research activities differently is having to make the determination in which category a project belongs, a distinction that can be difficult to operationalize.<sup><xref rid="R11" ref-type="bibr">11</xref>,<xref rid="R33" ref-type="bibr">33</xref></sup> Research has been commonly defined on the basis of its primary purpose to develop generalizable knowledge.<sup><xref rid="R34" ref-type="bibr">34</xref>,<xref rid="R35" ref-type="bibr">35</xref></sup> However, a number of researchers have argued that this distinction is not practical because it may be difficult to articulate a primary purpose of an activity.<sup><xref rid="R36" ref-type="bibr">36</xref>,<xref rid="R37" ref-type="bibr">37</xref></sup> It is, furthermore, unclear what degree of generalizability is required.<sup><xref rid="R12" ref-type="bibr">12</xref></sup> The example of implementation research&#x02014;which describes enquiries into the process of translating evidence into practice&#x02014;makes the difficulties with generalizability particularly visible: While its main purpose is to produce knowledge about the local context with limited generalizability, it is still generally considered research.<sup><xref rid="R38" ref-type="bibr">38</xref></sup> Those and further conceptual difficulties have resulted in considerable frustration and inconsistencies in identifying activities as practice or research.<sup><xref rid="R33" ref-type="bibr">33</xref></sup> Apart from these practical difficulties, a voluntary review process cannot solve the problem that practice activities may be associated with risks to participants and others but might simply not be reviewed with an ethics lens if the project team decides so. In addition, the mandatory &#x0201c;single system&#x0201d; approach may be more efficient at growing a culture of ethical integrity within an organization because it draws in even those staff who do not accept the need for ethics review and gives the ethics team the opportunity to demonstrate the value of bringing an ethics lens to activities.</p><p id="P43">To ensure ethics review of all activities that involve risks to participants, a mandatory approach based on risk instead of the research practice divide seems most appropriate. Such an approach, however, would necessitate a clear definition of risk and an independent mechanism for assessing it. Public Health Ontario has developed and successfully tested such a mechanism.<sup><xref rid="R31" ref-type="bibr">31</xref></sup> Furthermore, it might require significant capacity-building measures: first, staff need to be trained to review practice activities and sensitized to the specific ethical concerns arising in public health practice; second, the increase in number of projects having to undergo review might require additional staff. At PHO, overwhelming of the system has been avoided by providing a range of different review levels, use of a screening tool to assign projects to different levels based on risk, and introduction of a number of mechanisms to streamline review of low-risk activities. Another significant challenge to introducing a mandatory requirement for ethics review is gaining acceptance from those who deliver public health practice, for what can be seen as an interference or an obstacle to their work. Given the challenges of implementing a mandatory approach for high-risk projects, a voluntary system might be a good first step that would allow building acceptance of ethics reviews of practice activities and refining review processes.</p><p id="P44">Another interesting aspect is that all 3 institutions have developed tools to guide ethics review of practice activities. Those tools might help in sensitizing people to important issues and for possible differences between research and practice. Codes and frameworks developed for other contexts (eg, research ethics but also clinical ethics) often give imperfect guidance in public health practice contexts.<sup><xref rid="R20" ref-type="bibr">20</xref>,<xref rid="R21" ref-type="bibr">21</xref></sup> Members of review boards might not be aware of these differences, and tools can ensure that all relevant aspects are considered. The tools employed by the 3 institutions are question-based but they include different questions and are differently derived. However, they are all based on certain established normative principles that underlie the questions making up the frame-works. For example, in keeping with the scope of its global mission, when WHO developed its public health ethics consultation tool, it considered a wide range of ethical principles and frameworks and aimed to be as inclusive as possible (eg, the principle of solidarity is included even though this concept appeared in only a few, mainly European, frameworks). Public Health Ontario, on the contrary, has used nationally codified research ethics principles interpreted for the public health context as the basis for its tool.</p><p id="P45">Whether a certain principle is justifiably included in a particular tool can be debated and the justifiability of the inclusion decision might possibly depend on the specific context the tool is developed for. Furthermore, the principles and their corresponding questions do not provide full guidance but only a starting point for further deliberations. Those responsible for providing ethics input will still have to interpret normative concepts (eg, what constitutes a community in the given context) and weigh conflicting principles for the specific project and issue at hand (eg, whether the risk of stigmatization of a targeted health promotion program can be accepted in the face of considerable anticipated health gains). Although the users of the tools employed in our organizations have found them helpful, evaluations of the tools will have to show whether the guidance provided is sufficient. Further normative scholarship might also be necessary to identify possible gaps in tools employed.</p><p id="P46">There are further differences between the approaches that warrant reflection. Public Health Ontario is the only organization that requires community representation on the review group. While consideration of stakeholder interests is also an important part of WHO&#x02019;s and CDC&#x02019;s ethical analysis processes, mainly for pragmatic reasons their ethics committees or groups are staffed with internal experts. While the importance of community representation on ethics committees has been emphasized by organizations such as the US National Association of County &#x00026; City Health Officials,<sup><xref rid="R39" ref-type="bibr">39</xref></sup> the manner of community participation deserves further critical thought. One issue that remains unresolved is the issue of who should represent the community. Given the numerous variables that may form the basis of a community in relation to a public health activity, such as ethnicity, geography, use of a common service, or other type of social relatedness, as well as the heterogeneity of values and perspectives that are usually present within a community, there will always be a limitation to the degree to which one or a few individuals will be able to be &#x0201c;community representatives.&#x0201d; A similar challenge is faced by research ethics committees.<sup><xref rid="R40" ref-type="bibr">40</xref>,<xref rid="R41" ref-type="bibr">41</xref></sup> To address this limitation, the PHO ERB, for example, also includes members from several public health units across the province, who bring understanding of the local context for the populations they serve. In addition, where there is concern that a project may pose particular risks to specific communities, additional engagement with the affected communities is undertaken, either by the project team or occasionally by inviting the input of an ad hoc community member.</p><p id="P47">Irrespective of which approach is chosen and which tools are employed, obtaining buy-in from staff is&#x02014;in our experience&#x02014;critical for successful implementation of a new ethics program. All 3 organizations have used a mix of the following approaches to ensure staff acceptance: ongoing endorsement from senior leaders within the organization; extensive staff sensitization on the opportunity for and advantages of ethics services; raising organizational awareness about key issues; provision of a range of options to permit a truly proportionate review process rather than a &#x0201c;one-size-fits-all&#x0201d; approach; involving the users in development of services; and adapting and improving services in response to user feedback. Furthermore, it will be important to regularly reflect on and improve existing processes to ensure ethics review does not become a mere bureaucratic checklist.</p><p id="P48">Finally, the organizations whose ethics procedures have been discussed in the preceding paragraphs are acting on a provincial, national, or even international level. While their approaches can provide orientation to local health departments, these institutions might lack the necessary resources to implement formal ethics review services of their own. However, that does not mean that there are no possibilities for improvement; a core element for any approach is to increase the sensitivity of public health practitioners to ethical issues that may arise in their work. Smaller organizations can support this by promoting user-friendly ethics educational materials within the organization or by introducing ethical considerations into existing operational review or approval processes. The CDC has also been working closely with National Association of County &#x00026; City Health Officials to develop tools and resources for use by local health officials. This has included the development of public health ethics training materials<sup><xref rid="R42" ref-type="bibr">42</xref></sup> and guidance on how to establish PHECs.<sup><xref rid="R39" ref-type="bibr">39</xref></sup> The CDC also funded National Association of County &#x00026; City Health Officials to conduct a pilot program with a local health department to assist in their development of an ethics committee.</p></sec><sec id="S8"><title>Future evaluations of ethics processes needed</title><p id="P49">In this time of limited resources, it is important to document the impact of public health decisions and activities. The need to measure impact extends to ethics services, as has been shown by increased interest in evaluation of ethics consultations in the clinical context.<sup><xref rid="R43" ref-type="bibr">43</xref></sup> With this in mind, each of the 3 institutions has begun considering how to best evaluate its ethics consultation/review processes. The CDC&#x02019;s efforts in this regard have included the development of a logic model to describe the desired components of an ethics activity at the local health department level, the inputs needed to support this activity, and the desired short-term, intermediate, and long-term outcomes (see <xref rid="T2" ref-type="table">Table 2</xref>). Working with a group of external advisers, the CDC also identified key substantive ethical dimensions and key attributes of a successful ethical process that might serve as quality indicators for ethics consultations (see <xref rid="T3" ref-type="table">Table 3</xref>). The next step is to identify potential indicators/measures and possible data sources for each identified outcome so that comparisons over time and across institutions can be done. It may be necessary to begin with assessing process measures, such as data on the number of staff receiving training about public health ethics or the number of requests for an ethics consult. Therefore, it will be important to establish processes for documenting the number, topic, and outcome of each consult (including perceptions about the usefulness, timeliness of the consult process, and satisfaction with the outcome). This can be particularly challenging when less formal consult procedures are used (eg, informal discussions).</p><p id="P50">Public Health Ontario completed a formative evaluation of its ethics review process after 1 year of implementation, using a mixed-methods approach. Process measures included number and type of review according to the risk level of projects. A variety of short-term outcomes were assessed, including researcher and ERB member satisfaction with the review process, adequacy of educational materials, and ethics staff observations regarding service delivery. This early feedback was used to modify forms and instructions to enhance clarity and to streamline administrative processes.</p><p id="P51">An evaluation of WHO&#x02019;s ECS is planned after 2 years of its establishment. Currently, WHO is designing evaluative procedures fitting its specific organizational structure and mission.</p><p id="P52">More creative process and outcome measures will be needed to document the long-term impact of an ethics activity on building public trust and ultimately improving health outcomes. Hopefully, as more health departments establish ethics infrastructure, it will be possible to design empirical studies investigating the impact of public health ethics activities and compare results across institutions. In any case, public health institutions should develop and implement evaluation capacities alongside ethics measures to allow such studies.</p></sec></sec><sec id="S9"><title>Conclusion</title><p id="P53">There can be no doubt that public health has an obligation to conduct both research and practice activities that respect and promote the highest ethical standards. This includes identifying high-risk projects and ensuring that risks are adequately managed. There is a long history of ethics review and oversight of public health <italic>research</italic> activities. This is the first article to describe and compare approaches to ethics review of public health <italic>practice</italic> activities. We encourage other public health organizations to consider establishing ethics processes for public health practice, building upon the models presented in this article.</p><p id="P54">The approaches taken by the CDC, the PHO, and the WHO each have their advantages and disadvantages. To assess the relative value each approach brings to protecting the ethical integrity of all public health activities, additional work is needed to evaluate the impact of these approaches. The development of robust evaluation tools will be essential to further demonstrate the value of public health ethics consultation and review processes (for practice as well as research activities), to increase transparency, and to allow learning from each other.</p></sec></body><back><ack id="S10"><p id="P55">C.K. has received funding for a Carlo Schmid Fellowship from the German Academic Exchange Service (DAAD) in 2014&#x02013;2015 in support of an internship with the WHO Global Health Ethics Unit during which parts of this paper were developed. Funding bodies had no influence on this paper.</p></ack><fn-group><fn fn-type="COI-statement" id="FN2"><p id="P56">The authors declare no conflicts of interest. All authors, however, were involved in developing and implementing the services presented in this paper.</p></fn></fn-group><ref-list><title>References</title><ref id="R1"><label>1.</label><mixed-citation publication-type="web"><collab>Public Health Accreditation Board</collab>. <source>Accreditation overview</source>, <comment><ext-link ext-link-type="uri" xlink:href="http://www.phaboard.org/accreditation-overview/">http://www.phaboard.org/accreditation-overview/</ext-link>.</comment> Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R2"><label>2.</label><mixed-citation publication-type="web"><collab>Public Health Accreditation Board</collab>. <source>Standards &#x00026; measures, version 1.5</source>. <comment><ext-link ext-link-type="uri" xlink:href="http://www.phaboard.org/wp-content/uploads/PHABSM_WEB_LR1.pdf">http://www.phaboard.org/wp-content/uploads/PHABSM_WEB_LR1.pdf</ext-link>.</comment> Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R3"><label>3.</label><mixed-citation publication-type="book"><name><surname>Childress</surname><given-names>JF</given-names></name>. <chapter-title>Surveillance and Public health data: the foundation and eyes of public health</chapter-title> In: <name><surname>Bernheim</surname><given-names>RG</given-names></name>, <name><surname>Childress</surname><given-names>JF</given-names></name>, <name><surname>Bonnie</surname><given-names>RJ</given-names></name>, <name><surname>Melnick</surname><given-names>AL</given-names></name>, eds. <source>Essentials of Public Health Ethics</source>. <publisher-loc>Burlington, Canada</publisher-loc>: <publisher-name>Jones &#x00026; Bartlett Learning</publisher-name>; <year>2015</year>:<fpage>97</fpage>&#x02013;<lpage>118</lpage>.</mixed-citation></ref><ref id="R4"><label>4.</label><mixed-citation publication-type="journal"><name><surname>Klingler</surname><given-names>C</given-names></name>, <name><surname>Silva</surname><given-names>DS</given-names></name>, <name><surname>Schuermann</surname><given-names>C</given-names></name>, <name><surname>Reis</surname><given-names>AA</given-names></name>, <name><surname>Saxena</surname><given-names>A</given-names></name>, <name><surname>Strech</surname><given-names>D</given-names></name>. <article-title>Ethical issues in public health surveillance: a systematic qualitative review</article-title>. <source>BMC Public Health</source>. <year>2017</year>;<volume>17</volume>:<fpage>295</fpage>.<pub-id pub-id-type="pmid">28376752</pub-id></mixed-citation></ref><ref id="R5"><label>5.</label><mixed-citation publication-type="journal"><name><surname>Beilin</surname><given-names>E</given-names></name>, <name><surname>Dubler</surname><given-names>NN</given-names></name>. <article-title>The quality improvement-research divide and the need for external oversight</article-title>. <source>Am J Public Health</source>. <year>2001</year> ;<volume>91</volume>:<fpage>1512</fpage>&#x02013;<lpage>1517</lpage>.<pub-id pub-id-type="pmid">11527790</pub-id></mixed-citation></ref><ref id="R6"><label>6.</label><mixed-citation publication-type="journal"><name><surname>Petrini</surname><given-names>C</given-names></name>
<article-title>Procedures for the ethical review of public health surveillance protocols</article-title>. <source>Commentary. Ann 1st Super Sanita</source>. <year>2014</year>;<volume>50</volume>:<fpage>1</fpage>&#x02013;<lpage>3</lpage>.</mixed-citation></ref><ref id="R7"><label>7.</label><mixed-citation publication-type="journal"><name><surname>Casarett</surname><given-names>D</given-names></name>, <name><surname>Karlawish</surname><given-names>JH</given-names></name>, <name><surname>Sugarman</surname><given-names>J</given-names></name>. <article-title>Determining when quality improvement initiatives should be considered research: proposed criteria and potential implications</article-title>. <source>JAMA</source>. <year>2000</year>;<volume>283</volume>:<fpage>2275</fpage>&#x02013;<lpage>2280</lpage>.<pub-id pub-id-type="pmid">10807388</pub-id></mixed-citation></ref><ref id="R8"><label>8.</label><mixed-citation publication-type="journal"><name><surname>Fletcher</surname><given-names>J</given-names></name>
<article-title>Ethical approval for all studies involving human participants</article-title>. <source>CMAJ</source>. <year>2015</year>;<volume>187</volume>:<fpage>91</fpage>.<pub-id pub-id-type="pmid">25512648</pub-id></mixed-citation></ref><ref id="R9"><label>9.</label><mixed-citation publication-type="journal"><name><surname>MacQueen</surname><given-names>KM</given-names></name>, <name><surname>Buehler</surname><given-names>JW</given-names></name>. <article-title>Ethics, practice, and research in public health</article-title>. <source>Am J Public Health</source>. <year>2004</year>;<volume>94</volume>:<fpage>928</fpage>&#x02013;<lpage>931</lpage>.<pub-id pub-id-type="pmid">15249291</pub-id></mixed-citation></ref><ref id="R10"><label>10.</label><mixed-citation publication-type="journal"><name><surname>Wade</surname><given-names>DT</given-names></name>. <article-title>Ethics, audit, and research: all shades of grey</article-title>. <source>BMJ</source>. <year>2005</year>;<volume>330</volume>:<fpage>468</fpage>&#x02013;<lpage>471</lpage>.<pub-id pub-id-type="pmid">15731146</pub-id></mixed-citation></ref><ref id="R11"><label>11.</label><mixed-citation publication-type="journal"><name><surname>Willison</surname><given-names>DJ</given-names></name>, <name><surname>Ondrusek</surname><given-names>N</given-names></name>, <name><surname>Dawson</surname><given-names>A</given-names></name>, <etal/>
<article-title>What makes public health studies ethical? Dissolving the boundary between research and practice</article-title>. <source>BMC Med Ethics</source>. <year>2014</year>;<volume>15</volume>:<fpage>61</fpage>.<pub-id pub-id-type="pmid">25104180</pub-id></mixed-citation></ref><ref id="R12"><label>12.</label><mixed-citation publication-type="journal"><name><surname>Kass</surname><given-names>NE</given-names></name>, <name><surname>Faden</surname><given-names>RR</given-names></name>, <name><surname>Goodman</surname><given-names>SN</given-names></name>, <name><surname>Pronovost</surname><given-names>P</given-names></name>, <name><surname>Tunis</surname><given-names>S</given-names></name>, <name><surname>Beauchamp</surname><given-names>TL</given-names></name>. <article-title>The research-treatment distinction: a problematic approach for determining which activities should have ethical over-sight</article-title>. <source>Hastings Cent Rep. 2013;Spec Rep</source>
<volume>43</volume>:<fpage>S4</fpage>&#x02013;<lpage>S15</lpage>.</mixed-citation></ref><ref id="R13"><label>13.</label><mixed-citation publication-type="journal"><name><surname>Faden</surname><given-names>RR</given-names></name>, <name><surname>Kass</surname><given-names>NE</given-names></name>, <name><surname>Goodman</surname><given-names>SN</given-names></name>, <name><surname>Pronovost</surname><given-names>P</given-names></name>, <name><surname>Tunis</surname><given-names>S</given-names></name>, <name><surname>Beauchamp</surname><given-names>TL</given-names></name>. <article-title>An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics</article-title>. <source>Hastings Cent Rep. 2013; Spec Rep</source>
<volume>43</volume>:<fpage>S16</fpage>&#x02013;<lpage>S27</lpage>.</mixed-citation></ref><ref id="R14"><label>14.</label><mixed-citation publication-type="journal"><name><surname>Thurston</surname><given-names>WE</given-names></name>, <name><surname>Vollman</surname><given-names>AR</given-names></name>, <name><surname>Burgess</surname><given-names>MM</given-names></name>. <article-title>Ethical review of health promotion program evaluation proposals</article-title>. <source>Health Promot Pract</source>. <year>2003</year>;<volume>4</volume>:<fpage>45</fpage>&#x02013;<lpage>50</lpage>.<pub-id pub-id-type="pmid">14610971</pub-id></mixed-citation></ref><ref id="R15"><label>15.</label><mixed-citation publication-type="journal"><name><surname>Beauchamp</surname><given-names>TL</given-names></name>. <article-title>Viewpoint: why our conceptions of research and practice may not serve the best interest of patients and subjects</article-title>. <source>J Intern Med</source>. <year>2011</year>;<volume>269</volume>:<fpage>383</fpage>&#x02013;<lpage>387</lpage>.<pub-id pub-id-type="pmid">21410785</pub-id></mixed-citation></ref><ref id="R16"><label>16.</label><mixed-citation publication-type="journal"><name><surname>Baily</surname><given-names>MA</given-names></name>. <article-title>Harming through protection?</article-title>
<source>N Engl J Med</source>. <year>2008</year>; <volume>358</volume>:<fpage>768</fpage>&#x02013;<lpage>769</lpage>.<pub-id pub-id-type="pmid">18287599</pub-id></mixed-citation></ref><ref id="R17"><label>17.</label><mixed-citation publication-type="web"><collab>Clark County Public Health</collab>. <source>Advisory councils</source>, <comment><ext-link ext-link-type="uri" xlink:href="https://www.dark.wa.gov/public-health/advisory-councils">https://www.dark.wa.gov/public-health/advisory-councils</ext-link>.</comment> Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R18"><label>18.</label><mixed-citation publication-type="web"><collab>Mahoning County District Board of Health</collab>. <source>Code of public health ethics</source>, <comment><ext-link ext-link-type="uri" xlink:href="http://www.mahoninghealth.org/about-us/code-of-public-health-ethics/">http://www.mahoninghealth.org/about-us/code-of-public-health-ethics/</ext-link>.</comment> Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R19"><label>19.</label><mixed-citation publication-type="web"><collab>Sant&#x000e9; et Services Sociaux Qu&#x000e9;bec</collab>. <source>&#x000c9;thique en sant&#x000e9; et services sociaux</source>, <comment><ext-link ext-link-type="uri" xlink:href="http://www.guidesante.gouv.qc.ca/professionnels/ethique/ethique-en-sante-et-services-sociaux/">http://www.guidesante.gouv.qc.ca/professionnels/ethique/ethique-en-sante-et-services-sociaux/</ext-link>.</comment> Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R20"><label>20.</label><mixed-citation publication-type="journal"><name><surname>Kass</surname><given-names>NE</given-names></name>. <article-title>An ethics framework for public health</article-title>. <source>Am J Public Health</source>. <year>2001</year>;<volume>91</volume>:<fpage>1776</fpage>&#x02013;<lpage>1782</lpage>.<pub-id pub-id-type="pmid">11684600</pub-id></mixed-citation></ref><ref id="R21"><label>21.</label><mixed-citation publication-type="journal"><name><surname>Childress</surname><given-names>JF</given-names></name>, <name><surname>Faden</surname><given-names>RR</given-names></name>, <name><surname>Gaare</surname><given-names>RD</given-names></name>, <etal/>
<article-title>Public health ethics: mapping the terrain</article-title>. <source>J Law Med Ethics</source>. <year>2002</year>;<volume>30</volume>:<fpage>170</fpage>&#x02013;<lpage>178</lpage>.<pub-id pub-id-type="pmid">12066595</pub-id></mixed-citation></ref><ref id="R22"><label>22.</label><mixed-citation publication-type="journal"><name><surname>Marckmann</surname><given-names>G</given-names></name>, <name><surname>Schmidt</surname><given-names>H</given-names></name>, <name><surname>Sofaer</surname><given-names>N</given-names></name>, <name><surname>Strech</surname><given-names>D</given-names></name>. <article-title>Putting public health ethics into practice: a systematic framework</article-title>. <source>Front Public Health</source>. <year>2015</year>:<volume>3</volume>:<fpage>23</fpage>.<pub-id pub-id-type="pmid">25705615</pub-id></mixed-citation></ref><ref id="R23"><label>23.</label><mixed-citation publication-type="journal"><name><surname>Thompson</surname><given-names>AK</given-names></name>, <name><surname>Faith</surname><given-names>K</given-names></name>, <name><surname>Gibson</surname><given-names>JL</given-names></name>, <name><surname>Upshur</surname><given-names>RE</given-names></name>. <article-title>Pandemic influenza preparedness: an ethical framework to guide decision-making</article-title>. <source>BMC Med Ethics</source>. <year>2006</year>;<volume>7</volume>:<fpage>E12</fpage>.<pub-id pub-id-type="pmid">17144926</pub-id></mixed-citation></ref><ref id="R24"><label>24.</label><mixed-citation publication-type="journal"><name><surname>Upshur</surname><given-names>RE</given-names></name>. <article-title>Principles for the justification of public health intervention</article-title>. <source>Can J Public Health</source>. <year>2002</year>;<volume>93</volume>:<fpage>101</fpage>&#x02013;<lpage>103</lpage>.<pub-id pub-id-type="pmid">11968179</pub-id></mixed-citation></ref><ref id="R25"><label>25.</label><mixed-citation publication-type="journal"><name><surname>Tannahill</surname><given-names>A</given-names></name>
<article-title>Beyond evidence&#x02014;to ethics: a decision-making frame-work for health promotion, public health and health improvement</article-title>. <source>Health Promot Int</source>. <year>2008</year>;<volume>23</volume>:<fpage>380</fpage>&#x02013;<lpage>390</lpage>.<pub-id pub-id-type="pmid">18971394</pub-id></mixed-citation></ref><ref id="R26"><label>26.</label><mixed-citation publication-type="web"><collab>Ontario Agency for Health Protection and Promotion</collab>. <source>A framework for the ethical conduct of public health initiatives</source>, <comment><ext-link ext-link-type="uri" xlink:href="http://www.ontla.on.ca/library/repository/mon/26004/316975.pdf">www.ontla.on.ca/library/repository/mon/26004/316975.pdf</ext-link>.</comment> Published 2012. Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R27"><label>27.</label><mixed-citation publication-type="web"><collab>Nuffield Council on Bioethics</collab>. <source>Public Health: Ethical issues</source>. <comment><ext-link ext-link-type="uri" xlink:href="http://nuffieldbioethics.org/wp-content/uploads/2014/07/Public-health-ethical-issues.pdf">nuffieldbioethics.org/wp-content/uploads/2014/07/Public-health-ethical-issues.pdf</ext-link>.</comment> Published 2007. Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R28"><label>28.</label><mixed-citation publication-type="journal"><name><surname>Baum</surname><given-names>NM</given-names></name>, <name><surname>Gollust</surname><given-names>SE</given-names></name>, <name><surname>Goold</surname><given-names>SD</given-names></name>, <name><surname>Jacobson</surname><given-names>PD</given-names></name>. <article-title>Looking ahead: addressing ethical challenges in public health practice</article-title>. <source>J Law Med Ethics</source>. <year>2007</year>;<volume>35</volume>:<fpage>657</fpage>&#x02013;<lpage>667</lpage>.<pub-id pub-id-type="pmid">18076516</pub-id></mixed-citation></ref><ref id="R29"><label>29.</label><mixed-citation publication-type="web"><name><surname>Hickle</surname><given-names>D</given-names></name>, <name><surname>Richardson</surname><given-names>E</given-names></name>, <name><surname>Day</surname><given-names>F</given-names></name>, <etal/>
<source>Public policies, law and bioethics: a framework for producing public health policy across the European Union, eprints</source>. <comment><ext-link ext-link-type="uri" xlink:href="http://whiterose.ac.uk/100247/1/EuroPHENfullreport_libre.pdf">whiterose.ac.uk/100247/1/EuroPHENfullreport_libre.pdf</ext-link>.</comment> Published 2006. Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R30"><label>30.</label><mixed-citation publication-type="web"><collab>Public Health Leadership Society</collab>. <source>Principles of the ethical practice of public health</source>. <comment><ext-link ext-link-type="uri" xlink:href="https://www.apha.Org/~/media/files/pdf/membergroups/ethics_brochure.ashx">https://www.apha.Org/~/media/files/pdf/membergroups/ethics_brochure.ashx</ext-link>.</comment> Published 2002. Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R31"><label>31.</label><mixed-citation publication-type="journal"><name><surname>Ondrusek</surname><given-names>N</given-names></name>, <name><surname>Willison</surname><given-names>D</given-names></name>, <name><surname>Haroun</surname><given-names>V</given-names></name>, <name><surname>Bell</surname><given-names>J</given-names></name>, <name><surname>Bornbaum</surname><given-names>C</given-names></name>. <article-title>A risk screening tool for ethical appraisal of evidence-generating initiatives</article-title>. <source>BMC Med Ethics</source>. <year>2015</year>; <volume>16</volume>:<fpage>1</fpage>.<pub-id pub-id-type="pmid">25576996</pub-id></mixed-citation></ref><ref id="R32"><label>32.</label><mixed-citation publication-type="web"><collab>Canadian Institutes of Health Research, Natural Science and Engineering Research Council of Canada, and Social Sciences and Humanities Research Council of Canada</collab>. <source>Tri-council policy statement: ethical conduct for research involving humans</source>, <comment><ext-link ext-link-type="uri" xlink:href="http://www.pre.ethics.gc.ca/pdf/eng/tcps2-2014/TCPS_2_FINAL_Web.pdf">www.pre.ethics.gc.ca/pdf/eng/tcps2-2014/TCPS_2_FINAL_Web.pdf</ext-link>.</comment> Published 2014. Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R33"><label>33.</label><mixed-citation publication-type="journal"><name><surname>Fairchild</surname><given-names>AL</given-names></name>, <name><surname>Bayer</surname><given-names>R</given-names></name>. <article-title>Ethics and the conduct of public health surveillance</article-title>. <source>Science</source>. <year>2004</year>;<volume>303</volume>:<fpage>631</fpage>&#x02013;<lpage>632</lpage>.<pub-id pub-id-type="pmid">14752148</pub-id></mixed-citation></ref><ref id="R34"><label>34.</label><mixed-citation publication-type="web"><collab>Centers for Disease Control and Prevention</collab>. <source>Distinguishing public health research and public health nonresearch</source>, <comment><ext-link ext-link-type="uri" xlink:href="http://www.cdc.gov/od/science/integrity/docs/cdc-policy-distinguishing-public-health-research-nonresearch.pdf">www.cdc.gov/od/science/integrity/docs/cdc-policy-distinguishing-public-health-research-nonresearch.pdf</ext-link>.</comment> Published 2010. Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R35"><label>35.</label><mixed-citation publication-type="book"><collab>Council for International Organizations of Medical Sciences</collab>. <source>International Ethical Guidelines for Biomedical Research Involving Human Subjects</source>. <publisher-loc>Geneva, Switzerland</publisher-loc>: <publisher-name>CIOMS</publisher-name>; <year>2002</year>.</mixed-citation></ref><ref id="R36"><label>36.</label><mixed-citation publication-type="journal"><name><surname>Otto</surname><given-names>JL</given-names></name>, <name><surname>Holodniy</surname><given-names>M</given-names></name>, <name><surname>DeFraites</surname><given-names>RF</given-names></name>. <article-title>Public health practice is not research</article-title>. <source>Am J Public Health</source>. <year>2014</year>;<volume>104</volume>:<fpage>596</fpage>&#x02013;<lpage>602</lpage>.<pub-id pub-id-type="pmid">24524499</pub-id></mixed-citation></ref><ref id="R37"><label>37.</label><mixed-citation publication-type="book"><name><surname>Selgelid</surname><given-names>MJ</given-names></name>. <chapter-title>Distinguish between public health surveillance and public health research</chapter-title> In: <source>Ethics in Epidemics, Emergencies and Disasters: Research, Surveillance and Patient Care&#x02014;Training Manual</source>. <publisher-loc>Geneva, Switzerland</publisher-loc>: <publisher-name>World Health Organization</publisher-name>; <year>2015</year>:<fpage>21</fpage>&#x02013;<lpage>26</lpage>.</mixed-citation></ref><ref id="R38"><label>38.</label><mixed-citation publication-type="journal"><name><surname>Gopichandran</surname><given-names>V</given-names></name>, <name><surname>Luyckx</surname><given-names>VA</given-names></name>, <name><surname>Biller-Andorno</surname><given-names>N</given-names></name>, <etal/>
<article-title>Developing the ethics of implementation research in health</article-title>. <source>Implement Sci</source>. <year>2016</year>; <volume>11</volume>:<fpage>161</fpage>.<pub-id pub-id-type="pmid">27938400</pub-id></mixed-citation></ref><ref id="R39"><label>39.</label><mixed-citation publication-type="web"><collab>National Association of County &#x00026; City Health Officials</collab>. <source>So you want to start an ethics committee</source>, <comment><ext-link ext-link-type="uri" xlink:href="http://www.naccho.org/programs/public-health-infrastructure/ethics/so-you-want-to-start-an-ethics-committee">http://www.naccho.org/programs/public-health-infrastructure/ethics/so-you-want-to-start-an-ethics-committee</ext-link>.</comment> Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R40"><label>40.</label><mixed-citation publication-type="journal"><name><surname>Speers</surname><given-names>MA</given-names></name>, <name><surname>Rose</surname><given-names>S</given-names></name>. <article-title>Commentary: labeling institutional review board members does not lead to better protections for research participants</article-title>. <source>Acad Med</source>. <year>2012</year>;<volume>87</volume>:<fpage>842</fpage>&#x02013;<lpage>844</lpage>.<pub-id pub-id-type="pmid">22735560</pub-id></mixed-citation></ref><ref id="R41"><label>41.</label><mixed-citation publication-type="journal"><name><surname>Lidz</surname><given-names>CW</given-names></name>, <name><surname>Simon</surname><given-names>LJ</given-names></name>, <name><surname>Seligowski</surname><given-names>AV</given-names></name>, <etal/>
<article-title>The participation of community members on medical institutional review boards</article-title>. <source>J Empir Res Hum Res Ethics</source>. <year>2012</year>;<volume>7</volume>:<fpage>1</fpage>&#x02013;<lpage>6</lpage>.</mixed-citation></ref><ref id="R42"><label>42.</label><mixed-citation publication-type="web"><collab>Centers for Disease Control and Prevention</collab>. <source>Good decision making in real time: public health ethics training for local health departments</source>, <comment><ext-link ext-link-type="uri" xlink:href="https://www.cdc.gov/od/science/integrity/phethics/trainingmaterials.htm">https://www.cdc.gov/od/science/integrity/phethics/trainingmaterials.htm</ext-link>.</comment> Accessed <date-in-citation>September 29, 2017</date-in-citation>.</mixed-citation></ref><ref id="R43"><label>43.</label><mixed-citation publication-type="journal"><name><surname>Schildmann</surname><given-names>J</given-names></name>, <name><surname>Molewijk</surname><given-names>B</given-names></name>, <name><surname>Benaroyo</surname><given-names>L</given-names></name>, <name><surname>Forde</surname><given-names>R</given-names></name>, <name><surname>Neitzke</surname><given-names>G</given-names></name>. <article-title>Evaluation of clinical ethics support services and its normativity</article-title>. <source>J Med Ethics</source>. <year>2013</year>;<volume>39</volume>:<fpage>681</fpage>&#x02013;<lpage>685</lpage>.<pub-id pub-id-type="pmid">23328983</pub-id></mixed-citation></ref></ref-list></back><floats-group><table-wrap id="T1" position="float" orientation="landscape"><label>TABLE 1</label><caption><p id="P57">Comparison of Different Approaches</p></caption><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="center" valign="bottom" rowspan="1" colspan="1"/><th align="center" valign="bottom" rowspan="1" colspan="1">WHO Ethics Consultation Service</th><th colspan="2" align="center" valign="bottom" rowspan="1">CDC&#x02019;s Public Health Ethics Consultation Service</th><th colspan="4" align="center" valign="bottom" rowspan="1">PHO&#x02019;s Ethics Review Model</th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">Who is eligible for consultation?</td><td align="left" valign="top" rowspan="1" colspan="1">WHO staff supporting public health projects that do not require research ethics review (separate mechanism exists)</td><td colspan="2" align="left" valign="top" rowspan="1">CDC program leadership can request consultation</td><td colspan="4" align="left" valign="top" rowspan="1">PHO staff involved in nonroutine evidence-generating initiatives are eligible for consultation and review<break/>Health Units across Ontario are eligible for consultation</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Voluntary or mandatory?</td><td align="left" valign="top" rowspan="1" colspan="1">Voluntary</td><td colspan="2" align="left" valign="top" rowspan="1">Voluntary</td><td colspan="4" align="left" valign="top" rowspan="1">Mandatory&#x02014;an (additional) voluntary consultation can be requested</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Tools employed?</td><td align="left" valign="top" rowspan="1" colspan="1">Tool for ethical analysis identifying key ethical questions based on a review of published public health ethics frameworks</td><td colspan="2" align="left" valign="top" rowspan="1">Procedural heuristic that divides the consultation in 3 phases: identification, analysis, and resolution phase</td><td colspan="4" align="left" valign="top" rowspan="1">Risk Screening Tool and fast-track checklists (FTCs) that determine level of risk and extent of review; 10-question review framework based on research ethics principles applied to the public health context</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Different types of consultation?</td><td align="left" valign="top" rowspan="1" colspan="1">In-person meeting with requestor and at least 3 members of the Consultative Group; further input from external experts can be requested</td><td align="left" valign="top" rowspan="1" colspan="1">Informal discussion for time-sensitive and noncomplex issues</td><td align="left" valign="top" rowspan="1" colspan="1">Formal consult with subcommittee of Public Health Ethics Committee for other issues</td><td align="left" valign="top" rowspan="1" colspan="1">No review for projects with no risks identified or if conforming to FTCs</td><td align="left" valign="top" rowspan="1" colspan="1">Review by ethics officer or ethics review board member</td><td align="left" valign="top" rowspan="1" colspan="1">Delegated ethics board review (by 1&#x02013;2 members)</td><td align="left" valign="top" rowspan="1" colspan="1">Full ethics board review </td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Who provides consultations?</td><td align="left" valign="top" rowspan="1" colspan="1">The Consultative Group consists of WHO staff representing different disciplines, gender, geography, and experience with WHO regions</td><td align="left" valign="top" rowspan="1" colspan="1">Public Health Ethics Unit staff and center ethics lead</td><td align="left" valign="top" rowspan="1" colspan="1">Consult subcommittee of the Public Health Ethics Committee</td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">Research ethics officer</td><td colspan="2" align="left" valign="top" rowspan="1">PHO ethics review board compris ing experts representing a broad range of disciplines, roles, and research methods</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Specific training of reviewers?</td><td align="left" valign="top" rowspan="1" colspan="1">No specific previous training required, training in public health ethics continuously offered</td><td align="left" valign="top" rowspan="1" colspan="1">Public health ethics unit staff has advanced training in ethics</td><td align="left" valign="top" rowspan="1" colspan="1">No specific previous training required to serve on the public health ethics committee; however, monthly committee meetings are devoted to discussion of cases and ethics topics and thus serve as ongoing training</td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1">Advanced training and experience in research ethics</td><td colspan="2" align="left" valign="top" rowspan="1">Online research ethics training module to be taken before serv ing on ethics board; additional training offered regularly</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">How is ethics input to be used?</td><td align="left" valign="top" rowspan="1" colspan="1">At the discretion of requesting staff</td><td colspan="2" align="left" valign="top" rowspan="1">At the discretion of requesting staff</td><td colspan="4" align="left" valign="top" rowspan="1">Project teams have to address ethical concerns otherwise projects will not be approved (exception: recommendations from consultations are nonbinding)</td></tr></tbody></table><table-wrap-foot><fn id="TFN1"><p id="P58">Abbreviations: CDC, Centers for Disease Control and Prevention; FTCs, fast-track checklists; PHO, Public Health Ontario; WHO, World Health Organization.</p></fn></table-wrap-foot></table-wrap><table-wrap id="T2" position="float" orientation="landscape"><label>TABLE 2</label><caption><p id="P59">Public Health Ethics Activity Logic Model</p></caption><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="left" valign="top" rowspan="1" colspan="1">Inputs</th><th align="center" valign="top" rowspan="1" colspan="1">Activities</th><th align="center" valign="top" rowspan="1" colspan="1">Short-Term Outcomes</th><th align="center" valign="top" rowspan="1" colspan="1">Intermediate Outcomes</th><th align="center" valign="top" rowspan="1" colspan="1">Long-Term Outcomes</th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">Health department leadership and staff<break/>Key stakeholders<break/>Community organizations<break/>Professional associations<break/>Academic institutions<break/>Ethics codes and other public health ethics resources<break/>Financial resources<break/>Equipment</td><td align="left" valign="top" rowspan="1" colspan="1">Health department leadership establishes and supports a public health ethics infrastructure mechanism<break/>Establish a framework for conducting ethical deliberations<break/>Provide public health ethics training to staff<break/>Disseminate public health ethics information<break/>Conduct internal public health ethics reviews and consults that provide recommendations<sup><xref rid="TFN2" ref-type="table-fn">a</xref></sup><break/>Identify and engage key stakeholders to provide input on public health ethics issues</td><td align="left" valign="top" rowspan="1" colspan="1">Increase in staff<break/>&#x02003;&#x02022; Awareness and knowledge about what constitutes an ethics issue<break/>&#x02003;&#x02022; Systematic thinking about ethics and ethical choices<break/>&#x02003;&#x02022; Ability to analyze and resolve ethical issues<break/>&#x02003;&#x02022; Awareness and utilization of resources that assist with ethics issues<break/>Increased engagement with key stakeholders in public health ethics decision making<break/>Increased use of public health ethics infrastructure to inform decision making</td><td align="left" valign="top" rowspan="1" colspan="1">Staff and programs employ ethics guidance and consult services<break/>Staff apply ethical principles in their daily work<break/>Staff and programs make ethical decisions<break/>Leadership and staff have ethics-based justification for difficult and controversial decisions<break/>Public health decision-making process is ethical and perceived as ethical within health department</td><td align="left" valign="top" rowspan="1" colspan="1">General public perceives public health decision-making process as ethical<break/>Public health decisions are more positively perceived by the public and stakeholders leading to increased health department credibility and public trust<break/>Public health policies and programs are better/more sound<break/>&#x02003;&#x02022; responsive<break/>&#x02003;&#x02022; targeted<break/>&#x02003;&#x02022; meet needs<break/>Improved public health and health outcomes/reduced adverse outcomes</td></tr><tr><td colspan="5" align="left" valign="top" rowspan="1">Contextual factors that may impact public health ethics activities at all levels in the logic model: Leadership support; economic, environmental, and political climate; and community and social factors.</td></tr></tbody></table><table-wrap-foot><fn id="TFN2"><label>a</label><p id="P60">Consistent with key substantive ethical dimensions and attributes of an ethical process (see <xref rid="T3" ref-type="table">Table 3</xref>)</p></fn></table-wrap-foot></table-wrap><table-wrap id="T3" position="float" orientation="landscape"><label>Table 3</label><caption><p id="P61">Key Substantive Ethical Dimensions and Attributes of an Ethical Process</p></caption><table frame="hsides" rules="none"><colgroup span="1"><col align="left" valign="middle" span="1"/></colgroup><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">Key substantive ethical dimensions</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Weighing benefits vs harms, costs, and risks of a decision</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Considering rights, values, interests, and needs of individuals and particular communities vs obligation to protect the general public good</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Using least restrictive measures necessary to protect the common good</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Ensuring fair distribution of public health benefits/burden</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Addressing health equity/protection of vulnerable populations</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Working toward social justice</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Key attributes of an ethical process</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Is open, honest, and transparent</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Makes explicit the facts, values, principles, and assumptions used</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Prioritizes values according to a fair, inclusive process; judicious weighing of competing values and goods</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Allows for fair hearing of the interests, values, and perspectives of all</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Consistently applies standards across people and time (treating like cases alike)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Appropriately engages stakeholders in decision making</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Involves affected, informed, experienced, and neutral individuals and representatives of communities</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Provides information to affected stakeholders in a timely manner and in culturally and linguistically appropriate ways</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Uses best available scientific evidence</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x02003;&#x02022; Monitors and evaluates the process to allow for updating, revision, or correction of procedures in the light of new information, questions, criticisms, etc</td></tr><tr><td align="left" valign="bottom" rowspan="1" colspan="1"><hr/></td></tr></tbody></table></table-wrap><boxed-text id="BX1" position="float" orientation="portrait"><caption><title>Implications for Policy &#x00026; Practice</title></caption><list list-type="simple" id="L8"><list-item><label>&#x025a0;</label><p id="P62">While research and practice activities in public health can both entail ethically relevant risks, traditionally, only research projects are subjected to thorough ethical oversight. Public health institutions should accordingly consider implementing processes for providing ethics input on practice activities ensuring that ethical risks are adequately managed.</p></list-item><list-item><label>&#x025a0;</label><p id="P63">A mandatory approach to ethics review for practice activities will be most effective in preventing ethically relevant risks from materializing. However, public health organizations considering implementation of a review mechanism will also have to ensure their fit to the specific context and goals of the organization.</p></list-item><list-item><label>&#x025a0;</label><p id="P64">The effects of ethics review mechanisms on service provision have so far not been studied. Public health organizations should consider implementing evaluations to allow learning about and improvement of existing mechanisms.</p></list-item><list-item><label>&#x025a0;</label><p id="P65">A core element for any approach is to increase the sensitivity of public health practitioners to ethical issues that may arise in their work. Smaller organizations that lack resources to create a formal consultation or review process can support this in their organization by promoting user-friendly ethics educational materials or by introducing ethical considerations into existing operational review or approval processes.</p></list-item></list></boxed-text></floats-group></article>