<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="brief-report"><?properties open_access?><front><journal-meta><journal-id journal-id-type="nlm-ta">Prev Chronic Dis</journal-id><journal-id journal-id-type="iso-abbrev">Prev Chronic Dis</journal-id><journal-id journal-id-type="publisher-id">PCD</journal-id><journal-title-group><journal-title>Preventing Chronic Disease</journal-title></journal-title-group><issn pub-type="epub">1545-1151</issn><publisher><publisher-name>Centers for Disease Control and Prevention</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="pmid">31441770</article-id><article-id pub-id-type="pmc">6716386</article-id><article-id pub-id-type="publisher-id">18_0671</article-id><article-id pub-id-type="doi">10.5888/pcd16.180671</article-id><article-categories><subj-group subj-group-type="heading"><subject>Program Evaluation Brief</subject></subj-group><series-title>Peer Reviewed</series-title></article-categories><title-group><article-title>Implementation of Liver Cancer Education Among Health Care Providers and Community Coalitions in the Cherokee Nation</article-title></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>Momin</surname><given-names>Behnoosh</given-names></name><degrees>DrPH</degrees><degrees>MS</degrees><degrees>MPH</degrees><xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref></contrib><contrib contrib-type="author"><name><surname>Mera</surname><given-names>Jorge</given-names></name><degrees>MD</degrees><xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref></contrib><contrib contrib-type="author"><name><surname>Essex</surname><given-names>Whitney</given-names></name><degrees>MSN</degrees><xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref></contrib><contrib contrib-type="author"><name><surname>Gahn</surname><given-names>David</given-names></name><degrees>MD</degrees><degrees>MPH</degrees><xref ref-type="aff" rid="aff3">
<sup>3</sup>
</xref></contrib><contrib contrib-type="author"><name><surname>Burkhart</surname><given-names>Margie</given-names></name><xref ref-type="aff" rid="aff3">
<sup>3</sup>
</xref></contrib><contrib contrib-type="author"><name><surname>Nielsen</surname><given-names>Danielle</given-names></name><degrees>MPH</degrees><xref ref-type="aff" rid="aff4">
<sup>4</sup>
</xref></contrib><contrib contrib-type="author"><name><surname>Mezzo</surname><given-names>Jennifer</given-names></name><xref ref-type="aff" rid="aff4">
<sup>4</sup>
</xref></contrib><contrib contrib-type="author"><name><surname>Millman</surname><given-names>Alexander J.</given-names></name><degrees>MD</degrees><xref ref-type="aff" rid="aff5">
<sup>5</sup>
</xref></contrib><aff id="aff1">
<label>1</label>Division of Cancer Prevention and Control, Centers for Disease Control and Prevention, Atlanta, Georgia</aff><aff id="aff2">
<label>2</label>Cherokee Nation Health Services, Tahlequah, Oklahoma</aff><aff id="aff3">
<label>3</label>Cherokee Nation Comprehensive Cancer Control Program, Tahlequah, Oklahoma</aff><aff id="aff4">
<label>4</label>ICF, Atlanta, Georgia</aff><aff id="aff5">
<label>5</label>Division of Viral Hepatitis, Centers for Disease Control and Prevention, Atlanta, Georgia</aff></contrib-group><author-notes><corresp id="cor1">Corresponding Author: Behnoosh Momin, DrPH, MS, MPH, Division of Cancer Prevention and Control, Centers for Disease Control and Prevention, 4770 Buford Hwy, MS F-76, Atlanta, GA 30341. Telephone: 770-488-3112. Email: <email xlink:href="fqv6@cdc.gov">fqv6@cdc.gov</email>.</corresp></author-notes><pub-date pub-type="collection"><year>2019</year></pub-date><pub-date pub-type="epub"><day>22</day><month>8</month><year>2019</year></pub-date><volume>16</volume><elocation-id>E112</elocation-id><abstract><title>Introduction</title><p>The Cherokee Nation Comprehensive Cancer Control Program collaborated with the Cherokee Nation Hepatitis C Virus (HCV) Elimination Program within Cherokee Nation&#x02019;s Health Services to plan and implement activities to increase knowledge and awareness of liver cancer prevention among health care providers and the Cherokee Nation community. From August 2017 to April 2018, the 2 programs implemented liver cancer prevention interventions that focused on education of health care providers and community members. We used descriptive statistics to analyze data collected from a brief, retrospective pre&#x02013;post survey for each intervention. We assessed overall awareness and knowledge of liver cancer and ability and intention to address it on a scale of 1 to 5. Project Extension for Community Healthcare Outcomes didactic sessions resulted in a 1.1-point improvement, provider education workshops resulted in a 1.4-point improvement, and presentations at community coalition meetings resulted in a 1.7-point improvement. Our study shows that HCV interventions can be used by public health and medical professionals interested in controlling HCV and related diseases such as liver cancer.</p></abstract></article-meta></front><body><boxed-text id="Ba" position="float" orientation="portrait"><caption><title>Summary</title></caption><sec sec-type="other1"><title>What is already known on this topic?</title><p>Chronic infections with hepatitis C virus (HCV) are risk factors for primary liver cancer. Lack of knowledge and awareness among health care providers, populations at high risk, and the public are barriers to HCV prevention and control.</p></sec><sec sec-type="other2"><title>What is added by this report?</title><p>The Cherokee Nation Comprehensive Cancer Control program and the Cherokee Nation Health Services HCV Elimination Program implemented and evaluated activities to increase knowledge and awareness. Overall, awareness, knowledge, ability, and intention increased among participants in the 3 interventions.</p></sec><sec sec-type="other3"><title>What are the implications for public health practice?</title><p>Provider and community education interventions can improve knowledge and awareness of liver cancer and the ability and intention to talk about it among health care providers and community coalitions.</p></sec></boxed-text><sec sec-type="intro"><title>Introduction</title><p>Hepatocellular carcinoma (HCC), or primary liver cancer, is the second leading cause of cancer death worldwide among cancers that affect both men and women (<xref rid="R1" ref-type="bibr">1</xref>). In the United States, chronic infections with hepatitis B virus (HBV) or hepatitis C virus (HCV) are strong risk factors for HCC (<xref rid="R2" ref-type="bibr">2</xref>). Primary liver cancer incidence is increasing worldwide, including in the United States (<xref rid="R3" ref-type="bibr">3</xref>). Liver cancer is more common in men than in women, and among Asian/Pacific Islander, Hispanic, and American Indian/Alaska Native populations than in other racial and ethnic groups (<xref rid="R4" ref-type="bibr">4</xref>).</p><p>An Institute of Medicine report in 2010 described several barriers to HBV and HCV prevention and control efforts, including a lack of knowledge and awareness among health care providers, populations at high risk, and the public (<xref rid="R5" ref-type="bibr">5</xref>). The report included recommendations in 4 areas: improve viral hepatitis surveillance, improve provider and community education to increase knowledge and awareness of HBV and HCV, increase support for vaccine-based strategies to eliminate HBV transmission, and integrate and enhance viral hepatitis services, including risk factor screening and serologic testing.</p><p>The National Comprehensive Cancer Control Program (NCCCP), funded by the Centers for Disease Control and Prevention (CDC), provides funding and technical support for the development and implementation of cancer control programs to create cancer control plans in all 50 states, the District of Columbia, 8 tribes and tribal organizations, and 7 US territories (<xref rid="R6" ref-type="bibr">6</xref>). These plans guide the work of cancer control coalitions formed by each awardee. Coalitions include health department staff members (at the state, tribal, territory, US Pacific Island jurisdiction, and local levels) with expertise in cancer and their key partners, such as nonprofit organizations and community health centers. Awardee cancer control coalitions focus on current and emerging cancer issues in their target population and implement strategies in prevention, early detection, treatment, and survivorship by using policies, systems, and environmental changes to reduce the burden of cancer.</p></sec><sec sec-type="other4"><title>Purpose and Objectives</title><p>In 2017, the Cherokee Nation Comprehensive Cancer Control (CNCCC) program initiated a partnership with the Cherokee Nation Health Services (CNHS) HCV Elimination Program. The goal of the HCV Elimination Program is to expand HCV testing and refer patients infected with HCV for treatment. The 2 groups collaborated to plan, implement, and evaluate activities to increase knowledge and awareness of HCC among health care providers and Cherokee Nation communities. Although lead staff members from the CNCCC program and HCV Elimination Program had collaborated on previous work, this partnership was their first official partnership. The objective of this study was to describe findings from the evaluation of 3 interventions implemented by the 2 programs. </p></sec><sec sec-type="other5"><title>Intervention Approach</title><p>The 2 programs implemented liver cancer prevention interventions from August 2017 through April 2018. Prevention strategies (<xref rid="T1" ref-type="table">Table 1</xref>) aligned with provider and community education recommendations in the 2010 Institute of Medicine report (<xref rid="R5" ref-type="bibr">5</xref>).</p><table-wrap id="T1" orientation="portrait" position="float"><label>Table 1</label><caption><title>Liver Cancer Education Interventions for Cherokee Nation Health Care Providers and Community Coalitions, 2017&#x02013;2018</title></caption><table frame="hsides" rules="groups"><col width="83" span="1"/><col width="77" span="1"/><col width="127" span="1"/><col width="70" span="1"/><col width="104" span="1"/><col width="90" span="1"/><thead><tr><th valign="bottom" align="left" scope="col" rowspan="1" colspan="1">Intervention</th><th valign="bottom" align="center" scope="col" rowspan="1" colspan="1">Strategy</th><th valign="bottom" align="center" scope="col" rowspan="1" colspan="1">Description of Activity</th><th valign="bottom" align="center" scope="col" rowspan="1" colspan="1">No. of Completed Surveys/No. of Attendees</th><th valign="bottom" align="center" scope="col" rowspan="1" colspan="1">Participant Characteristics</th><th valign="bottom" align="center" scope="col" rowspan="1" colspan="1">Time in Practice</th></tr></thead><tbody><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">HCV Elimination Program</td><td valign="top" align="left" rowspan="1" colspan="1">Conduct monthly Project ECHO<xref rid="T1FN1" ref-type="table-fn">a</xref> didactic sessions</td><td valign="top" align="left" rowspan="1" colspan="1">Conducted 15-minute didactic sessions during 8 Project ECHO clinics. Topics included incidence and prevalence of HCC, risk factors for and diagnosis of HCC, diagnosis of cirrhosis, and HCC surveillance.</td><td valign="top" align="center" rowspan="1" colspan="1">72/83</td><td valign="top" align="left" rowspan="1" colspan="1">All participants were health care professionals; 30.6% physicians; 20.8% nurses; 20.8% pharmacists; 8.3% psychologists; 6.9% nurse practitioners; 4.2% case managers; 8.3% described themselves as &#x0201c;other&#x0201d; health care professional</td><td valign="top" align="left" rowspan="1" colspan="1">1 week to &#x02265;40 years (median of 10 years in practice)</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">HCV Elimination Program</td><td valign="top" align="left" rowspan="1" colspan="1">Conduct health care provider education workshops</td><td valign="top" align="left" rowspan="1" colspan="1">Conducted 8 two-hour provider education workshops; one at a CNHS hospital, and 7 at CNHS outlying clinics. Topics included incidence and prevalence of HCC, risk factors for and diagnosis of HCC, diagnosis of cirrhosis, and HCC surveillance.</td><td valign="top" align="center" rowspan="1" colspan="1">108/123</td><td valign="top" align="left" rowspan="1" colspan="1">All participants were health care professionals: 35.2% nurses; 21.3% nurse practitioners; 17.6% physicians; 25.9% described themselves as &#x0201c;other&#x0201d; health care professional</td><td valign="top" align="left" rowspan="1" colspan="1">0&#x02013;50 years (median of 10 years in practice)</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Cherokee Nation Comprehensive Cancer Control Program</td><td valign="top" align="left" rowspan="1" colspan="1">Conduct presentations at community coalition meetings</td><td valign="top" align="left" rowspan="1" colspan="1">Conducted 5 presentations at community coalition meetings, held in different venues in different geographic locations. Each presentation was approximately 30 minutes and was intended to reach the general community.</td><td valign="top" align="center" rowspan="1" colspan="1">62/78</td><td valign="top" align="left" rowspan="1" colspan="1">Participants represented 26 organizations</td><td valign="top" align="left" rowspan="1" colspan="1">NA</td></tr></tbody></table><table-wrap-foot><fn><p>Abbreviations: CNHS, Cherokee Nation Health Services; HCC, hepatocellular carcinoma; HCV, hepatitis C virus; NA, not applicable; Project ECHO, Project Extension for Community Healthcare Outcomes.</p></fn><fn id="T1FN1"><label>a</label><p> Project ECHO is a collaborative model of education and care management that brings together health care providers to increase access to specialty treatment in rural and underserved areas (<ext-link ext-link-type="uri" xlink:href="https://echo.unm.edu">https://echo.unm.edu</ext-link>).</p></fn></table-wrap-foot></table-wrap><p>The HCV Elimination Program was responsible for conducting didactic sessions for CNHS health care providers on HCC epidemiology, diagnosis, and surveillance through the Project Extension for Community Healthcare Outcomes (ECHO) platform (The Echo Model). Launched in 2003 by a liver disease physician in Albuquerque, New Mexico, Project ECHO is a collaborative model of education and care management that brings together health care providers to increase access to specialty treatment in rural and underserved areas (<xref rid="R7" ref-type="bibr">7</xref>). The didactic sessions were delivered in a series of 15-minute presentations during regularly scheduled Project ECHO meetings that were hosted virtually using Microsoft Lync. The HCV Elimination Program was also responsible for conducting health care provider education workshops focused on liver cancer at 8 CNHS facilities. The same slide set used for Project ECHO didactic sessions was used for these workshops, but instead of delivering content in multiple sessions, the entire presentation was given in 1 workshop. The workshops were conducted in person at 7 of the 8 clinics and at the hospital in the Cherokee Nation in Oklahoma. Various health care providers, including nurses, case managers, physicians, nurse practitioners, and physician assistants, were invited to the workshops. </p><p>The CNCCC program was responsible for making liver cancer prevention presentations to community coalition members at cancer coalition meetings. Content for each meeting was identical; however, content delivery was tailored to each audience. Presentations focused on causes, prevention, symptoms, and diagnosis of liver cancer. Participants represented 26 coalitions in the Cherokee Nation and included workers from the public school system, local recreation centers, farmers markets, and other community organizations. The CNCCC program presented liver cancer information at 5 coalition meetings.</p></sec><sec sec-type="methods"><title>Evaluation Methods</title><p>For each of the 3 interventions, CNHS assessed changes among program participants in awareness, knowledge, ability, and intention by administering a brief, retrospective pre&#x02013;post survey (<xref rid="R8" ref-type="bibr">8</xref>). Survey development was informed by materials developed by CNHS for provider and community presentations and outcomes of interest to CNHS. A paper-and-pencil survey was administered at the end of each session. For each intervention, we collected information on the number of participants and the number and types of medical professionals attending and organizations represented.</p><p>For didactic sessions and provider education workshops, <italic>awareness</italic> measured the provider&#x02019;s awareness of statistics and the role of the liver and liver cancer; <italic>knowledge</italic> measured the provider&#x02019;s knowledge of liver cancer risk factors, prevention, and signs and symptoms of the disease; <italic>ability</italic> measured the provider&#x02019;s ability to identify patients who are at high risk for liver cancer, and <italic>intention</italic> measured the provider&#x02019;s intent to speak with patients about HCC risk and recommend screening for patients at high risk. For the community coalition meetings, <italic>awareness</italic> measured the participant&#x02019;s awareness of the function of the liver and liver cancer statistics; <italic>knowledge</italic> measured the participant&#x02019;s knowledge of liver cancer risk factors, prevention, and signs and symptoms of the disease; <italic>ability</italic> measured the participant&#x02019;s ability to speak with a health care provider about liver cancer risk and prevention, and <italic>intention</italic> measured the participant&#x02019;s intent to speak with a health care provider about screening for HCV infection. Survey participants marked their responses on a Likert-type scale (from 1 to 5, with 5 indicating the best outcome).</p><p>Our analyses focused on assessing whether the interventions had any effect on participants&#x02019; awareness, knowledge, abilities, and intentions. Although pre-exposure and post-exposure data were reported in the same survey, surveys were completed anonymously; therefore, we were not able to match data for individual participants across didactic sessions. We combined items (awareness, knowledge, ability, and intention) to create a composite score for each intervention. We also developed an overall composite score, which used all survey questions pre-exposure and post-exposure to examine change overall. We calculated mean composite scores and standard deviations in Stata version 14 (StataCorp LLC). The range for the overall scores was calculated as an average of the ranges for all categories. The overall scores were calculated as an average of all of the scores that make up the score (awareness, knowledge, ability, intention). We used paired <italic>t</italic> tests to assess significance of overall change from pre-exposure to post-exposure (across awareness, knowledge, ability, intention) for each of the 3 interventions, but not for each variable of interest. We generated <italic>P</italic> values; however, not every individual attended all 8 didactic sessions. Therefore, differences between pre-exposure and post-exposure might not be large for the didactic sessions, which would cause the <italic>P</italic> values to be only slightly anticonservative. We excluded missing responses from analyses.</p><p>We collected contextual information about implementation challenges, facilitators, and lessons learned through ongoing communication between CNCCC and HCV Elimination Program staff members and NCCCP staff members. Lead CNCCC and HCV Elimination Program staff members took part in monthly technical assistance calls with NCCCP staff members throughout planning and implementation of the 3 interventions. At the close of the project, NCCCP staff members also met informally with lead staff members from each program to discuss final thoughts and experiences. </p></sec><sec sec-type="results"><title>Results</title><p>Overall, awareness, knowledge, ability, and intention increased among participants in the 3 interventions. For overall awareness, knowledge, ability, and intention, Project ECHO didactic sessions resulted in a 1.1-point increase (2.9 pre-exposure vs 4.0 post-exposure, <italic>t</italic>
<sub>70</sub> = 3.02, <italic>P</italic> &#x0003c; .001), provider education workshops resulted in a 1.4-point increase (2.9 vs 4.3, <italic>t</italic>
<sub>101</sub> = 4.91, <italic>P</italic> &#x0003c; .001), and presentations at community coalition meetings resulted in a 1.7-point increase (2.5 vs 4.2, <italic>t</italic>
<sub>59</sub> = 4.3, <italic>P</italic> &#x0003c; .001). We found improvement in each variable of interest in each intervention (<xref rid="T2" ref-type="table">Table 2</xref>). The greatest improvement in knowledge and awareness (1.2-point increase for each) was in the Project ECHO didactic sessions. The provider education workshops had the greatest improvement in awareness (1.6-point increase), and the community coalition presentations had the greatest improvement in knowledge (2.1-point increase), closely followed by awareness (2.0-point increase).</p><table-wrap id="T2" orientation="portrait" position="float"><label>Table 2</label><caption><title>Pre-Exposure and Post-Exposure Composite Scores for Project ECHO<xref rid="T2FN1" ref-type="table-fn">a</xref> Didactic Sessions, Health Care Provider Education Workshops, and Presentations at Community Coalition Meetings</title></caption><table frame="hsides" rules="groups"><col width="215" span="1"/><col width="94" span="1"/><col width="94" span="1"/><col width="99" span="1"/><thead><tr><th rowspan="2" valign="bottom" align="left" scope="col" colspan="1">Intervention/Variable of Interest</th><th rowspan="2" valign="bottom" align="center" scope="col" colspan="1">No. of Surveys Included in Analysis/No. of Completed Surveys</th><th valign="bottom" colspan="2" align="center" scope="colgroup" rowspan="1">Composite Scores<xref rid="T2FN2" ref-type="table-fn">b</xref>
<hr/>
</th></tr><tr><th valign="bottom" colspan="1" align="center" scope="colgroup" rowspan="1">Pre-Exposure, Mean (SD) [Range]</th><th valign="bottom" align="center" scope="col" rowspan="1" colspan="1">Post-Exposure, Mean (SD) [Range]</th></tr></thead><tbody><tr><td colspan="4" valign="top" align="left" scope="col" rowspan="1">
<bold>Project ECHO didactic sessions</bold>
</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Awareness of the role of the liver, liver cancer, and statistics</td><td rowspan="5" valign="top" align="center" colspan="1">71/72</td><td valign="top" align="center" rowspan="1" colspan="1">2.98 (1.02) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.14 (0.73) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Knowledge of liver cancer risk factors, prevention, and signs and symptoms of the disease</td><td valign="top" colspan="1" align="center" rowspan="1">2.72 (1.14) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">3.91 (0.80) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Ability to identify at-risk patients</td><td valign="top" colspan="1" align="center" rowspan="1">2.58 (1.05) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">3.70 (0.80) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Intention to speak with patients about HCC risk and recommend screening for at-risk patients</td><td valign="top" colspan="1" align="center" rowspan="1">3.05 (1.13) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.03 (0.88) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Overall<xref rid="T2FN3" ref-type="table-fn">c</xref>
</td><td valign="top" colspan="1" align="center" rowspan="1">2.92 (1.03) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.03 (0.73) [1&#x02013;5]</td></tr><tr><td colspan="4" valign="top" align="left" scope="col" rowspan="1">
<bold>Provider education workshops</bold>
</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Awareness of the role of the liver, liver cancer, and statistics</td><td rowspan="5" valign="top" align="center" colspan="1">102/108</td><td valign="top" align="center" rowspan="1" colspan="1">2.81 (0.81) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.39 (0.52) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Knowledge of liver cancer risk factors, prevention, and signs and symptoms of the disease</td><td valign="top" colspan="1" align="center" rowspan="1">2.96 (0.80) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.25 (0.65) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Ability to identify at-risk patients</td><td valign="top" colspan="1" align="center" rowspan="1">2.58 (1.05) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">3.70 (0.80) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Intention to speak with patients about HCC risk and recommend screening for at-risk patients</td><td valign="top" colspan="1" align="center" rowspan="1">3.05 (1.13) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.03 (0.88) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Overall<xref rid="T2FN3" ref-type="table-fn">c</xref>
</td><td valign="top" colspan="1" align="center" rowspan="1">2.88 (0.81) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.25 (0.67) [1&#x02013;5]</td></tr><tr><td colspan="4" valign="top" align="left" scope="col" rowspan="1">
<bold>Community coalition meetings</bold>
</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Awareness of the role of the liver and liver cancer statistics</td><td rowspan="5" valign="top" align="center" colspan="1">60/62</td><td valign="top" align="center" rowspan="1" colspan="1">2.23 (0.83) [1&#x02013;4]</td><td valign="top" align="center" rowspan="1" colspan="1">4.25 (0.54) [3&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Knowledge of liver cancer risk factors, prevention, and signs and symptoms of the disease</td><td valign="top" colspan="1" align="center" rowspan="1">2.09 (0.98) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.20 (0.51) [3&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Ability to speak with a health care provider about liver cancer risk and prevention</td><td valign="top" colspan="1" align="center" rowspan="1">2.23 (1.09) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.14 (0.66) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Intention to speak with a health care provider about screening for hepatitis C virus infection</td><td valign="top" colspan="1" align="center" rowspan="1">3.23 (0.99) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.23 (0.72) [1&#x02013;5]</td></tr><tr><td valign="top" align="left" scope="row" rowspan="1" colspan="1">Overall<xref rid="T2FN3" ref-type="table-fn">c</xref>
</td><td valign="top" colspan="1" align="center" rowspan="1">2.49 (0.85) [1&#x02013;5]</td><td valign="top" align="center" rowspan="1" colspan="1">4.23 (0.59) [1&#x02013;5]</td></tr></tbody></table><table-wrap-foot><fn><p>Abbreviations: ECHO, Extension for Community Healthcare Outcomes; HCC, hepatocellular carcinoma; SD, standard deviation.</p></fn><fn id="T2FN1"><label>a</label><p> Project ECHO is a collaborative model of education and care management that brings together health care providers to increase access to specialty treatment in rural and underserved areas (<ext-link ext-link-type="uri" xlink:href="https://echo.unm.edu">https://echo.unm.edu</ext-link>).</p></fn><fn id="T2FN2"><label>b</label><p> Participants scored their awareness, knowledge, ability, and intention by using a Likert-type scale from 1&#x02013;5, with 5 being the highest score for each variable measured. </p></fn><fn id="T2FN3"><label>c</label><p> Paired <italic>t</italic> tests used to assess significance of overall change from pre-exposure to post-exposure (across awareness, knowledge, ability, intention) for each of the 3 interventions; <italic>P</italic> &#x0003c; .001 for each intervention overall.</p></fn></table-wrap-foot></table-wrap><p>Health care providers also improved their ability to identify patients at high risk for viral hepatitis and HCC and improved their intention to talk to patients about risk for the diseases. Among community coalition participants, we found an improvement in their ability and intention to talk to their health care provider about their risk for liver cancer and for getting tested for viral hepatitis.</p></sec><sec sec-type="other6"><title>Implications for Public Health</title><p>Our study has implications for the cancer control community, including cancer control coalitions and health care providers, because our findings address awareness and education of health care providers, populations at risk, and the public about health risks associated with liver cancer. The study shows how provider and community education interventions can improve knowledge and awareness of liver cancer and the ability and intention to talk about it among health care providers and community coalitions. The improvements in each variable of interest and overall improvements were greater among participants in community coalition meetings than among participants in didactic sessions and provider education workshops. Although greater improvements might be attributed to initially lower levels of knowledge among community coalition participants compared with health care providers, improvements demonstrate the commitment of community coalition members in obtaining vital information needed to best address the needs of their target population.</p><p>Several factors facilitated implementation of our intervention, and awareness of these factors can help others in implementing similar interventions. Regularly scheduled meeting times (ie, through Project ECHO) with providers interested in liver cancer and who care for relevant patient populations increased participation rates and resulted in a captive audience and a robust discussion. A collaborative approach across programs facilitated access to essential evaluation resources and expertise. An established relationship with clinic directors (ie, infectious disease specialists through Project ECHO) helped in scheduling the workshops and ensuring provider participation. Involving CNHS public health educators in the coordination of coalition meetings ensured that liver cancer prevention presentations were included in meeting agendas and that space was secured for each meeting. Access to audiovisual equipment and printing resources and a meeting facilitator with a flexible schedule helped accommodate schedules of participants.</p><p>We found numerous challenges in planning and implementing these interventions. Developing the PowerPoint presentation for the Project ECHO didactic sessions and provider education workshops was challenging in scheduling, time consumption, and commitment. Finding convenient meeting times for the majority of health care providers was difficult. Also, competing responsibilities of CNHS public health educators made it difficult for them to dedicate a substantial amount of time to coordinating activities. For example, they traveled for 2 or 3 hours to reach community coalition meetings.</p><p>We learned several valuable lessons. The first is to start small. CNHS planned and implemented 3 unique liver cancer prevention interventions simultaneously. However, both NCCCP and HCV Elimination Program staff members found the workload demanding and in hindsight felt that focusing on just 1 or 2 activities at a time would have been better. Second is to be realistic about resources required, such as time and staffing. Planning and implementing the 3 interventions took a large amount of time. CNHS reported through interviews that it had to continuously shuffle priorities to conduct the provider education sessions and complete other time-intensive tasks. In addition, many administrative tasks (eg, monthly reporting requirements, scheduling workshops, completing data tracking sheets) were time consuming. The CNHS team provided an administrative staff member to complete these tasks. The third lesson is to identify and maximize resources. Both NCCCP and HCV Elimination Program staff members spent substantial time developing content for presentations. Greater collaboration among staff members in various programs and outreach to others who might have already developed high-quality resources that required only minor adjustments for the population of interest could have increased the efficiency of staff members and decreased the time required to implement the interventions.</p><p>Liver cancer rates are increasing in the United States and public health programs, including the NCCCP, should continue to build and diversify their work in addressing viral hepatitis for liver cancer prevention. The CNHS cancer control and HCV elimination programs have demonstrated a successful partnership model to address liver cancer that can be adapted by other programs. Increasing viral hepatitis and liver cancer prevention interventions among all public health programs is an important step in lowering liver cancer rates in the United States.</p></sec></body><back><ack><title>Acknowledgments</title><p>The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention or Cherokee Nation Health Services. We did not use any copyrighted materials in this article.</p></ack><fn-group><fn><p>The opinions expressed by authors contributing to this journal do not necessarily reflect the opinions of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions.</p></fn><fn><p>
<italic>Suggested citation for this article:</italic> Momin B, Mera J, Essex W, Gahn D, Burkhart M, Nielsen D, et al. Implementation of Liver Cancer Education Among Health Care Providers and Community Coalitions in the Cherokee Nation. Prev Chronic Dis 2019;16:180671. DOI: <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5888/pcd16.180671">https://doi.org/10.5888/pcd16.180671</ext-link>.</p></fn></fn-group><ref-list><title>References</title><ref id="R1"><label>1. </label><mixed-citation publication-type="journal">
<string-name>
<surname>Ferlay</surname>
<given-names>J</given-names>
</string-name>, <string-name>
<surname>Soerjomataram</surname>
<given-names>I</given-names>
</string-name>, <string-name>
<surname>Dikshit</surname>
<given-names>R</given-names>
</string-name>, <string-name>
<surname>Eser</surname>
<given-names>S</given-names>
</string-name>, <string-name>
<surname>Mathers</surname>
<given-names>C</given-names>
</string-name>, <string-name>
<surname>Rebelo</surname>
<given-names>M</given-names>
</string-name>, <etal/>
<article-title>Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012.</article-title>
<source>Int J Cancer</source>
<year>2015</year>;<volume>136</volume>(<issue>5</issue>):<fpage>E359</fpage>&#x02013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1002/ijc.29210</pub-id>
<pub-id pub-id-type="pmid">25220842</pub-id></mixed-citation></ref><ref id="R2"><label>2. </label><mixed-citation publication-type="journal">
<string-name>
<surname>Di Bisceglie</surname>
<given-names>AM</given-names>
</string-name>, <string-name>
<surname>Lyra</surname>
<given-names>AC</given-names>
</string-name>, <string-name>
<surname>Schwartz</surname>
<given-names>M</given-names>
</string-name>, <string-name>
<surname>Reddy</surname>
<given-names>RK</given-names>
</string-name>, <string-name>
<surname>Martin</surname>
<given-names>P</given-names>
</string-name>, <string-name>
<surname>Gores</surname>
<given-names>G</given-names>
</string-name>, <etal/>
<article-title>Hepatitis C-related hepatocellular carcinoma in the United States: influence of ethnic status.</article-title>
<source>Am J Gastroenterol</source>
<year>2003</year>;<volume>98</volume>(<issue>9</issue>):<fpage>2060</fpage>&#x02013;<lpage>3</lpage>. <pub-id pub-id-type="doi">10.1111/j.1572-0241.2003.t01-1-07641.x</pub-id>
<pub-id pub-id-type="pmid">14499788</pub-id></mixed-citation></ref><ref id="R3"><label>3. </label><mixed-citation publication-type="journal">
<string-name>
<surname>Ryerson</surname>
<given-names>AB</given-names>
</string-name>, <string-name>
<surname>Eheman</surname>
<given-names>CR</given-names>
</string-name>, <string-name>
<surname>Altekruse</surname>
<given-names>SF</given-names>
</string-name>, <string-name>
<surname>Ward</surname>
<given-names>JW</given-names>
</string-name>, <string-name>
<surname>Jemal</surname>
<given-names>A</given-names>
</string-name>, <string-name>
<surname>Sherman</surname>
<given-names>RL</given-names>
</string-name>, <etal/>
<article-title>Annual report to the nation on the status of cancer, 1975&#x02013;2012, featuring the increasing incidence of liver cancer.</article-title>
<source>Cancer</source>
<year>2016</year>;<volume>122</volume>(<issue>9</issue>):<fpage>1312</fpage>&#x02013;<lpage>37</lpage>. <pub-id pub-id-type="doi">10.1002/cncr.29936</pub-id>
<pub-id pub-id-type="pmid">26959385</pub-id></mixed-citation></ref><ref id="R4"><label>4. </label><mixed-citation publication-type="web">
<collab>US Cancer Statistics Working Group</collab>. United States cancer statistics: 1999&#x02013;2015 incidence and mortality web-based report. Atlanta (GA): US Department of Health and Human Services, Centers for Disease Control and Prevention, and National Cancer Institute; <year>2018</year>
<ext-link ext-link-type="uri" xlink:href="http://www.cdc.gov/uscs">http://www.cdc.gov/uscs</ext-link>. Accessed October 17, 2018. </mixed-citation></ref><ref id="R5"><label>5. </label><mixed-citation publication-type="book">
<collab>Committee on the Prevention and Control of Viral Hepatitis Infection, Institute of Medicine</collab>. Hepatitis and liver cancer: a national strategy for prevention and control of hepatitis B and C<italic>.</italic> Colvin HM, Mitchell AE, eds. Washington (DC): National Academies Press; <year>2010</year>.</mixed-citation></ref><ref id="R6"><label>6. </label><mixed-citation publication-type="web">
<collab>Centers for Disease Control and Prevention</collab>. National comprehensive cancer control program. <ext-link ext-link-type="uri" xlink:href="https://www.cdc.gov/cancer/ncccp/index.htm">https://www.cdc.gov/cancer/ncccp/index.htm</ext-link>. Accessed October 30, 2018.</mixed-citation></ref><ref id="R7"><label>7. </label><mixed-citation publication-type="web">
<collab>Project ECHO, The University of New Mexico</collab>. A revolution in medical education and care delivery. <ext-link ext-link-type="uri" xlink:href="https://echo.unm.edu">https://echo.unm.edu</ext-link>. Accessed September 4, 2018.</mixed-citation></ref><ref id="R8"><label>8. </label><mixed-citation publication-type="journal">
<string-name>
<surname>Pratt</surname>
<given-names>CC</given-names>
</string-name>, <string-name>
<surname>McGuigan</surname>
<given-names>WM</given-names>
</string-name>, <string-name>
<surname>Katzev</surname>
<given-names>AR</given-names>
</string-name>. <article-title>Measuring program outcomes: using retrospective pretest methodology.</article-title>
<source>Am J Eval</source>
<year>2000</year>;<volume>21</volume>(<issue>3</issue>):<fpage>341</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1177/109821400002100305</pub-id>
</mixed-citation></ref></ref-list></back></article>