<!DOCTYPE article
PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD with MathML3 v1.2 20190208//EN" "JATS-archivearticle1-mathml3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article"><?properties manuscript?><front><journal-meta><journal-id journal-id-type="nlm-journal-id">101603896</journal-id><journal-id journal-id-type="pubmed-jr-id">41074</journal-id><journal-id journal-id-type="nlm-ta">J Int Assoc Provid AIDS Care</journal-id><journal-id journal-id-type="iso-abbrev">J Int Assoc Provid AIDS Care</journal-id><journal-title-group><journal-title>Journal of the International Association of Providers of AIDS Care</journal-title></journal-title-group><issn pub-type="ppub">2325-9574</issn><issn pub-type="epub">2325-9582</issn></journal-meta><article-meta><article-id pub-id-type="pmid">28795611</article-id><article-id pub-id-type="pmc">7745845</article-id><article-id pub-id-type="doi">10.1177/2325957417724206</article-id><article-id pub-id-type="manuscript">NIHMS1651262</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>The relationship of repeated technical assistance support visits to the delivery of positive health, dignity and prevention (PHDP) messages by healthcare providers in Mozambique: A Longitudinal Multilevel Analysis</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Gutin</surname><given-names>Sarah A.</given-names></name><degrees>MPH</degrees><xref ref-type="aff" rid="A1">1</xref><xref ref-type="aff" rid="A2">2</xref><xref rid="CR1" ref-type="corresp">*</xref></contrib><contrib contrib-type="author"><name><surname>Amico</surname><given-names>K. Rivet</given-names></name><degrees>PhD</degrees><xref ref-type="aff" rid="A1">1</xref></contrib><contrib contrib-type="author"><name><surname>Hunguana</surname><given-names>Elsa</given-names></name><xref ref-type="aff" rid="A3">3</xref></contrib><contrib contrib-type="author"><name><surname>Munguambe</surname><given-names>Ant&#x000f3;nio Orlando</given-names></name><xref ref-type="aff" rid="A3">3</xref></contrib><contrib contrib-type="author"><name><surname>Rose</surname><given-names>Carol Dawson</given-names></name><degrees>PhD</degrees><xref ref-type="aff" rid="A2">2</xref></contrib></contrib-group><aff id="A1"><label>1</label>Dept. of Health Behavior and Health Education, School of Public Health, University of Michigan, 1415 Washington Heights, Ann Arbor, MI 48109, USA</aff><aff id="A2"><label>2</label>Dept. of Community Health Systems, School of Nursing, University of California, San Francisco, 2 Koret Way, San Francisco, CA, 94143, USA</aff><aff id="A3"><label>3</label>I-TECH Mozambique, Avenida Cahora Bassa 106, Maputo, Mozambique</aff><author-notes><corresp id="CR1"><label>*</label>Corresponding Author: Sarah A. Gutin, Tel: (415) 602 3495, Fax: (734) 763 7379, <email>sgutin@umich.edu</email></corresp></author-notes><pub-date pub-type="nihms-submitted"><day>4</day><month>12</month><year>2020</year></pub-date><pub-date pub-type="epub"><day>10</day><month>8</month><year>2017</year></pub-date><pub-date pub-type="ppub"><season>Sep-Oct</season><year>2017</year></pub-date><pub-date pub-type="pmc-release"><day>17</day><month>12</month><year>2020</year></pub-date><volume>16</volume><issue>5</issue><fpage>487</fpage><lpage>493</lpage><!--elocation-id from pubmed: 10.1177/2325957417724206--><abstract id="ABS1"><sec id="S1"><title>Background:</title><p id="P1">PHDP is Mozambique&#x02019;s strategy to engage clinicians in the delivery of prevention messages to their HIV positive clients. This national implementation strategy uses provider trainings on offering key messages and focuses on intervening on nine evidence-based risk-reduction areas. We investigated the impact of longitudinal technical assistance(TA) as an addition to this basic training.</p></sec><sec id="S2"><title>Methods:</title><p id="P2">We followed 153 healthcare providers in 5 Mozambican provinces over 6 months to evaluate the impact of on-site, observation-based TA on PHDP implementation. Longitudinal multilevel models were estimated to model change in PHDP message delivery over time among individual providers.</p></sec><sec id="S3"><title>Results:</title><p id="P3">With each additional TA visit, providers delivered about one additional PHDP message (p&#x0003c;0.001); clinicians and non-clinicians started at about the same baseline level but clinicians improved more quickly (p=0.004). Message delivery varied by practice sector; maternal and child health sectors outperformed other sectors.</p></sec><sec id="S4"><title>Conclusions:</title><p id="P4">Longitudinal TA helped reach the programmatic goals of the PHDP program in Mozambique.</p></sec></abstract><kwd-group><kwd>Positive Health, Dignity and Prevention (PHDP)</kwd><kwd>Implementation research</kwd><kwd>Technical Assistance</kwd><kwd>multi-level models</kwd><kwd>Mozambique</kwd></kwd-group></article-meta></front><body><sec id="S5"><title>INTRODUCTION</title><p id="P5">Mozambique has one of the world&#x02019;s highest HIV/AIDS burdens.<sup><xref rid="R1" ref-type="bibr">1</xref></sup> The national HIV prevalence is estimated at 11.5% among adults aged 15&#x02013;49 years, with prevalence as high as 25% in some provinces.<sup><xref rid="R1" ref-type="bibr">1</xref>,<xref rid="R2" ref-type="bibr">2</xref></sup> Although from 2001 to 2012, Mozambique saw the incidence of HIV among adults fall by more than 25%, continued high prevalence rates demonstrate the need for additional prevention strategies to effectively reduce HIV transmission.<sup><xref rid="R1" ref-type="bibr">1</xref></sup></p><p id="P6">The rapid scale-up of HIV care and treatment in Mozambique has provided an opportunity to engage people living with HIV (PLHIV) in strategies targeting the prevention of onward HIV transmission. Focusing prevention efforts on people who know their HIV status is crucial as this can reduce transmission of HIV to partners and children who are not already infected. Meta-analyses have suggested that interventions delivered in routine medical care settings significantly reduced sexual risk behaviors and may be ideal locations for behavior change counseling to reduce the onward transmission of HIV.<sup><xref rid="R3" ref-type="bibr">3</xref></sup> Such Positive Health, Dignity, and Prevention (PHDP) interventions have already been developed and tested in sub-Saharan African settings and have been found to reduce risky sexual behaviors and increase condom use.<sup><xref rid="R4" ref-type="bibr">4</xref>&#x02013;<xref rid="R8" ref-type="bibr">8</xref></sup> Other studies have found that PHDP interventions are feasible to implement during routine clinical care and are acceptable to PLHIV in sub-Saharan African contexts.<sup><xref rid="R5" ref-type="bibr">5</xref>,<xref rid="R9" ref-type="bibr">9</xref>,<xref rid="R10" ref-type="bibr">10</xref></sup> In some cases, however, difficulties have been noted with intervention fidelity and high quality implementation.<sup><xref rid="R11" ref-type="bibr">11</xref>,<xref rid="R12" ref-type="bibr">12</xref></sup></p><p id="P7">The PHDP framework guides clinical practice evaluation and improvement for treatment and prevention among PLHIV in Mozambique and is included in Mozambique&#x02019;s 2015&#x02013;2019 National Strategic Plan for HIV/AIDS.<sup><xref rid="R13" ref-type="bibr">13</xref>,<xref rid="R14" ref-type="bibr">14</xref></sup> PHDP, which is known locally as Positive Prevention (PP), encompasses nine evidence-based approaches to reducing transmission, including addressing sexual risk and promoting condom use, supporting disclosure and partner testing, antiretroviral therapy (ART) adherence, screening for sexually transmitted infections (STIs), prevention of mother-to-child transmission (PMTCT) or offering family planning (FP), addressing the use of alcohol and drugs, referral to community support services and, addressing gender-based violence (GBV) (see <xref rid="T1" ref-type="table">Table 1</xref>).<sup><xref rid="R15" ref-type="bibr">15</xref></sup> PP training has been offered in Mozambique since 2006 and targets healthcare providers who see PLHIV during routine HIV care.</p><p id="P8">Reports of PHDP message delivery in clinical care settings in Mozambique suggested that after receiving PP training, some providers struggled with offering PP messages during their daily interactions with PLHIV. Dewing and colleagues in South Africa found a similar situation and reported that following a PP training, providers failed to reach full proficiency but benefited from refresher training and supervision.<sup><xref rid="R11" ref-type="bibr">11</xref>,<xref rid="R16" ref-type="bibr">16</xref></sup> Work by various researchers has suggested that in order to achieve and maintain proficiency with HIV prevention counseling and behavior change communication, more intensive training as well as follow-up technical assistance (TA) may be needed.<sup><xref rid="R12" ref-type="bibr">12</xref>,<xref rid="R17" ref-type="bibr">17</xref></sup> Effective strategies that improve the implementation of PP are desperately needed to improve clinical care and reduce HIV transmission.</p><p id="P9">Therefore, in order to support the implementation of PP in Mozambique, we provided on-site, observation-based TA to providers following a three-day PP training workshop. We evaluated the impact of TA implemented over six months on the delivery of accurate PP messages. We hypothesized that on-going TA would increase the delivery of PP messages over-time. By assessing the impact of on-site TA, we hoped to learn lessons and develop best practices that would help refine TA approaches to ultimately improve HIV provider prevention counseling for PLHIV.</p></sec><sec id="S6"><title>METHODS</title><sec id="S7"><title>Sample.</title><p id="P10">The study population was healthcare providers who offer care and treatment to PLHIV at health facilities in Mozambique. For this evaluation, providers were defined broadly to include Physicians, technicians providing either comprehensive (Medical Technician) or basic (Agente) medical care, maternal and child health nurses, general nurses, psychologists, psychiatric technicians, counselors, and midwives. Although their educational backgrounds and job functions differed, these various cadres were chosen to receive PP training because they represent the various types of healthcare workers who have contact with and provide services to the client population. In total, 153 healthcare providers at 39 health centers in 5 provinces took part in this study. This final sample consisted of 103 clinicians and 50 non-clinicians.</p><p id="P11">To be eligible, providers had to be at least 18 years old and fluent in Portuguese (both minimum job entry requirements in Mozambique), have participated in a PP training, and be regularly providing care to PLHIV. Observed interactions also required that the client be 18 years of age or older, HIV-positive, and provide assent for their consultation to be observed.</p><p id="P12">Evaluation sites were drawn from five of Mozambique&#x02019;s 11 provinces (Maputo City, Maputo Province, Gaza Province, Inhambane Province, and Zamb&#x000e9;zia Province) and were all MOH clinics. Each site was chosen because it employed healthcare providers who had received the PP training, was located in a province with a high HIV prevalence, and was deemed a priority by the provincial department of health. Within each health center, providers were recruited from priority health sectors that included Maternal and Child Health, Maternity, Psychosocial Support, adult and adolescent HIV counselling and testing, integrated consultations (where PLHIV access HIV care and treatment), and the National Program to Control Tuberculosis (TB). At each health center, all providers in the priority health sectors were recruited to take part in the evaluation. Providers in other sectors of the health center (for example, laboratory or pharmacy) were not part of this evaluation although PP training was provided to all healthcare providers at the health center. All providers who were recruited took part in the evaluation.</p></sec><sec id="S8"><title>Data collection.</title><p id="P13">Data collection took place from March through September 2013. The evaluation approach consisted of one PP project member trained in monitoring and supervision visiting an implementation health center to observe trained healthcare workers in their clinical visits with at least three clients. During each observed provider-client interaction, the trained staff member would be present in the consultation room and would note the PP messages that providers accurately and completely offered to clients during the session, as well as messages that were not complete or accurate. All data was collected on paper-based TA checklist forms by trained project staff. The TA staff member did not interact with the client or comment during the client consultation. Directly following the conclusion of each observed provider-client session, the trained staff member would provide feedback to the provider about areas in which they excelled as well as areas for improvement. PP staff members were all PP curriculum and training experts and were highly knowledgeable of all PP messages and strategies for integration during clinical care. Following TA visits, data from paper-based forms were entered into a custom-designed database (CS Pro) and then cleaned and aggregated by data analysts.</p></sec><sec id="S9"><title>Measures.</title><p id="P14">Mozambican PP technical staff members developed all evaluation measures and data collection tools in collaboration with researchers from the University of California, San Francisco. New measures were created to assess PP message delivery as no existing tools measured delivery of PP messages. After initial item generation, content validity was established by submitting the scale to HIV care and PP experts. The scale was pilot tested with a sample of PLHIV from the catchment area that met eligibility criteria to ensure face validity and to assess understanding, cultural relevance, and language clarity. Following pilot testing, the scale was further refined. These approaches provided confidence in the comprehensiveness of the new scale. The final scale contained nine items with four response categories (ie: message given correctly and completely, message given incompletely, message given incorrectly, message not given).</p><p id="P15">Provider variables recorded by the evaluation staff members included: sex (female/ male), professional category (physicians, medical technicians, agentes, maternal and child health nurses, general nurses, psychiatric technicians, midwives, counselors, and psychologists), province, health center name, and health center sector where the provider delivered services (Maternal and Child Health/ Maternity, Psychosocial Support, adult and adolescent HIV counselling and testing, integrated consultations and the National Program to Control TB). Since we hypothesized that there might be differences in message provision based on professional category, we used the provider professional category information to construct a variable for clinical category that was coded as clinicians (ie: physicians, medical technicians, agentes, maternal and child health nurses, general nurses, psychiatric technicians, and midwives) and non-clinicians (ie: counselors and psychologists). In assessing providers during client interactions, client variables including sex (female/ male) and ART status (on ART/ not on ART) were recorded.</p><p id="P16">The main outcome of interest was whether each PP message was delivered completely (risks and alternatives clearly explained by service provider) and accurately (informational content was accurate) to the client at any point in the observed consultation. Each PP message was coded as a binary variable (message given accurately and completely [yes=1] and message not given (at all or not accurately) [no=0]). A sum score was then created as a measure of message delivery success with higher scores reflecting higher correct message delivery. The score ranged from 0 to 9 reflecting the nine possible PP messages that could be given [1) sexual risk assessment and condom distribution, 2) sero-status disclosure and partner testing, 3) treatment adherence, 4) STIs, 5) family planning, 6) PMTCT, 7) drug and alcohol use, 8) community support services, and 9) gender-based violence].</p></sec><sec id="S10"><title>Design.</title><p id="P17">This evaluation utilized a non-experimental, prospective, longitudinal cohort design to examine provider ability to accurately and completely offer PP interventions during day-to-day interactions with PLHIV. All recruited providers were observed and had received the PP training. There was no control condition. All providers at evaluation health centers had been trained regardless of their clinical category. However, laboratory and pharmacy staff were not included in this evaluation as they are less likely to offer PP messages in their regular interactions with PLHIV. Not including these health center staff likely improves the observed level of PP message delivery.</p></sec><sec id="S11"><title>Analyses.</title><p id="P18">Analyses were conducted with STATA version 13.1 (StataCorp LP, College Station, TX). Descriptive statistics were used to characterize the sample, inspect the distributions of main variables and examine for differences in providers observed over the full study versus those who were lost to follow-up. Longitudinal multilevel models with random intercepts for individual healthcare providers were estimated to determine if implementation of key messages changed over time and if change over time was dependent on professional category, provider sex, sector where the provider offers services or patient factors while adjusting for the nested nature of data (repeated observations nested within individual providers). In these models, time is represented as the number of TA exposures (1 to 5), which were implemented generally in 5-week cycles.</p></sec><sec id="S12"><title>Ethics.</title><p id="P19">All procedures were reviewed by the Committee on Human Research at the University of California, San Francisco (UCSF), the IRB at the University of Washington, the US Centers for Disease Control and Prevention (CDC) Division of Global HIV/AIDS, and the Comit&#x000e9; Nacional de Bio&#x000e9;tica a Sa&#x000fa;de in Mozambique, with the determination that written consent from providers was not required as the activities described were considered quality improvement. However, verbal assent from provider and any client observed was confirmed prior to engagement in any TA procedure. Providers could decline TA or stop TA at any time without consequence.</p></sec></sec><sec id="S13"><title>RESULTS</title><p id="P20">In total, 153 healthcare providers were followed at 39 health centers in 5 provinces. The sample consisted of 103 clinicians and 50 non-clinicians. The majority of providers were female (68%), 67% were clinicians, and 35% were providing care during integrated consultations (where most PLHIV access HIV care and treatment services). Just over half (55.6 %) of the clients being seen by the healthcare providers were women and almost half (47.7%) were on ART (see <xref rid="T2" ref-type="table">Table 2</xref>). Across all data collection time points, PP messages were delivered an average of 3.05 (SD=1.48) times per client.</p><sec id="S14"><title>Modeling the impact of TA.</title><p id="P21">As indicated in <xref rid="T3" ref-type="table">Table 3</xref>, Model 1, the impact of exposures to TA was important for the successful implementation of the PP program. Specifically, the baseline number of messages delivered (2 messages) increased by an additional message for each additional TA visit (p&#x0003c;0.001). Independent variables including provider sex, the sector the provider works in at the health center, client sex, and client ART status were evaluated for impact on the number of correct PP messages delivered (<xref rid="T3" ref-type="table">Table 3</xref>, Model 2). The only significant findings for this multivariable model were for time, professional category, and sector. With each additional TA visit, providers delivered just under one additional PP message: clinicians offered almost one PP message less as compared to non-clinicians (p=0.058). In addition, providers in the integrated consultations sector as well as TB sectors delivered fewer messages than providers in the maternal and child health and maternity sectors. The interaction of time and provider professional category was also significant (p=0.004), suggesting that clinician message delivery improves more quickly than non-clinicians as TA sessions accumulate over time (see <xref rid="F1" ref-type="fig">Figure 1</xref>).</p></sec></sec><sec id="S15"><title>DISCUSSION</title><p id="P22">In this study, we examined the impact of an implementation improvement strategy that could be used in various settings. Overall, longitudinal TA was shown to increase the frequency of accurate and complete PP message delivery implemented during routine practice within low resource, public sector clinics in Mozambique. In addition to TA visits, the strongest predictor of PP message delivery following training was the sector where the provider offered services. Providers in the integrated consultations and TB sectors delivered fewer messages than providers in the maternal and child health and maternity sectors. Additionally, provider professional category (whether the provider was a clinician versus a non-clinician) was significant and suggested that clinicians may be slightly worse than non-clinicians at delivering PP messages at baseline but that over time, clinicians improve their PP message delivery more quickly than non-clinicians. These results support the value of on-site observation based repeated TA for improving provider competency and the importance of providing ongoing technical support during implementation in order to improve PP message delivery by various types of HIV care providers.</p><p id="P23">In this analysis, the mean number of PP messages delivered was three messages. Full implementation of the PP intervention is the provision of eight prevention messages. Therefore, on average, providers were not reaching full intervention implementation. Other HIV prevention counseling studies have also found that providers may have difficulty achieving full proficiency with prevention interventions and techniques.<sup><xref rid="R18" ref-type="bibr">18</xref>&#x02013;<xref rid="R20" ref-type="bibr">20</xref></sup> Transferring evidence-based practices into real-world settings can present implementation challenges and barriers.<sup><xref rid="R9" ref-type="bibr">9</xref>,<xref rid="R16" ref-type="bibr">16</xref>,<xref rid="R18" ref-type="bibr">18</xref>,<xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R23" ref-type="bibr">23</xref></sup> Furthermore, it may be unrealistic outside of study settings to expect near-perfect implementation.<sup><xref rid="R17" ref-type="bibr">17</xref></sup> For example, structural barriers such as limited time and space for counseling, high client load, and frequent staff turnover, have been noted in South Africa and Mozambique.<sup><xref rid="R9" ref-type="bibr">9</xref>,<xref rid="R16" ref-type="bibr">16</xref>,<xref rid="R18" ref-type="bibr">18</xref></sup></p><p id="P24">The models presented also suggest that individual provider characteristics do not make a substantial impact on PP message delivery. As it relates to HIV service provision, this lack of a provider effect may mean that providers are delivering PP messages based on their clinical judgment. This is reasonable and suggests that providers may be delivering only those messages they felt were pertinent to a given client, versus implementation of all messages regardless of current client needs. Such an adaptation would arguably be more consistent with tailored approaches, such as patient-centered counseling. Tailoring the intervention to the specific needs of the target population may improve the fit of the intervention and may also promote maintenance and implementation over time.<sup><xref rid="R23" ref-type="bibr">23</xref>&#x02013;<xref rid="R26" ref-type="bibr">26</xref></sup> This finding suggests there is an opportunity to impact provider clinical practices over time.</p><p id="P25">With each additional TA visit, providers delivered about one additional PP message, showing steady improvement over time. TA has generally been found to be associated with more effective implementation following the initiation of new programs<sup><xref rid="R17" ref-type="bibr">17</xref></sup>. One strength of the TA support provided was that it was offered shortly after the initial training and it was delivered repeatedly over time in the providers&#x02019; practice environment. Similar interventions have shown that training alone is not enough to ensure fidelity and implementation of PP interventions<sup><xref rid="R11" ref-type="bibr">11</xref></sup> and have also suggested that TA can improve message provision over time, therefore allowing providers to address more PLHIV prevention needs.<sup><xref rid="R12" ref-type="bibr">12</xref></sup> Since the transfer of learned skills into practice is an ongoing process that is influenced by the work environment<sup><xref rid="R27" ref-type="bibr">27</xref></sup>, regular supervision incorporated in the context of the daily work environment may help to reinforce competencies as providers learn how to implement PP during regular care.</p><p id="P26">Our results also suggest that although clinicians and non-clinicians may start at slightly different levels of PP message delivery at baseline, clinicians improve their PP message delivery at a more rapid pace than non-clinicians. It is possible that clinicians may feel more comfortable delivering biomedical messages (such as about STI treatment or FP method provision)<sup><xref rid="R28" ref-type="bibr">28</xref></sup> and this may aid in their faster improvement. However, not all PP messages are clinically based and many focus on psychosocial support (such as messages about referrals to community support services or addressing GBV). Although messages offered by clinicians can be especially effective at impacting the transmission risk behaviors of PLHIV<sup><xref rid="R29" ref-type="bibr">29</xref></sup>, it is necessary to find approaches for discussing risk behavior and prevention that are acceptable to providers regardless of clinical cadre. All providers should be encouraged to discuss all PP messages with their clients and develop comfort providing both biomedical and behavioral prevention messages, as this is an important opportunity to prevent HIV transmission.</p><p id="P27">These findings should be interpreted in light of some limitations. As this was a longitudinal study, evaluating provider practice and not clients, we did not track client data. It is possible that the same client could have been seen multiple times adding an additional level of clustering to the data. Given the varied observation schedules, we do not suspect that this occurred often. Additionally, the data for this study comes from consultations with PLHIV clients observed by trained Mozambican PP staff members. Since counseling sessions were observed, it could be argued that the results may be overly favorable as the presence of an observer would likely cue providers to implement messages. While this is possible, all observation data was collected in the same manner over time, and we did have variability in the data collected. Thus, for most providers the presence of the PP team member did not produce &#x0201c;perfect&#x0201d; performance. Finally, there was no control group or comparison condition. It is possible that provider PP message delivery would have improved over time in the absence of TA. However, other studies have found that following trainings, providers benefit from refresher training and supervision,<sup><xref rid="R11" ref-type="bibr">11</xref>,<xref rid="R16" ref-type="bibr">16</xref></sup> suggesting that TA provides an added enhancement in HIV prevention counseling.</p></sec><sec id="S16"><title>CONCLUSION</title><p id="P28">In this analysis, we report the results of an effective implementation improvement strategy. Overall, longitudinal TA steadily increased the frequency of PP message delivery in Mozambique. While these results are encouraging, there is still much to be explored in order to know whether the PP intervention can reduce transmission risk behavior since the delivery of PP messages does not necessarily translate into patient behavior modification. Moreover, whether all PP messages are indeed needed or if changes to the PP approach represent valuable adaptations to client needs should be carefully evaluated. In order to maintain the gains noted here, ongoing support is needed to achieve full integration and to ensure the delivery of PP with good quality. Given ongoing supervision that is tailored to the needs of providers, additional follow-up should continue to build competence and enable providers to deliver PP counseling that can address the prevention needs of PLHIV and ultimately reduce HIV transmissions.</p></sec></body><back><ack id="S17"><title>ACKNOWLEDGEMENT</title><p id="P29">The authors would like to extend our heartfelt thanks to the many people who made this work possible: Katia Manjate, Jer&#x000f3;nimo Simbine, Paulo Bulule, Jo&#x000e3;o Guerra, Vilma Pinto Novo, Cibele Maquile, Freide C&#x000e9;sar, L&#x000fa;cio Macamo, Dr. Gerito Augusto, and Dr. Florindo Mudender at I-TECH Mozambique. We would also like to thank our collaborators at CDC Mozambique, Dr. Daniel Shodell and Dr. Della Correia. We also thank Kirsten Herold and Yvette Cuca for their thorough review of this manuscript. Finally, we offer our sincere gratitude to Bruce Cooper, Missy Plegue, and Andy Grogan-Kaylor for their review of the statistical methods employed in this analysis.</p><p id="P30">FUNDING</p><p id="P31">This research was supported by the President&#x02019;s Emergency Plan for AIDS Relief (PEPFAR) through the CDC Mozambique [Cooperative Agreement 3U2GPS002770-03S1]. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention. This research was also supported by an NICHD training grant to the Population Studies Center at the University of Michigan [T32 HD007339] and by the Department of Health Behavior and Health Education at the University of Michigan.</p></ack><fn-group><fn fn-type="COI-statement" id="FN1"><p id="P32">DECLARATION OF CONFLICTING INTERESTS</p><p id="P33">The Authors declare that there are no conflicts of interest.</p></fn></fn-group><ref-list><title>REFERENCES</title><ref id="R1"><label>1.</label><mixed-citation publication-type="web"><collab>UNAIDS</collab>. <source>GLOBAL REPORT: UNAIDS Report on the Global AIDS Epidemic 2013</source>.; <year>2013</year>
<comment><ext-link ext-link-type="uri" xlink:href="http://www.unaids.org/&#x02026;/unaids/&#x02026;/2013/gr2013/UNAIDS_Global_Report_2013">www.unaids.org/&#x02026;/unaids/&#x02026;/2013/gr2013/UNAIDS_Global_Report_2013</ext-link>.</comment></mixed-citation></ref><ref id="R2"><label>2.</label><mixed-citation publication-type="book"><collab>Instituto Nacional de Sa&#x000fa;de, Instituto Nacional de Estat&#x000ed;stica, ICF Macro</collab>. <source>Inqu&#x000e9;rito Nacional de Preval&#x000ea;ncia, Riscos Comportamentais E Informa&#x000e7;&#x000e3;o Sobre O HIV E SIDA Em Mo&#x000e7;ambique 2009</source>. <publisher-name>Calverton</publisher-name>; <year>2010</year>.</mixed-citation></ref><ref id="R3"><label>3.</label><mixed-citation publication-type="journal"><name><surname>Crepaz</surname><given-names>N</given-names></name>, <name><surname>Lyles</surname><given-names>CM</given-names></name>, <name><surname>Wolitski</surname><given-names>RJ</given-names></name>, <etal/>
<article-title>Do prevention interventions reduce HIV risk behaviours among people living with HIV? A meta-analytic review of controlled trials</article-title>. <source>AIDS</source>. <year>2006</year>;<volume>20</volume>(<issue>2</issue>):<fpage>143</fpage>&#x02013;<lpage>157</lpage>.<pub-id pub-id-type="pmid">16511407</pub-id></mixed-citation></ref><ref id="R4"><label>4.</label><mixed-citation publication-type="journal"><name><surname>Bunnell</surname><given-names>R</given-names></name>, <name><surname>Paul</surname><given-names>J</given-names></name>, <name><surname>Solberg</surname><given-names>P</given-names></name>, <etal/>
<article-title>Changes in sexual behavior and risk of HIV transmission after antiretroviral therapy and prevention interventions in rural Uganda</article-title>. <source>AIDS</source>. <year>2006</year>;<volume>20</volume>(<issue>1</issue>):<fpage>85</fpage>&#x02013;<lpage>92</lpage>.<pub-id pub-id-type="pmid">16327323</pub-id></mixed-citation></ref><ref id="R5"><label>5.</label><mixed-citation publication-type="journal"><name><surname>Cornman</surname><given-names>DH</given-names></name>, <name><surname>Kiene</surname><given-names>SM</given-names></name>, <name><surname>Christie</surname><given-names>S</given-names></name>, <etal/>
<article-title>Clinic-based intervention reduces unprotected sexual behavior among HIV-infected patients in KwaZulu-Natal, South Africa: results of a pilot study</article-title>. <source>J Acquir Immune Defic Syndr</source>. <year>2008</year>;<volume>48</volume>:<fpage>553</fpage>&#x02013;<lpage>560</lpage>.<pub-id pub-id-type="pmid">18645518</pub-id></mixed-citation></ref><ref id="R6"><label>6.</label><mixed-citation publication-type="journal"><name><surname>Fisher</surname><given-names>JD</given-names></name>, <name><surname>Cornman</surname><given-names>DH</given-names></name>, <name><surname>Shuper</surname><given-names>PA</given-names></name>, <etal/>
<article-title>HIV Prevention Counseling Intervention Delivered During Routine Clinical Care Reduces HIV Risk Behavior in HIV-Infected South Africans Receiving Antiretroviral Therapy&#x0202f;: The Izindlela Zokuphila / Options for Health Randomized Trial</article-title>. <source>JAIDS</source>. <year>2014</year>;<volume>67</volume>(<issue>5</issue>):<fpage>499</fpage>&#x02013;<lpage>507</lpage>.<pub-id pub-id-type="pmid">25230288</pub-id></mixed-citation></ref><ref id="R7"><label>7.</label><mixed-citation publication-type="journal"><name><surname>Kennedy</surname><given-names>CE</given-names></name>, <name><surname>Medley</surname><given-names>AM</given-names></name>, <name><surname>Sweat</surname><given-names>D</given-names></name>, <name><surname>Reilly</surname><given-names>KRO</given-names></name>. <article-title>The effectiveness of HIV positive prevention behavioral interventions in developing countries&#x0202f;: a systematic review and meta-analysis</article-title>. <source>Bull World Health Organ</source>. <year>2010</year>:<fpage>1</fpage>&#x02013;<lpage>21</lpage>.</mixed-citation></ref><ref id="R8"><label>8.</label><mixed-citation publication-type="journal"><name><surname>Peltzer</surname><given-names>K</given-names></name>, <name><surname>Tabane</surname><given-names>C</given-names></name>, <name><surname>Matseke</surname><given-names>G</given-names></name>, <name><surname>Simbayi</surname><given-names>L</given-names></name>. <article-title>Lay counsellor-based risk reduction intervention with HIV positive diagnosed patients at public HIV counselling and testing sites in Mpumalanga, South Africa</article-title>. <source>Eval Program Plann</source>. <year>2010</year>;<volume>33</volume>(<issue>4</issue>):<fpage>379</fpage>&#x02013;<lpage>385</lpage>.<pub-id pub-id-type="pmid">20416948</pub-id></mixed-citation></ref><ref id="R9"><label>9.</label><mixed-citation publication-type="journal"><name><surname>Jaiantilal</surname><given-names>P</given-names></name>, <name><surname>Gutin</surname><given-names>SA</given-names></name>, <name><surname>Cummings</surname><given-names>B</given-names></name>, <name><surname>Mbofana</surname><given-names>F</given-names></name>, <name><surname>Rose</surname><given-names>CD</given-names></name>. <article-title>Acceptability, feasibility and challenges of implementing an HIV prevention intervention for people living with HIV/AIDS among healthcare providers in Mozambique: Results of a qualitative study</article-title>. <source>SAHARA-J J Soc Asp HIV/AIDS</source>. <year>2015</year>;<volume>12</volume>(<issue>1</issue>):<fpage>2</fpage>&#x02013;<lpage>9</lpage>.</mixed-citation></ref><ref id="R10"><label>10.</label><mixed-citation publication-type="journal"><name><surname>Cornman</surname><given-names>DH</given-names></name>, <name><surname>Christie</surname><given-names>S</given-names></name>, <name><surname>Shepherd</surname><given-names>LM</given-names></name>, <etal/>
<article-title>Counsellor-delivered HIV risk reduction intervention addresses safer sex barriers of people living with HIV in KwaZulu-Natal, South Africa</article-title>. <source>Psychol Health</source>. <year>2011</year>;<volume>26</volume>:<fpage>1623</fpage>&#x02013;<lpage>1641</lpage>.<pub-id pub-id-type="pmid">21745150</pub-id></mixed-citation></ref><ref id="R11"><label>11.</label><mixed-citation publication-type="journal"><name><surname>Dewing</surname><given-names>S</given-names></name>, <name><surname>Mathews</surname><given-names>C</given-names></name>, <name><surname>Cloete</surname><given-names>A</given-names></name>, <etal/>
<article-title>From research to practice: Lay adherence counsellors&#x02019; fidelity to an evidence-based intervention for promoting adherence to antiretroviral treatment in the Western Cape, South Africa</article-title>. <source>AIDS Behav</source>. <year>2013</year>;<volume>17</volume>(<issue>9</issue>):<fpage>2935</fpage>&#x02013;<lpage>2945</lpage>.<pub-id pub-id-type="pmid">23666183</pub-id></mixed-citation></ref><ref id="R12"><label>12.</label><mixed-citation publication-type="journal"><name><surname>Dewing</surname><given-names>S</given-names></name>, <name><surname>Mathews</surname><given-names>C</given-names></name>, <name><surname>Cloete</surname><given-names>A</given-names></name>, <name><surname>Schaay</surname><given-names>N</given-names></name>, <name><surname>Simbayi</surname><given-names>L</given-names></name>, <name><surname>Louw</surname><given-names>J</given-names></name>. <article-title>Lay counselors&#x02019; ability to deliver counseling for behavior change</article-title>. <source>J Consult Clin Psychol</source>. <year>2014</year>;<volume>82</volume>(<issue>1</issue>):<fpage>19</fpage>&#x02013;<lpage>29</lpage>.<pub-id pub-id-type="pmid">24099433</pub-id></mixed-citation></ref><ref id="R13"><label>13.</label><mixed-citation publication-type="book"><collab>CNCS</collab>. <source>National Strategic Plan for HIV/AIDS 2015&#x02013;2019 (PEN IV)</source>. <publisher-name>Maputo, Mozambique</publisher-name>; <year>2015</year>.</mixed-citation></ref><ref id="R14"><label>14.</label><mixed-citation publication-type="book"><collab>MISAU</collab>. <source>Plano de Acelera&#x000e7;&#x000e3;o Da Resposta Ao HIV E SIDA Em Mo&#x000e7;ambique 2013&#x02013; 2015</source>. <publisher-name>Maputo</publisher-name>; <year>2013</year>.</mixed-citation></ref><ref id="R15"><label>15.</label><mixed-citation publication-type="book"><collab>Positive Prevention Program</collab>. <source>Positive Prevention Training for Health Care Providers: Facilitator Guide</source>. <comment>Version 3.</comment>
<publisher-loc>San Francisco, CA</publisher-loc>: <publisher-name>University of California, San Francisco (UCSF)</publisher-name>; <year>2011</year>
<comment><ext-link ext-link-type="uri" xlink:href="http://www.positiveprevention.ucsf.edu">www.positiveprevention.ucsf.edu</ext-link>.</comment></mixed-citation></ref><ref id="R16"><label>16.</label><mixed-citation publication-type="journal"><name><surname>Dewing</surname><given-names>S</given-names></name>, <name><surname>Mathews</surname><given-names>C</given-names></name>, <name><surname>Schaay</surname><given-names>N</given-names></name>, <name><surname>Cloete</surname><given-names>A</given-names></name>, <name><surname>Simbayi</surname><given-names>L</given-names></name>, <name><surname>Chopra</surname><given-names>M</given-names></name>. <article-title>The feasibility of implementing a sexual risk reduction intervention in routine clinical practice at an ARV clinic in Cape Town: A case study</article-title>. <source>AIDS Behav</source>. <year>2011</year>;<volume>15</volume>(<issue>5</issue>):<fpage>905</fpage>&#x02013;<lpage>910</lpage>.<pub-id pub-id-type="pmid">20535540</pub-id></mixed-citation></ref><ref id="R17"><label>17.</label><mixed-citation publication-type="journal"><name><surname>Durlak</surname><given-names>JA</given-names></name>, <name><surname>DuPre</surname><given-names>EP</given-names></name>. <article-title>Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation</article-title>. <source>Am J Community Psychol</source>. <year>2008</year>;<volume>41</volume>(<issue>3&#x02013;4</issue>):<fpage>327</fpage>&#x02013;<lpage>350</lpage>.<pub-id pub-id-type="pmid">18322790</pub-id></mixed-citation></ref><ref id="R18"><label>18.</label><mixed-citation publication-type="journal"><name><surname>Dewing</surname><given-names>S</given-names></name>, <name><surname>Mathews</surname><given-names>C</given-names></name>, <name><surname>Schaay</surname><given-names>N</given-names></name>, <name><surname>Cloete</surname><given-names>A</given-names></name>, <name><surname>Louw</surname><given-names>J</given-names></name>, <name><surname>Simbayi</surname><given-names>L</given-names></name>. <article-title>Behaviour change counselling for ARV adherence support within primary health care facilities in the western cape, South Africa</article-title>. <source>AIDS Behav</source>. <year>2012</year>;<volume>16</volume>(<issue>5</issue>):<fpage>1286</fpage>&#x02013;<lpage>1294</lpage>.<pub-id pub-id-type="pmid">21983698</pub-id></mixed-citation></ref><ref id="R19"><label>19.</label><mixed-citation publication-type="journal"><name><surname>Evangeli</surname><given-names>M</given-names></name>, <name><surname>Engelbrecht</surname><given-names>S-K</given-names></name>, <name><surname>Swartz</surname><given-names>L</given-names></name>, <name><surname>Turner</surname><given-names>K</given-names></name>, <name><surname>Forsberg</surname><given-names>L</given-names></name>, <name><surname>Soka</surname><given-names>N</given-names></name>. <article-title>An evaluation of a brief motivational interviewing training course for HIV/AIDS counsellors in Western Cape Province, South Africa</article-title>. <source>AIDS Care</source>. <year>2009</year>;<volume>21</volume>(<issue>2</issue>):<fpage>189</fpage>&#x02013;<lpage>196</lpage>.<pub-id pub-id-type="pmid">19229688</pub-id></mixed-citation></ref><ref id="R20"><label>20.</label><mixed-citation publication-type="journal"><name><surname>Mash</surname><given-names>R</given-names></name>, <name><surname>Baldassini</surname><given-names>G</given-names></name>, <name><surname>Mkhatshwa</surname><given-names>H</given-names></name>, <name><surname>Sayeed</surname><given-names>I</given-names></name>, <name><surname>Ndapeua</surname><given-names>S</given-names></name>, <name><surname>Mash</surname><given-names>B</given-names></name>. <article-title>Reflections on the training of counsellors in motivational interviewing for programmes for the prevention of mother to child transmission of HIV in sub-Saharan Africa</article-title>. <source>South African Fam Pract</source>. <year>2008</year>;<volume>50</volume>(<issue>2</issue>):<fpage>53</fpage>&#x02013;<lpage>59</lpage>.</mixed-citation></ref><ref id="R21"><label>21.</label><mixed-citation publication-type="journal"><name><surname>Cohen</surname><given-names>DJ</given-names></name>, <name><surname>Crabtree</surname><given-names>BF</given-names></name>, <name><surname>Etz</surname><given-names>RS</given-names></name>, <etal/>
<article-title>Fidelity Versus Flexibility. Translating Evidence-Based Research into Practice</article-title>. <source>Am J Prev Med</source>. <year>2008</year>;<volume>35</volume>(<issue>5 Suppl.</issue>):<fpage>S381</fpage>&#x02013;<lpage>9</lpage>.<pub-id pub-id-type="pmid">18929985</pub-id></mixed-citation></ref><ref id="R22"><label>22.</label><mixed-citation publication-type="journal"><name><surname>Glasgow</surname><given-names>RE</given-names></name>, <name><surname>Emmons</surname><given-names>KM</given-names></name>. <article-title>How can we increase translation of research into practice? Types of evidence needed</article-title>. <source>Annu Rev Public Health</source>. <year>2007</year>;<volume>28</volume>:<fpage>413</fpage>&#x02013;<lpage>433</lpage>.<pub-id pub-id-type="pmid">17150029</pub-id></mixed-citation></ref><ref id="R23"><label>23.</label><mixed-citation publication-type="journal"><name><surname>Norton</surname><given-names>WE</given-names></name>, <name><surname>Amico</surname><given-names>KR</given-names></name>, <name><surname>Cornman</surname><given-names>DH</given-names></name>, <name><surname>Fisher</surname><given-names>WA</given-names></name>, <name><surname>Fisher</surname><given-names>JD</given-names></name>. <article-title>An agenda for advancing the science of implementation of evidence-based HIV prevention interventions</article-title>. <source>AIDS Behav</source>. <year>2009</year>;<volume>13</volume>(<issue>3</issue>):<fpage>424</fpage>&#x02013;<lpage>429</lpage>.<pub-id pub-id-type="pmid">19360464</pub-id></mixed-citation></ref><ref id="R24"><label>24.</label><mixed-citation publication-type="journal"><name><surname>Dawson Rose</surname><given-names>C</given-names></name>, <name><surname>Gutin</surname><given-names>SA</given-names></name>, <name><surname>Reyes</surname><given-names>M</given-names></name>. <article-title>Adapting Positive Prevention Interventions for International Settings: Applying U.S. Evidence to Epidemics in Developing Countries</article-title>. <source>J Assoc Nurses AIDS Care</source>. <year>2011</year>;<volume>22</volume>(<issue>1</issue>):<fpage>38</fpage>&#x02013;<lpage>52</lpage>.<pub-id pub-id-type="pmid">20538491</pub-id></mixed-citation></ref><ref id="R25"><label>25.</label><mixed-citation publication-type="journal"><name><surname>Wegbreit</surname><given-names>J</given-names></name>, <name><surname>Bertozzi</surname><given-names>S</given-names></name>, <name><surname>DeMaria</surname><given-names>LM</given-names></name>, <name><surname>Padian</surname><given-names>NS</given-names></name>. <article-title>Effectiveness of HIV prevention strategies in resource-poor countries: tailoring the intervention to the context</article-title>. <source>AIDS</source>. <year>2006</year>;<volume>20</volume>(<issue>9</issue>):<fpage>1217</fpage>&#x02013;<lpage>1235</lpage>.<pub-id pub-id-type="pmid">16816550</pub-id></mixed-citation></ref><ref id="R26"><label>26.</label><mixed-citation publication-type="journal"><name><surname>Koester</surname><given-names>KA</given-names></name>, <name><surname>Maiorana</surname><given-names>A</given-names></name>, <name><surname>Vernon</surname><given-names>K</given-names></name>, <name><surname>Myers</surname><given-names>J</given-names></name>, <name><surname>Rose</surname><given-names>CD</given-names></name>, <name><surname>Morin</surname><given-names>S</given-names></name>. <article-title>Implementation of HIV prevention interventions with people living with HIV/AIDS in clinical settings: challenges and lessons learned</article-title>. <source>AIDS Behav</source>. <year>2007</year>;<volume>11</volume>(<issue>5 Suppl</issue>):<fpage>S17</fpage>&#x02013;<lpage>29</lpage>. doi:<pub-id pub-id-type="doi">10.1007/s10461-007-9233-8</pub-id><comment>.</comment><pub-id pub-id-type="pmid">17436072</pub-id></mixed-citation></ref><ref id="R27"><label>27.</label><mixed-citation publication-type="journal"><name><surname>Van Den Eertwegh</surname><given-names>V</given-names></name>, <name><surname>van Dulmen</surname><given-names>S</given-names></name>, <name><surname>van Dalen</surname><given-names>J</given-names></name>, <name><surname>Scherpbier</surname><given-names>AJJA</given-names></name>, <name><surname>van der Vleuten</surname><given-names>CPM</given-names></name>. <article-title>Learning in context: Identifying gaps in research on the transfer of medical communication skills to the clinical workplace</article-title>. <source>Patient Educ Couns</source>. <year>2013</year>;<volume>90</volume>(<issue>2</issue>):<fpage>184</fpage>&#x02013;<lpage>192</lpage>.<pub-id pub-id-type="pmid">22796303</pub-id></mixed-citation></ref><ref id="R28"><label>28.</label><mixed-citation publication-type="journal"><name><surname>Rose</surname><given-names>CD</given-names></name>, <name><surname>Koester</surname><given-names>KA</given-names></name>, <name><surname>Kang Dufour</surname><given-names>M-S</given-names></name>, <etal/>
<article-title>Messages HIV clinicians use in prevention with positives interventions</article-title>. <source>AIDS Care</source>. <year>2012</year>;<volume>24</volume>(<issue>6</issue>):<fpage>704</fpage>&#x02013;<lpage>711</lpage>.<pub-id pub-id-type="pmid">22299672</pub-id></mixed-citation></ref><ref id="R29"><label>29.</label><mixed-citation publication-type="journal"><name><surname>Myers</surname><given-names>JJ</given-names></name>, <name><surname>Shade</surname><given-names>SB</given-names></name>, <name><surname>Rose</surname><given-names>CD</given-names></name>, <etal/>
<article-title>Interventions delivered in clinical settings are effective in reducing risk of HIV transmission among people living with HIV: results from the Health Resources and Services Administration (HRSA)&#x02019;s Special Projects of National Significance initiative</article-title>. <source>AIDS Behav</source>. <year>2010</year>;<volume>14</volume>(<issue>3</issue>):<fpage>483</fpage>&#x02013;<lpage>492</lpage>.<pub-id pub-id-type="pmid">20229132</pub-id></mixed-citation></ref></ref-list></back><floats-group><fig id="F1" orientation="portrait" position="float"><label>FIGURE 1</label><caption><p id="P34">Delivery of PP Messages over time disaggregated by provider clinical status</p></caption><graphic xlink:href="nihms-1651262-f0001"/></fig><table-wrap id="T1" position="float" orientation="portrait"><label>Table 1:</label><caption><p id="P35">PP messages</p></caption><table frame="box" rules="all"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="left" valign="top" rowspan="1" colspan="1">PP message</th><th align="left" valign="top" rowspan="1" colspan="1">Description of message</th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">1. Addressing sexual risk and promoting condom use</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L2"><list-item><p id="P36">Risk behavior assessment</p></list-item><list-item><p id="P37">Discussion of risk factors</p></list-item><list-item><p id="P38">Options for risk reduction</p></list-item><list-item><p id="P39">Provide condoms</p></list-item></list></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2. Supporting disclosure and partner testing</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L4"><list-item><p id="P40">Advantages of disclosure</p></list-item><list-item><p id="P41">Disclosure support</p></list-item><list-item><p id="P42">Evaluate partner serostatus</p></list-item><list-item><p id="P43">Importance of partner testing</p></list-item><list-item><p id="P44">Addressing serodiscordance</p></list-item></list></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">3. Antiretroviral therapy (ART) adherence</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L6"><list-item><p id="P45">Importance of adherence</p></list-item><list-item><p id="P46">Adherence assessment</p></list-item><list-item><p id="P47">Support for adherence</p></list-item></list></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">4. Screening for sexually transmitted infections (STIs)</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L8"><list-item><p id="P48">STI screening</p></list-item><list-item><p id="P49">Treatment of STIs</p></list-item><list-item><p id="P50">Invitation of partner to STI treatment Referral</p></list-item></list></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">5. Prevention of mother-to-child transmission (PMTCT)</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L10"><list-item><p id="P51">Need for PMTCT</p></list-item><list-item><p id="P52">Importance of PMTCT</p></list-item><list-item><p id="P53">PMTCT messages</p></list-item></list></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">6. Offering family planning (FP)</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L12"><list-item><p id="P54">Evaluation of possible pregnancy</p></list-item><list-item><p id="P55">Need for FP</p></list-item><list-item><p id="P56">Referral for methods when necessary</p></list-item></list></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">7. Addressing the use of alcohol and drugs</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L14"><list-item><p id="P57">Screening for signs of alcohol and/or drug use</p></list-item><list-item><p id="P58">Risks associated with alcohol and other drugs</p></list-item><list-item><p id="P59">Messages for reducing consumption of alcohol and other drugs</p></list-item></list></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">8. Referral to community support services</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L16"><list-item><p id="P60">Identifying needs for additional community support</p></list-item><list-item><p id="P61">Referral to community support groups</p></list-item></list></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">9. Addressing gender-based violence (GBV)</td><td align="left" valign="top" rowspan="1" colspan="1"><list list-type="bullet" id="L18"><list-item><p id="P62">Screening for signs of GBV</p></list-item><list-item><p id="P63">Support the victim</p></list-item><list-item><p id="P64">Referral for additional support</p></list-item></list></td></tr></tbody></table></table-wrap><table-wrap id="T2" position="float" orientation="portrait"><label>Table 2:</label><caption><p id="P65">Demographics characteristics of providers and clients</p></caption><table frame="box" rules="cols"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="left" valign="top" rowspan="1" colspan="1"/><th align="left" valign="top" rowspan="1" colspan="1">Mean (SD)</th></tr></thead><tbody><tr><td align="left" valign="top" style="border-bottom: solid 1px; border-top: solid 1px" rowspan="1" colspan="1"><bold>Correct and complete delivery of PP messages</bold></td><td align="left" valign="top" style="border-bottom: solid 1px; border-top: solid 1px" rowspan="1" colspan="1">3.05 (1.48)</td></tr><tr><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1"/><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1"><bold>PROVIDERS (n=153)</bold></td><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1"><bold>n (%)</bold></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"><bold>Provider Sex</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Female</td><td align="left" valign="top" rowspan="1" colspan="1">104 (68)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Male</td><td align="left" valign="top" rowspan="1" colspan="1">49 (32)</td></tr><tr><td align="left" valign="top" style="border-top: solid 1px" rowspan="1" colspan="1"><bold>Provider Cadre</bold></td><td align="left" valign="top" style="border-top: solid 1px" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"><underline><bold>Clinicians</bold></underline></td><td align="left" valign="top" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Medical Technician</td><td align="left" valign="top" rowspan="1" colspan="1">37 (24)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Maternal and Child Health Nurse</td><td align="left" valign="top" rowspan="1" colspan="1">29 (19)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Agente</td><td align="left" valign="top" rowspan="1" colspan="1">17 (11)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">General Nurse</td><td align="left" valign="top" rowspan="1" colspan="1">16 (10.5)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Psychiatric Technician</td><td align="left" valign="top" rowspan="1" colspan="1">2 (1)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Midwife</td><td align="left" valign="top" rowspan="1" colspan="1">1 (0.65)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Physician</td><td align="left" valign="top" rowspan="1" colspan="1">1 (0.65)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"><underline><bold>Non-clinicians</bold></underline></td><td align="left" valign="top" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Counselors</td><td align="left" valign="top" rowspan="1" colspan="1">47 (31)</td></tr><tr><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1">Psychologists</td><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1">3 (2)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"><bold>Province</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Maputo Province</td><td align="left" valign="top" rowspan="1" colspan="1">46 (30)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Gaza</td><td align="left" valign="top" rowspan="1" colspan="1">35 (23)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Zambezia</td><td align="left" valign="top" rowspan="1" colspan="1">30 (20)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Maputo City</td><td align="left" valign="top" rowspan="1" colspan="1">26 (17)</td></tr><tr><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1">Inhambane</td><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1">16 (10)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"><bold>Sector at Health Center where provider practices</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Integrated Consultations</td><td align="left" valign="top" rowspan="1" colspan="1">54 (35)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Psycho-social support</td><td align="left" valign="top" rowspan="1" colspan="1">40 (26)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Maternal and Child Health/ Maternity</td><td align="left" valign="top" rowspan="1" colspan="1">29 (19)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">TB Clinic</td><td align="left" valign="top" rowspan="1" colspan="1">20 (13)</td></tr><tr><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1">Adult/ adolescent counseling and testing</td><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1">10 (7)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"><bold>Sex of client</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Female</td><td align="left" valign="top" rowspan="1" colspan="1">85 (56)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Male</td><td align="left" valign="top" rowspan="1" colspan="1">53 (35)</td></tr><tr><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1">No data</td><td align="left" valign="top" style="border-bottom: solid 1px" rowspan="1" colspan="1">15 (10)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"><bold>ART status of client</bold></td><td align="left" valign="top" rowspan="1" colspan="1"/></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">On ART</td><td align="left" valign="top" rowspan="1" colspan="1">73 (48)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Not on ART</td><td align="left" valign="top" rowspan="1" colspan="1">71 (46)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">No data</td><td align="left" valign="top" rowspan="1" colspan="1">9 (6)</td></tr></tbody></table></table-wrap><table-wrap id="T3" position="float" orientation="portrait"><label>Table 3:</label><caption><p id="P66">Relationship between TA visits (time), independent variables, and the interaction of provider professional category with the slope of the TA visit time trajectory with the number of correct PP messages delivered<sup><xref rid="TFN1" ref-type="table-fn">1</xref></sup></p></caption><table frame="box" rules="all"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><tbody><tr><th align="left" valign="top" rowspan="1" colspan="1"/><th colspan="4" align="left" valign="top" rowspan="1">Model 1</th></tr><tr><th align="left" valign="top" rowspan="1" colspan="1">Variable</th><th align="left" valign="top" rowspan="1" colspan="1">&#x003b2;</th><th align="left" valign="top" rowspan="1" colspan="1">SE</th><th align="left" valign="top" rowspan="1" colspan="1">t</th><th align="left" valign="top" rowspan="1" colspan="1"><italic>p-value</italic></th></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Technical Assistance visits (time)</td><td align="left" valign="top" rowspan="1" colspan="1">1.084</td><td align="left" valign="top" rowspan="1" colspan="1">0.037</td><td align="left" valign="top" rowspan="1" colspan="1">29.04</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x0003c;0.001</bold></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Intercept</td><td align="left" valign="top" rowspan="1" colspan="1">1.973</td><td align="left" valign="top" rowspan="1" colspan="1">0.140</td><td align="left" valign="top" rowspan="1" colspan="1">14.09</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x0003c;0.001</bold></td></tr></tbody><tbody><tr><th align="left" valign="top" rowspan="1" colspan="1"/><th colspan="4" align="left" valign="top" rowspan="1">Model 2</th></tr><tr><th align="left" valign="top" rowspan="1" colspan="1">Variable</th><th align="left" valign="top" rowspan="1" colspan="1">&#x003b2;</th><th align="left" valign="top" rowspan="1" colspan="1">SE</th><th align="left" valign="top" rowspan="1" colspan="1">t</th><th align="left" valign="top" rowspan="1" colspan="1"><italic>p-value</italic></th></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Technical Assistance visits (time)</td><td align="left" valign="top" rowspan="1" colspan="1">0.920</td><td align="left" valign="top" rowspan="1" colspan="1">0.063</td><td align="left" valign="top" rowspan="1" colspan="1">14.57</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x0003c;0.001</bold></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Provider is clinician</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;0.907</td><td align="left" valign="top" rowspan="1" colspan="1">0.478</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;1.90</td><td align="left" valign="top" rowspan="1" colspan="1">0.058</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Time x provider category interaction</td><td align="left" valign="top" rowspan="1" colspan="1">0.230</td><td align="left" valign="top" rowspan="1" colspan="1">0.079</td><td align="left" valign="top" rowspan="1" colspan="1">2.91</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>0.004</bold></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Sex of provider - female</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;0.076</td><td align="left" valign="top" rowspan="1" colspan="1">0.215</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;0.36</td><td align="left" valign="top" rowspan="1" colspan="1">0.722</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Sector in health center</td><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"/></tr><tr><td align="right" valign="top" rowspan="1" colspan="1">Psycho-social support</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;0.677</td><td align="left" valign="top" rowspan="1" colspan="1">0.444</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;1.52</td><td align="left" valign="top" rowspan="1" colspan="1">0.128</td></tr><tr><td align="right" valign="top" rowspan="1" colspan="1">Integrated Consultation</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;0.558</td><td align="left" valign="top" rowspan="1" colspan="1">0.274</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;2.04</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>0.041</bold></td></tr><tr><td align="right" valign="top" rowspan="1" colspan="1">TB Clinic</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;1.240</td><td align="left" valign="top" rowspan="1" colspan="1">0.361</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;3.43</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>0.001</bold></td></tr><tr><td align="right" valign="top" rowspan="1" colspan="1">Adult and adolescent counseling and testing</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;0.824</td><td align="left" valign="top" rowspan="1" colspan="1">0.537</td><td align="left" valign="top" rowspan="1" colspan="1">&#x02212;1.54</td><td align="left" valign="top" rowspan="1" colspan="1">0.125</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Client sex</td><td align="left" valign="top" rowspan="1" colspan="1">0.176</td><td align="left" valign="top" rowspan="1" colspan="1">0.132</td><td align="left" valign="top" rowspan="1" colspan="1">1.34</td><td align="left" valign="top" rowspan="1" colspan="1">0.180</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Client ART status</td><td align="left" valign="top" rowspan="1" colspan="1">0.136</td><td align="left" valign="top" rowspan="1" colspan="1">0.138</td><td align="left" valign="top" rowspan="1" colspan="1">0.98</td><td align="left" valign="top" rowspan="1" colspan="1">0.325</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Intercept</td><td align="left" valign="top" rowspan="1" colspan="1">2.793</td><td align="left" valign="top" rowspan="1" colspan="1">0.598</td><td align="left" valign="top" rowspan="1" colspan="1">4.67</td><td align="left" valign="top" rowspan="1" colspan="1"><bold>&#x0003c;0.001</bold></td></tr></tbody></table><table-wrap-foot><fn id="TFN1"><label>1</label><p id="P67">The intraclass correlation (ICC) for the null model was 0.092. An ICC of 0.092 means that 9% of the variation in PP message provision can be attributed to a healthcare provider effect.</p></fn></table-wrap-foot></table-wrap></floats-group></article>