<!DOCTYPE article
PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD with MathML3 v1.3 20210610//EN" "JATS-archivearticle1-3-mathml3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="1.3" xml:lang="en" article-type="research-article"><?properties manuscript?><processing-meta base-tagset="archiving" mathml-version="3.0" table-model="xhtml" tagset-family="jats"><restricted-by>pmc</restricted-by></processing-meta><front><journal-meta><journal-id journal-id-type="nlm-journal-id">8704773</journal-id><journal-id journal-id-type="pubmed-jr-id">1656</journal-id><journal-id journal-id-type="nlm-ta">Am J Prev Med</journal-id><journal-id journal-id-type="iso-abbrev">Am J Prev Med</journal-id><journal-title-group><journal-title>American journal of preventive medicine</journal-title></journal-title-group><issn pub-type="ppub">0749-3797</issn><issn pub-type="epub">1873-2607</issn></journal-meta><article-meta><article-id pub-id-type="pmid">38367928</article-id><article-id pub-id-type="pmc">11260538</article-id><article-id pub-id-type="doi">10.1016/j.amepre.2024.02.009</article-id><article-id pub-id-type="manuscript">HHSPA1970234</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>A Community Guide Systematic Review: Digital HIV Pre-exposure Prophylaxis Interventions</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Kamitani</surname><given-names>Emiko</given-names></name><degrees>PhD, MPH, MS, RN</degrees><xref rid="A1" ref-type="aff">1</xref></contrib><contrib contrib-type="author"><name><surname>Peng</surname><given-names>Yinan</given-names></name><degrees>PhD, MPH</degrees><xref rid="A2" ref-type="aff">2</xref></contrib><contrib contrib-type="author"><name><surname>Hopkins</surname><given-names>David</given-names></name><degrees>MD, MPH</degrees><xref rid="A2" ref-type="aff">2</xref></contrib><contrib contrib-type="author"><name><surname>Higa</surname><given-names>Darrel H</given-names></name><degrees>PhD, MSW</degrees><xref rid="A1" ref-type="aff">1</xref></contrib><contrib contrib-type="author"><name><surname>Mullins</surname><given-names>Mary M.</given-names></name><degrees>MSLS</degrees><xref rid="A1" ref-type="aff">1</xref></contrib><contrib contrib-type="author"><collab>Community Preventive Services Task Force</collab></contrib></contrib-group><aff id="A1"><label>1</label>Division of HIV Prevention, National Center for HIV/AIDS, Viral hepatitis, STD, &#x00026; TB Prevention</aff><aff id="A2"><label>2</label>Community Guide Program, Office of Science, Centers for Disease Control and Prevention</aff><author-notes><fn id="FN1"><p id="P1">Names and affiliations of the Community Preventive Services Task Force members can be found at: <ext-link xlink:href="https://www.thecommunityguide.org/task-force/community-preventive-services-task-force-members" ext-link-type="uri">https://www.thecommunityguide.org/task-force/community-preventive-services-task-force-members</ext-link>.</p></fn><corresp id="CR1">Corresponding author: Emiko Kamitani, PhD, MPH, MS, RN, Division of HIV Prevention, Centers for Disease Control and Prevention, 1600 Clifton Road, MS-H24-5; Atlanta, GA 30329-4027, <email>ekamitani@cdc.gov</email></corresp></author-notes><pub-date pub-type="nihms-submitted"><day>6</day><month>3</month><year>2024</year></pub-date><pub-date pub-type="ppub"><month>8</month><year>2024</year></pub-date><pub-date pub-type="epub"><day>16</day><month>2</month><year>2024</year></pub-date><pub-date pub-type="pmc-release"><day>01</day><month>8</month><year>2024</year></pub-date><volume>67</volume><issue>2</issue><fpage>303</fpage><lpage>310</lpage><abstract id="ABS1"><sec id="S1"><title>Introduction:</title><p id="P2">HIV preexposure prophylaxis (PrEP) is highly effective when taken as prescribed. Digital health adherence interventions have been identified as effective for improving antiretroviral therapy adherence among people with HIV, but limited evidence exists for PrEP adherence interventions among people without HIV. The purpose of this Community Guide systematic review was to present the characteristics and effectiveness of digital PrEP adherence interventions.</p></sec><sec id="S2"><title>Methods:</title><p id="P3">The author searched the CDC HIV Prevention Research Synthesis cumulative database for digital health interventions with PrEP adherence outcomes published in peer-reviewed journals from 2000-2022. Studies with comparison arms or pre-post data evaluating interventions in high-income countries were included. Two reviewers independently screened citations, extracted data, conducted risk of bias assessment, and resolved discrepancies through discussion. Summary effect estimates were calculated using median and interquartile interval.</p></sec><sec id="S3"><title>Results:</title><p id="P4">Nine studies were included and all focused on gay, bisexual, and other men who have sex with men. Eight studies were U.S.-based while the other was conducted in the Netherlands. Five were randomized control trials and four were pre-/post studies. All studies showed improved adherence in the intervention arms compared with comparison groups or pre-intervention data. One study also reported improvement in PrEP care retention.</p></sec><sec id="S4"><title>Discussion:</title><p id="P5">Digital health adherence interventions with different strategies to improve PrEP and HIV-related outcomes were identified. The small number of studies identified is a limitation. Findings from this review served as the basis for the Community Preventive Services Task Force recommendation to use these interventions to increase PrEP adherence to prevent HIV infection.</p></sec></abstract></article-meta></front><body><sec id="S5"><title>Introduction</title><p id="P6">Ending the HIV Epidemic in the U.S. (EHE) is the operational plan developed by agencies across the U.S. Department of Health and Human Services (DHHS) to pursue the goal to reduce new HIV infections by 75% by 2025 and 90% by 2030.<sup><xref rid="R1" ref-type="bibr">1</xref></sup> DHSS identified four key strategies to achieve these goals in the United States, including 1) diagnosing people with HIV as early as possible after infection, 2) treat people with HIV rapidly and effectively to reach sustained viral suppression, 3) prevent new HIV transmission through evidence-based interventions including pre-exposure prophylaxis (PrEP) and syringe services programs (SSPs), and 4) respond quickly to potential HIV outbreaks to get prevention and treatment services to people who need them. The National HIV/AIDS Strategy (2022-2025) is closely aligned with and complements the EHE.<sup><xref rid="R2" ref-type="bibr">2</xref></sup> The national strategy encourages collaboration between all sectors of society to prevent new HIV infections, improve health outcomes of people with HIV, and reduce HIV-related disparities and health inequities.</p><p id="P7">The U.S. Preventive Services Task Force (USPSTF) recommends clinicians offer PrEP to persons who are at high risk for HIV acquisition.<sup><xref rid="R3" ref-type="bibr">3</xref></sup> When taken daily as prescribed, PrEP reduces the risk of getting HIV from sex by 99% and from injection drug use by at least 74%.<sup><xref rid="R4" ref-type="bibr">4</xref></sup> There is a strong connection between adherence to PrEP and its effectiveness in preventing HIV acquisition; reduced adherence is associated with a decline in effectiveness.<sup><xref rid="R4" ref-type="bibr">4</xref>&#x02013;<xref rid="R6" ref-type="bibr">6</xref></sup> The CDC Prevention Research Synthesis (PRS) Project has been closely following the research on PrEP use and adherence to identify Best Practices (i.e., evidence-based, evidence-informed interventions)<sup><xref rid="R7" ref-type="bibr">7</xref></sup>. The CDC PRS Project collaborated with the Community Guide Program (CGP; &#x0201d;Community Guide&#x0201d;) to provide evidence for the Community Preventive Services Task Force (CPSTF) to make a recommendation. CPSTF was established by DHHS to complement the work of the USPSTF, and the recommendations by CPSTF are considered to be the gold standard for what works to protect and improve population health.<sup><xref rid="R9" ref-type="bibr">9</xref></sup> CGP provides administrative, scientific, and technical support for CPSTF.<sup><xref rid="R8" ref-type="bibr">8</xref></sup> Results from the systematic review was the basis for the CPSTF&#x02019;s recommendation for digital health interventions to increase adherence to PrEP.<sup><xref rid="R10" ref-type="bibr">10</xref></sup></p><p id="P8">A digital health intervention is an umbrella term that covers all technology meant to improve patient outcomes and uses text messages, mobile applications (apps), phone calls, or websites to deliver reminders, guidance, and support that may be tailored to an individual&#x02019;s needs. Digital health interventions have been identified as effective for improving HIV care among people with HIV.<sup><xref rid="R11" ref-type="bibr">11</xref></sup> Digital interventions provide one or more of the following:</p><list list-type="bullet" id="L2"><list-item><p id="P9">Information about HIV, PrEP, and strategies for being in care and persistence.</p></list-item><list-item><p id="P10">Services such as automated or interactive feedback, online forum discussions, virtual support groups, or adherence tracking intended to motivate participants.</p></list-item><list-item><p id="P11">Regular reminders for medications, virtual check-in appointments, and clinic visits.</p></list-item></list><p id="P12">Digital interventions may be combined with in-person activities such as one-on-one counseling, peer-led group sessions, or patient navigation.</p></sec><sec id="S6"><title>Methods</title><p id="P13">Community Guide methods were used to conduct this systematic review.<sup><xref rid="R12" ref-type="bibr">12</xref>&#x02013;<xref rid="R14" ref-type="bibr">14</xref></sup> In brief, the methods include the steps of 1) forming multidisciplinary chapter development teams, 2) developing a conceptual approach to organizing, grouping, selecting and evaluating the interventions; 3) selecting interventions to be evaluated; 4) searching for and retrieving evidence; 5) assessing the quality of and summarizing the body of evidence of effectiveness; 6) translating the body of evidence of effectiveness into recommendations; 7) considering information on evidence other than effectiveness; and 8) identifying and summarizing research gaps. PRS librarians conducted a digital health and PrEP search query in the CDC PRS Project database, a cumulative HIV database created using search results from ongoing targeted comprehensive literature searches that include a PrEP focused literature search.<sup><xref rid="R15" ref-type="bibr">15</xref></sup> The PrEP search is run in the databases (platforms) MEDLINE (OVID), EMBASE (OVID), PsycINFO (OVID, and CINAHL (EBSCOhost), supplemented by additional hand searches (e.g., journals, reference list checks). A PRS trained coder screens each citation by title and abstract to identify articles published in English that report PrEP-related behavioral (e.g., behaviors or behavioral intentions related to PrEP uptake) or biologic (e.g., any aspect of the use or effects of a PrEP medication for HIV prevention) outcomes and assigns a &#x0201c;PrEP&#x0201d; code to the article. Next, a pair of the PRS trained coders independently screen the full text of these PrEP articles to identify those reporting PrEP adherence outcomes (i.e., any subset or grouping based on PrEP adherence) and assign the code &#x0201c;PrEP adherence&#x0201d;. <sup><xref rid="R16" ref-type="bibr">16</xref>,<xref rid="R17" ref-type="bibr">17</xref></sup> The coders meet to discuss and reconcile coding discrepancies. If coders could not reach consensus, a third PRS team member was consulted. Articles with keywords &#x0201c;PrEP&#x0201d; and &#x0201c;PrEP adherence&#x0201d; were identified from the PRS Project database and were eligible for inclusion in the systematic review. Eligible articles published 2000 &#x02013; 2022 were identified in June 2021 with an update in May 2023 by using the same search query. A detailed search strategy is available from the Community Guide website.<sup><xref rid="R10" ref-type="bibr">10</xref></sup></p><p id="P14">Primary studies (e.g., research studies that included data gathered and analyzed by the authors) published in a peer-reviewed journal were included if they 1) evaluated digital health interventions to improve PrEP adherence, 2) reported PrEP adherence, 3) had comparison arms or pre-post data 4) were conducted in a country with a high-income economy<sup><xref rid="R18" ref-type="bibr">18</xref></sup>, and 5) were written in English. Commentaries, reviews, and non-peer-reviewed publications were not eligible for this review.</p><p id="P15">Three team members who were authors for this review and had extensive systematic review experience were trained to code studies specific for this review. They independently screened potential publications for inclusion and abstracted information from included studies. Coding pairs assessed included studies on their quality of execution using an established set of criteria.<sup><xref rid="R12" ref-type="bibr">12</xref>&#x02013;<xref rid="R14" ref-type="bibr">14</xref></sup> The tool addressed threats to internal and external validity and included six domains with nine possible limitations for each study.<sup><xref rid="R12" ref-type="bibr">12</xref>&#x02013;<xref rid="R14" ref-type="bibr">14</xref></sup> These domains are: description of the intervention and population (0-1 limitation); description of the sampling process (0-1); validity and reliability of the intervention exposure and measurement (0-2); description and use of appropriate analytic methods (0-1); interpretations of results including attrition (i.e., whether more than 20% of study participants was lost to follow-up), confounding and potential bias (0-3); and other (0-1). Studies were classified as having good (0&#x02013;1 limitations), fair (2&#x02013;4), or limited (&#x0003e;4) quality of execution. Studies with limited quality of execution were excluded from the analyses.<sup><xref rid="R12" ref-type="bibr">12</xref>,<xref rid="R13" ref-type="bibr">13</xref></sup> Discrepancies between coder pairs were reconciled via discussion and, if needed, a senior coder was consulted. All screening and data abstract forms were pilot tested and revised as necessary.</p><p id="P16">The primary outcome of interest was daily PrEP adherence while HIV incidence and HIV-related morbidity (i.e., the state of being symptomatic or unhealthy for a disease or condition) and mortality (i.e., the number of deaths caused by the health event under investigation) were secondary outcomes.<sup><xref rid="R19" ref-type="bibr">19</xref></sup> PrEP adherence was assessed using &#x0201c;excellent adherence&#x0201d;, defined as taking seven doses of PrEP per week, &#x0201c;good adherence&#x0201d;, defined as taking four or more doses of PrEP per week, or &#x0201c;poor adherence&#x0201d;, defined as less than four doses per week.<sup><xref rid="R20" ref-type="bibr">20</xref></sup> For summary measures, medians and interquartile intervals (IQI) were calculated. Studies that performed stratified analysis based on different intervention or demographic characteristics were narratively summarized.</p></sec><sec id="S7"><title>Results</title><p id="P17">This review found 1,260 citations (1,259 citations in the PRS database and 1 citation through the PubMed hand search) with the initial search and 27 from the updated search. Overall, the authors screened 23 full texts. Of these, 14 studies did not meet the study criteria. Thus, this review included nine<sup><xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup> studies evaluating eight unique interventions (<xref rid="F1" ref-type="fig">Figure 1</xref>). These nine intervention studies are:</p><list list-type="bullet" id="L4"><list-item><p id="P18">DOT<sup><xref rid="R29" ref-type="bibr">29</xref></sup>, a culturally- and youth-tailored app that sent pill reminders and educational texts,</p></list-item><list-item><p id="P19">Enhanced AMPrEP <sup><xref rid="R21" ref-type="bibr">21</xref></sup> a mobile app plus visualized feedback,</p></list-item><list-item><p id="P20">enPrEP<sup><xref rid="R22" ref-type="bibr">22</xref></sup> that sent automated weekly text message reminders with an online support group,</p></list-item><list-item><p id="P21">iTAB<sup><xref rid="R23" ref-type="bibr">23</xref></sup> that sent daily and customized text messages via a mobile app,</p></list-item><list-item><p id="P22">iTEXT<sup><xref rid="R24" ref-type="bibr">24</xref></sup> that sent weekly bidirectional text or email messages via a mobile app,</p></list-item><list-item><p id="P23">mSMART that evaluated an app with a camera-based medication event-monitoring tool
<list list-type="bullet" id="L6"><list-item><p id="P24">among gay, bisexual, and other men who have sex with men (collectively referred to as MSM) in general,<sup><xref rid="R25" ref-type="bibr">25</xref></sup> and</p></list-item><list-item><p id="P25">among African American MSM,<sup><xref rid="R28" ref-type="bibr">28</xref></sup></p></list-item></list></p></list-item><list-item><p id="P26">PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup> that provided daily at customized time text messages and youth-tailored interactive online support groups, and</p></list-item><list-item><p id="P27">ViralCombat<sup><xref rid="R27" ref-type="bibr">27</xref></sup>, a gaming adherence intervention.</p></list-item></list><p id="P28">Details about the included studies are available on the Community Guide website.<sup><xref rid="R30" ref-type="bibr">30</xref></sup></p><p id="P29">Five<sup><xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R27" ref-type="bibr">27</xref></sup> studies were individual randomized controlled trials (iRCTs) and four<sup><xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup> used pre-post only design. Studies evaluating enhanced AMPrEP<sup><xref rid="R21" ref-type="bibr">21</xref></sup>, iTAB<sup><xref rid="R23" ref-type="bibr">23</xref></sup>, PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup>, and mSMART among African American MSM<sup><xref rid="R28" ref-type="bibr">28</xref></sup> had good quality of execution; the remaining studies<sup><xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R27" ref-type="bibr">27</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup> had fair quality of execution. The commonly assigned limitations were unclear sampling process<sup><xref rid="R24" ref-type="bibr">24</xref>&#x02013;<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>, use of self-reported data or outcome measures without validation<sup><xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>, and high attrition<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R27" ref-type="bibr">27</xref></sup>.</p><p id="P30">Most of included studies are U.S.-based (n=8)<sup><xref rid="R22" ref-type="bibr">22</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup>, but Enhanced AMPrEP<sup><xref rid="R21" ref-type="bibr">21</xref></sup> is from the Netherlands. Sample sizes were 10 to 398, and all the U.S. studies were implemented in urban areas and covered all four regions as defined by the <ext-link xlink:href="https://www2.census.gov/geo/pdfs/maps-data/maps/reference/us_regdiv.pdf" ext-link-type="uri">U.S. Census Bureau</ext-link>, with iTAB<sup><xref rid="R23" ref-type="bibr">23</xref></sup> in the West, PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup> in the Midwest, mSMART<sup><xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R28" ref-type="bibr">28</xref></sup> and ViralCombat<sup><xref rid="R27" ref-type="bibr">27</xref></sup> in the South, DOT<sup><xref rid="R29" ref-type="bibr">29</xref></sup> and enPrEP<sup><xref rid="R22" ref-type="bibr">22</xref></sup> in the Northeast, and iTEXT<sup><xref rid="R24" ref-type="bibr">24</xref></sup> in both Midwest and West regions.</p><p id="P31">The included studies provided various digital health services and communicated with participants using different methods at varied frequencies. The digital health services included medication reminders for daily PrEP use (n=7)<sup><xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>, information and education (n=5)<sup><xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R27" ref-type="bibr">27</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>, adherence tracking (n=4)<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>, support groups (n=2)<sup><xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R26" ref-type="bibr">26</xref></sup>, and counseling (n=1).<sup><xref rid="R23" ref-type="bibr">23</xref></sup> These services were delivered through a digital app only (n=3)<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R28" ref-type="bibr">28</xref></sup>, an app plus text messaging (n=2)<sup><xref rid="R27" ref-type="bibr">27</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>, text messaging only (n=1)<sup><xref rid="R23" ref-type="bibr">23</xref></sup>, or text messaging plus email, phone, or internet (n=3)<sup><xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R26" ref-type="bibr">26</xref></sup>. Study participants received digital communications at least daily (n=5)<sup><xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>, weekly (n=3)<sup><xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R27" ref-type="bibr">27</xref></sup>, or monthly (n=1).<sup><xref rid="R21" ref-type="bibr">21</xref></sup> These communications could be unidirectional where pre-set messages were sent to the participants (n=3),<sup><xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R23" ref-type="bibr">23</xref></sup> bidirectional with automated messages where participants&#x02019; questions were answered by pre-set messages (n=5),<sup><xref rid="R24" ref-type="bibr">24</xref>&#x02013;<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup> or bidirectional with personalized messages where participants&#x02019; questions were answered by live support (n=2).<sup><xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R26" ref-type="bibr">26</xref></sup></p><p id="P32">In addition to the digital health services, enPrEP<sup><xref rid="R22" ref-type="bibr">22</xref></sup> provided an in-person support group. ViralCombat<sup><xref rid="R27" ref-type="bibr">27</xref></sup> provided smartphones to study participants while other interventions required participants to have a smartphone and data plan. None of the studies provided information about the languages used for communications, though PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup> and ViralCombat<sup><xref rid="R27" ref-type="bibr">27</xref></sup> recruited only English speaking participants while iTAB<sup><xref rid="R23" ref-type="bibr">23</xref></sup> included both English- and Spanish-speakers.</p><p id="P33">All studies used standard forms saved in a central cloud location to collect data, obtain lab work, and provide information or instructions to participants. The median for intervention duration was nine months, with five studies<sup><xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R27" ref-type="bibr">27</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup> lasting six months or less and four studies<sup><xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R26" ref-type="bibr">26</xref></sup> lasting longer than six months.</p><p id="P34">In terms of demographic characteristics of participants in included studies, six studies<sup><xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R25" ref-type="bibr">25</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup> reported the mean age of participants; the median was 25 years. Two studies reported median ages of 39<sup><xref rid="R21" ref-type="bibr">21</xref></sup> and 49<sup><xref rid="R24" ref-type="bibr">24</xref></sup> years, and the remaining study<sup><xref rid="R22" ref-type="bibr">22</xref></sup> did not report age.</p><p id="P35">Most participants were male (median of 99%). Five studies<sup><xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R27" ref-type="bibr">27</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup> only recruited male participants. Four recruited transgender women and they accounted for a median of 3% of participants.<sup><xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R26" ref-type="bibr">26</xref></sup> All studies focused on MSM.</p><p id="P36">All studies conducted in the United States (n=8<sup><xref rid="R22" ref-type="bibr">22</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup>) reported racial or ethnic distributions. Participants were White (median of 60%, n=6<sup><xref rid="R23" ref-type="bibr">23</xref>&#x02013;<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>), Black or African American (median of 23%, n=8<sup><xref rid="R22" ref-type="bibr">22</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup>), Hispanic or Latino (median 11%, n=7<sup><xref rid="R22" ref-type="bibr">22</xref>&#x02013;<xref rid="R27" ref-type="bibr">27</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>), or Asian American (median of 5%, n=5<sup><xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>). Study participants were demographically similar to the U.S. general population. EnPrEP<sup><xref rid="R22" ref-type="bibr">22</xref></sup> and one of mSMART<sup><xref rid="R28" ref-type="bibr">28</xref></sup> studies recruited only Black or African American participants and showed the intervention to be effective in increasing PrEP adherence. No study analyzed whether intervention effectiveness varied based on race or ethnicity.</p><p id="P37">All studies reported at least one measure of socioeconomic status. A median 81% of participants were employed full time or part-time (n=6<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R26" ref-type="bibr">26</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>); the remaining three studies<sup><xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R27" ref-type="bibr">27</xref></sup> did not report employment status. In two studies, the majority of participants had an annual income less than $20K (59%<sup><xref rid="R26" ref-type="bibr">26</xref></sup>, 66%<sup><xref rid="R22" ref-type="bibr">22</xref></sup>). Three studies<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R25" ref-type="bibr">25</xref></sup> reported a median of 22% of participants who had an annual income less than $24-25K. Four studies<sup><xref rid="R24" ref-type="bibr">24</xref>,<xref rid="R27" ref-type="bibr">27</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup> did not report income. Eight studies<sup><xref rid="R22" ref-type="bibr">22</xref>&#x02013;<xref rid="R29" ref-type="bibr">29</xref></sup> reported a median of 89% of participants who completed some college or more. Most participants were insured (78%<sup><xref rid="R26" ref-type="bibr">26</xref></sup> and 100%<sup><xref rid="R21" ref-type="bibr">21</xref></sup>, n=2), covered by Medicaid or Medicare (64%<sup><xref rid="R22" ref-type="bibr">22</xref></sup> and 90%<sup><xref rid="R27" ref-type="bibr">27</xref></sup>, n=2), or paid for healthcare through private insurance or self-pay (19%, n=1<sup><xref rid="R22" ref-type="bibr">22</xref></sup>). One study<sup><xref rid="R27" ref-type="bibr">27</xref></sup> reported that just under 50% of participants were receiving PrEP payment assistance. Five studies<sup><xref rid="R23" ref-type="bibr">23</xref>&#x02013;<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R28" ref-type="bibr">28</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup> did not report insurance status.</p><p id="P38">Four studies assessed participants&#x02019; drug use history using questionnaires such as the Drug Abuse Screening Test<sup><xref rid="R31" ref-type="bibr">31</xref></sup> and reported no or low (63%<sup><xref rid="R23" ref-type="bibr">23</xref></sup> and 100%<sup><xref rid="R25" ref-type="bibr">25</xref></sup>) or excessive substance use (median of 37%, n=3<sup><xref rid="R21" ref-type="bibr">21</xref>&#x02013;<xref rid="R23" ref-type="bibr">23</xref></sup>). In two studies, the majority of participants reported they engaged in &#x0201c;any&#x0201d; recreational substance use (64%<sup><xref rid="R26" ref-type="bibr">26</xref></sup> and 72%<sup><xref rid="R23" ref-type="bibr">23</xref></sup>, n=2). Of four studies that reported alcohol use, study participants reported low alcohol use (100%, n=1<sup><xref rid="R25" ref-type="bibr">25</xref></sup>) or excessive alcohol use (median of 29%, n=3<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R26" ref-type="bibr">26</xref></sup>). Additionally, three studies reported on mental health issues and showed a median of 13% of study participants reporting mild depression, depression, or anxiety symptoms (n=3).<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R25" ref-type="bibr">25</xref></sup></p><p id="P39">In terms of changes in PrEP adherence, all studies showed participants receiving interventions had greater improvement on adherence (e.g., self-reported, dried blood spot) and higher adherence compared with comparisons (e.g., standard of care, no intervention, in-person adherence counseling) (<xref rid="T1" ref-type="table">Table 1</xref>). Most studies reported &#x0201c;good adherence&#x0201d; only<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R26" ref-type="bibr">26</xref></sup> or &#x0201c;excellent adherence&#x0201d;.<sup><xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R27" ref-type="bibr">27</xref></sup> When evaluated against comparisons, a higher proportion of intervention participants achieved good adherence (median of 13.0 percentage points higher; Interquartile Interval (IQI): 6.4-25.3 percentage points; n=6<sup><xref rid="R21" ref-type="bibr">21</xref>,<xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R25" ref-type="bibr">25</xref>&#x02013;<xref rid="R28" ref-type="bibr">28</xref></sup>) or excellent adherence (median of 16.8 percentage points higher; IQI: 12.7-26.7 percentage points; n=4<sup><xref rid="R23" ref-type="bibr">23</xref>,<xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R27" ref-type="bibr">27</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup>). ITEXT<sup><xref rid="R24" ref-type="bibr">24</xref></sup> provided weekly bidirectional personalized texts or email reminders for pill taking and reported that the post-intervention group missed statistically significant fewer PrEP doses when compared to the pre-intervention group (Relative Risk 0.50; 95% Confidence Interval [CI] 0.29-0.84).</p><p id="P40">The intervention group in Enhanced AMPrEP<sup><xref rid="R21" ref-type="bibr">21</xref></sup> received visualized feedback in the app while the comparison group only received text messages. More participants in the intervention group achieved excellent adherence (Odds Ratio [OR] 2.0, 95% CI 1.1-3.8; p = 0.026) but the number of participants with &#x0201c;poor adherence&#x0201d; didn&#x02019;t change (OR 1.5, 95% CI 0.61-3.8; p = 0.36). The authors also found poor adherence was associated with symptoms of depression or anxiety (OR 3.2, 95% CI 1.1-9.5) and low concern of acquiring HIV (OR 4.3, 95% CI 1.6-12).</p><p id="P41">iTAB<sup><xref rid="R23" ref-type="bibr">23</xref></sup>, PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup>, and ViralCombat<sup><xref rid="R27" ref-type="bibr">27</xref></sup> intervened throughout the follow-up periods and examined intervention effects over time. While all three studies found effects diminishing over time (duration of 3 to 12 months), iTAB<sup><xref rid="R23" ref-type="bibr">23</xref></sup> and ViralCombat<sup><xref rid="R27" ref-type="bibr">27</xref></sup> reported higher adherence in the intervention groups when compared with the control groups over time.</p><p id="P42">There is no evidence/report from the included studies that intervention effectiveness differed by interventions or participants&#x02019; characteristics including age, socioeconomic status, or drug use history.</p><p id="P43">In terms of HIV incidence and HIV-related morbidity and mortatlity, iTAB<sup><xref rid="R23" ref-type="bibr">23</xref></sup> and PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup> studies reported HIV incidence. PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup> reported no HIV seroconversions in either the intervention or comparison groups. iTAB<sup><xref rid="R23" ref-type="bibr">23</xref></sup> reported two HIV seroconversions in the intervention group among patients who discontinued PrEP. None of included studies reported HIV-related morbidity or mortality outcomes.</p><p id="P44">Other intervention benefits include that PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup> found that a significantly larger proportion of PrEP care visits were completed by participants in the intervention group compared with those in the comparison group (OR 2.62, 95% CI 1.24-5.54; p=0.01).</p><p id="P45">DOT<sup><xref rid="R29" ref-type="bibr">29</xref></sup>, enPrEP<sup><xref rid="R22" ref-type="bibr">22</xref></sup>, and PrEPmate<sup><xref rid="R26" ref-type="bibr">26</xref></sup> identified a reduction in sexual risk behaviors as an additional benefit of these interventions. Studies reported decreases in the mean number of anal sex partners and the proportion of study participants who reported condomless anal sex. The studies also found lower proportions of participants with a diagnosed sexually transmitted infection (STI) at follow-up. Reductions were similar for both intervention and control groups.</p><p id="P46">Although the majority of studies did not assess acceptability of the intervention, in the few studies<sup><xref rid="R25" ref-type="bibr">25</xref>,<xref rid="R29" ref-type="bibr">29</xref></sup> that did, digital interventions to improve adherence to daily-use HIV PrEP were highly acceptable. Of the services offered, study participants were most likely to use daily pill reminders and weekly check-ins.<sup><xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R24" ref-type="bibr">24</xref>&#x02013;<xref rid="R27" ref-type="bibr">27</xref></sup></p></sec><sec id="S8"><title>Discussion</title><p id="P47">This systematic review found that digital PrEP adherence interventions improved both daily-use pill taking and retention in PrEP care, thereby improving health for population groups which are at risk for HIV infection. Findings from this review served as the basis for the CPSTF&#x02019;s recommendation to use these interventions to increase PrEP adherence to prevent HIV infection.<sup><xref rid="R10" ref-type="bibr">10</xref></sup></p><p id="P48">Based on the CDC&#x02019;s PrEP clinical practice guideline, clinical visits every three months are recommended for daily PrEP users to receive HIV testing, medication adherence counseling, behavioral risk reduction support, side effect assessment, STI symptom assessment, and renal function and bacterial STI testing.<sup><xref rid="R32" ref-type="bibr">32</xref></sup> This review found that some of these strategies including counseling and behavioral risk reduction support can be provided by digital interventions between clinical visits.</p><p id="P49">Digital health may enhance care access for persons no matter where they live<sup><xref rid="R33" ref-type="bibr">33</xref></sup> but it has technology and equipment requirements. Eight of the nine included studies only recruited participants who had smartphones and adequate data plans. In 2021, 85% of U.S. adults used a smartphone<sup><xref rid="R34" ref-type="bibr">34</xref></sup>, 77% had high-speed broadband service at home<sup><xref rid="R35" ref-type="bibr">35</xref></sup>, and 93% used the Internet<sup><xref rid="R35" ref-type="bibr">35</xref></sup>, suggesting digital interventions could be widely implemented. Inequalities of smartphone ownership have diminished by race or ethnicity, but still exists for Americans with lower incomes<sup><xref rid="R36" ref-type="bibr">36</xref></sup>, older adults, and people living in rural areas.<sup><xref rid="R37" ref-type="bibr">37</xref></sup> In addition, even those who do own a smartphone may have pay-as-you-go type plans and face financial barriers to pay the cost of data and text messaging. It is important to consider participants&#x02019; income, age, and geographic location when implementing these interventions.</p><p id="P50">Most participants in the included studies were insured, but such coverage may not represent the general population in the U.S. Most insurance plans and state Medicaid programs cover the cost of PrEP.<sup><xref rid="R38" ref-type="bibr">38</xref></sup> Other programs provide PrEP for free or at a reduced cost, such as Ready, Set, PrEP<sup><xref rid="R39" ref-type="bibr">39</xref></sup> that provides medication at no cost to those who qualify, co-pay assistance programs<sup><xref rid="R40" ref-type="bibr">40</xref></sup> that lower costs of PrEP medications, and state PrEP assistance programs<sup><xref rid="R41" ref-type="bibr">41</xref></sup> that cover the costs for medication, clinical visits, and lab testing. Despite these programs, people who earn incomes that are too high for marketplace subsides or earn incomes below the federal poverty level in states that do not have expanded Medicaid may not be on PrEP due to the costs of PrEP medications and other costs including clinical visits and lab tests. Finally, the potential privacy risks, and need to ensure confidentiality and privacy are important to consider for digital health interventions. One of the included studies reported confidentiality concerns around receiving HIV-related text messages.<sup><xref rid="R22" ref-type="bibr">22</xref></sup> The study used innocuous language such as &#x0201c;time to take vitamin pills&#x0201d; or &#x0201c;time to take mints&#x0201d; to replace HIV-specific language to help protect confidentiality.<sup><xref rid="R22" ref-type="bibr">22</xref></sup> Digital health intervention materials also need to be compliant with Health Insurance Portability and Accountability Act (HIPAA) to protect privacy.<sup><xref rid="R42" ref-type="bibr">42</xref></sup></p></sec><sec id="S9"><title>Limitations</title><p id="P51">This review has several limitations. All studies focused on MSM; thus, the findings may not be applicable for other groups with risk factors for HIV infection such as people who share needles or equipment or people who exchange sex for money. This review also has a limited number of included studies and only included digital health interventions conducted in high-income countries, limiting its findings&#x02019; applicability to mid- and low-income countries. In response to the COVID-19 pandemic, use of digital health has been expanded, and more studies may be available in the next few years. Further reviews with more studies would help fill in the evidence gaps and increase understanding about the generalizability of the findings.</p></sec><sec id="S10"><title>Conclusions</title><p id="P52">Based on the findings, CPSTF recommends digital health interventions to increase adherence to HIV PrEP based on sufficient evidence of effectiveness.<sup><xref rid="R20" ref-type="bibr">20</xref></sup> These interventions improve both daily-use pill taking and retention in PrEP care, thereby potentially improving health for population groups not infected with HIV but at high risk for HIV infection.</p></sec></body><back><ack id="S11"><title>Acknowledgments:</title><p id="P53">We acknowledge Theresa, Sipe<sup>1</sup>, PhD, MPH, MS, RN, and the following PrEP adherence review coordination team members: Priya Jakhmola<sup>3</sup>, MS, MBA, Camilla Harshbarger<sup>1</sup>, PhD, Dawn Smith<sup>1</sup>, MD, MPH, Katrina Hedberg<sup>3</sup>, MD, MPH, Doug Campos-Outcalt<sup>4</sup>, MD, MPA, Sarah Stoddard<sup>5</sup>, PhD, RN, CNP, FSAHM, FAAN, Matthew Hogben<sup>6</sup>, PhD, Jason Farley<sup>7</sup>, PhD, ANP-BC, FAAN, Michael Stirratt<sup>8</sup>, PhD, Jeffery Kwong<sup>9</sup>, DNP, MPH, FAANP, FAAN, Timothy W Menza<sup>10</sup>, MD, PhD, Patrick Sullivan<sup>11</sup>, DVM, PhD, Casey Messer<sup>12</sup>, DHSc, PA-C, AAHIVS.</p><p id="P54">Acknowledged PrEP adherence review coordination members&#x02019; Affiliations: <sup>1</sup>Division of HIV Prevention, <sup>6</sup>Division of Sexually Transmitted Disease Prevention, National Center for HIV/AIDS, Viral hepatitis, STD, &#x00026; TB Prevention; <sup>3</sup>Public Health Science and Surveillance, Office of Science, Centers for Disease Control and Prevention; <sup>4</sup>Oregon Health Authority; <sup>3</sup>University of Arizona; <sup>5</sup>University of Michigan; <sup>7</sup>John Hopkins University; <sup>8</sup>National Institute of Mental Health; <sup>9</sup>American Association of Nursing Practitioners; <sup>10</sup>Oregon State Health Department; <sup>11</sup>Emory University; <sup>12</sup>American Academy of Physician Assistants.</p><p id="P55">The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.</p></ack><ref-list><title>References</title><ref id="R1"><label>1.</label><mixed-citation publication-type="webpage"><collab>U.S. Department of Health &#x00026; Human Services</collab>. <source>What is Ending the HIV Epidemic in the U.S.?</source>
<date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.hiv.gov/federal-response/ending-the-hiv-epidemic/overview" ext-link-type="uri">https://www.hiv.gov/federal-response/ending-the-hiv-epidemic/overview</ext-link></comment></mixed-citation></ref><ref id="R2"><label>2.</label><mixed-citation publication-type="webpage"><collab>U.S. Department of Health &#x00026; Human Services</collab>. <source>National HIV/AIDS Strategy (2022-2025)</source>. <comment>Updated</comment>
<month>December</month>
<day>1</day>, <year>2023</year>. <date-in-citation>Accessed Febryary 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.hiv.gov/federal-response/national-hiv-aids-strategy/national-hiv-aids-strategy-2022-2025" ext-link-type="uri">https://www.hiv.gov/federal-response/national-hiv-aids-strategy/national-hiv-aids-strategy-2022-2025</ext-link></comment></mixed-citation></ref><ref id="R3"><label>3.</label><mixed-citation publication-type="webpage"><collab>U.S. Preventive Services Task Force</collab>. <source>Prevention of Acquisition of HIV: Preexposure Prophylaxis</source>. <comment>Updated</comment>
<month>August</month>
<day>22</day>, <year>2023</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.uspreventiveservicestaskforce.org/uspstf/recommendation/prevention-of-human-immunodeficiency-virus-hiv-infection-pre-exposure-prophylaxis" ext-link-type="uri">https://www.uspreventiveservicestaskforce.org/uspstf/recommendation/prevention-of-human-immunodeficiency-virus-hiv-infection-pre-exposure-prophylaxis</ext-link></comment></mixed-citation></ref><ref id="R4"><label>4.</label><mixed-citation publication-type="webpage"><collab>Centers for Disease Control and Prevention</collab>. <source>PrEP Effectiveness</source>. <comment>Updated</comment>
<month>June</month>
<day>6</day>, <year>2022</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.cdc.gov/hiv/basics/prep/prep-effectiveness.html" ext-link-type="uri">https://www.cdc.gov/hiv/basics/prep/prep-effectiveness.html</ext-link></comment></mixed-citation></ref><ref id="R5"><label>5.</label><mixed-citation publication-type="journal"><name><surname>Sidebottom</surname><given-names>D</given-names></name>, <name><surname>Ekstr&#x000f6;m</surname><given-names>AM</given-names></name>, <name><surname>Str&#x000f6;mdahl</surname><given-names>S</given-names></name>. <article-title>A systematic review of adherence to oral pre-exposure prophylaxis for HIV - how can we improve uptake and adherence?</article-title>
<source>BMC Infect Dis</source>. <month>Nov</month>
<day>16</day>
<year>2018</year>;<volume>18</volume>(<issue>1</issue>):<fpage>581</fpage>. doi:<pub-id pub-id-type="doi">10.1186/s12879-018-3463-4</pub-id><pub-id pub-id-type="pmid">30445925</pub-id>
</mixed-citation></ref><ref id="R6"><label>6.</label><mixed-citation publication-type="journal"><name><surname>Dimitrov</surname><given-names>DT</given-names></name>, <name><surname>M&#x000e2;sse</surname><given-names>BR</given-names></name>, <name><surname>Donnell</surname><given-names>D</given-names></name>. <article-title>PrEP adherence patterns strongly affect individual HIV risk and observed efficacy in randomized clinical trials</article-title>. <source>J Acquir Immune Defic Syndr</source>. <month>Aug</month>
<day>1</day>
<year>2016</year>;<volume>72</volume>(<issue>4</issue>):<fpage>444</fpage>&#x02013;<lpage>51</lpage>. doi:<pub-id pub-id-type="doi">10.1097/qai.0000000000000993</pub-id><pub-id pub-id-type="pmid">26990823</pub-id>
</mixed-citation></ref><ref id="R7"><label>7.</label><mixed-citation publication-type="webpage"><collab>Centers for Disease Control and Prevention</collab>. <source>PrEP Best Practices Criteria</source>. <comment>Updated</comment>
<month>January</month>
<day>12</day>, <year>2022</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.cdc.gov/hiv/research/interventionresearch/compendium/prep/prep-best-practices.html" ext-link-type="uri">https://www.cdc.gov/hiv/research/interventionresearch/compendium/prep/prep-best-practices.html</ext-link></comment></mixed-citation></ref><ref id="R8"><label>8.</label><mixed-citation publication-type="webpage"><collab>The Community Guide</collab>. <source>About the Community Preventive Services Task Force</source>. <comment>Updated</comment>
<month>June</month>
<day>22</day>, <year>2023</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://thecommunityguide.org/pages/about-community-preventive-services-task-force.html" ext-link-type="uri">https://thecommunityguide.org/pages/about-community-preventive-services-task-force.html</ext-link></comment></mixed-citation></ref><ref id="R9"><label>9.</label><mixed-citation publication-type="webpage"><collab>The Community Guide</collab>. <source>About The Community Guide</source>. <comment>Updated</comment>
<month>May</month>
<day>31</day>, <year>2023</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://thecommunityguide.org/pages/about-community-guide.html" ext-link-type="uri">https://thecommunityguide.org/pages/about-community-guide.html</ext-link></comment></mixed-citation></ref><ref id="R10"><label>10.</label><mixed-citation publication-type="webpage"><collab>Guide to Community Preventive Services</collab>. <source>HIV Prevention: Digital Health Interventions to Improve Adherence to HIV Pre-Exposure Prophylaxis</source>. <comment>Updated</comment>
<month>October</month>
<day>11</day>, <year>2022</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.thecommunityguide.org/findings/hiv-prevention-digital-health-interventions-improve-adherence-hiv-pre-exposure-prophylaxis.html" ext-link-type="uri">https://www.thecommunityguide.org/findings/hiv-prevention-digital-health-interventions-improve-adherence-hiv-pre-exposure-prophylaxis.html</ext-link>.</comment></mixed-citation></ref><ref id="R11"><label>11.</label><mixed-citation publication-type="journal"><name><surname>Lester</surname><given-names>RT</given-names></name>. <article-title>Ask, Don&#x02019;t tell &#x02014; Mobile phones to improve HIV care</article-title>. <source>N Engl J Med</source>. <year>2013</year>;<volume>369</volume>(<issue>19</issue>):<fpage>1867</fpage>&#x02013;<lpage>1868</lpage>. doi:<pub-id pub-id-type="doi">10.1056/NEJMc1310509</pub-id></mixed-citation></ref><ref id="R12"><label>12.</label><mixed-citation publication-type="journal"><name><surname>Briss</surname><given-names>PA</given-names></name>, <name><surname>Zaza</surname><given-names>S</given-names></name>, <name><surname>Pappaioanou</surname><given-names>M</given-names></name>, <etal/>
<article-title>Developing an evidence-based Guide to Community Preventive Services--methods</article-title>. <collab>The Task Force on Community Preventive Services</collab>. <source>Am J Prev Med</source>. <month>Jan</month>
<year>2000</year>;<volume>18</volume>(<issue>1 Suppl</issue>):<fpage>35</fpage>&#x02013;<lpage>43</lpage>. doi:<pub-id pub-id-type="doi">10.1016/s0749-3797(99)00119-1</pub-id><pub-id pub-id-type="pmid">10806978</pub-id>
</mixed-citation></ref><ref id="R13"><label>13.</label><mixed-citation publication-type="journal"><name><surname>Zaza</surname><given-names>S</given-names></name>, <name><surname>Wright-De Ag&#x000fc;ero</surname><given-names>LK</given-names></name>, <name><surname>Briss</surname><given-names>PA</given-names></name>, <etal/>
<article-title>Data collection instrument and procedure for systematic reviews in the Guide to Community Preventive Services</article-title>. <collab>Task Force on Community Preventive Services</collab>. <source>Am J Prev Med</source>. <month>Jan</month>
<year>2000</year>;<volume>18</volume>(<issue>1 Suppl</issue>):<fpage>44</fpage>&#x02013;<lpage>74</lpage>. doi:<pub-id pub-id-type="doi">10.1016/s0749-3797(99)00122-1</pub-id><pub-id pub-id-type="pmid">10806979</pub-id>
</mixed-citation></ref><ref id="R14"><label>14.</label><mixed-citation publication-type="webpage"><collab>The Community Guide</collab>. <source>Methods Manual for Community Guide Systematic Reviews</source>. <date-in-citation>Accessed November 7, 2023</date-in-citation>. <comment><ext-link xlink:href="https://www.thecommunityguide.org/pages/methods-manual.html" ext-link-type="uri">https://www.thecommunityguide.org/pages/methods-manual.html</ext-link></comment></mixed-citation></ref><ref id="R15"><label>15.</label><mixed-citation publication-type="journal"><name><surname>DeLuca</surname><given-names>JB</given-names></name>, <name><surname>Mullins</surname><given-names>MM</given-names></name>, <name><surname>Lyles</surname><given-names>CM</given-names></name>, <name><surname>Crepaz</surname><given-names>N</given-names></name>, <name><surname>Kay</surname><given-names>L</given-names></name>, <name><surname>Thadiparthi</surname><given-names>S</given-names></name>. <article-title>Developing a comprehensive search strategy for evidence based systematic reviews</article-title>. <source>Evid Based Lib Inf Pract</source>. <month>03</month>/<day>17</day>
<year>2008</year>;<volume>3</volume>(<issue>1</issue>):<fpage>3</fpage>&#x02013;<lpage>32</lpage>. doi:<pub-id pub-id-type="doi">10.18438/B8KP66</pub-id></mixed-citation></ref><ref id="R16"><label>16.</label><mixed-citation publication-type="journal"><name><surname>Kamitani</surname><given-names>E</given-names></name>, <name><surname>Johnson</surname><given-names>WD</given-names></name>, <name><surname>Wichser</surname><given-names>ME</given-names></name>, <name><surname>Adegbite</surname><given-names>AH</given-names></name>, <name><surname>Mullins</surname><given-names>MM</given-names></name>, <name><surname>Sipe</surname><given-names>TA</given-names></name>. <article-title>Growth in proportion and disparities of HIV PrEP use among key populations identified in the United States national goals: Systematic review and meta-analysis of published surveys</article-title>. <source>J Acquir Immune Defic Syndr</source>. <month>Aug</month>
<day>1</day>
<year>2020</year>;<volume>84</volume>(<issue>4</issue>):<fpage>379</fpage>&#x02013;<lpage>386</lpage>. doi:<pub-id pub-id-type="doi">10.1097/qai.0000000000002345</pub-id><pub-id pub-id-type="pmid">32205721</pub-id>
</mixed-citation></ref><ref id="R17"><label>17.</label><mixed-citation publication-type="webpage"><collab>Centers for Disease Control and Prevention</collab>. <source>Compendium of evidence-based interventions and best practices for HIV prevention: pre-exposure prophylaxis (PrEP) chapter</source>. <comment>Updated</comment>
<month>February</month>
<day>23</day>, <year>2022</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.cdc.gov/hiv/research/interventionresearch/compendium/prep/index.html" ext-link-type="uri">https://www.cdc.gov/hiv/research/interventionresearch/compendium/prep/index.html</ext-link>.</comment></mixed-citation></ref><ref id="R18"><label>18.</label><mixed-citation publication-type="webpage"><collab>The World Bank</collab>. <source>World Bank Country and Lending Groups</source>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://datahelpdesk.worldbank.org/knowledgebase/articles/906519" ext-link-type="uri">https://datahelpdesk.worldbank.org/knowledgebase/articles/906519</ext-link></comment>),</mixed-citation></ref><ref id="R19"><label>19.</label><mixed-citation publication-type="book"><name><surname>Hernandez</surname><given-names>JBR</given-names></name>, <name><surname>Kim</surname><given-names>PY</given-names></name>. <article-title>Epidemiology Morbidity And Mortality. StatPearls. StatPearls Publishing Copyright &#x000a9; 2023, StatPearls Publishing LLC.; 2023. [Updated 2022 Oct 3]</article-title>. In: <source>StatPearls [Internet]</source>. <publisher-loc>Treasure Island (FL)</publisher-loc>: <publisher-name>StatPearls Publishing</publisher-name>; <year>2024</year>
<month>Jan</month>-. Available from: <comment><ext-link xlink:href="https://www.ncbi.nlm.nih.gov/books/NBK547668/" ext-link-type="uri">https://www.ncbi.nlm.nih.gov/books/NBK547668/</ext-link></comment></mixed-citation></ref><ref id="R20"><label>20.</label><mixed-citation publication-type="webpage"><collab>Guide to Community Preventive Services</collab>. <source>TFFRS - HIV Prevention: Digital Health Interventions to Improve Adherence to HIV Pre-Exposure Prophylaxis</source>. <comment>Updated</comment>
<month>October</month>
<day>11</day>, <year>2022</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.thecommunityguide.org/pages/tffrs-hiv-prevention-digital-health-interventions-improve-adherence-hiv-pre-exposure-prophylaxis.html" ext-link-type="uri">https://www.thecommunityguide.org/pages/tffrs-hiv-prevention-digital-health-interventions-improve-adherence-hiv-pre-exposure-prophylaxis.html</ext-link></comment></mixed-citation></ref><ref id="R21"><label>21.</label><mixed-citation publication-type="journal"><name><surname>van den Elshout</surname><given-names>MAM</given-names></name>, <name><surname>Hoornenborg</surname><given-names>E</given-names></name>, <name><surname>Achterbergh</surname><given-names>RCA</given-names></name>, <etal/>
<article-title>Improving adherence to daily preexposure prophylaxis among MSM in Amsterdam by providing feedback via a mobile application</article-title>. <source>AIDS</source>. <month>Sep</month>
<day>1</day>
<year>2021</year>;<volume>35</volume>(<issue>11</issue>):<fpage>1823</fpage>&#x02013;<lpage>1834</lpage>. doi:<pub-id pub-id-type="doi">10.1097/qad.0000000000002949</pub-id><pub-id pub-id-type="pmid">34001705</pub-id>
</mixed-citation></ref><ref id="R22"><label>22.</label><mixed-citation publication-type="journal"><name><surname>Colson</surname><given-names>PW</given-names></name>, <name><surname>Franks</surname><given-names>J</given-names></name>, <name><surname>Wu</surname><given-names>Y</given-names></name>, <etal/>
<article-title>Adherence to pre-exposure prophylaxis in black men who have sex with men and transgender women in a community setting in Harlem, NY</article-title>. <source>AIDS Behav</source>. <month>Dec</month>
<year>2020</year>;<volume>24</volume>(<issue>12</issue>):<fpage>3436</fpage>&#x02013;<lpage>3455</lpage>. doi:<pub-id pub-id-type="doi">10.1007/s10461-020-02901-6</pub-id><pub-id pub-id-type="pmid">32385678</pub-id>
</mixed-citation></ref><ref id="R23"><label>23.</label><mixed-citation publication-type="journal"><name><surname>Moore</surname><given-names>DJ</given-names></name>, <name><surname>Jain</surname><given-names>S</given-names></name>, <name><surname>Dub&#x000e9;</surname><given-names>MP</given-names></name>, <etal/>
<article-title>Randomized controlled trial of daily text messages to support adherence to preexposure prophylaxis in individuals at risk for human immunodeficiency virus: The TAPIR Study</article-title>. <source>Clin Infect Dis</source>. <month>May</month>
<day>2</day>
<year>2018</year>;<volume>66</volume>(<issue>10</issue>):<fpage>1566</fpage>&#x02013;<lpage>1572</lpage>. doi:<pub-id pub-id-type="doi">10.1093/cid/cix1055</pub-id><pub-id pub-id-type="pmid">29228144</pub-id>
</mixed-citation></ref><ref id="R24"><label>24.</label><mixed-citation publication-type="journal"><name><surname>Fuchs</surname><given-names>JD</given-names></name>, <name><surname>Stojanovski</surname><given-names>K</given-names></name>, <name><surname>Vittinghoff</surname><given-names>E</given-names></name>, <etal/>
<article-title>A mobile health strategy to support adherence to antiretroviral preexposure prophylaxis</article-title>. <source>AIDS Patient Care STDS</source>. <month>Mar</month>
<year>2018</year>;<volume>32</volume>(<issue>3</issue>):<fpage>104</fpage>&#x02013;<lpage>111</lpage>. doi:<pub-id pub-id-type="doi">10.1089/apc.2017.0255</pub-id><pub-id pub-id-type="pmid">29565183</pub-id>
</mixed-citation></ref><ref id="R25"><label>25.</label><mixed-citation publication-type="journal"><name><surname>Mitchell</surname><given-names>JT</given-names></name>, <name><surname>LeGrand</surname><given-names>S</given-names></name>, <name><surname>Hightow-Weidman</surname><given-names>LB</given-names></name>, <etal/>
<article-title>Smartphone-based contingency management intervention to improve pre-exposure prophylaxis adherence: Pilot trial</article-title>. <source>JMIR Mhealth Uhealth</source>. <year>2018</year>;<volume>6</volume>(<issue>9</issue>):<fpage>e10456</fpage>. doi:<pub-id pub-id-type="doi">10.2196/10456</pub-id><pub-id pub-id-type="pmid">30201601</pub-id>
</mixed-citation></ref><ref id="R26"><label>26.</label><mixed-citation publication-type="journal"><name><surname>Liu</surname><given-names>AY</given-names></name>, <name><surname>Vittinghoff</surname><given-names>E</given-names></name>, <name><surname>von Felten</surname><given-names>P</given-names></name>, <etal/>
<article-title>Randomized controlled trial of a mobile health intervention to promote retention and adherence to preexposure prophylaxis among young people at risk for human immunodeficiency virus: The EPIC study</article-title>. <source>Clin Infect Dis</source>. <month>May</month>
<day>30</day>
<year>2019</year>;<volume>68</volume>(<issue>12</issue>):<fpage>2010</fpage>&#x02013;<lpage>2017</lpage>. doi:<pub-id pub-id-type="doi">10.1093/cid/ciy810</pub-id><pub-id pub-id-type="pmid">30239620</pub-id>
</mixed-citation></ref><ref id="R27"><label>27.</label><mixed-citation publication-type="journal"><name><surname>Whiteley</surname><given-names>L</given-names></name>, <name><surname>Craker</surname><given-names>L</given-names></name>, <name><surname>Haubrick</surname><given-names>KK</given-names></name>, <etal/>
<article-title>The impact of a mobile gaming intervention to increase adherence to pre-exposure prophylaxis</article-title>. <source>AIDS Behav</source>. <month>Jun</month>
<year>2021</year>;<volume>25</volume>(<issue>6</issue>):<fpage>1884</fpage>&#x02013;<lpage>1889</lpage>. doi:<pub-id pub-id-type="doi">10.1007/s10461-020-03118-3</pub-id><pub-id pub-id-type="pmid">33483897</pub-id>
</mixed-citation></ref><ref id="R28"><label>28.</label><mixed-citation publication-type="journal"><name><surname>Mitchell</surname><given-names>JT</given-names></name>, <name><surname>Burns</surname><given-names>CM</given-names></name>, <name><surname>Atkinson</surname><given-names>B</given-names></name>, <etal/>
<article-title>Feasibility, acceptability, and preliminary Effficacy of a gamified mobile health contingency management intervention for PrEP adherence among Black MSM</article-title>. <source>AIDS Behav</source>. <month>Oct</month>
<year>2022</year>;<volume>26</volume>(<issue>10</issue>):<fpage>3311</fpage>&#x02013;<lpage>3324</lpage>. doi:<pub-id pub-id-type="doi">10.1007/s10461-022-03675-9</pub-id><pub-id pub-id-type="pmid">35416595</pub-id>
</mixed-citation></ref><ref id="R29"><label>29.</label><mixed-citation publication-type="journal"><name><surname>Weitzman</surname><given-names>PF</given-names></name>, <name><surname>Zhou</surname><given-names>Y</given-names></name>, <name><surname>Kogelman</surname><given-names>L</given-names></name>, <name><surname>Rodarte</surname><given-names>S</given-names></name>, <name><surname>Vicente</surname><given-names>SR</given-names></name>, <name><surname>Levkoff</surname><given-names>SE</given-names></name>. <article-title>mHealth for pre-exposure prophylaxis adherence by young adult men who have sex with men</article-title>. <source>Mhealth</source>. <year>2021</year>;<volume>7</volume>:<fpage>44</fpage>. doi:<pub-id pub-id-type="doi">10.21037/mhealth-20-51</pub-id><pub-id pub-id-type="pmid">34345621</pub-id>
</mixed-citation></ref><ref id="R30"><label>30.</label><mixed-citation publication-type="webpage"><collab>Guide to Community Preventive Services</collab>. <source>HIV Prevention: Digital Health Interventions to Improve Adherence to HIV Pre-Exposure Prophylaxis: Summary Evidence Table</source>. <year>2021</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.thecommunityguide.org/media/2022/set-hiv-prep-508.pdf" ext-link-type="uri">https://www.thecommunityguide.org/media/2022/set-hiv-prep-508.pdf</ext-link></comment></mixed-citation></ref><ref id="R31"><label>31.</label><mixed-citation publication-type="webpage"><collab>National Institute on Drug Abuse (NIDA) Clinical Trials Network</collab>. <source>Drug Abuse Screening Test (DAST-10)</source>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://cde.drugabuse.gov/sites/nida_cde/files/DrugAbuseScreeningTest_2014Mar24.pdf" ext-link-type="uri">https://cde.drugabuse.gov/sites/nida_cde/files/DrugAbuseScreeningTest_2014Mar24.pdf</ext-link></comment></mixed-citation></ref><ref id="R32"><label>32.</label><mixed-citation publication-type="webpage"><collab>Centers for Disease Control and Prevention: US Public Health Service</collab>. <source>Preexposure Prophylaxis for the Prevention of HIV infection in the United States - 2021 Update: a clinical practice guideline</source>. <year>2021</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.cdc.gov/hiv/pdf/risk/prep/cdc-hiv-prep-guidelines-2021.pdf?msclkid=c0988d62a62d11ecbc61ab52784fea5b" ext-link-type="uri">https://www.cdc.gov/hiv/pdf/risk/prep/cdc-hiv-prep-guidelines-2021.pdf?msclkid=c0988d62a62d11ecbc61ab52784fea5b</ext-link></comment></mixed-citation></ref><ref id="R33"><label>33.</label><mixed-citation publication-type="journal"><name><surname>Wong</surname><given-names>KYK</given-names></name>, <name><surname>Stafylis</surname><given-names>C</given-names></name>, <name><surname>Klausner</surname><given-names>JD</given-names></name>. <article-title>Telemedicine: a solution to disparities in human immunodeficiency virus prevention and pre-exposure prophylaxis uptake, and a framework to scalability and equity</article-title>. <source>Mhealth</source>. <year>2020</year>;<volume>6</volume>:<fpage>21</fpage>. doi:<pub-id pub-id-type="doi">10.21037/mhealth.2019.12.06</pub-id><pub-id pub-id-type="pmid">32270013</pub-id>
</mixed-citation></ref><ref id="R34"><label>34.</label><mixed-citation publication-type="webpage"><collab>Statista</collab>. <source>Percentage of U.S. adults who own a smartphone from 2011 to 2021</source>. <month>March</month>
<day>21st</day>,, <year>2022</year>. <comment>Updated</comment>
<month>April</month>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.statista.com/statistics/219865/percentage-of-us-adults-who-own-a-smartphone/" ext-link-type="uri">https://www.statista.com/statistics/219865/percentage-of-us-adults-who-own-a-smartphone/</ext-link></comment></mixed-citation></ref><ref id="R35"><label>35.</label><mixed-citation publication-type="webpage"><collab>Pew Research Center</collab>. <source>Internet/Broadbanc Fact Sheet</source>. <comment>Updated</comment>
<month>January</month>
<day>31</day>
<year>2024</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.pewresearch.org/internet/fact-sheet/internet-broadband/" ext-link-type="uri">https://www.pewresearch.org/internet/fact-sheet/internet-broadband/</ext-link></comment></mixed-citation></ref><ref id="R36"><label>36.</label><mixed-citation publication-type="webpage"><name><surname>Vogels</surname><given-names>EA</given-names></name>. <source>Digital divide persists even as Americans with lower incomes make gains</source> in <comment>Updated</comment>
<month>June</month>
<day>22</day>nd, <year>2021</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.pewresearch.org/fact-tank/2021/06/22/digital-divide-persists-even-as-americans-with-lower-incomes-make-gains-in-tech-adoption/" ext-link-type="uri">https://www.pewresearch.org/fact-tank/2021/06/22/digital-divide-persists-even-as-americans-with-lower-incomes-make-gains-in-tech-adoption/</ext-link></comment></mixed-citation></ref><ref id="R37"><label>37.</label><mixed-citation publication-type="webpage"><name><surname>Vogels</surname><given-names>EA</given-names></name>. <source>Some digital divides persist between rural, urban and suburban America</source>. <comment>Updated</comment>
<month>August</month>
<day>19</day>th, <year>2021</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.pewresearch.org/fact-tank/2021/08/19/some-digital-divides-persist-between-rural-urban-and-suburban-america/" ext-link-type="uri">https://www.pewresearch.org/fact-tank/2021/08/19/some-digital-divides-persist-between-rural-urban-and-suburban-america/</ext-link></comment></mixed-citation></ref><ref id="R38"><label>38.</label><mixed-citation publication-type="webpage"><collab>Centers for Disease Control and Prevention</collab>. <source>Paying for PrEP</source>. <month>October</month>
<day>5</day>, <year>2023</year>. <comment>Updated June 6, 2022</comment>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.cdc.gov/hiv/basics/prep/paying-for-prep/index.html" ext-link-type="uri">https://www.cdc.gov/hiv/basics/prep/paying-for-prep/index.html</ext-link></comment></mixed-citation></ref><ref id="R39"><label>39.</label><mixed-citation publication-type="journal"><name><surname>Abbas</surname><given-names>UL</given-names></name>, <name><surname>Glaubius</surname><given-names>R</given-names></name>, <name><surname>Mubayi</surname><given-names>A</given-names></name>, <name><surname>Hood</surname><given-names>G</given-names></name>, <name><surname>Mellors</surname><given-names>JW</given-names></name>. <article-title>Antiretroviral therapy and pre-exposure prophylaxis: Combined impact on HIV transmission and drug resistance in South Africa</article-title>. <source>J Infect Dis</source>. <year>2013</year>;<volume>208</volume>(<issue>2</issue>):<fpage>224</fpage>&#x02013;<lpage>234</lpage>. doi:<pub-id pub-id-type="doi">10.1093/infdis/jit150</pub-id><pub-id pub-id-type="pmid">23570850</pub-id>
</mixed-citation></ref><ref id="R40"><label>40.</label><mixed-citation publication-type="webpage"><collab>Gilead</collab>. <source>Gilead&#x02019;s advancing access<sup>&#x000ae;</sup> programs is here to help you</source>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.gileadadvancingaccess.com/" ext-link-type="uri">https://www.gileadadvancingaccess.com/</ext-link></comment></mixed-citation></ref><ref id="R41"><label>41.</label><mixed-citation publication-type="webpage"><collab>National Alliance of State and Territorial AIDS Directors</collab>. <source>PrEP/PEP Access: State PrEP assistance programs</source>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://nastad.org/prepcost-resources/prep-assistance-programs" ext-link-type="uri">https://nastad.org/prepcost-resources/prep-assistance-programs</ext-link></comment></mixed-citation></ref><ref id="R42"><label>42.</label><mixed-citation publication-type="webpage"><collab>Helathcare Insurance Portability and Accountability Act (HIPAA) Journal</collab>. <source>HIPAA Compliance Checklist</source>
<year>2022</year>. <date-in-citation>Accessed February 1, 2024</date-in-citation>. <comment><ext-link xlink:href="https://www.hipaajournal.com/hipaa-compliance-checklist/" ext-link-type="uri">https://www.hipaajournal.com/hipaa-compliance-checklist/</ext-link></comment></mixed-citation></ref></ref-list></back><floats-group><fig position="float" id="F1"><label>Figure 1:</label><caption><p id="P56">PRISMA flowchart</p></caption><graphic xlink:href="nihms-1970234-f0001" position="float"/></fig><table-wrap position="float" id="T1"><label>Table 1.</label><caption><p id="P57">Effectiveness of Digital Health Interventions to Increase PrEP Adherence</p></caption><table frame="box" rules="all"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="left" valign="top" rowspan="1" colspan="1">Outcome Measure</th><th align="left" valign="top" rowspan="1" colspan="1">Number of Studies</th><th align="left" valign="top" rowspan="1" colspan="1">Effect Sizes</th></tr></thead><tbody><tr><td rowspan="2" align="left" valign="top" colspan="1">Good adherence<sup><xref rid="TFN2" ref-type="table-fn">a</xref></sup></td><td rowspan="2" align="center" valign="top" colspan="1">6</td><td align="left" valign="top" rowspan="1" colspan="1">Absolute difference:<break/>&#x02003;&#x000a0;&#x000a0;Median: 13.0 pct pts (IQI<sup><xref rid="TFN5" ref-type="table-fn">d</xref></sup>: 6.4 - 25.3 pct pts<sup><xref rid="TFN6" ref-type="table-fn">e</xref></sup>)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Relative difference:<break/>&#x02003;&#x000a0;&#x000a0;Median: 19.3% (IQI<sup><xref rid="TFN5" ref-type="table-fn">d</xref></sup>: 9.0 - 40.0%)</td></tr><tr><td rowspan="2" align="left" valign="top" colspan="1">Excellent adherence<sup><xref rid="TFN3" ref-type="table-fn">b</xref></sup></td><td rowspan="2" align="center" valign="top" colspan="1">4</td><td align="left" valign="top" rowspan="1" colspan="1">Absolute difference:<break/>&#x02003;&#x000a0;&#x000a0;Median: 16.8 pct pts (IQI<sup><xref rid="TFN5" ref-type="table-fn">d</xref></sup>: 12.7 - 26.7 pct pts<sup><xref rid="TFN6" ref-type="table-fn">e</xref></sup>)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Relative difference:<break/>&#x02003;&#x000a0;&#x000a0;Median: 75.5% (IQI<sup><xref rid="TFN5" ref-type="table-fn">d</xref></sup>: 12.7 - 26.7%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Retention<sup><xref rid="TFN4" ref-type="table-fn">c</xref></sup></td><td align="center" valign="top" rowspan="1" colspan="1">1</td><td align="left" valign="top" rowspan="1" colspan="1">OR<sup><xref rid="TFN7" ref-type="table-fn">f</xref></sup>: 2.62 (95% CI 1.24 - 5.54; <bold>p=0.01</bold>)</td></tr></tbody></table><table-wrap-foot><fn id="TFN1"><p id="P58">Note: Boldface indicates statistical significance (p&#x0003c;0.05)</p></fn><fn id="TFN2"><label>a</label><p id="P59">Good adherence: consistent with four or more doses of PrEP per week</p></fn><fn id="TFN3"><label>b</label><p id="P60">Excellent adherence: consistent with 7 doses of PrEP per week</p></fn><fn id="TFN4"><label>c</label><p id="P61">Retention: proportion of participants making all clinical visits</p></fn><fn id="TFN5"><label>d</label><p id="P62">IQI: interquartile interval</p></fn><fn id="TFN6"><label>e</label><p id="P63">Pct pts: percentage points</p></fn><fn id="TFN7"><label>f</label><p id="P64">OR: odds ratio</p></fn></table-wrap-foot></table-wrap></floats-group></article>