<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article"><?properties manuscript?><front><journal-meta><journal-id journal-id-type="nlm-journal-id">100970413</journal-id><journal-id journal-id-type="pubmed-jr-id">22289</journal-id><journal-id journal-id-type="nlm-ta">J Biomed Inform</journal-id><journal-id journal-id-type="iso-abbrev">J Biomed Inform</journal-id><journal-title-group><journal-title>Journal of biomedical informatics</journal-title></journal-title-group><issn pub-type="ppub">1532-0464</issn><issn pub-type="epub">1532-0480</issn></journal-meta><article-meta><article-id pub-id-type="pmid">26184057</article-id><article-id pub-id-type="pmc">4987091</article-id><article-id pub-id-type="doi">10.1016/j.jbi.2015.07.009</article-id><article-id pub-id-type="manuscript">HHSPA807744</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>A structured approach to recording AIDS-defining illnesses in Kenya: A SNOMED CT based solution</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Oluoch</surname><given-names>Tom</given-names></name><xref ref-type="aff" rid="A1">a</xref><xref rid="FN1" ref-type="author-notes">*</xref></contrib><contrib contrib-type="author"><name><surname>de Keizer</surname><given-names>Nicolette</given-names></name><xref ref-type="aff" rid="A2">b</xref></contrib><contrib contrib-type="author"><name><surname>Langat</surname><given-names>Patrick</given-names></name><xref ref-type="aff" rid="A3">c</xref></contrib><contrib contrib-type="author"><name><surname>Alaska</surname><given-names>Irene</given-names></name><xref ref-type="aff" rid="A3">c</xref></contrib><contrib contrib-type="author"><name><surname>Ochieng</surname><given-names>Kenneth</given-names></name><xref ref-type="aff" rid="A3">c</xref></contrib><contrib contrib-type="author"><name><surname>Okeyo</surname><given-names>Nicky</given-names></name><xref ref-type="aff" rid="A3">c</xref></contrib><contrib contrib-type="author"><name><surname>Kwaro</surname><given-names>Daniel</given-names></name><xref ref-type="aff" rid="A3">c</xref></contrib><contrib contrib-type="author"><name><surname>Cornet</surname><given-names>Ronald</given-names></name><xref ref-type="aff" rid="A2">b</xref><xref ref-type="aff" rid="A4">d</xref></contrib></contrib-group><aff id="A1"><label>a</label>U.S. Centers for Disease Control and Prevention, Division of Global HIV/AIDS, Nairobi, Kenya</aff><aff id="A2"><label>b</label>Department of Medical Informatics, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands</aff><aff id="A3"><label>c</label>Kenya Medical Research Institute &#x02013; CDC Collaborative Program, Kisumu, Kenya</aff><aff id="A4"><label>d</label>Department of Biomedical Engineering, Link&#x000f6;ping University, Link&#x000f6;ping, Sweden</aff><author-notes><corresp id="FN1"><label>*</label>Corresponding author at: U.S. Centers for Disease Control and Prevention, Division of Global HIV/AIDS, P.O. Box 606, 00621, Village Market, Nairobi, Kenya. Tel.: +254 20 286 7000; fax: +254 20 271 4745. <email>toluoch@cdc.gov</email>, <email>oluoch.tom@gmail.com</email> (T. Oluoch)</corresp></author-notes><pub-date pub-type="nihms-submitted"><day>5</day><month>8</month><year>2016</year></pub-date><pub-date pub-type="epub"><day>13</day><month>7</month><year>2015</year></pub-date><pub-date pub-type="ppub"><month>8</month><year>2015</year></pub-date><pub-date pub-type="pmc-release"><day>16</day><month>8</month><year>2016</year></pub-date><volume>56</volume><fpage>387</fpage><lpage>394</lpage><!--elocation-id from pubmed: 10.1016/j.jbi.2015.07.009--><abstract><sec id="S1"><title>Introduction</title><p id="P1">Several studies conducted in sub-Saharan Africa (SSA) have shown that routine clinical data in HIV clinics often have errors. Lack of structured and coded documentation of diagnosis of AIDS defining illnesses (ADIs) can compromise data quality and decisions made on clinical care.</p></sec><sec id="S2"><title>Methods</title><p id="P2">We used a structured framework to derive a reference set of concepts and terms used to describe ADIs. The four sources used were: (i) CDC/Accenture list of opportunistic infections, (ii) SNOMED Clinical Terms (SNOMED CT), (iii) Focus Group Discussion (FGD) among clinicians and nurses attending to patients at a referral provincial hospital in western Kenya, and (iv) chart abstraction from the Maternal Child Health (MCH) and HIV clinics at the same hospital. Using the January 2014 release of SNOMED CT, concepts were retrieved that matched terms abstracted from approach iii &#x00026; iv, and the content coverage assessed. Post-coordination matching was applied when needed.</p></sec><sec id="S3"><title>Results</title><p id="P3">The final reference set had 1054 unique ADI concepts which were described by 1860 unique terms. Content coverage of SNOMED CT was high (99.9% with pre-coordinated concepts; 100% with post-coordination). The resulting reference set for ADIs was implemented as the interface terminology on OpenMRS data entry forms.</p></sec><sec id="S4"><title>Conclusion</title><p id="P4">Different sources demonstrate complementarity in the collection of concepts and terms for an interface terminology. SNOMED CT provides a high coverage in the domain of ADIs. Further work is needed to evaluate the effect of the interface terminology on data quality and quality of care.</p></sec></abstract><kwd-group><kwd>AIDS</kwd><kwd>SNOMED CT</kwd><kwd>AIDS-related opportunistic infections</kwd><kwd>Developing countries</kwd><kwd>Quality of healthcare</kwd></kwd-group></article-meta></front><body><sec id="S5"><title>1. Introduction</title><p id="P5">AIDS-Defining opportunistic Illnesses (ADIs), defined as illnesses that occur with more severity and higher frequency among persons with HIV, remain the main course of morbidity and mortality among HIV-infected persons [<xref rid="R1" ref-type="bibr">1</xref>,<xref rid="R2" ref-type="bibr">2</xref>]. Although several studies show a decline in incidence of individual ADIs such as tuberculosis, Pneumocystis pneumonia and Kaposi sarcoma since the introduction of anti-retroviral therapy (ART) [<xref rid="R3" ref-type="bibr">3</xref>,<xref rid="R4" ref-type="bibr">4</xref>], mortality associated with ADIs remains high. Sub-Saharan Africa (SSA), which is home to nearly two-thirds of the world&#x02019;s 33.6 million people living with HIV, also has the highest rates of HIV-ADI co-infection [<xref rid="R5" ref-type="bibr">5</xref>]. The US Centers for Disease Control and Prevention (CDC) and the World Health Organisation (WHO) have released guidelines for prevention and treatment of ADIs, intended for use by healthcare providers and policy makers [<xref rid="R6" ref-type="bibr">6</xref>,<xref rid="R7" ref-type="bibr">7</xref>]. WHO classifies ADIs into four clinical stages indicative of HIV disease progression to help clinicians in resource-limited settings (mainly in Africa and Asia) with no immediate access to key laboratory testing capability to make decisions on ART eligibility [<xref rid="R8" ref-type="bibr">8</xref>].</p><p id="P6">Many studies conducted in SSA have shown that routine clinical data often have errors and in several cases missing key data elements such as diagnosis of ADIs [<xref rid="R9" ref-type="bibr">9</xref>&#x02013;<xref rid="R11" ref-type="bibr">11</xref>]. Poor recording or incorrect inference of WHO clinical staging based on the ADIs can lead to under or over-treatment of patients. A majority of clinics providing HIV care and treatment in SSA use a fixed list of coarse-grained ADIs to perform clinical staging of HIV-infection as recommended by WHO [<xref rid="R8" ref-type="bibr">8</xref>]. Kiragga et al. estimate that ADIs in clinical settings are under-reported by up to 67% in HIV clinics in Uganda [<xref rid="R10" ref-type="bibr">10</xref>]. Classification and terminology systems are increasingly used in developed countries for clinical documentation [<xref rid="R12" ref-type="bibr">12</xref>]. Lack of a structured, uniquely coded and comprehensive set of ADIs based on a terminology standard, from which diagnoses can be documented to support clinical decisions such as eligibility for antiretroviral therapy can potentially compromise the quality of care [<xref rid="R10" ref-type="bibr">10</xref>,<xref rid="R13" ref-type="bibr">13</xref>]. Additionally, in busy clinics with over-worked health workers, ADIs are rarely recorded with a fine granularity including more specific disease sub-types. Lack of granular information on diagnosis may influence continuity of treatment given.</p><p id="P7">Jaramogi Oginga Odinga Teaching and Referral Hospital (JOOTRH) in Kisumu county, western Kenya has two busy HIV clinics where more than 7000 patients receive care and treatment. The hospital does not have a standardized way of documenting signs, symptoms and disorders during patient visits and a previous data review showed that diagnoses may have been under-reported by up to 60% [<xref rid="R14" ref-type="bibr">14</xref>]. This potentially impacts the quality of data recorded, inference of WHO clinical staging as well as continuity of care for patients who transfer from one clinic to another. In order to address this problem, we propose to standardize the recording of ADIs using a standard terminology. A terminology system such as SNOMED Clinical Terms (SNOMED CT) can contribute to data accuracy and re-use through concept-based definition of diagnoses and coded storage of data [<xref rid="R15" ref-type="bibr">15</xref>].</p><p id="P8">This study describes a structured approach to derive a comprehensive set of ADI concepts based on SNOMED CT and evaluates SNOMED CT&#x02019;s content coverage for ADIs in a provincial referral hospital in Kenya. The ADI reference set is derived from various sources based on a framework developed by Bakhshi-Raiez et al. [<xref rid="R16" ref-type="bibr">16</xref>], which applies a multi-step approach. The resultant set of concepts will be integrated into Electronic Medical Record (EMR) systems and implemented as an interface terminology in OpenMRS EMR at the JOOTRH providing clinicians with a standardized tool for fine-grained recording of ADIs and automated inference of WHO clinical staging.</p></sec><sec id="S6"><title>2. Background</title><sec id="S7"><title>2.1. WHO clinical staging and ART eligibility</title><p id="P9">The WHO clinical staging uses clinical presentation of patients to categorize HIV infection into 4 stages based on the severity of ADIs and prognosis. The stages reflect progression of HIV infection from asymptomatic to conditions where presumptive diagnoses can be made on the basis of clinical presentation or simple investigations [<xref rid="R8" ref-type="bibr">8</xref>]. Clinical staging is progressive, meaning that when a patient has recovered from a condition defined in a higher stage, they retain the higher clinical stage and can never be classified at a lower stage. Patients with stage I and II HIV infection present with (or have a history of) conditions such as minor skin diseases and upper respiratory tract infections, which are indicative of early HIV infection. WHO clinical stages III and IV, which are indicative of advanced HIV disease, may manifest as one or more illnesses such as severe bacterial infection, extra-pulmonary tuberculosis and non-Hodgkin lymphoma. WHO recommends initiation of ART for patients who have stage III or stage IV conditions [<xref rid="R8" ref-type="bibr">8</xref>].</p><p id="P10">The Kenyan Ministry of Health (MOH) HIV care and treatment guidelines [<xref rid="R17" ref-type="bibr">17</xref>], which are adapted from the WHO guidelines, recommend that all HIV-infected pregnant women receive ART, irrespective of their immunological or clinical indication of opportunistic infections associated with HIV [<xref rid="R7" ref-type="bibr">7</xref>].</p></sec><sec id="S8"><title>2.2. SNOMED CT</title><p id="P11">SNOMED CT is an international logic-based, controlled vocabulary used in clinical care that amongst other areas includes terms for diagnostic concepts [<xref rid="R18" ref-type="bibr">18</xref>]. SNOMED CT enables meaning-based retrieval of clinical information from electronic health records (EHR) and is able to express finer-grained concepts than classification systems such as ICD-10. For this study, we used the January 2014 release of SNOMED CT which had 298,581 active concepts associated with 781,878 active descriptions. The concepts are interrelated by 896,942 active relationships which can be hierarchical (Is-A relationship) or non-hierarchical (e.g. &#x0201c;associated morphology&#x0201d; or &#x0201c;finding site&#x0201d;). A SNOMED CT reference set provides a mechanism to group concepts and/or descriptions for a common goal (such as diagnosis concepts for AIDS defining illnesses).</p><p id="P12">Rosenbloom et al. describe an interface terminology as a systematic collection of health-care phrases or terms that support clinicians&#x02019; entry of patient-related information into computer programs and decision tools [<xref rid="R19" ref-type="bibr">19</xref>]. Interface terminologies also support the display of computer-stored patient information to clinical users in simple human-readable format. The use of a SNOMED CT based terminology on the user interface of an EMR supports efficient selection of terms during data entry based on uniquely coded concepts and promotes data re-use in decision support, statistical analysis and reporting.</p><p id="P13">The Kenya Medical Research Institute (KEMRI), a collaborator in this study, applied for and obtained a free institutional SNOMED CT license from IHTSDO within the category of developing countries. Under this license, KEMRI can access the SNOMED CT database and use the concepts, descriptions and relationships in EMRs supporting clinical care and research. The license is renewed annually.</p></sec><sec id="S9"><title>2.3. OpenMRS</title><p id="P14">OpenMRS is a free, collaborative, open source software that supports the delivery of health care and is widely used in developing countries. It is based on a &#x0201c;concept dictionary&#x0201d; that describes data items such as clinical findings and laboratory results. It provides a platform which can be customized through addition of new data items, forms and reports without programming. It is web based but can be deployed on a single standard-alone desktop computer, a laptop or a large server and runs on Linux, Windows or Mac OS X.</p></sec></sec><sec id="S10"><title>3. Methods</title><sec id="S11"><title>3.1. Study setting</title><p id="P15">The JOOTRH provides ambulatory HIV care and treatment services to over 7000 active patients, of whom about 4800 are receiving ART. The services are provided within the Maternal and Child Health (MCH), the HIV clinic/Patient Support Centre (PSC) and the Integrated Tuberculosis clinic. The three clinics in the hospital use a hybrid system of paper records and EMR to manage patient data; the EMR system is currently under staged deployment and is expected to replace the paper records by the end of 2014. The study was conducted at the HIV/PSC clinic and the MCH clinic which includes the Ante-Natal Care (ANC) clinic.</p></sec><sec id="S12"><title>3.2. Study participants</title><p id="P16">We extracted free-text data used to describe diagnoses, signs and symptoms from paper-based clinical notes for all HIV-positive patients receiving care and treatment services at the HIV/PSC as well as HIV-positive pregnant women presenting for antenatal care or at the labor and delivery room during the months of February and March 2014, and receiving Antiretroviral Therapy (ART). We also conducted a Focus Group Discussion (FGD) among clinicians and nurses who attend to patients visiting the MCH and HIV/PSC clinics.</p></sec><sec id="S13"><title>3.3. Review of term-based ADI recording</title><p id="P17">A trained clinician (clinical officer) extracted terms for diagnoses, signs and symptoms recorded in the patient charts to determine the terms used to document ADIs at the ANC and HIV/PSC. Data were retrieved from the two clinics to ensure comprehensive coverage of terms used to describe ADIs. Although terms for diagnoses, signs and symptoms were retrieved from the charts, we only included in the analysis those that matched SNOMED CT &#x0201c;disorder&#x0201d; concepts as described later.</p></sec><sec id="S14"><title>3.4. Deriving ADI reference set</title><p id="P18">Based on a framework developed by Bakhshi-Raiez et al. [<xref rid="R16" ref-type="bibr">16</xref>], we derived the reference set of ADI concepts through a multi-step approach. The first three steps describe how the ADI reference set was derived as shown in <xref rid="F1" ref-type="fig">Fig. 1</xref>. In the first step, concept-based subsets of ADIs from SNOMED CT and Accenture/CDC (described below) were merged. The <italic>CliniClue Xplore</italic> browser [<xref rid="R20" ref-type="bibr">20</xref>] and <italic>NICTIZ terminology explorer</italic> [<xref rid="R21" ref-type="bibr">21</xref>] were used to explore the concepts. The second step entailed extraction of term-based concepts from patient charts and Focus Group Discussions. In step 3, the concept-based and term-based concepts were merged.</p><sec id="S15"><title>Step 1: Processing concept-based ADI subsets</title><list list-type="alpha-lower" id="L1"><list-item><p id="P19"><bold><italic>Accenture/CDC subset:</italic></bold> The US Centers for Disease Control and Prevention (CDC) derived a list of opportunistic infections considered to be AIDS defining illnesses [<xref rid="R6" ref-type="bibr">6</xref>]. CDC and Accenture mapped the <italic>diagnosis</italic> and <italic>organism</italic> concepts on to SNOMED CT to come up with a hierarchical set of SNOMED CT-based concepts stored in the Web Ontology Language (OWL) format [<xref rid="R22" ref-type="bibr">22</xref>]. The Accenture/CDC subset contains 907 concepts and 1528 associated descriptions for ADIs.</p></list-item><list-item><p id="P20"><bold><italic>SNOMED CT subset</italic></bold>: We used structured query language (SQL) commands to select concepts and descriptions associated with ADIs from an instance of the January 2014 release of SNOMED CT which was stored in a MySQL database. The SQL commands were based on the conditions described below:
<list list-type="bullet" id="L2"><list-item><p id="P21">Concepts described by terms including &#x0201c;assoc&#x0201d; and (&#x0201c;AIDS&#x0201d; or &#x0201c;HIV&#x0201d;).</p></list-item><list-item><p id="P22">Concepts linked by the relationship &#x0201c;<italic>associated with</italic>&#x0201d; to the concept &#x0201c;<italic>HIV infection</italic>&#x0201d;.</p></list-item><list-item><p id="P23">All subtypes (descendants) of the above selected concepts.</p></list-item><list-item><p id="P24">The active descriptions of the resulting concepts in SNOMED CT.</p></list-item></list></p></list-item></list><p id="P25">The SQL queries used to retrieve the data are in Appendix A. Since all patients seen in the study clinics had HIV, those super-types of concepts were retrieved that did not include the phrase &#x0201c;Associated with AIDS&#x0201d;. For example: <italic>Pneumococcal Pneumonia associated with AIDS</italic> (concept ID = 420787001) was replaced with the parent concept <italic>Pneumococcal Pneumonia</italic> (concept ID = 233607000).</p><p id="P26">The two ADI subsets described in steps (a) and (b) above were merged into subset A as shown in <xref rid="F1" ref-type="fig">Fig. 1</xref>, sorted by SNOMED CT concept ID and all duplicate concepts and terms deleted.</p></sec><sec id="S16"><title>Step 2: Deriving term-based concepts</title><list list-type="alpha-lower" id="L3"><list-item><p id="P27"><bold><italic>Free text abstraction:</italic></bold></p><p id="P28">Two clinical officers reviewed free-text records from 583 initial patient visits and 762 follow-up visits for the same patients who visited the JOOTRH ANC and HIV/PSC clinics in the months of February and March 2014 and abstracted terms used to describe ADIs at the clinic. Due to the large number of patients seen at the clinics, and our interest to discover as many ADIs as possible, the two clinicians shared the data abstraction responsibility with each one reviewing a different set of patient charts. The free-text terms were extracted from paper-based patient records as well as those entered in the OpenMRS EMR. Terms and description IDs from SNOMED CT that matched the free-text terms were retrieved by a medical informatician with SNOMED CT expertise (TO). These concepts and the terms describing them were stored as subset B (<xref rid="F1" ref-type="fig">Fig. 1</xref>).</p></list-item><list-item><p id="P29"><bold><italic>Focus Group Discussion:</italic></bold></p><p id="P30">In this step, a Focus Group Discussion (FGD) was held involving clinicians who attend to patients at the ANC and HIV/PSC clinics. A separate FGD was conducted among nurses working at the same clinics. All descriptions for the concepts from subset A were made available to the clinicians prior to the start of the FGD. Clinicians&#x02019; and nurses&#x02019; knowledge was sought on the most common ADIs in their setting (JOOTRH). Using local terms, they listed as many ADIs as they could in addition to the concepts and terms included in subset A. Clinicians and nurses were further asked what factors they consider in determining whether the symptoms and signs are suggestive of an ADI. Terms and description IDs from SNOMED CT that matched terms used for ADI diagnoses in the FGD were retrieved by the same medical informatician (TO).</p></list-item></list><p id="P31">The terms and concepts derived through abstraction of data from the MCH/PSC records and the FGD were merged into subset B and duplicates removed (see <xref rid="F1" ref-type="fig">Fig. 1</xref>). Concepts were retrieved from SNOMED CT based on the &#x0201c;exact match&#x0201d; and if needed, by post-coordination. The example below shows how we derived a post-coordinated concept <italic>oropharyngeal candidiasis</italic> which is not in SNOMED CT. CDC describes <italic>oropharyngeal candidiasis as candidiasis that develops in the throat or mouth</italic> [<xref rid="R23" ref-type="bibr">23</xref>]. Candidiasis (78048006): finding site (363698007) = Mouth and/or pharynx structures (312533001).</p></sec><sec id="S17"><title>Step 3: Merging the subsets</title><p id="P32">In the final step, all derived concepts (subsets A and B) and their descriptions were merged into a single subset C and all duplicate concepts and descriptions deleted.</p></sec><sec id="S18"><title>Step 4: SNOMED CT subset extension</title><p id="P33">If terms could not be matched with SNOMED CT concepts and descriptions, these terms were presented to a team of clinicians and informaticians with expertise in SNOMED CT for review. They determined whether these could be considered as local extensions of SNOMED CT through post-coordination of concepts or as entirely new concepts or descriptions.</p></sec><sec id="S19"><title>Step 5: Constraining the ADI subset</title><p id="P34">Several non-ADI concepts were deleted from the term-based subsets. Although these non-ADIs were common co-infections that HIV patients attending the clinics at JOOTRH present with, they were not considered for implementation of the interface terminology. Such non-ADI concepts included <italic>malaria</italic> (concept ID = 61462000) and <italic>urinary tract infection</italic> (concept ID = 68566005).</p></sec></sec><sec id="S20"><title>3.5. Assessing content coverage</title><p id="P35">We matched each of the term-based concepts to SNOMED CT concepts in order to assess content coverage in the latter. Due to the small number of concepts, we did a manual matching and recorded the concepts that could not be found in SNOMED CT.</p></sec><sec id="S21"><title>3.6. Implementation of the interface terminology</title><p id="P36">The resulting concept subset and description subset from the above steps were represented in the OpenMRS concept dictionary and implemented as the interface terminology on OpenMRS data entry forms to improve ease and accuracy of recording of ADIs. A separate set of non-ADI concepts representing common co-infections or signs, symptoms among patients seeking HIV treatment at JOOTRH was also created from the chart review and FGD for the purpose of presentation on the user interface. Subsetting the concepts into ADI and non-ADI disorders for the purpose of presentation on the user interface provides clinicians quick access to shorter lists of relevant diagnosis concepts to choose from. The ADI concepts were presented on the user interface as a dropdown menu with autocomplete/autosuggest textbox feature derived using a list builder. A &#x02019;more details&#x02019; button is displayed for each of the ADIs selected for a particular patient. Clicking on this button allows the selection of qualifiers of a particular diagnosis.</p><p id="P37">The patients&#x02019; WHO staging is automatically inferred based on the recorded ADI concept. To accomplish this, the ADI concept is matched with the corresponding WHO stage as defined in the HIV treatment guidelines [<xref rid="R8" ref-type="bibr">8</xref>,<xref rid="R17" ref-type="bibr">17</xref>]. The WHO clinical staging list showing the ADI concepts and corresponding WHO clinical stage is in Appendix B [<xref rid="R8" ref-type="bibr">8</xref>].</p></sec><sec id="S22"><title>3.7. Ethical considerations</title><p id="P38">The study was approved by the Associate Director for Science at the Center for Global Health of the US Centers for Disease Control and Prevention (CDC) and the Kenya Medical Research Institute (KEMRI) institutional review board. The women whose data were included in the study consented to the use of their data for clinical care and research studies taking place at the ANC clinic. As the study subjects were considered a vulnerable population (HIV-positive pregnant women), the study team ensured that the individual patient data were de-identified and their privacy and confidentiality maintained in line with the KEMRI guidelines on research ethics.</p></sec></sec><sec id="S23"><title>4. Results</title><p id="P39">A total of 1104 ADI concepts were derived from the four data sources. The final reference set had 1054 unique concepts after deleting 50 duplicate concepts. The 1054 unique concepts were described by 1860 unique terms. <xref rid="F1" ref-type="fig">Fig. 1</xref> shows the number of terms and concepts used to describe ADIs in each subset.</p><sec id="S24"><title>4.1. Concept-based terms (CDC ADI and SNOMED CT subsets)</title><p id="P40">The CDC/Accenture ADI subset had 907 unique disorder concepts described by 1528 terms. For the SNOMED CT subset, the first query (<italic>concepts described by terms including &#x0201c;assoc&#x0201d; and (&#x0201d;AIDS&#x0201d; or &#x0201c;HIV&#x0201d;)</italic>) yielded 102 concepts while the second query (<italic>concepts linked by the relationship &#x0201c;associated with&#x0201d; (ID = 47429007) to the concept &#x0201c;HIV infection&#x0201d; (ID = 86406008)</italic>) resulted in 105 unique concepts. Merging the two subsets described above and removing duplicates resulted in 109 unique concepts. Finally, the subtype children of the resulting concepts were derived using the fourth query. Where relevant, these concepts were replaced by their supertype concept for which the description did not contain &#x0201c;associated with AIDS&#x0201d;. For the resulting 110 concepts, 254 terms together with their description ID were retrieved from SNOMED CT.</p></sec><sec id="S25"><title>4.2. Term-based ADI subset (abstraction from MCH and PSC, and Focus Group Discussions)</title><p id="P41">A total of 87 ADI concepts were derived from the term-based subset i.e. those abstracted from the paper records of patients attending the MCH clinic and PSC, and from the FGD. The concepts were described using 157 terms.</p></sec><sec id="S26"><title>4.3. Content coverage</title><p id="P42">The overall content coverage was 99.9% with pre-coordinated concepts and 100% with post-coordination. All but two term-based concepts from the chart abstraction at the MCH and PSC, as well as the FGDs matched the SNOMED CT concepts. The two concepts that required post-coordination were: <italic>(i) Oropharyngeal candidiasis, and (ii) genital ulcer disease</italic>. <italic>Oropharyngeal candidiasis</italic> was post-coordinated as: Candidiasis (78048006): finding site (363698007) = Mouth and/or pharynx structures (312533001). <italic>Genital ulcer disease</italic> was post-coordinated as: Ulcer (429040005): finding site (363698007) = Structure of genital organ (700037000).</p></sec><sec id="S27"><title>4.4. Interface terminology implementation</title><p id="P43">The implementation of the interface terminology includes 1860 terms describing 1054 unique concepts. The data entry forms, developed using the HTML Form Entry module of OpenMRS, display ADI concepts from the reference set and include qualifiers such as severity (e.g. &#x0201c;mild&#x0201d;, &#x0201c;moderate&#x0201d; or &#x0201c;severe&#x0201d;), onset (e.g. &#x0201c;sudden&#x0201d; or &#x0201c;gradual&#x0201d;) and laterality which describes the side of the body that is infected (e.g. right middle zone pneumonia indicative that the infection is in the right middle lobe of the lung). Defining characteristics which include causative agent were implicit to the interface terminology, allowing more specific types of diagnosis to be selected (e.g. for &#x0201c;pneumococcal pneumonia&#x0201d; where &#x0201c;pneumococcus&#x0201d; is the causative agent). Additional context information that can be selected is the type of diagnosis, i.e. presumptive (working), differential or final diagnosis and status (&#x0201c;active&#x0201d; or &#x0201c;inactive&#x0201d;) (see <xref rid="F2" ref-type="fig">Fig. 2</xref>). Once ADI diagnoses are captured, using the data entry form, the concept ID is stored and can be re-used for decision support, e.g. inferring ART eligibility and to generate statistical summaries. Statistical summaries are reported to the Kenyan Ministry of Health on a monthly basis.</p></sec></sec><sec id="S28"><title>5. Discussion</title><p id="P44">More than 1000 ADI concepts described by nearly 1900 terms were derived from four data sources using a well-structured approach based on an earlier published framework for developing interface terminology reference sets [<xref rid="R16" ref-type="bibr">16</xref>]. While most concepts were described by one term, some of the concepts were described using as many as 9 terms which provide a wide variety of relevant synonyms that include locally used terms from which clinicians can make selections to accurately describe diagnoses. Content coverage was high; consistent with the study by Rosenbloom et al. [<xref rid="R24" ref-type="bibr">24</xref>]. In our study, all but two concepts generated from the term-based sources matched SNOMED CT concepts.</p><p id="P45">Although signs and symptoms were included in the data abstracted from the MCH and PSC, as well as the FGD, we did not include them in the final reference set since they had a very broad scope and some were not associated with HIV infection. It is important to note that the WHO clinical staging list includes some signs and symptoms such as <italic>fever (concept ID = 421154002</italic>) together with &#x02018;real&#x02019; ADIs used to determine the progression of HIV infection based on clinical presentation of the patient [<xref rid="R8" ref-type="bibr">8</xref>] (see Appendix B). These will be added to the local concept dictionary through dynamic updates to support automated inference of WHO clinical staging. The ADI list of concepts will be shared with Columbia University that maintains the concept dictionary for OpenMRS users. It will also be shared with the International Health Terminology Standards Development Organization (IHTSDO) that maintains SNOMED CT for distribution to its members and affiliates. Access to the reference set can be gained by contacting IHTSDO.</p><p id="P46">An observation of the term-based data abstracted from the MCH clinic and PSC, as well as data recorded from the FGDs showed a number of spelling mistakes. This shows that lack of a structured list of ADIs with a rich selection of terms contributes to poor data quality on diagnoses entered in EMR systems, as observed elsewhere [<xref rid="R13" ref-type="bibr">13</xref>]. The implementation of an interface terminology with the ADIs selected from a comprehensive reference set that includes child and parent concepts of key disorders will enhance the quality of data recorded leading to appropriate decisions on clinical care. Additionally, enhanced decision support through automated inference of WHO clinical stage based on the recorded ADIs will ensure that patients get appropriate treatment determined by the accurate recording of progression of HIV infection. The study benefited from data collection from a busy referral hospital that provides HIV care and treatment to a large number of patients with diverse conditions hence a broad coverage of terms used to describe ADIs. Furthermore, the use of chart abstraction and FGDs enabled the study team to collect context-specific terms that are most appropriate for local use at JOOTRH but may also be broadly used in similar contexts in low-resource settings.</p><p id="P47">Our study had a few limitations. The chart abstraction was conducted over a two-month period and this may not be long enough to provide the breadth of data required. The effect of the short data collection period was minimized since this is a high-volume hospital with diverse patients. Incorrect spellings and use of ADI terms that were not specific enough, made matching SNOMED CT concepts difficult. Consultation with the clinicians helped resolve the errors and all the terms were matched. Additionally, the EMR implementation has a provision for dynamic update of concepts which may be missing from the current list or those that will be derived through post-coordination of new and existing terms.</p></sec><sec id="S29"><title>6. Conclusion</title><p id="P48">We described a structured approach to deriving an ADI reference set based on SNOMED CT and the implementation of an interface terminology for OpenMRS at a busy provincial referral hospital in a resource-constrained setting. Use of different sources demonstrates complementarity in the collection of concepts and terms for an interface terminology. SNOMED CT provides a high coverage in the domain of ADIs. We anticipate that the context-specific reference set will support improved recording of high quality data ensuring completeness and reusability. Further work is needed to evaluate the effectiveness of the interface terminology on data quality and quality of care.</p></sec></body><back><ack id="S30"><p>The authors would like to acknowledge the KEMRI Director and his staff for the approval of this study and for reviewing and clearing the manuscript. We would also like to thank Ms. Mevis Omolo and Philister Anyango for outstanding work in recording and transcribing the FGD, and all staff at the JOOTRH that supported the data collection for this study and implementation of OpenMRS.</p><p><bold>Funding</bold></p><p>This publication was made possible by support from the U.S. President&#x02019;s Emergency Plan for AIDS Relief (PEPFAR) through the U.S. Centers for Disease Control and Prevention (CDC), Division of HIV/AIDS (DGHA), under the KEMRI/CDC Cooperative Agreement no. GH000048-04.</p></ack><fn-group><fn id="FN2"><p><bold>Disclaimer</bold></p><p>The findings and conclusions in this report are those of the author(s) and do not necessarily represent the official position of the Centers for Disease Control and Prevention/the Agency for Toxic Substances and Disease Registry, or the Kenya Medical Research Institute.</p></fn><fn id="FN3" fn-type="con"><p><bold>Co-author contribution</bold></p><p>Tom Oluoch, Nicolette de Keizer and Ronald Cornet conceptualized and designed the study. Irene Alaska and Daniel Kwaro contributed to the clinical components of the study and manuscript review. Patrick Langat and Nicky Okeyo provided oversight to the data management team that conducted the chart abstraction, FGD and overall data cleaning. Kenneth Ochieng did the programming in OpenMRS, including developing the user interface. All co-authors were involved in interpreting the results. TO, NdK and RC drafted and revised the manuscript. All authors edited and reviewed the manuscript and gave their final approval for submission to the journal.</p></fn><fn id="FN4" fn-type="conflict"><p><bold>Conflicts of interest</bold></p><p>Authors are members of the Technical Committee (Ronald Cornet) and Quality Assurance Committee (Nicolette de Keizer) of the International Health Terminology Standards Development Organization (IHTSDO), which publishes SNOMED CT. Their positions at the IHTSDO, however, had no bearing on the research study or results.</p></fn></fn-group><app-group><app id="APP1"><title>Appendix A. SQL queries for retrieval of ADI concept IDs for ADIs from SNOMED CT database</title><p id="P49">We used the queries below to retrieve the relevant ADI concepts and descriptions:</p><table-wrap id="T1" position="anchor" orientation="portrait"><table frame="hsides" rules="none"><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">(i) <bold><italic>Concepts described by terms including &#x0201c;assoc&#x0201d; and (&#x0201c;AIDS&#x0201d; or &#x0201c;HIV&#x0201d;)</italic></bold><break/>&#x02003;CREATE VIEW c1 AS<break/>&#x02003;SELECT c201401.Id, c201401.active, c201401.definitionStatusId, d201401.conceptID, d201401.typeId, d201401.term<break/>&#x02003;FROM c201401<break/>&#x02003;JOIN d201401 ON c201401.Id = d201401.conceptId<break/>&#x02003;WHERE c201401.active = 1<break/>&#x02003;AND d201401.active = 1<break/>&#x02003;AND (<break/>&#x02003;d201401.term LIKE &#x02019;%AIDS%&#x02019;<break/>&#x02003;OR d201401.term LIKE &#x02019;%HIV%&#x02019;<break/>&#x02003;)<break/>&#x02003;AND d201401.term LIKE &#x02019;%assoc%&#x02019;<break/><break/>&#x02003;(n = 102 unique concepts)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">(ii) <bold><italic>Concepts linked by the relationship &#x0201c;associated with&#x0201d; (Id = 47429007) to the concept &#x0201c;HIV Infection&#x0201d; (Id = 86406008)</italic></bold><break/>&#x02003;CREATE VIEW &#x02018;c2&#x02018; AS<break/>&#x02003;select &#x02018;sourceconcept&#x02018;.&#x02018;Id&#x02018; AS &#x02018;conceptId&#x02018;<break/>&#x02003;FROM (((&#x02018;c201401&#x02019; &#x02018;sourceconcept&#x02019; join &#x02018;r201401&#x02019; on((&#x02018;sourceconcept&#x02019;.&#x02018;Id&#x02019; = &#x02018;r201401&#x02019;.&#x02018;sourceId&#x02019;)))<break/>&#x02003;JOIN &#x02018;transitiveclosure_20140131&#x02019; &#x02018;t1&#x02019; ON ((&#x02018;r201401&#x02019;.&#x02018;destinationId&#x02019; = &#x02018;t1&#x02019;.&#x02018;SubtypeId&#x02019;)))<break/>&#x02003;JOIN &#x02018;transitiveclosure_20140131&#x02019; &#x02018;t2&#x02019; ON ((&#x02018;t2&#x02019;.&#x02018;SubtypeId&#x02019; = &#x02018;r201401&#x02019;.&#x02018;typeId&#x02019;)))<break/>&#x02003;WHERE ((&#x02018;sourceconcept&#x02019;.&#x02018;active&#x02019; = 1) and (&#x02018;r201401&#x02019;.&#x02018;active&#x02019; = 1)<break/>&#x02003;AND (&#x02018;t1&#x02019;.&#x02018;SupertypeId&#x02019; = 86406008)<break/>&#x02003;AND (&#x02018;t2&#x02019;.&#x02018;SupertypeId&#x02019; = 47429007))<break/><break/>&#x02003;(n = 105 unique concepts)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">(iii) <bold><italic>Merging the two views c1 and c2 into a new one c3</italic></bold><break/>&#x02003;CREATE VIEW &#x02018;c3&#x02019; AS<break/>&#x02003;SELECT &#x02018;c1&#x02019;.&#x02018;conceptID&#x02019; AS &#x02018;conceptId&#x02019;<break/>&#x02003;FROM &#x02018;c1&#x02019; union select &#x02018;c2&#x02019;.&#x02018;conceptId&#x02019; AS &#x02018;conceptId&#x02019; from &#x02018;c2&#x02019;<break/><break/>&#x02003;(n = 109 unique concepts)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">(iv) <bold><italic>Concept Identifiers of all unique subtype concepts of AIDS-associated disorder concepts (above)</italic></bold><break/>&#x02003;CREATE VIEW c4 AS<break/>&#x02003;SELECT DISTINCT subtypeId<break/>&#x02003;FROM transitiveclosure_20140131<break/>&#x02003;JOIN c3 ON supertypeId = conceptId<break/><break/>&#x02003;(n = 110 unique concepts)<break/><break/>&#x02003;<bold>c201401</bold> is the concepts table<break/>&#x02003;<bold>d201401</bold> is the description table<break/>&#x02003;<bold>r201401</bold> is the relationship table</td></tr></tbody></table></table-wrap></app><app id="APP2"><title>Appendix B. WHO clinical staging list used at the JOOTRH</title><table-wrap id="T2" position="anchor" orientation="portrait"><table frame="hsides" rules="groups"><thead><tr><th valign="bottom" align="left" rowspan="1" colspan="1"/><th valign="bottom" align="left" rowspan="1" colspan="1">Description</th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><italic>Clinical stage 1</italic></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;1</td><td align="left" valign="top" rowspan="1" colspan="1">Asymptomatic</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;2</td><td align="left" valign="top" rowspan="1" colspan="1">Persistent generalized lymphadenopathy</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><italic>Clinical stage 2</italic></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;1</td><td align="left" valign="top" rowspan="1" colspan="1">Moderate unexplained weight loss (&#x0003c;10% of presumed or measured body weight)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;2</td><td align="left" valign="top" rowspan="1" colspan="1">Minor mucocutaneous manifestations (seborrheic dertmatitis, papular pruritic eruptions, fungal nail infections, recurrent oral ulcerations, angular cheilitis)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;3</td><td align="left" valign="top" rowspan="1" colspan="1">Herpes zoster</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;4</td><td align="left" valign="top" rowspan="1" colspan="1">Recurrent upper respiratory tract infections (sinusitis, tonsillitis, bronchitis, otitis media, pharyngitis</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><italic>Clinical stage 3</italic></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;1</td><td align="left" valign="top" rowspan="1" colspan="1">Unexplained severe weight loss (over 10% of presumed or measured body weight)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;2</td><td align="left" valign="top" rowspan="1" colspan="1">Unexplained chronic diarrhea for longer than one month</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;3</td><td align="left" valign="top" rowspan="1" colspan="1">Unexplained persistent fever (intermittent or constant for longer than one month)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;4</td><td align="left" valign="top" rowspan="1" colspan="1">Persistent oral candidiasis</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;5</td><td align="left" valign="top" rowspan="1" colspan="1">Oral hairy leukoplakia</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;6</td><td align="left" valign="top" rowspan="1" colspan="1">Pulmonary tuberculosis</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;7</td><td align="left" valign="top" rowspan="1" colspan="1">Severe bacterial infections (e.g. pneumonia, empyema, pyomyositis, bone or joint infection, meningitis, bacteraemia)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;8</td><td align="left" valign="top" rowspan="1" colspan="1">Acute nectrotizing ulcerative stomatitis, gingivitis or periodontitis</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;9</td><td align="left" valign="top" rowspan="1" colspan="1">Unexplained anemia (hemoglobin below 8 g/dl), neutropenia (below 0.5 109/l) and/or chronic thrombocytopenia (below 50 10&#x002c6;9/l)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><italic>Clinical stage 4</italic></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><italic>Conditions where a presumptive diagnosis can be made using clinical signs or simple investigations</italic></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;1</td><td align="left" valign="top" rowspan="1" colspan="1">HIV wasting syndrome</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;2</td><td align="left" valign="top" rowspan="1" colspan="1">Pneumocystis jirovecii pneumonia (PCP)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;3</td><td align="left" valign="top" rowspan="1" colspan="1">Recurrent severe bacterial pneumonia (&#x0003e;2 episodes within 1 year)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;4</td><td align="left" valign="top" rowspan="1" colspan="1">Cryptococcal meningitis</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;5</td><td align="left" valign="top" rowspan="1" colspan="1">Toxoplasmosis of the brain</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;6</td><td align="left" valign="top" rowspan="1" colspan="1">Chronic orolabial, genital or ano-rectal herpes simplex infection for &#x0003e;1 month</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;7</td><td align="left" valign="top" rowspan="1" colspan="1">Kaposi sarcoma</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;8</td><td align="left" valign="top" rowspan="1" colspan="1">HIV encephalopathy</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;9</td><td align="left" valign="top" rowspan="1" colspan="1">Extrapulmonary tuberculosis</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1"/><td align="left" valign="top" rowspan="1" colspan="1"><italic>Conditions where confirmatory diagnosis testing is necessary:</italic></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;1</td><td align="left" valign="top" rowspan="1" colspan="1">Cryptosporidiosis, with diarrhea &#x0003e;1 month</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;2</td><td align="left" valign="top" rowspan="1" colspan="1">Isosporiasis</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;3</td><td align="left" valign="top" rowspan="1" colspan="1">Cryptococcosis (extrapulmonary)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;4</td><td align="left" valign="top" rowspan="1" colspan="1">Disseminated non-tuberculosis mycobacterial infection</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;5</td><td align="left" valign="top" rowspan="1" colspan="1">Cytomegalovirus (CMV) retinitis or infection of the organs (other than liver, spleen, or lymph nodes)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;6</td><td align="left" valign="top" rowspan="1" colspan="1">Progressive multifocal leocoencephalopathy (PML)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;7</td><td align="left" valign="top" rowspan="1" colspan="1">Any disseminated mycosis (e.g. histoplasmosis, coccidiomycosis)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;8</td><td align="left" valign="top" rowspan="1" colspan="1">Candidiasis of the oesophagus or airways</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;9</td><td align="left" valign="top" rowspan="1" colspan="1">Non-typhoid salmonella (NTS) septicaemia</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">10</td><td align="left" valign="top" rowspan="1" colspan="1">Lymphoma cerebral or B cell Non Hogdkins&#x02019;s Lymphoma</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">11</td><td align="left" valign="top" rowspan="1" colspan="1">Invasive cervical cancer</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">12</td><td align="left" valign="top" rowspan="1" colspan="1">Visceral leishmaniasis</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">13</td><td align="left" valign="top" rowspan="1" colspan="1">Symptomatic HIV-associated nephropathy or HIV-associated cardiomyopathy</td></tr></tbody></table></table-wrap></app></app-group><ref-list><ref id="R1"><label>1</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lawn</surname><given-names>SD</given-names></name><name><surname>Gupta</surname><given-names>A</given-names></name><name><surname>Wood</surname><given-names>R</given-names></name></person-group><article-title>Assessing the impact of prevalent tuberculosis on mortality among antiretroviral treatment initiators: accurate tuberculosis diagnosis is essential</article-title><source>AIDS</source><volume>26</volume><issue>13</issue><year>2012</year><fpage>1730</fpage><lpage>1731</lpage><pub-id pub-id-type="pmid">22874482</pub-id></element-citation></ref><ref id="R2"><label>2</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Toossi</surname><given-names>Z</given-names></name><name><surname>Mayanja-Kizza</surname><given-names>H</given-names></name><name><surname>Hirsch</surname><given-names>CS</given-names></name><name><surname>Edmonds</surname><given-names>KL</given-names></name><name><surname>Spahlinger</surname><given-names>T</given-names></name><name><surname>Hom</surname><given-names>DL</given-names></name><etal/></person-group><article-title>Impact of tuberculosis (TB) on HIV-1 activity in dually infected patients</article-title><source>Clin Exp Immunol</source><volume>123</volume><issue>2</issue><year>2001</year><fpage>233</fpage><lpage>238</lpage><pub-id pub-id-type="pmid">11207653</pub-id></element-citation></ref><ref id="R3"><label>3</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grabar</surname><given-names>S</given-names></name><name><surname>Lanoy</surname><given-names>E</given-names></name><name><surname>Allavena</surname><given-names>C</given-names></name><name><surname>Mary-Krause</surname><given-names>M</given-names></name><name><surname>Bentata</surname><given-names>M</given-names></name><name><surname>Fischer</surname><given-names>P</given-names></name><etal/></person-group><article-title>Causes of the first AIDS-defining illness and subsequent survival before and after the advent of combined antiretroviral therapy</article-title><source>HIV Med</source><volume>9</volume><issue>4</issue><year>2008</year><fpage>246</fpage><lpage>256</lpage><pub-id pub-id-type="pmid">18366449</pub-id></element-citation></ref><ref id="R4"><label>4</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ledergerber</surname><given-names>B</given-names></name><name><surname>Egger</surname><given-names>M</given-names></name><name><surname>Erard</surname><given-names>V</given-names></name><name><surname>Weber</surname><given-names>R</given-names></name><name><surname>Hirschel</surname><given-names>B</given-names></name><name><surname>Furrer</surname><given-names>H</given-names></name><etal/></person-group><article-title>AIDS-related opportunistic illnesses occurring after initiation of potent antiretroviral therapy: the Swiss HIV Cohort Study</article-title><source>JAMA</source><volume>282</volume><issue>23</issue><year>1999</year><fpage>2220</fpage><lpage>2226</lpage><pub-id pub-id-type="pmid">10605973</pub-id></element-citation></ref><ref id="R5"><label>5</label><element-citation publication-type="journal"><collab>World Health Organization</collab><source>Global Update on HIV Treatment 2013: Results, Impact and Opportunities</source><year>2013</year><month>6</month><day>6</day></element-citation></ref><ref id="R6"><label>6</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kaplan</surname><given-names>JE</given-names></name><name><surname>Benson</surname><given-names>C</given-names></name><name><surname>Holmes</surname><given-names>KK</given-names></name><name><surname>Brooks</surname><given-names>JT</given-names></name><name><surname>Pau</surname><given-names>A</given-names></name><name><surname>Masur</surname><given-names>H</given-names></name></person-group><article-title>Guidelines for prevention and treatment of opportunistic infections in HIV-infected adults and adolescents: recommendations from CDC, the National Institutes of Health, and the HIV Medicine Association of the Infectious Diseases Society of America</article-title><source>MMWR Recomm Rep</source><volume>58</volume><issue>RR-4</issue><year>2009</year><fpage>1</fpage><lpage>207</lpage></element-citation></ref><ref id="R7"><label>7</label><element-citation publication-type="journal"><collab>World Health Organizations</collab><source>Consolidated Guidelines on the Use of Antiretroviral Drugs for Treating and Preventing HIV Infection</source><year>2013</year><month>6</month><day>6</day></element-citation></ref><ref id="R8"><label>8</label><element-citation publication-type="journal"><collab>World Health Organization</collab><source>WHO Case Definitions of HIV for Surveillance and Revised Clinical Staging and Immunological Classification of HIV-related Disease in Adults and Children</source><year>2006</year></element-citation></ref><ref id="R9"><label>9</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Castelnuovo</surname><given-names>B</given-names></name><name><surname>Kiragga</surname><given-names>A</given-names></name><name><surname>Afayo</surname><given-names>V</given-names></name><name><surname>Ncube</surname><given-names>M</given-names></name><name><surname>Orama</surname><given-names>R</given-names></name><name><surname>Magero</surname><given-names>S</given-names></name><etal/></person-group><article-title>Implementation of provider-based electronic medical records and improvement of the quality of data in a large HIV program in Sub-Saharan Africa</article-title><source>PLoS ONE</source><volume>7</volume><issue>12</issue><year>2012</year><fpage>e51631</fpage><pub-id pub-id-type="pmid">23284728</pub-id></element-citation></ref><ref id="R10"><label>10</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kiragga</surname><given-names>AN</given-names></name><name><surname>Castelnuovo</surname><given-names>B</given-names></name><name><surname>Schaefer</surname><given-names>P</given-names></name><name><surname>Muwonge</surname><given-names>T</given-names></name><name><surname>Easterbrook</surname><given-names>PJ</given-names></name></person-group><article-title>Quality of data collection in a large HIV observational clinic database in sub-Saharan Africa: implications for clinical research and audit of care</article-title><source>J Int AIDS Soc</source><volume>14</volume><year>2011</year><fpage>3</fpage><pub-id pub-id-type="pmid">21251327</pub-id></element-citation></ref><ref id="R11"><label>11</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Libamba</surname><given-names>E</given-names></name><name><surname>Makombe</surname><given-names>S</given-names></name><name><surname>Mhango</surname><given-names>E</given-names></name><name><surname>de Ascurra</surname><given-names>TO</given-names></name><name><surname>Limbambala</surname><given-names>E</given-names></name><name><surname>Schouten</surname><given-names>EJ</given-names></name><etal/></person-group><article-title>Supervision, monitoring and evaluation of nationwide scale-up of antiretroviral therapy in Malawi</article-title><source>Bull World Health Organ</source><volume>84</volume><issue>4</issue><year>2006</year><fpage>320</fpage><lpage>326</lpage><pub-id pub-id-type="pmid">16628306</pub-id></element-citation></ref><ref id="R12"><label>12</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hojen</surname><given-names>AR</given-names></name><name><surname>Goeg</surname><given-names>KR</given-names></name><name><surname>Elberg</surname><given-names>PB</given-names></name></person-group><article-title>Re-use of SNOMED CT subset in development of the Danish national standard for home care nursing problems</article-title><source>Stud Health Technol Inform</source><volume>210</volume><year>2015</year><fpage>140</fpage><lpage>144</lpage><pub-id pub-id-type="pmid">25991118</pub-id></element-citation></ref><ref id="R13"><label>13</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shah</surname><given-names>AD</given-names></name><name><surname>Martinez</surname><given-names>C</given-names></name><name><surname>Hemingway</surname><given-names>H</given-names></name></person-group><article-title>The freetext matching algorithm: a computer program to extract diagnoses and causes of death from unstructured text in electronic health records</article-title><source>BMC Med Inform Decis Mak</source><volume>12</volume><year>2012</year><fpage>88</fpage><pub-id pub-id-type="pmid">22870911</pub-id></element-citation></ref><ref id="R14"><label>14</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Oluoch</surname><given-names>T</given-names></name><name><surname>N de</surname><given-names>K</given-names></name><name><surname>Kwaro</surname><given-names>D</given-names></name><name><surname>Wattoyi</surname><given-names>I</given-names></name><name><surname>Okeyo</surname><given-names>N</given-names></name><name><surname>Cornet</surname><given-names>R</given-names></name></person-group><article-title>Inconsistencies between recorded opportunistic infections and WHO HIV staging in western Kenya</article-title><source>Stud Health Technol Inform</source><volume>192</volume><year>2013</year><fpage>1139</fpage><pub-id pub-id-type="pmid">23920913</pub-id></element-citation></ref><ref id="R15"><label>15</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Liaw</surname><given-names>ST</given-names></name><name><surname>Taggart</surname><given-names>J</given-names></name><name><surname>Yu</surname><given-names>H</given-names></name><name><surname>Lusignan</surname><given-names>SD</given-names></name><name><surname>Kuziemsky</surname><given-names>C</given-names></name><name><surname>Hayen</surname><given-names>A</given-names></name></person-group><article-title>Integrating electronic health record information to support integrated care: practical application of ontologies to improve the accuracy of diabetes disease registers</article-title><source>J Biomed Inform</source><year>2014</year></element-citation></ref><ref id="R16"><label>16</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bakhshi-Raiez</surname><given-names>F</given-names></name><name><surname>Ahmadian</surname><given-names>L</given-names></name><name><surname>Cornet</surname><given-names>R</given-names></name><name><surname>E de</surname><given-names>J</given-names></name><name><surname>De Keizer</surname><given-names>NF</given-names></name></person-group><article-title>Construction of an interface terminology on SNOMED CT. Generic approach and its application in intensive care</article-title><source>Methods Inf Med</source><volume>49</volume><issue>4</issue><year>2010</year><fpage>349</fpage><lpage>359</lpage><pub-id pub-id-type="pmid">20582384</pub-id></element-citation></ref><ref id="R17"><label>17</label><element-citation publication-type="journal"><collab>Kenyan Ministry of Health</collab><source>Guidelines for Antiretroviral Treatment in Kenya</source><year>2014</year><month>6</month><day>6</day></element-citation></ref><ref id="R18"><label>18</label><element-citation publication-type="web"><collab>International Health Terminologies Standards Development Organization, SNOMED CT</collab><comment>&#x0003c;<ext-link ext-link-type="uri" xlink:href="http://www.ihtsdo.org/snomed-ct/">http://www.ihtsdo.org/snomed-ct/</ext-link>&#x0003e; (accessed 10.10.14)</comment></element-citation></ref><ref id="R19"><label>19</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rosenbloom</surname><given-names>ST</given-names></name><name><surname>Miller</surname><given-names>RA</given-names></name><name><surname>Johnson</surname><given-names>KB</given-names></name><name><surname>Elkin</surname><given-names>PL</given-names></name><name><surname>Brown</surname><given-names>SH</given-names></name></person-group><article-title>Interface terminologies: facilitating direct entry of clinical data into electronic health record systems</article-title><source>J Am Med Inform Assoc</source><volume>13</volume><issue>3</issue><year>2006</year><fpage>277</fpage><lpage>288</lpage><pub-id pub-id-type="pmid">16501181</pub-id></element-citation></ref><ref id="R20"><label>20</label><element-citation publication-type="web"><collab>Clinic Information Consultancy Ltd</collab><source>CliniClue Xplore, CliniClue Xplore</source><comment>&#x0003c;<ext-link ext-link-type="uri" xlink:href="http://www.cliniclue.com/cliniclue_xplore">http://www.cliniclue.com/cliniclue_xplore</ext-link>&#x0003e; (10.10.14)</comment></element-citation></ref><ref id="R21"><label>21</label><element-citation publication-type="web"><collab>NICTIZ, Terminologiecentrum Nictiz, NICTIZ</collab><comment>&#x0003c;<ext-link ext-link-type="uri" xlink:href="http://terminologie.nictiz.nl/art-decor/snomed-ct">http://terminologie.nictiz.nl/art-decor/snomed-ct</ext-link>&#x0003e; (10.10.14).</comment></element-citation></ref><ref id="R22"><label>22</label><note><p>US Centers for Disease Control and Prevention, Accenture, Unpublished List of AIDS Defining Illnesses, 6-6-2012.</p></note></ref><ref id="R23"><label>23</label><element-citation publication-type="web"><collab>US Centers for Disease Control and Prevention, Definition of Oropharyngeal Candidiasis</collab><comment>&#x0003c;<ext-link ext-link-type="uri" xlink:href="http://www.cdc.gov/fungal/diseases/candidiasis/thrush/">http://www.cdc.gov/fungal/diseases/candidiasis/thrush/</ext-link>&#x0003e; (10.10.14)</comment></element-citation></ref><ref id="R24"><label>24</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rosenbloom</surname><given-names>ST</given-names></name><name><surname>Brown</surname><given-names>SH</given-names></name><name><surname>Froehling</surname><given-names>D</given-names></name><name><surname>Bauer</surname><given-names>BA</given-names></name><name><surname>Wahner-Roedler</surname><given-names>DL</given-names></name><name><surname>Gregg</surname><given-names>WM</given-names></name><etal/></person-group><article-title>Using SNOMED CT to represent two interface terminologies</article-title><source>J Am Med Inform Assoc</source><volume>16</volume><issue>1</issue><year>2009</year><fpage>81</fpage><lpage>88</lpage><pub-id pub-id-type="pmid">18952944</pub-id></element-citation></ref></ref-list></back><floats-group><fig id="F1" orientation="portrait" position="float"><label>Fig. 1</label><caption><p>Derivation of terms and concepts used to describe ADI from concept-based and term-based sources.</p></caption><graphic xlink:href="nihms807744f1"/></fig><fig id="F2" orientation="portrait" position="float"><label>Fig. 2</label><caption><p>A screen-shot of a data entry form using ADI reference set.</p></caption><graphic xlink:href="nihms807744f2"/></fig></floats-group></article>