Online J Public Health InformOnline J Public Health InformOJPHIOnline Journal of Public Health Informatics1947-2579University of Illinois at Chicago Library263928504576438ojphi-07-e22010.5210/ojphi.v7i2.5859Research ArticleCoding of Electronic Laboratory Reports for Biosurveillance, Selected United States Hospitals, 2011DhakalSanjaya 1 * BurrerSherry L. 2 WinstonCarla A. 3 DeyAchintya 1 AjaniUmed 1 GrosecloseSamuel L. 4 Division of Health Informatics and Surveillance, Center for Surveillance, Epidemiology and Laboratory Services, Office of Public Health Scientific ServicesDivision of Environmental Hazards and Health Effects, Injury and Environmental Health, National Center for Environmental Health, Office of Non-communicable DiseasesVeterans Health Administration, Office of Public Health, Office of Public Health Surveillance and Research, U.S. Department of Veterans AffairsOffice of Science and Public Health Practice, Office of Public Health Preparedness and ResponseCorresponding Author: hgj2@cdc.gov0172015201572e220Copyright Statement for OJPHI: This is an Open Access article. Authors own copyright of their articles appearing in the Online Journal of Public Health Informatics. Readers may copy articles without permission of the copyright owner(s), as long as the author and OJPHI are acknowledged in the copy and the copy is used for educational, not-for-profit purposes.20152015 the author(s)

Objective

Electronic laboratory reporting has been promoted as a public health priority. The Office of the U.S. National Coordinator for Health Information Technology has endorsed two coding systems: Logical Observation Identifiers Names and Codes (LOINC) for laboratory test orders and Systemized Nomenclature of Medicine-Clinical Terms (SNOMED CT) for test results.

Materials and Methods

We examined LOINC and SNOMED CT code use in electronic laboratory data reported in 2011 by 63 non-federal hospitals to BioSense electronic syndromic surveillance system. We analyzed the frequencies, characteristics, and code concepts of test orders and results.

Results

A total of 14,028,774 laboratory test orders or results were reported. No test orders used SNOMED CT codes. To describe test orders, 77% used a LOINC code, 17% had no value, and 6% had a non-informative value, “OTH”. Thirty-three percent (33%) of test results had missing or non-informative codes. For test results with at least one informative value, 91.8% had only LOINC codes, 0.7% had only SNOMED codes, and 7.4% had both. Of 108 SNOMED CT codes reported without LOINC codes, 45% could be matched to at least one LOINC code.

Conclusion

Missing or non-informative codes comprised almost a quarter of laboratory test orders and a third of test results reported to BioSense by non-federal hospitals. Use of LOINC codes for laboratory test results was more common than use of SNOMED CT. Complete and standardized coding could improve the usefulness of laboratory data for public health surveillance and response.

Logical Observation Identifiers Names and Codes (LOINC)Systemized Nomenclature of Medicine Clinical Terms (SNOMED CT)electronic laboratory reportcomputerized medical record systemsbiosurveillance
Introduction

Because Electronic Laboratory Reporting (ELR) has been seen to be more accurate, timely, and cost-effective than reporting by other conventional means (e.g., mail, fax, etc.), ELR adoption has been systematically promoted as a public health priority [1-7]. A major deterrent to laboratory data being used in public health research and biosurveillance programs seems to be the lack of interoperability of automated laboratory information management systems [8-12]. Standardized, universal coding that records laboratory test order and result information in a structured and systematic fashion is an essential component of interoperable ELR systems [9,13,14]. The use of local codes or terminology and unstructured text fields to describe laboratory test orders and results varies widely among laboratories [15,16]. Several coding strategies are available to make electronic laboratory data more computational and thus readily interchangeable electronically. Long established coding systems such as International Classification of Diseases (ICD) and Current Procedural Terminology (CPT) are used for insurance reimbursement and other administrative purposes. ICD codes are primarily designed for classifying diseases and other health conditions while CPT is designed to record a medical service or a procedure. Therefore, coding laboratory information is out of scope for ICD and CPT coding systems. Several coding strategies are available to make electronic laboratory data more computational and thus readily interchangeable electronically; Logical Observation Identifiers Names and Codes (LOINC) and Systemized Nomenclature of Medicine Clinical Terms (SNOMED CT) are the two most comprehensive coding systems representing lab test type and result information.

Therefore, these two information coding systems were specifically recommended for use in coding laboratory information in electronic health records by the U.S. Department of Health and Human Services Office of National Coordinator for Health Information Technology

Established in 1994, LOINC is a coding system designed to identify medical laboratory observations and procedures. LOINC covers both laboratory tests and clinical observations enabling coding of test orders and test results. The system has been endorsed by the American Clinical Laboratory Association and the College of American Pathologists. A LOINC code is composed of six attributes that characterize the details of laboratory test orders and results, namely: component (e.g., Escherichia coli, potassium), property (e.g., arbitrary concentration, mass concentration), timing (e.g., point in time, over a span of time), system (e.g., stool, blood), scale (e.g., ordinal, nominal), and method (e.g., culture, microscopy). The most recent version of the LOINC database contains more than 70,000 codes [17-22]. LOINC codes are updated twice a year to reflect changes in diagnostic practices over time.

Established in 1965, SNOMED CT is a coding system designed to identify anatomic and clinical pathology information and laboratory results. The system is a collection of medical terms, codes, findings and procedures. A SNOMED CT code is composed of the following three attributes; unique concepts (e.g., E. coli), concept descriptions (e.g., is a), and relationships between concepts (e.g., bacteria present in stool). The system is updated twice a year and currently includes over 300,000 unique concepts [23]. SNOMED CT is the ontological basis of the upcoming International Classification of Diseases 11th Edition (ICD-11) revision spearheaded by the World Health Organization [24,25].

Objective

We examined the use of LOINC and SNOMED CT codes for coding laboratory test orders and results in laboratory reports transmitted to BioSense program from 63 non-federal hospitals in the calendar year 2011. In this report, we present the first national level description of the use of LOINC and SNOMED CT codes from biosurveillance data to characterize laboratory test orders and results reported by hospital-based laboratories.

Materials and Methods

BioSense is a syndromic surveillance system supported by the U.S. Centers for Disease Control and Prevention (CDC), and it receives daily medical encounter data from participating hospitals. During 2011, 11% of participating non-federal hospitals also shared laboratory data with BioSense [26,27]. Details of the data transmission from hospitals to CDC’s BioSense program have been previously described [28-30]. In brief, data reporting standards follow guidance from the Public Health Information Network Messaging System’s (PHINMS) syndromic surveillance message guide and are transmitted securely via digital certificates and data encryption [31]. The laboratory reports included in this analysis were transmitted using version 2.3.1 of Health Level 7 (HL7) message formats. All laboratory reports from non-federal hospitals reporting to BioSense from January 1, 2011 through December 31, 2011 were extracted from HL7 messages and converted to SAS analytic data files. Reports included laboratory test orders only, test orders with results, and results only.

Data elements in each laboratory message can be broadly categorized into three sections: 1) administrative data elements, 2) laboratory test order related data elements, and 3) laboratory result related data elements. Administrative data elements include date of visit, type of service facility, testing laboratory ID, and date of HL7 message creation. Laboratory test order data elements include order number, order test name, order test codes (local and “standard”), order test coding system, and segments of coding structure. Laboratory result data elements are grouped into two categories: observation identifier (OBR) and observation value (OBX). Elements of OBR include observation result code, observation result coding system, local observation result code, observation result text (local and “standard”), and observation result type. Elements of OBX include result coding system, result test code (local and “standard”), result status, result notes, result test date, result test name (local and “standard”), result unit, test interpretation, and details of the sample to be tested (component, property, timing, system, scale, method). Additionally, BioSense laboratory message data include site and type of the specimen, diagnostic criteria, and test sequence number.

Each laboratory test result with result code was categorized into one of six result status categories, namely: “final result”, “preliminary result”, “specimen in the laboratory”, “correction”, “deletes OBX record”, and “result can’t be obtained for this observation”. Since results identified as “preliminary” constituted almost one-third of all laboratory results reported we analyzed all reported results regardless of their status. Later we compared our analysis with findings from a separate review limited to “final” results.

We analyzed the frequency distribution of laboratory test orders and results to determine characteristics of the test orders and results reported, and to examine the 25 most common test orders and results. Unique LOINC or SNOMED CT codes used in the reports were identified, along with the percentage of reports that were missing a standardized code. For each of the SNOMED CT codes reported without corresponding LOINC codes, we used the Public Health Information Network Vocabulary Access and Distribution System (https://phinvads.cdc.gov) web sites to obtain the SNOMED CT concept or descriptive text. Then each concept was searched in Regenestrief LOINC Mapping Assistant (RELMA®) software version 5.8, to determine if there was a LOINC code that might corresponded to the SNOMED CT concept. Since the value “OTH” in HL7 messages does not clearly indicate a specific laboratory test order or results, rather it indicates concepts not represented by the code system; we treated reports coded with “OTH” as non-informative data. This analysis was determined to be a public health surveillance activity rather than human subject research requiring institutional board review.

Results

Out of 569 non-federal hospitals reporting data to BioSense in 2011, 63 (11.1%) hospitals in 14 states submitted 14,028,774 laboratory reports (test orders and/ or results) from 821,108 unique laboratory visits. On average, 38,000 laboratory reports were reported daily. In the reports with at least one result code, the hospital diagnostic service ordering the test was categorized into five groups: microbiology (94.7%), serology (2.8%), outside laboratory (1.7%), virology (0.5%), and immunology (0.4%).The reports consisted of final (68.7%), preliminary (31.0%), specimen in the lab (0.2%) and corrected (0.1%) result status (Table 1).

Characteristics of hospital-based laboratory data reported to BioSense, 2011
Characteristics N (%)
Number of reporting hospital laboratories 63 (100)
Number of unique laboratory visits 821,108 (100)
Number of laboratory reports (test orders or test results)          LOINC order codes          Non-informative order codes (missing or HL7 null code “OTH”)14,028,774 (100)10,776,494 (76.8)3,252,280 (23.2)
Number of laboratory reports with test results code          LOINC or SNOMED CT or both result codes          Non-informative codes (both missing or one missing and the other is HL7 null code “OTH”)9,347,179 (66.6)4,681,595 (33.4)
Number of test results with code by code system          LOINC codes only          SNOMED CT codes only          LOINC and SNOMED CT both9,347,179 (100)8,584,826 (91.8)69,566 (0.7)692,787 (7.4)
Number of unique LOINC codes for orders 805 (100)
Number of unique codes for results          SNOMED CT codes          LOINC codes608 (100)1,428 (100)
Test result status          Final result          Preliminary result          Specimen in lab          Correction          Deletes observation value (OBX) record*          Result can’t be obtained for this observation9,347,179 (100)6,420,538 (68.7)2,898,975 (31.0)18,739 (0.2)7,011 (0.1)331 (0.0)7 (0.0)
Diagnostic services          Microbiology          Serology          Outside Laboratory          Virology          Immunology9,347,179 (100)8,849,051 (94.7) 258740 (2.8) 161,561 (1.7)42,974 (0.5)34,853 (0.4)

Among the 14,028,774 laboratory test reports, 76.8% had LOINC order codes, while for the rest either the codes were missing (16.8%) or had the HL7 null code, “OTH” (6.4%). No test orders were reported using a SNOMED CT code. Out of 10,776,494 laboratory test orders with LOINC codes, 9,347,179 (86.7%) also had either LOINC or SNOMED CT or both codes for the test result.

Of all laboratory reports, 9,347,179 (66.6%) had at least one result code (LOINC or SNOMED CT or both); of these, 91.8% had only LOINC codes, 0.7% had only SNOMED CT codes while 7.4% had both codes (Table 1). Of the remaining 4,681,595 laboratory reports, 63.4% were missing a SNOMED or LOINC result code with “OTH” reported as a result value while 36.6% had neither LOINC nor SNOMED codes for the results. Laboratory test results with “final” status comprised the majority (68.7%) of all laboratory reports with result codes (Table 1) Findings from the analysis comparing results with “final” status to all results were comparable except that the number of laboratory test results with only LOINC codes differed (91.8% in all messages versus 61.4% in only “final” result messages). This suggests that results reported as “preliminary” were not updated when result status changed to “final”.

For test orders, 805 unique LOINC codes were used. After excluding “OTH” and missing, values, LOINC codes to identify bacteria in blood (35.0%), urine (15.2%), respiratory specimens (4.8%), or wounds (4.2%), and to test antibiotic susceptibilities by agar diffusion (3.0%), were the five most frequent laboratory orders reported (Table 2). Fourteen hundred twenty eight unique LOINC and 608 unique SNOMED CT codes were used to describe laboratory test results. For results with LOINC codes, the five most commonly reported tests were: bacteria identified by blood culture (12.2%), microscopic observation of unspecified specimen by Gram stain (8.9%), appearance of unspecified specimen (7.6%), microorganism identified in unspecified specimen by culture (7.5%), and bacteria identified by urine culture (6.6%)(Table 3a). For results with SNOMED CT codes, a qualifier for antimicrobial susceptibility (10.4%), Escherichia coli (10.4%), a qualifier for bacterial sensitivity (9.9%), Staphylococcus aureus (9.7%), and a qualifier for non-reactive status (6.5%) were the five most frequent codes (Table 3b).

<bold>Twenty five most common hospital-based laboratory order test types reported to BioSense, 2011, with Logical Observation Identifiers Names and Codes</bold> (<bold>LOINC) codes</bold>
LOINC Test Name LOINC Code Test Orders N (%)
Bacteria identified (Blood)600-73770050 (35.0)
Bacteria identified (Urine)630-41637400 (15.2)
Bacteria identified- Respiratory culture32355-0522495 (4.8)
Bacteria identified- Wound culture6462-6459784 (4.3)
Antibiotic- Agar diffusion45187-2328113 (3.0)
Fungus Identified- Culture580-1291370 (2.7)
Mycobacterium sp identified543-9284631 (2.6)
Bacteria identified (Anaerobic+Aerobic)- Culture21020-3283577 (2.6)
Staphylococcus aureus methicillin resistant isolate- Culture13317-3207718 (1.9)
Bacteria identified- Body fluid culture611-4186589 (1.7)
Microscopic observation- Wet preparation680-9174113 (1.6)
Bacteria identified- Stool culture625-4159657 (1.5)
Chlamydia trachomatis + Neisseriagonorrhoeae- Probe36902-5155606 (1.4)
Bacteria identified- Aerobic culture (Wound)632-0145213 (1.3)
Bacteria identified- CSF culture606-4139418 (1.3)
Bacteria identified (Anaerobic)- Culture635-3112496 (1.0)
Bacteria identified (Aerobic)- Culture634-692773 (0.9)
Streptococcus pyogenes Ag – EIA6558-189173 (0.8)
Microscopic observation (Gram Stain)664-381129 (0.8)
Bacteria identified- Culture (system- xxx)6463-467118 (0.6)
Antibiotic- Minimum inhibitory concentration21070-858891 (0.5)
Bacteria identified- Culture43408-457084 (0.5)
Bacteria identified (Sputum)- Respiratory culture624-756906 (0.5)
Clostridium difficile toxin A+B (Stool)34713-855567 (0.5)
Bacteria identified- Throat culture626-250977 (0.5)
<bold>Twenty five most common hospital-based laboratory result types reported to BioSense, 2011, with Logical Observation Identifiers Names and Codes</bold> (<bold>LOINC) codes</bold>
LOINC Long Name LOINC Code Test Results N (%)
Bacteria identified in blood by culture600-71128381(12.2)
Microscopic observation in unspecified specimen by gram stain664-3823440 (8.9)
Appearance of unspecified specimen33511-7707650 (7.6)
Microorganism Identified in unspecified specimen by culture11475-1696652 (7.5)
Bacteria identified in urine by culture630-4611553 (6.6)
Specimen Source of unspecified specimen31208-2532232 (5.7)
Bacteria identified in unspecified specimen41741-0*271916 (2.9)
Service comment#8251-1176943 (1.9)
Bacteria identified in unspecified specimen by respiratory culture32355-0148069 (1.6)
Fungus identified in unspecified specimen by culture580-1140800 (1.5)
Bacteria identified in blood by aerobe culture17928-3127807 (1.4)
Microscopic observation in unspecified specimen by other stain11546-9115486 (1.2)
Bacteria identified in wound by aerobe culture632-0110500 (1.2)
Microorganism or agent Identified in unspecified specimen41852-5107766 (1.2)
Mycobacterium SP Identified in unspecified specimen by culture543-9106956 (1.2)
Bacteria identified in wound by culture6462-6103717 (1.1)
Bacteria identified in blood by anaerobe culture17934-198539 (1.1)
Microscopic observation in wound by Gram stain10357-298288 (1.1)
Microscopic observation in unspecified specimen by wet preparation680-993901(1.0)
Gentamycin susceptibility18928-275789 (0.8)
Microscopic observation in unspecified specimen by acid fast stain11545-170546 (0.8)
Trimethoprim + Sulfamethoxazole susceptibility18998-568972 (0.7)
Microorganism identified in stool by culture625-464295 (0.7)
Levofloxacin susceptibility20629-260212 (0.7)
Ciprofloxacin susceptibility:18906-851448 (0.6)

*- LOINC code 41741-0 has been deprecated and superseded by LOINC code 23667-9.

#- LOINC code for Service Comment terms indicates user-defined text.

<bold>Twenty five most common hospital-based laboratory results types reported to BioSense, 2011, with Systemized Nomenclature of Medicine Clinical Terms</bold> (<bold>SNOMED CT) codes</bold>
Observation Identifier (OBS) Text SNOMEDCT Code Test Results N (%)
Susceptible13119600979465 (10.4)
Escherichia coli 11228300779255 (10.4)
Sensitive8318500575142 (9.9)
Staphylococcus aureus 309200874216 (9.7)
Non-Reactive13119400749852 (6.5)
Resistant3071400644504 (5.8)
None*26041300739924 (5.2)
Pseudomonas aeruginosa 5249900430555 (4.0)
Gram-negative bacillus8717200818016 (2.4)
Leukocyte5250100717678 (2.3)
Staphylococcus, coagulase negative11619700816094 (2.1)
Proteus mirabilis 7345700814522 (1.9)
Reactive1121400613693 (1.8)
Klebsiella pneumoniae 5641500813446 (1.8)
Staphylococcus epidermidis 6087500113182 (1.7)
Enterococcus fecalis 7806500212610 (1.7)
Klebsiella pneumonia ss. pneumoniae184000029681 (1.3)
Yeast620930058457 (1.1)
Enterococcus species1312970077733 (1.0)
Enterobacter cloacae 143850026794 (0.9)
Enterococcus 27850005720 (0.8)
Candida albicans 533260055446 (0.7)
No organism seen278630085139 (0.7)
Staphylococcus species1164990014362 (0.6)
Stenotrophomonas maltophilia 1136970024342 (0.6)
Streptococcus agalactiae 434920074113 (0.5)

*- “None” is a SNOMED CT qualifier value for “absence findings”

Among the 608 unique SNOMED CT codes used to report laboratory test results, 498 (81.9%) had corresponding LOINC codes reported. For the 108 SNOMED codes that did not have corresponding LOINC codes in the reported laboratory results, we found that 49 (45.4%) of the SNOMED CT concepts could be associated with at least one LOINC code. The majority of SNOMED CT concepts matched to LOINC (47 of 49) were microorganism related, while one was an anatomical structure (urethra) and one was a system concept (blood). Among 49 SNOMED CT concepts that matched to LOINC codes, 27 concepts matched to more than one LOINC code, depending on other LOINC components including property, timing, system, scale, and method. Among 59 SNOMED CT concepts not identified in mapping to LOINC codes, 47 were for microorganisms, seven were for qualifiers, three were for anatomical structures, and two were for systems.

Discussion

The hospitals included in our study used LOINC as the coding system to record laboratory test orders. Laboratory test results were coded using both LOINC and SNOMED CT coding systems, though, the use of LOINC was much more common. Our findings indicate that participating hospital laboratories undertook reporting of laboratory test orders and results as recommended in ELR HL7 messaging guidance [32]. However, missing or non-informative codes comprised almost a quarter of laboratory test orders and a third of test results from hospitals reporting to BioSense in 2011.

By design, the primary objectives of BioSense program were to monitor clinical syndromes related to infectious diseases for early outbreak detection and ongoing situational awareness [27-29]. Therefore, Biosense recommended that participating hospitals preferentially report laboratory information related to infectious diseases. As a result, the majority of the laboratory reports in this analysis were microbiology related. We examined both test orders and preliminary and final test results. Monitoring laboratory test orders could provide early warning signals of suspicion of infectious disease, while monitoring results could contribute to biosurveillance by providing increased diagnostic specificity to automated syndromic case definition algorithms based on chief complaint text fields [26,33-35]. Laboratory data could also be used to evaluate interventions, and to monitor disease trends and progression, which might result in timely more effective outbreak response and management [1,13].

In ELR reporting, the debate over the definition of “questions” (orders) and “answers” (results) is far from over. It has been suggested that LOINC is used for coding laboratory “questions” while SNOMED CT is used for coding the “answers”. [22] Laboratory reports from hospitals in our analysis indicate that LOINC codes are used to code laboratory orders as well as results, illustrating LOINC’s potential to provide codes for “questions” as well as “answers”. On the other hand, there may be unique situations where a SNOMED CT code is required in combination with a LOINC code to fully represent a lab test result. For example, the SNOMED CT system allows coding for certain clinical structures (cervix, urethra), and for certain conditions (e.g., hyperbilirubinemia), that are currently not accounted for in the LOINC system.

Several earlier reports have suggested different mapping strategies to associate laboratory codes to diseases or health conditions [20,36-41]. Our findings suggest that the BioSense surveillance program might be able to focus on a small subset of LOINC and SNOMED CT codes related to diseases or syndromes of interest, as evidenced by the use of a relatively small number of unique LOINC (n= 1,428) and SNOMED CT (n= 608) codes in the data we analyzed compared to the number of codes available. To determine if laboratory data improves syndromic surveillance performance for enhanced outbreak detection and improved situational awareness, an evaluation of syndromic case definitions that incorporate laboratory test order or result information is required.

Some limitations in interpreting our findings should be noted. Non-federal hospitals who participated in BioSense are not a representative sample of all the U.S. hospitals. Use of the convenience sample of facilities that are able and willing to share electronic laboratory data with CDC may limit the generalizability of our findings. Furthermore, laboratory data in this analysis were primarily collected for infectious disease syndromic surveillance purposes. Therefore our findings may not be representative of the use of LOINC and SNOMED CT codes for ELR for all hospital laboratory testing. Completeness of ELR data in BioSense has not been validated prior to this study, which shows that one-third of electronic laboratory records are missing standardized codes or are coded as HL7 null “OTH” for result information that would be necessary for interpretation for surveillance. We are unable to report specific accuracy metrics such as specificity or sensitivity related to LOINC and SNOMED CT due to lack of a reference “gold standard”.

The current analysis has several important strengths, beginning with computability of the coded laboratory test order and result information in the HL7 messaging format that supports automated categorization for surveillance. Consequently, we were able to merge data files from different hospitals to create one large laboratory data repository and apply standard criteria that could potentially augment information from other surveillance data sources. Laboratory reports in this analysis derived from local hospitals illustrate the potential value of standardizing laboratory data to provide timely information to hospital based infection preventionists and local health departments for situation awareness and early response, as well as contributing to national biosurveillance. Most importantly this study adds value to existing scientific knowledge by describing the use of LOINC and SNOMED CT codes in ELR contributed by select U.S. hospitals as healthcare organizations move towards implementing Meaningful Use and health information exchange [42,43].

Conclusion

We analyzed more than 14 million laboratory reports from non-federal hospital to assess the use of two structured coding systems, SNOMED CT and LOINC. The LOINC system was used more commonly than SNOMED system in the hospitals studied. Missing data and differences in representing laboratory test orders and results may inhibit effective analysis of electronic laboratory data. Increased completeness of coded lab data, data management tools that translate locally coded laboratory test information into LOINC or SNOMED CT codes, and increased participation of hospitals laboratories are needed to fully realize the value of laboratory data in public health practice and syndromic surveillance.

Disclaimer: The findings and conclusions in this article ate those of the authors and do not represent the official position of the Centers for Disease Control and Prevention or the Department of Veterans Affairs.

Acknowledgments

We are thankful to all non-federal hospitals participating in the BioSense Program that contributed laboratory data used in this manuscript.

Contributorship Statement:

SD, SB, CW and SG contributed equally in conceptualizing, analyzing, and interpreting data. SD drafted the manuscript. All authors including AD, UA contributed in revising it critically for important intellectual content of the paper. All authors have approved the final version of the paper submitted for publication.

There are no competing interests

No external funding was received for this project.

There are no additional published or unpublished data available from the study.

References:Kite-PowellAH. 2008. J J; Hopkins, R S. Potential effects of electronic laboratory reporting on improving timeliness of infectious disease notification--Florida, 2002-2006. MMWR Morb Mortal Wkly Rep. 57, 1325-28.19078921MooreKMReddyVKapellDBalterS. 2008. Impact of electronic laboratory reporting on hepatitis A surveillance in New York City. J Public Health Manag Pract. 14, 437-41. 10.1097/01.PHH.0000333877.78443.f018708886OverhageJMGrannisSMcDonaldCJ. 2008. A comparison of the completeness and timeliness of automated electronic laboratory reporting and spontaneous reporting of notifiable conditions. Am J Public Health. 98, 344-50. 10.2105/AJPH.2006.09270018172157EfflerPChing-LeeMBogardAIeongMCNekomotoT 1999. Statewide system of electronic notifiable disease reporting from clinical laboratories: comparing automated reporting with conventional methods. JAMA. 282, 1845-50. 10.1001/jama.282.19.184510573276SahmDFCritchleyIAKellyLJ 2001. Evaluation of current activities of fluoroquinolones against gram-negative bacilli using centralized in vitro testing and electronic surveillance. Antimicrob Agents Chemother. 45, 267-74. 10.1128/AAC.45.1.267-274.200111120976SternLLightfootD. 1999. Automated outbreak detection: a quantitative retrospective analysis. Epidemiol Infect. 122, 103-10. 10.1017/S095026889800193910098792PanackalAAM'IkanathaNMTsuiFC 2002. Automatic electronic laboratory-based reporting of notifiable infectious diseases at a large health system. Emerg Infect Dis. 8, 685-91. 10.3201/eid0807.01049312095435OverhageJMSuicoJMcDonaldCJ. 2001. Electronic laboratory reporting: barriers, solutions and findings. J Public Health Manag Pract. 7, 60-66. 10.1097/00124784-200107060-0000711713754LazoRLiWMeigsM 2006. The APHL/CDC Public Health Laboratory Interoperability Project Portal: a web-based collaborative tool to establish a national harmonized vocabulary for public health data exchange. AMIA Annu Symp Proc. 2006, 999.17238618MillerRHSimI. 2004. Physicians' use of electronic medical records: barriers and solutions. Health Aff (Millwood). 23, 116-26. 10.1377/hlthaff.23.2.11615046136McDonaldCJ. 1997. The barriers to electronic medical record systems and how to overcome them. J Am Med Inform Assoc. 4, 213-21. 10.1136/jamia.1997.00402139147340McGinnCAGagnonMPShawN 2012. Users' perspectives of key factors to implementing electronic health records in Canada: a Delphi study. BMC Med Inform Decis Mak. 12, 105. 10.1186/1472-6947-12-10522967231CDC. Electronic reporting of laboratory data for public health: meeting report and recommendations. Atlanta, GA: Centers for Disease Control and Prevention; 1997.JerniganDB. 2001. Electronic laboratory-based reporting: opportunities and challenges for surveillance. Emerg Infect Dis. 7, 538. 10.3201/eid0707.01771711485655BoonstraABroekhuisM. 2010. Barriers to the acceptance of electronic medical records by physicians from systematic review to taxonomy and interventions. BMC Health Serv Res. 10, 231. 10.1186/1472-6963-10-23120691097Dixon BE, McGowan JJ, Grannis SJ. Electronic laboratory data quality and the value of a health information exchange to support public health reporting processes. AMIA Annu Symp Proc 2011;2011:322-30.ForreyAWMcDonaldCJDeMoorG 1996. Logical observation identifier names and codes (LOINC) database: a public use set of codes and names for electronic reporting of clinical laboratory test results. Clin Chem. 42, 81-90.8565239HuffSMRochaRAMcDonaldCJ 1998. Development of the Logical Observation Identifier Names and Codes (LOINC) vocabulary. J Am Med Inform Assoc. 5, 276-92. 10.1136/jamia.1998.00502769609498KhanANGriffithSPMooreCRussellDRosarioACJr 2006. Standardizing laboratory data by mapping to LOINC. J Am Med Inform Assoc. 13, 353-55. 10.1197/jamia.M193516501183KimHEl-KarehRGoelAVineetFNUChapmanWW. 2012. An approach to improve LOINC mapping through augmentation of local test names. J Biomed Inform. 45, 651-57. 10.1016/j.jbi.2011.12.00422210167LinMCVreemanDJMcDonaldCJHuffSM. 2011. A characterization of local LOINC mapping for laboratory tests in three large institutions. Methods Inf Med. 50, 105-14. 10.3414/ME09-01-007220725694McDonaldCJHuffSMSuicoJG 2003. LOINC, a universal standard for identifying laboratory observations: a 5-year update. Clin Chem. 49, 624-33. 10.1373/49.4.62412651816CornetRde KeizerN. 2008. Forty years of SNOMED: a literature review. BMC Med Inform Decis Mak. 8(Suppl 1), S2. 10.1186/1472-6947-8-S1-S219007439RodriguesJMKumarABousquetCTrombertB. 2009. Using the CEN/ISO standard for categorial structure to harmonise the development of WHO international terminologies. Stud Health Technol Inform. 150, 255-59.19745309MasseyKAAnserminoJMvon DadelszenPMorrisTJListonRM 2009. What is SNOMED CT® and Why Should the ISSHP Care? Hypertens Pregnancy. 28, 119-21. 10.1080/1064195080260129419165676AsatryanABenoitSMaHEnglishRElkinP 2011. Detection of pneumonia using free-text radiology reports in the BioSense system. Int J Med Inform. 80, 67-73. 10.1016/j.ijmedinf.2010.10.01321093355BenoitSRBurkomHMcIntyreAF 2012. Pneumonia in US hospitalized patients with influenza-like illness: BioSense, 2007-2010. Epidemiol Infect. 141(4), 1-11.23046921BradleyCARolkaHWalkerDLoonskJ. 2005. BioSense: implementation of a national early event detection and situational awareness system. MMWR Morb Mortal Wkly Rep. 54(Suppl), 11-19.16177687LoonskJW. 2004. BioSense--a national initiative for early detection and quantification of public health emergencies. MMWR Morb Mortal Wkly Rep. 53(Suppl), 53-55.15714629TokarsJIEnglishRMcMurrayPRhodesB. 2010. Summary of data reported to CDC's national automated biosurveillance system, 2008. BMC Med Inform Decis Mak. 10, 30. 10.1186/1472-6947-10-3020500863CDC. PHIN Messaging Guide for Syndromic Surveillance. CDC; 2011.HL7 Version 2.5.1 Implementation guide: orders and observations; interoperable laboratory result reporting to EHR (US Realm), Release 1. Office of National Coordinator (ONC); 2007.Public Health Systems and Emerging Infections: Assessing the Capabilities of the Public and Private Sectors: Workshop Summary. In: Davis JR, Lederberg J, eds. Public Health Systems and Emerging Infections: Assessing the Capabilities of the Public and Private Sectors: Workshop Summary. Washington (DC)2000.BenoitSRMcDonaldLCEnglishRTokarsJI. 2011. Automated surveillance of Clostridium difficile infections using BioSense. Infect Control Hosp Epidemiol. 32, 26-33. 10.1086/65763321128815BravataDMMcDonaldKMSmithWM 2004. Systematic review: surveillance systems for early detection of bioterrorism-related diseases. Ann Intern Med. 140, 910-22. 10.7326/0003-4819-140-11-200406010-0001315172906AbhyankarSDemner-FushmanDMcDonaldCJ. 2012. Standardizing clinical laboratory data for secondary use. J Biomed Inform. 45, 642-50. 10.1016/j.jbi.2012.04.01222561944Fidahussein M, Friedlin J, Grannis S. Practical challenges in the secondary use of real-world data: the notifiable condition detector. AMIA Annu Symp Proc 2011;2011:402-8.Gamache RE, Dixon BE, Grannis S, Vreeman DJ. Impact of selective mapping strategies on automated laboratory result notification to public health authorities. AMIA Annu Symp Proc 2012;2012:228-36.SimpsonCRAnandanCFischbacherCLefevreKSheikhA. 2007. Will Systematized Nomenclature of Medicine-Clinical Terms improve our understanding of the disease burden posed by allergic disorders? Clin Exp Allergy. 37, 1586-93. 10.1111/j.1365-2222.2007.02830.x17883425VreemanDJMcDonaldCJ. 2006. A comparison of intelligent mapper and document similarity scores for mapping local radiology terms to LOINC. AMIA Annu Symp Proc. 2006, 809-13.17238453ZunnerCBurkleTProkoschHUGanslandtT. 2012. Mapping local laboratory interface terms to LOINC at a German university hospital using RELMA V.5: a semi-automated approach. J Am Med Inform Assoc.22802268MedicareCMS. and Medicaid programs; electronic health record incentive program--stage 2. Final rule. Fed Regist 2012;77:53967-4162.229461382012. Office of the National Coordinator for Health Information T. Health information technology: revisions to the 2014 edition electronic health record certification criteria; and Medicare and Medicaid programs; revisions to the Electronic Health Record Incentive Program. Interim final rule with comment period. Fed Regist. 77, 72985-91.23227573