<!DOCTYPE article
PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD with MathML3 v1.2 20190208//EN" "JATS-archivearticle1-mathml3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article"><?properties manuscript?><front><journal-meta><journal-id journal-id-type="nlm-journal-id">9505213</journal-id><journal-id journal-id-type="pubmed-jr-id">21279</journal-id><journal-id journal-id-type="nlm-ta">J Public Health Manag Pract</journal-id><journal-id journal-id-type="iso-abbrev">J Public Health Manag Pract</journal-id><journal-title-group><journal-title>Journal of public health management and practice : JPHMP</journal-title></journal-title-group><issn pub-type="ppub">1078-4659</issn><issn pub-type="epub">1550-5022</issn></journal-meta><article-meta><article-id pub-id-type="pmid">31765350</article-id><article-id pub-id-type="pmc">6956845</article-id><article-id pub-id-type="doi">10.1097/PHH.0000000000000897</article-id><article-id pub-id-type="manuscript">HHSPA1065421</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>Assessing the Burden of Neonatal Abstinence Syndrome: Validation of <italic>ICD-9-CM</italic> Data, Florida, 2010-2011</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Phillips-Bell</surname><given-names>Ghasi S.</given-names></name><degrees>ScD, MS</degrees><aff id="A1">Division of Reproductive Health, National Center for Chronic Disease Prevention and Health Promotion, Atlanta, Georgia</aff><aff id="A2">Division of Community Health Promotion, Florida Department of Health, Tallahassee, Florida</aff></contrib><contrib contrib-type="author"><name><surname>Holicky</surname><given-names>Abigail</given-names></name><degrees>MPH</degrees><aff id="A3">Division of Community Health Promotion, Florida Department of Health, Tallahassee, Florida</aff><aff id="A4">Centers for Disease Control and Prevention/Council of State and Territorial Epidemiologists Applied Epidemiology Fellowship, Atlanta, Georgia</aff></contrib><contrib contrib-type="author"><name><surname>Lind</surname><given-names>Jennifer N.</given-names></name><degrees>PharmD, MPH</degrees><aff id="A5">Division of Congenital and Developmental Disorders, National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention, Atlanta, Georgia</aff></contrib><contrib contrib-type="author"><name><surname>Sappenfield</surname><given-names>William M.</given-names></name><degrees>MD</degrees><aff id="A6">Department of Community and Family Health, The Chiles Center, College of Public Health, University of South Florida, Tampa, Florida</aff></contrib><contrib contrib-type="author"><name><surname>Hudak</surname><given-names>Mark L.</given-names></name><degrees>MD</degrees><aff id="A7">Department of Pediatrics, University of Florida College of Medicine&#x02014;Jacksonville, Jacksonville, Florida</aff></contrib><contrib contrib-type="author"><name><surname>Petersen</surname><given-names>Emily</given-names></name><degrees>MD</degrees><aff id="A8">Division of Reproductive Health, National Center for Chronic Disease Prevention and Health Promotion, Atlanta, Georgia</aff></contrib><contrib contrib-type="author"><name><surname>Anjorhin</surname><given-names>Suzanne</given-names></name><degrees>MPH</degrees><aff id="A9">Public Health Research Unit, Division of Community Health Promotion, Florida Department of Health, Tallahassee, Florida</aff></contrib><contrib contrib-type="author"><name><surname>Watkins</surname><given-names>Sharon M.</given-names></name><degrees>PhD</degrees><aff id="A10">Public Health Research Unit, Division of Community Health Promotion, Florida Department of Health, Tallahassee, Florida</aff></contrib><contrib contrib-type="author"><name><surname>Creanga</surname><given-names>Andreea A.</given-names></name><degrees>MD</degrees><aff id="A11">Department of International Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland</aff></contrib><contrib contrib-type="author"><name><surname>Correia</surname><given-names>Jane A.</given-names></name><degrees>BS</degrees><aff id="A12">Public Health Research Unit, Division of Community Health Promotion, Florida Department of Health, Tallahassee, Florida</aff></contrib></contrib-group><author-notes><corresp id="CR1"><bold>Correspondence:</bold> Ghasi S. Phillips-Bell, ScD, MS, Division of Community Health Promotion, Florida Department of Health, 4052 Bald Cypress Way, Bin A13, Tallahassee, FL 32399 (<email>Ghasi.Phillips-Bell@flhealth.gov</email>).</corresp></author-notes><pub-date pub-type="nihms-submitted"><day>31</day><month>12</month><year>2019</year></pub-date><pub-date pub-type="ppub"><season>Jan-Feb</season><year>2020</year></pub-date><pub-date pub-type="pmc-release"><day>01</day><month>1</month><year>2021</year></pub-date><volume>26</volume><issue>1</issue><fpage>E1</fpage><lpage>E8</lpage><!--elocation-id from pubmed: 10.1097/PHH.0000000000000897--><abstract id="ABS1"><sec id="S1"><title>Context:</title><p id="P1">On October 1, 2015, the United States transitioned from using the <italic>International Classification of Diseases, Ninth Revision, Clinical Modification</italic> (<italic>ICD-9-CM</italic>) to <italic>ICD-10-CM.</italic> Continuing to monitor the burden of neonatal abstinence syndrome (NAS) after the transition presently requires use of data dependent on <italic>ICD-9-CM</italic> coding to enable trend analyses. Little has been published on the validation of using <italic>ICD-9-CM</italic> codes to identify NAS cases.</p></sec><sec id="S2"><title>Objective:</title><p id="P2">To assess the validity of hospital discharge data (HDD) from selected Florida hospitals for passive NAS surveillance, based on <italic>ICD-9-CM</italic> codes, which are used to quantify baseline prevalence of NAS.</p></sec><sec id="S3"><title>Design:</title><p id="P3">We reviewed infant and maternal data for all births at 3 Florida hospitals from 2010 to 2011. Potential NAS cases included infants with <italic>ICD-9-CM</italic> discharge codes 779.5 and/or 760.72 in linked administrative data (ie, HDD linked to vital records) or in unlinked HDD and infants identified through review of neonatal intensive care unit admission logs or inpatient pharmacy records. Confirmed infant cases met 3 clinician-proposed criteria. Sensitivity and positive predictive value were calculated to assess validity for the 2 <italic>ICD-9-CM</italic> codes, individually and combined.</p></sec><sec id="S4"><title>Results:</title><p id="P4">Of 157 confirmed cases, 134 with 779.5 and/or 760.72 codes were captured in linked HDD (sensitivity = 85.4%) and 151 in unlinked HDD (sensitivity = 96.2%). Positive predictive value was 74.9% for linked HDD and 75.5% for unlinked HDD. For either HDD types, the single 779.5 code had the highest positive predictive value (86%), lowest number of false positives, and good to excellent sensitivity.</p></sec><sec id="S5"><title>Conclusions:</title><p id="P5">Passive surveillance using <italic>ICD-9-CM</italic> code 779.5 in either linked or unlinked HDD identified NAS cases with reasonable validity. Our work supports the use of <italic>ICD-9-CM</italic>code 779.5 to assess the baseline prevalence of NAS through 2015.</p></sec></abstract><kwd-group><kwd>hospital discharge data</kwd><kwd>maternal opioid use</kwd><kwd>neonatal abstinence syndrome</kwd><kwd>surveillance</kwd><kwd>validation</kwd></kwd-group></article-meta></front><body><p id="P6">Neonatal abstinence syndrome (NAS) is a constellation of clinical signs observed in newborns consistent with withdrawal from antenatal exposure to certain illicit or prescription drugs.<sup><xref rid="R1" ref-type="bibr">1</xref></sup> Almost invariably, NAS occurs in the setting of maternal opioid use.<sup><xref rid="R2" ref-type="bibr">2</xref></sup> Physiological and neurobehavioral signs of opioid withdrawal in infants include excessive high-pitched crying, irritability, sleep-wake disturbances, alteration in infant tone and movement, feeding difficulties, gastrointestinal disturbances, autonomic dysfunction, and failure to thrive.<sup><xref rid="R3" ref-type="bibr">3</xref></sup></p><p id="P7">The use of prescription opioids has markedly increased in the United States. More than a third of reproductive-aged women insured by Medicaid and more than a quarter with private insurance filled a prescription for opioid pain medication between 2008 and2012.<sup><xref rid="R4" ref-type="bibr">4</xref></sup> Moreover, between 1999 and 2010, deaths among women due to overdose from prescription opioids increased by more than 400%.<sup><xref rid="R5" ref-type="bibr">5</xref></sup> The incidence of newborns afflicted with NAS has risen in parallel by nearly 5-fold from 2004 to 2014. In 2014, 8.0 per 1000 hospital births in the United States were diagnosed with NAS.<sup><xref rid="R6" ref-type="bibr">6</xref></sup></p><p id="P8">Drug abuse and misuse, along with the corresponding increase in NAS cases, have become prominent public health problems in Florida.<sup><xref rid="R7" ref-type="bibr">7</xref></sup> Among pregnant women, opioid use disorder has increased 13-fold in the state, compared with 4-fold in the nation, from 1999 to 2014.<sup><xref rid="R8" ref-type="bibr">8</xref></sup> Neonatal abstinence syndrome incidence in Florida increased from 0.4 per 1000 hospital births in 1999 to 6.3 per 1000 hospital births in 2013, with an annual incidence rate change of 0.6 per 1000 births.<sup><xref rid="R9" ref-type="bibr">9</xref></sup> Statewide data from 2011 to 2013 suggest that the incidence of NAS has plateaued at rates between 6.67 and 6.99 per 1000 live births.<sup><xref rid="R10" ref-type="bibr">10</xref></sup></p><p id="P9">The Florida Department of Health added this condition to the <italic>List of Reportable Diseases and Conditions</italic> to facilitate passive NAS surveillance.<sup><xref rid="R7" ref-type="bibr">7</xref></sup> To date, the most successful examples of statewide NAS surveillance implementation come from states, such as Tennessee, which have established a &#x0201c;near real-time&#x0201d; surveillance system for NAS based on electronic case reporting by providers and hospitals.<sup><xref rid="R11" ref-type="bibr">11</xref></sup></p><p id="P10">Florida&#x02019;s Agency for Health Care Administration is responsible for collecting patient discharge data from all licensed acute care hospitals within the state in accordance with state statute 408.061.<sup><xref rid="R12" ref-type="bibr">12</xref></sup> These data are collected for financial and condition/disease reporting. To improve reporting, the United States transitioned from using the <italic>International Classification of Diseases, Ninth Revision, Clinical Modification (ICD- 9-CM)</italic> to the Tenth Revision <italic>(ICD-10-CM)</italic> on October 1, 2015. With this transition, the number of diagnostic codes increased from 14 025 <italic>ICD-9-CM</italic> codes to 68 069 <italic>ICD-10-CM</italic> codes. It will take time for professional coders, physicians, and hospital staff to become familiar with the new system. Even with the transition, there are still no diagnostic codes that are specific for NAS cases. Additional diagnostic variation results, in part, to the absence of a standardized NAS case definition. Consequently, these issues create challenges for using administrative data to conduct analyses, including NAS trend analyses. Recommendations exist for reporting statistics using data that include both <italic>ICD-9-CM</italic> and <italic>ICD-10-CM</italic> codes.<sup><xref rid="R13" ref-type="bibr">13</xref></sup> However, only 1 study<sup><xref rid="R14" ref-type="bibr">14</xref></sup> has examined the accuracy of administrative <italic>ICD-9-CM</italic> coding for NAS. Thus, additional research is needed to support the use of <italic>ICD-9-CM</italic> codes for NAS in future posttransition studies that aim to use <italic>ICD-9-CM</italic> data as baseline data for trend analyses.</p><p id="P11">This investigation addressed the following questions: (1) What are the sensitivity and positive predictive values (PPVs) for <italic>ICD-9-CM</italic> codes indicative of NAS?; (2) Does the passive identification of NAS cases using hospital discharge data (HDD) linked to vital records differ from using unlinked HDD?; and (3) What combination of <italic>ICD-9-CM</italic> codes in HDD records will identify confirmed cases of NAS with greatest sensitivity and lowest false-positive rate?</p><sec id="S6"><title>Methods</title><sec id="S7"><title>Data sources</title><p id="P12">We invited 6 hospitals in 2 Florida counties with higher volumes of NAS cases than other Florida counties to participate in this study. Only 3 hospitals could participate; the other 3 were unable to obtain all the necessary data for this investigation.</p><p id="P13">We examined the use of 3 <italic>ICD-9-CM</italic> codes for NAS (779.5 [drug withdrawal syndrome in a newborn], 760.72 [narcotics affecting fetus or newborn via placenta or breast milk], and 304.1 [sedative, hypnotic, or anxiolytic dependence]) for surveillance purposes using 2 HDD data sets:</p><list list-type="bullet" id="L1"><list-item><p id="P14">Infant and maternal HDD linked to infant vital records (revised birth certificate and infant death certificate data), herein referred to as &#x0201c;linked HDD.&#x0201d;</p></list-item><list-item><p id="P15">Infant and maternal HDD not linked to vital records, herein referred to as &#x0201c;unlinked HDD.&#x0201d;</p></list-item></list><p id="P16">To identify all NAS cases at the 3 facilities, the examination also used an &#x0201c;alternative case ascertainment method,&#x0201d; which was used in a previous study.<sup><xref rid="R15" ref-type="bibr">15</xref></sup> Specifically, we examined infant and maternal hospital medical records, including neonatal intensive care unit (NICU) admission logs and infant inpatient pharmacy records. Hospital staff used infant inpatient pharmacy records to identify infants treated with morphine, methadone, or clonidine during the 2-year period. These medications are among the most common treatment options for NAS<sup><xref rid="R1" ref-type="bibr">1</xref></sup> and were used as primary or adjunctive treatments for NAS at the 3 hospitals. While morphine was the most common pharmacologic therapy used for NAS at the 3 hospitals, phenobarbital was also frequently used.<sup><xref rid="R15" ref-type="bibr">15</xref></sup> Not including phenobarbital in the list of medications used to identify infants treated for NAS did not invalidate our findings because phenobarbital was used at these hospitals as an adjunctive treatment when opioids (ie, morphine or methadone) alone were not sufficient for controlling withdrawal signs.<sup><xref rid="R1" ref-type="bibr">1</xref></sup> Hospital staff also identified infants admitted to the NICU for NAS treatment, based on documentation in NICU admission logs. The alternative case ascertainment method might be expected to identify additional potential NAS cases than the method based on <italic>ICD-9-CM</italic> codes, as it likely includes exposed babies admitted for observation for NAS but who did not develop the clinical syndrome.</p><p id="P17">Electronic medical records were pulled using a unique patient identification number from the hospitals. Three investigators each reviewed and abstracted a third of the medical records for the infants and their mothers. The standardized data abstraction form included data elements on infant demographic and clinical characteristics, pharmacologic therapy for NAS, feeding history, infant and maternal <italic>ICD-9-CM</italic> discharge diagnosis codes, maternal drug use history, and services received by the mother during the birth hospitalization. Before the abstraction, the investigators pilot-tested the collection form in the field among a random sample of 10% of infants with NAS and their mothers on 3 selected questions that were key to the investigation such as &#x0201c;Was NAS diagnosed?&#x0201d; Responses where either &#x0201c;yes&#x0201d; or &#x0201c;no.&#x0201d; The 3 investigators were comparable on 73% to 96% of their responses. Discrepancies were discussed and the form was then revised to facilitate improved interpretation and recording of medical record information.</p></sec><sec id="S8"><title>Linked HDD</title><p id="P18">Linked HDD provide more information on patient characteristics than HDD alone<sup><xref rid="R16" ref-type="bibr">16</xref></sup>; however, approximately 8% of Florida birth certificates cannot be linked to an HDD record. The linked HDD file used for this analysis excluded infants who were adopted or transferred from another birth facility, as well as infants born to non-Florida residents and undocumented immigrants. Personal identifiers used for linkage include patient social security number and date of birth. We restricted our analytic sample according to guidance from the National Committee for Quality Assurance for identifying live birth deliveries.<sup><xref rid="R17" ref-type="bibr">17</xref></sup> No infants with <italic>ICD-9-CM</italic> codes V39.1 (liveborn, unspecified whether single, twin or multiple, born before admission to hospital) or V39.2 (liveborn, unspecified whether single, twin or multiple, born outside hospital, and not hospitalized) were included in any of our analyses. Infants diagnosed with NAS in the linked HDD (n = 179) were combined with an additional 124 infants identified by the alternative case ascertainment method (ie, present in NICU logs or inpatient pharmacy records), yielding a total of 303 unduplicated cases (see <xref rid="SD1" ref-type="supplementary-material">Figure</xref>, <xref rid="SD1" ref-type="supplementary-material">Supplemental Digital Content 1</xref>, available at <ext-link ext-link-type="uri" xlink:href="http://links.lww.com/JPHMP/A534">http://links.lww.com/JPHMP/A534</ext-link>, which presents a flowchart of this sample).</p></sec><sec id="S9"><title>Unlinked HDD</title><p id="P19">Data from the unlinked HDD were also restricted to birth hospitalizations, using the same methodology as that for the linked HDD. Data for infants with a NAS diagnosis identified in the unlinked HDD (n = 203) were combined with data from an additional 103 infants identified by the alternative case ascertainment method (ie, present in NICU logs or inpatient pharmacy records), yielding a total of 306 unduplicated infant records that were eligible for inclusion in this investigation. We excluded 3 infants from the unlinked HDD for whom information necessary for the confirmed case definition (see later) could not be obtained from the alternative case ascertainment method data; thus, 303 infants were included in the final sample (see <xref rid="SD2" ref-type="supplementary-material">Figure</xref>, <xref rid="SD2" ref-type="supplementary-material">Supplemental Digital Content 2</xref>, available at <ext-link ext-link-type="uri" xlink:href="http://links.lww.com/JPHMP/A535">http://links.lww.com/JPHMP/A535</ext-link>, which presents a flowchart of this sample). Therefore, all patients captured by the 2 types of HDD and the alternative case ascertainment method (n = 303) are the same but are distributed differently between the linked and unlinked HDD.</p></sec><sec id="S10"><title>Potential NAS case definition</title><p id="P20">Infants with any of the following 3 <italic>ICD-9-CM</italic> discharge diagnosis codes were considered potential NAS cases: 779.5 (drug withdrawal syndrome in a newborn), 760.72 (narcotics affecting fetus or newborn via placenta or breast milk), or 304.1 (sedative, hypnotic, or anxiolytic dependence). In addition, all infants identified by the NICU admission logs or inpatient pharmacy data were considered potential NAS cases.</p></sec><sec id="S11"><title>NAS case definition</title><p id="P21">Currently, no standardized approach for NAS diagnosis exists in the United States. We consulted with neonatologists to develop for this investigation a case definition for a confirmed NAS case. The definition of confirmed NAS required all 3 of the following criteria (as abstracted from the medical record):</p><list list-type="bullet" id="L2"><list-item><p id="P22">Presence of a constellation of clinical signs consistent with NAS (defined as a documented NAS Finnegan score of &#x0003e;8), not explained by another etiology.<sup><xref rid="R18" ref-type="bibr">18</xref>,<xref rid="R19" ref-type="bibr">19</xref></sup></p></list-item><list-item><p id="P23">Documented history of maternal use of prescription/illicit drugs associated with NAS during pregnancy<sup><xref rid="R1" ref-type="bibr">1</xref></sup> and/or laboratory confirmation of recent maternal drug use or fetal exposure to such drugs.</p></list-item><list-item><p id="P24">A level of severity of clinical signs that resulted in prolonged (&#x0003e;2 days) neonatal hospitalization.</p></list-item></list><p id="P25">Infants who do not meet all 3 criteria were not classified as confirmed NAS in this study. Based on the NAS case definition, cases of possible iatrogenic withdrawal were excluded.</p></sec><sec id="S12"><title>Statistical analyses</title><p id="P26">We assessed the quality of the 2 types of HDD by calculating the sensitivity and PPV with 95% confidence intervals (CI) using the binomial exact method. Sensitivity was calculated as the number of confirmed NAS cases in the HDD divided by the total number of confirmed NAS cases, multiplied by 100. Positive predictive value was defined as the number of confirmed NAS cases in the HDD divided by the total number of potential NAS cases detected in the HDD, multiplied by 100. For both types of HDD, analyses were completed separately for the following <italic>ICD-9-CM</italic> code combinations: (1) 779.5 and/or 760.72,(2) 779.5, and (3) 760.72. No infants with potential or confirmed NAS were assigned an <italic>ICD-9-CM</italic> code of 304.1 in the linked or unlinked HDD. However, there was 1 mother present in the unlinked HDD, and not in the linked HDD, who had the 304.1 code. In a sensitivity analysis, estimates were examined after removal of this mother and her infant from our analytic sample.</p><p id="P27">Data were analyzed using STATA v.14.0. The Florida Department of Health Institutional Review Board deemed this a nonresearch public health investigation exempt from review.</p></sec></sec><sec id="S13"><title>Results</title><sec id="S14"><title>Linked HDD</title><p id="P28">We identified 303 infants with potential NAS (179 from the linked HDD with any <italic>ICD-9-CM</italic> code combination and an additional 124 from the alternative case ascertainment method) (<xref rid="T1" ref-type="table">Table 1</xref>). Of 303 potential cases, 157 met the definition for a confirmed NAS case. Given that 134 infants with confirmed NAS were identified in the linked HDD, 23 of 157 confirmed cases were missed and 45 false positives were included.</p><p id="P29">Using codes 779.5 and/or 760.72, the linked HDD identified 134 of 157 infants with confirmed NAS (sensitivity = 85.4%, 95% CI: 78.8%&#x02013;90.5%) (<xref rid="T2" ref-type="table">Table 2</xref>). Among the 179 potential NAS cases identified by the linked HDD, 134 had confirmed NAS (PPV = 74.9%, 95% CI: 67.8%&#x02013;81.0%). Compared with the use of both codes 779.5 and 760.72, the single code 779.5 had a similar sensitivity of 84.1% (95% CI: 77.4%&#x02013;89.4%) but a greater PPV of 86.3% (79.8%&#x02013;91.3%). The single code 760.72 performed poorly with a sensitivity of 4.7% (1.9%&#x02013;9.4%) and a PPV of 20.6% (8.7%&#x02013;37.9%).</p></sec><sec id="S15"><title>Unlinked HDD</title><p id="P30">The unlinked HDD identified 200 infants with potential NAS who when paired with an additional 103 from the alternative case ascertainment method yielded 303 total infants with potential NAS (<xref rid="T3" ref-type="table">Table 3</xref>). Of note, 21 of these infants were not found in the linked HDD. The majority of the 21 infants were adoption cases who were excluded from the linked HDD. Among the potential cases, 157 met the definition for a confirmed NAS case. Given that 151 infants with confirmed NAS were identified from the 200 infants in the unlinked HDD, 6 of 157 confirmed cases were missed and 49 false positives were included.</p><p id="P31">In the entire analytic sample, 151 of 157 infants with confirmed NAS were identified using unlinked HDD (sensitivity = 96.2%, 95% CI: 91.9%&#x02013;98.6%) (<xref rid="T2" ref-type="table">Table 2</xref>). Of the 200 infants with potential NAS identified by the unlinked HDD, 151 had confirmed NAS (PPV = 75.5%, 95% CI: 68.9%&#x02013;81.3%). Compared with the use of both codes 779.5 and 760.72, the single code 779.5 had a similar sensitivity of 94.9% (90.2%&#x02013;97.8%) but a greater PPV of 86.1% (80.1%&#x02013;90.9%). The single <italic>ICD-9-CM</italic> code 760.72 exhibited both a poor sensitivity of 5.4% (2.4%&#x02013;10.3%) and a poor PPV of 22.2% (10.1%&#x02013;39.2%).</p><p id="P32">In the sensitivity analysis, the infant of the mother with diagnostic code 304.1 had only a 779.5 code and was a confirmed case. Removal of this dyad pair from our analytic sample did not appreciably change our results. All PPV and sensitivity values were the same except for the PPV for 779.5 and/or 760.72: 75.5% before the exclusion and 78.5% after.</p></sec></sec><sec id="S16"><title>Discussion</title><p id="P33">Continuing to monitor the burden of NAS after the nation transitioned to <italic>ICD-10-CM</italic> coding presently requires use of data dependent on <italic>ICD-9-CM</italic> coding to enable trend analyses. To date, little has been done to assess the accuracy and validity of <italic>ICD-9-CM</italic> codes to capture NAS cases. In this study, the use of the single <italic>ICD-9-CM</italic> code 779.5, in both linked and unlinked HDD, resulted in the best profile of sensitivity and PPV. However, compared with linked HDD, unlinked HDD included more confirmed NAS cases and had greater estimated sensitivity (94.9% vs 84.1%) but had a similar PPV (86.1% vs 86.3%).</p><p id="P34">Our results for the linked HDD were consistent with those from a pilot study conducted in Tennessee that examined the accuracy of administrative coding for NAS (779.5 code only) from 2009 to 2011 using outpatient prescription Medicaid claims data linked to vital statistics and hospital outpatient data.<sup><xref rid="R14" ref-type="bibr">14</xref></sup> Specific elements of their standard NAS case definition that they used as a reference, however, were not reported. Sensitivity and PPV were 88.1% (95% CI: 83.3%&#x02013;91.7%) and 91.2% (86.8%&#x02013;94.2%), respectively, in the study by Patrick et al<sup><xref rid="R14" ref-type="bibr">14</xref></sup> versus 84.1% (77.4%&#x02013;89.4%) and 86.3% (79.8%&#x02013;91.3%), respectively, in our linked HDD. In our study, the PPV for code 779.5 used alone was higher than that for 779.5 and/or 760.72 (86.3% vs 74.9%). Typically, based on the experience of clinicians in our investigation team, providers used code 779.5 for infants with signs of NAS and reserved 760.72 for babies who might have been exposed but did not develop signs of NAS. Taken together, our results with the experience of clinicians on our investigative team demonstrate that passive NAS surveillance identified NAS cases with reasonable validity using <italic>ICD-9-CM</italic> code 779.5 alone.</p><p id="P35">Approximately 8% of birth certificate records in Florida are not linked to an HDD record because of a variety of factors, including the birth having occurred out-of-state, at home, at a birthing center, or at another facility type without a hospital identification number.<sup><xref rid="R16" ref-type="bibr">16</xref></sup> In addition, births in which the primary source of payment was &#x0201c;self-pay,&#x0201d; and births to women who did not have a high school diploma, who were foreign born, and who self-identified as &#x0201c;Hispanic&#x0201d; experienced greater odds of not linking their birth certificate to an HDD record.<sup><xref rid="R16" ref-type="bibr">16</xref></sup> Undocumented immigrants and non-Florida residents are also excluded. Thus, the infants captured in the linked HDD might not be representative of all infants living in the state. Because of this limitation, we hypothesized that unlinked HDD would perform better at identifying NAS cases than the linked HDD. This held true for both potential and confirmed NAS cases ascertained using HDD: the unlinked HDD captured 173 potential and 149 confirmed NAS cases for code 779.5 whereas the linked HDD identified 153 potential and 132 confirmed NAS cases. Moreover, based on the experience of data analysts in Florida, unlinked HDD are timelier with only a 5-month lag for data acquisition compared with the 18-month lag for the linked HDD. Overall, unlinked HDD appear to be better for providing the number, rate, and some limited clinical and birth hospitalization characteristics of NAS- diagnosed infants born in Florida. Vital records add more maternal and infant demographic and clinical information, which can be used to better understand factors contributing to women&#x02019;s use of opioids during pregnancy and to identify specific groups of women for targeted interventions. If a state can link HDD with vital statistics records and if the time needed for such linkages is not critical, then the purposes of surveillance may determine whether linked versus unlinked HDD are optimal. Of note, our results also indicate that an alternative case ascertainment method is necessary to identify all cases of confirmed NAS while excluding false positives.</p><p id="P36">This report has some limitations. Our findings reflect reporting practices in only 3 hospitals in 1 area of Florida. These hospitals could provide all necessary information for the alternative case ascertainment method (inpatient pharmacy records and NICU logs) and their practices may not reflect the situation in all delivery hospitals in the community or state. This possibility could be assessed in a statewide investigation. During the 2-year study period, NAS scoring tools were not routinely included in electronic medical records at the participating hospitals and therefore some infants with NAS Finnegan scores greater than 8 might have been missed if documentation were present elsewhere in the medical record or the information was not well captured. The 3 hospitals were able to provide only inpatient pharmacy data based on the medication dispense date rather than infant&#x02019;s date of birth. Consequently, infants born near the end of 2011 might not have been identified by the alternative case ascertainment method if pharmacologic treatment for NAS was dispensed in 2012. Also, since NAS can be treated with a variety of pharmaceuticals, some of which were not incorporated into our NAS case finding, the number of infants with NAS may have been slightly underestimated. At the time of the investigation, <italic>ICD-10-CM</italic> had not been implemented as the new standard diagnostic tool and therefore we cannot determine with certainty whether our results based on <italic>ICD-9-CM</italic> codes (779.5 and 760.72) would be equivalent to results using the <italic>ICD-10-CM</italic> codes for NAS (P96.1 and P04.49, respectively). Also, this study does not formally validate <italic>ICD-9-CM</italic> data as a baseline measure for NAS in analyses that also include <italic>ICD-10-CM.</italic> Biases in the 2 classification systems may differ somewhat even though both will use a single <italic>ICD</italic> code. Changes in prevalence over time could still be due to changes in coding. Instead, this study specifically validates <italic>ICD-9-CM</italic> data, which are integral to the published work of others who have examined NAS trends. Validation of <italic>ICD-10-CM</italic> data is currently being completed and will be the subject of a subsequent report. Finally, passive surveillance using unlinked HDD restricted to the single code 779.5 slightly overestimated the number of real NAS cases (n = 157) because the number of false-positive NAS cases (n = 24) among the 173 potential cases exceeded the number of missed cases of NAS (n = 8) for an overestimation rate of 10.2% = [(173&#x02013;157)/157].</p><p id="P37">Our study has several strengths. We applied a strong methodologic approach to investigating the accuracy of reporting through searching multiple hospital databases with verification by chart audit. These methods would also be essential for assessing <italic>ICD-10-CM</italic> codes. Clinical experts developed our NAS case definition and 3 experienced clinicians conducted the medical record reviews. Furthermore, our sample was restricted to birth hospitalizations, given our interest in identifying NAS cases at birth, which helped exclude NAS cases diagnosed after birth or duplicate cases. Our unique examination of different <italic>ICD-9-CM</italic> code combinations and comparison of linked and unlinked HDD in addition to the use of a proposed NAS case definition can inform and guide state efforts to conduct passive surveillance of NAS.</p></sec><sec id="S17"><title>Conclusions</title><p id="P38">This study supports the use of HDD and <italic>ICD-9-CM</italic> codes to establish baseline data on NAS prevalence through 2015. Our results from 3 Florida birth facilities are promising, but we suggest that they should be furthered by a statewide investigation that examines <italic>ICD-10-CM</italic> codes as a means of passive NAS surveillance. The methodology used in this article to assess the validity of NAS-related <italic>ICD-9-CM</italic> codes could serve as the basis for such a study. Confidence in case ascertainment and surveillance strategies is key to designing the best state-based NAS surveillance system from which appropriate interventions can be developed, monitored, and evaluated.</p></sec><sec sec-type="supplementary-material" id="SM1"><title>Supplementary Material</title><supplementary-material content-type="local-data" id="SD1"><label>#1</label><media xlink:href="NIHMS1065421-supplement--1.docx" orientation="portrait" xlink:type="simple" id="d36e613" position="anchor"/></supplementary-material><supplementary-material content-type="local-data" id="SD2"><label>#2</label><media xlink:href="NIHMS1065421-supplement--2.docx" orientation="portrait" xlink:type="simple" id="d36e617" position="anchor"/></supplementary-material></sec></body><back><ack id="S18"><p id="P39">The authors acknowledge the following: Statewide Task Force on Prescription Drug Abuse and Newborns. Florida Office of the Attorney General. John H. Armstrong, MD; Celeste Philip, MD, MPH; Anna Likos, MD; Carina Blackmore, DVM, PhD; Philip Cavicchia, PhD, MSPH; Cheryl L. Clark, DrPH; Marie Bailey, MA, MSW; Karen Freeman, MPH, MS; Heather Lake-Burger, MS, MPH, Florida Department of Health. Diana Sampat, MPH, University of South Florida Birth Defects Surveillance Program. Leonard J. Paulozzi, MD, National Center for Injury Prevention and Control, CDC. John Curran, MD, University of South Florida. Philip A. Lederer, MD, Centers for Disease Control and Prevention Epidemic Intelligence Service Program. Robert W. Yelverton, MD, American Congress of Obstetricians and Gynecologists. The staff at the participating hospitals in Florida. This study/report was supported in part by an appointment to the Applied Epidemiology Fellowship Program administered by the Council of State and Territorial Epidemiologists (CSTE) and funded by the Centers for Disease Control and Prevention Cooperative Agreement Number 1U38OT000143-03.</p></ack><fn-group><fn id="FN1"><p id="P40">The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention, the Florida Department of Health, or any other organization.</p></fn><fn id="FN2"><p id="P41">Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal&#x02019;s Web site (<ext-link ext-link-type="uri" xlink:href="http://www.jphmp.com/">http://www.JPHMP.com</ext-link>).</p></fn><fn fn-type="COI-statement" id="FN3"><p id="P42">The authors declare no conflicts of interest.</p></fn></fn-group><ref-list><title>References</title><ref id="R1"><label>1.</label><mixed-citation publication-type="journal"><name><surname>Hudak</surname><given-names>ML</given-names></name>, <name><surname>Tan</surname><given-names>RC</given-names></name>. <article-title>Neonatal drug withdrawal</article-title>. <source>Pediatrics</source>. <year>2012</year>;<volume>129</volume>(<issue>2</issue>):<fpage>e540</fpage>&#x02013;<lpage>e560</lpage>.<pub-id pub-id-type="pmid">22291123</pub-id></mixed-citation></ref><ref id="R2"><label>2.</label><mixed-citation publication-type="journal"><name><surname>Patrick</surname><given-names>SW</given-names></name>, <name><surname>Schumacher</surname><given-names>RE</given-names></name>, <name><surname>Benneyworth</surname><given-names>BD</given-names></name>, <name><surname>Krans</surname><given-names>EE</given-names></name>, <name><surname>McAllister</surname><given-names>JM</given-names></name>, <name><surname>Davis</surname><given-names>MM</given-names></name>. <article-title>Neonatal abstinence syndrome and associated health care expenditures: United States, 2000&#x02013;2009</article-title>. <source>JAMA</source>. <year>2012</year>; <volume>307</volume>(<issue>18</issue>):<fpage>1934</fpage>&#x02013;<lpage>1940</lpage>.<pub-id pub-id-type="pmid">22546608</pub-id></mixed-citation></ref><ref id="R3"><label>3.</label><mixed-citation publication-type="journal"><name><surname>Jansson</surname><given-names>LM</given-names></name>, <name><surname>Velez</surname><given-names>M</given-names></name>. <article-title>Neonatal abstinence syndrome</article-title>. <source>Curr Opin Pediatr</source>. <year>2012</year>;<volume>24</volume>(<issue>2</issue>):<fpage>252</fpage>&#x02013;<lpage>258</lpage>.<pub-id pub-id-type="pmid">22227786</pub-id></mixed-citation></ref><ref id="R4"><label>4.</label><mixed-citation publication-type="journal"><name><surname>Ailes</surname><given-names>EC</given-names></name>, <name><surname>Dawson</surname><given-names>AL</given-names></name>, <name><surname>Lind</surname><given-names>JN</given-names></name>, <etal/>
<article-title>Opioid prescription claims among women of reproductive age&#x02014;United States, 2008&#x02013;2012</article-title>. <source>MMWR Morb Mortal Wkly Rep</source>. <year>2015</year>;<volume>64</volume>(<issue>2</issue>):<fpage>37</fpage>&#x02013;<lpage>41</lpage>.<pub-id pub-id-type="pmid">25611168</pub-id></mixed-citation></ref><ref id="R5"><label>5.</label><mixed-citation publication-type="journal"><collab>Centers for Disease Control and Prevention</collab>. <article-title>Vital signs: overdoses of prescription opioid pain relievers and other drugs among women&#x02014;United States, 1999&#x02013;2010</article-title>. <source>MMWR Morb Mortal Wkly Rep</source>. <year>2013</year>;<volume>62</volume>(<issue>26</issue>):<fpage>537</fpage>&#x02013;<lpage>542</lpage>.<pub-id pub-id-type="pmid">23820967</pub-id></mixed-citation></ref><ref id="R6"><label>6.</label><mixed-citation publication-type="journal"><name><surname>Winkelman</surname><given-names>TNA</given-names></name>, <name><surname>Villapiano</surname><given-names>N</given-names></name>, <name><surname>Kozhimannil</surname><given-names>KB</given-names></name>, <name><surname>Davis</surname><given-names>MM</given-names></name>, <name><surname>Patrick</surname><given-names>SW</given-names></name>. <article-title>Incidence and costs of neonatal abstinence syndrome among infants with Medicaid: 2004&#x02013;2014</article-title>. <source>Pediatrics</source>. <year>2018</year>;<volume>141</volume>(<issue>4</issue>):<comment>pii: e20173520.</comment></mixed-citation></ref><ref id="R7"><label>7.</label><mixed-citation publication-type="web"><collab>Florida Office of the Attorney General</collab>. <source>Statewide task force on prescription drug abuse &#x00026; newborns: February 2013 final report</source>. <comment>Published 2013.</comment>
<comment><ext-link ext-link-type="uri" xlink:href="http://myfloridalegal.com/webfiles.nsf/WF/RMAS-94LJPF/$flle/Statewide_Task_Force_on_Prescription_Drug_Abuse_and_Newborns_Final_Report.pdf">http://myfloridalegal.com/webfiles.nsf/WF/RMAS-94LJPF/$flle/Statewide_Task_Force_on_Prescription_Drug_Abuse_and_Newborns_Final_Report.pdf</ext-link>.</comment>
<date-in-citation>Accessed December 20, 2016</date-in-citation>.</mixed-citation></ref><ref id="R8"><label>8.</label><mixed-citation publication-type="journal"><name><surname>Haight</surname><given-names>SC</given-names></name>, <name><surname>Ko</surname><given-names>JY</given-names></name>, <name><surname>Tong</surname><given-names>VT</given-names></name>, <name><surname>Bohm</surname><given-names>MK</given-names></name>, <name><surname>Callaghan</surname><given-names>WM</given-names></name>. <article-title>Opioid use disorder documented at delivery hospitalization&#x02014;United States, 1999&#x02013;2014</article-title>. <source>MMWR Morb Mortal Wkly Rep</source>. <year>2018</year>;<volume>67</volume>(<issue>31</issue>):<fpage>845</fpage>&#x02013;<lpage>849</lpage>.<pub-id pub-id-type="pmid">30091969</pub-id></mixed-citation></ref><ref id="R9"><label>9.</label><mixed-citation publication-type="journal"><name><surname>Ko</surname><given-names>JY</given-names></name>, <name><surname>Patrick</surname><given-names>SW</given-names></name>, <name><surname>Tong</surname><given-names>VT</given-names></name>, <name><surname>Patel</surname><given-names>R</given-names></name>, <name><surname>Lind</surname><given-names>JN</given-names></name>, <name><surname>Barfleld</surname><given-names>WD</given-names></name>. <article-title>Incidence of neonatal abstinence syndrome&#x02014;28 States, 1999&#x02013;2013</article-title>. <source>MMWR Morb Mortal Wkly Rep</source>. <year>2016</year>;<volume>65</volume>(<issue>31</issue>):<fpage>799</fpage>&#x02013;<lpage>802</lpage>.<pub-id pub-id-type="pmid">27513154</pub-id></mixed-citation></ref><ref id="R10"><label>10.</label><mixed-citation publication-type="book"><name><surname>Anjohrin</surname><given-names>S</given-names></name>, <name><surname>Cavicchia</surname><given-names>P</given-names></name>, <name><surname>Bailey</surname><given-names>M</given-names></name>, <name><surname>Correia</surname><given-names>J</given-names></name>, <name><surname>Watkins</surname><given-names>S</given-names></name>. <source>Neonatal Abstinence Syndrome Data Summary: Maternal Characteristics Among Live Births From 2011 Through 2013</source>. <publisher-loc>Tallahassee, FL</publisher-loc>: <publisher-name>Florida Department of Health</publisher-name>; <year>2015</year>.</mixed-citation></ref><ref id="R11"><label>11.</label><mixed-citation publication-type="journal"><name><surname>Warren</surname><given-names>MD</given-names></name>, <name><surname>Miller</surname><given-names>AM</given-names></name>, <name><surname>Traylor</surname><given-names>J</given-names></name>, <etal/>
<article-title>Implementation of a statewide surveillance system for neonatal abstinence syndrome&#x02014;Tennessee, 2013</article-title>. <source>MMWR Morb Mortal Wkly Rep</source>. <year>2015</year>;<volume>64</volume>(<issue>5</issue>):<fpage>125</fpage>&#x02013;<lpage>128</lpage>.<pub-id pub-id-type="pmid">25674995</pub-id></mixed-citation></ref><ref id="R12"><label>12.</label><mixed-citation publication-type="web"><collab>Agency for Health Care Administration</collab>. <source>Office of data collection and quality assurance</source>. <comment><ext-link ext-link-type="uri" xlink:href="http://ahca.myflorida.com/schs/DataCollection/DataCollection.shtml">http://ahca.myflorida.com/schs/DataCollection/DataCollection.shtml</ext-link>.</comment>
<comment>Published 2016.</comment>
<date-in-citation>Accessed December 20, 2016</date-in-citation>.</mixed-citation></ref><ref id="R13"><label>13.</label><mixed-citation publication-type="book"><name><surname>Elixhauser</surname><given-names>A</given-names></name>, <name><surname>Heslin</surname><given-names>KC</given-names></name>, <name><surname>Owens</surname><given-names>PL</given-names></name>. <source>Healthcare Cost and Utilization Project (HCUP) Recommendations for Reporting Trends Using ICD-9-CM and ICD-10-CM/PCS Data</source>. <publisher-loc>Rockville, MD</publisher-loc>: <publisher-name>US Agency for Healthcare Research and Quality</publisher-name>; <year>2017</year></mixed-citation></ref><ref id="R14"><label>14.</label><mixed-citation publication-type="journal"><name><surname>Patrick</surname><given-names>SW</given-names></name>, <name><surname>Dudley</surname><given-names>J</given-names></name>, <name><surname>Martin</surname><given-names>PR</given-names></name>, <etal/>
<article-title>Prescription opioid epidemic and infant outcomes</article-title>. <source>Pediatrics</source>. <year>2015</year>;<volume>135</volume>(<issue>5</issue>):<fpage>842</fpage>&#x02013;<lpage>850</lpage>.<pub-id pub-id-type="pmid">25869370</pub-id></mixed-citation></ref><ref id="R15"><label>15.</label><mixed-citation publication-type="journal"><name><surname>Lind</surname><given-names>JN</given-names></name>, <name><surname>Petersen</surname><given-names>EE</given-names></name>, <name><surname>Lederer</surname><given-names>PA</given-names></name>, <etal/>
<article-title>Infant and maternal characteristics in neonatal abstinence syndrome&#x02014;selected hospitals in Florida, 2010&#x02013;2011</article-title>. <source>MMWR Morb Mortal Wkly Rep</source>. <year>2015</year>;<volume>64</volume>(<issue>8</issue>): <fpage>213</fpage>&#x02013;<lpage>216</lpage>.<pub-id pub-id-type="pmid">25742381</pub-id></mixed-citation></ref><ref id="R16"><label>16.</label><mixed-citation publication-type="journal"><name><surname>Salemi</surname><given-names>JL</given-names></name>, <name><surname>Tanner</surname><given-names>JP</given-names></name>, <name><surname>Bailey</surname><given-names>M</given-names></name>, <name><surname>Mbah</surname><given-names>AK</given-names></name>, <name><surname>Salihu</surname><given-names>HM</given-names></name>. <article-title>Creation and evaluation of a multi-layered maternal and child health database for comparative effectiveness research</article-title>. <source>J Registry Manag</source>. <year>2013</year>;<volume>40</volume>(<issue>1</issue>):<fpage>14</fpage>&#x02013;<lpage>28</lpage>.<pub-id pub-id-type="pmid">23778693</pub-id></mixed-citation></ref><ref id="R17"><label>17.</label><mixed-citation publication-type="journal"><collab>National Committee for Quality Assurance</collab>. <article-title>The healthcare effectiveness data and information set</article-title>. <source>Prenatal and postpartum care</source>. <comment><ext-link ext-link-type="uri" xlink:href="http://www.ncqa.org/portals/0/prenatal%20postpartum%20care.pdf">http://www.ncqa.org/portals/0/prenatal%20postpartum%20care.pdf</ext-link>.</comment>
<comment>Published 2015.</comment>
<date-in-citation>Accessed April 4, 2017</date-in-citation>.</mixed-citation></ref><ref id="R18"><label>18.</label><mixed-citation publication-type="book"><name><surname>Finnegan</surname><given-names>LP</given-names></name>. <chapter-title>Neonatal abstinence syndrome: assessment and pharmacotherapy</chapter-title> In: <name><surname>Rubaltelli</surname><given-names>FF</given-names></name>, <name><surname>Granti</surname><given-names>B</given-names></name>, eds. <source>Neonatal Therapy: An Update</source>. <publisher-loc>Amsterdam, New York, Oxford</publisher-loc>: <publisher-name>Elsevier Sciences Publishers BV</publisher-name>; <year>1986</year>.</mixed-citation></ref><ref id="R19"><label>19.</label><mixed-citation publication-type="journal"><name><surname>Zimmermann-Baer</surname><given-names>U</given-names></name>, <name><surname>Notzli</surname><given-names>U</given-names></name>, <name><surname>Rentsch</surname><given-names>K</given-names></name>, <name><surname>Bucher</surname><given-names>HU</given-names></name>. <source>Finnegan</source> neonatal abstinence scoring system: normal values for first 3 days and weeks 5&#x02013;6 in non-addicted infants. Addiction. <year>2010</year>;<volume>105</volume>(<issue>3</issue>):<fpage>524</fpage>&#x02013;<lpage>528</lpage>.</mixed-citation></ref></ref-list></back><floats-group><table-wrap id="T1" position="float" orientation="landscape"><label>TABLE 1</label><caption><p id="P43">Counts for Confirmed NAS Cases and Noncases by Detection in the Linked Hospital Discharge Data Set and <italic>ICD-9-CM</italic> Code Combination, Florida, 2010&#x02013;2011</p></caption><table frame="below" rules="none"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1">779.5 and/or<break/> 760.72 <italic>ICD-9 CM</italic> Codes</th><th colspan="3" align="center" valign="bottom" rowspan="1">779.5 <italic>ICD-9-CM</italic> Code</th><th colspan="3" align="center" valign="bottom" rowspan="1">760.72 <italic>ICD-9 CM</italic> Code</th></tr><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th></tr><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1">Confirmed NAS<sup><xref rid="TFN2" ref-type="table-fn">a</xref></sup></th><th colspan="3" align="center" valign="top" rowspan="1">Confirmed NAS<sup><xref rid="TFN2" ref-type="table-fn">a</xref></sup></th><th colspan="3" align="center" valign="top" rowspan="1">Confirmed NAS<sup><xref rid="TFN2" ref-type="table-fn">a</xref></sup></th></tr><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th></tr><tr><th align="left" valign="top" rowspan="1" colspan="1">Detected in HDD</th><th align="center" valign="top" rowspan="1" colspan="1">Yes</th><th align="center" valign="top" rowspan="1" colspan="1">No</th><th align="center" valign="top" rowspan="1" colspan="1">Total</th><th align="center" valign="top" rowspan="1" colspan="1">Yes</th><th align="center" valign="top" rowspan="1" colspan="1">No</th><th align="center" valign="top" rowspan="1" colspan="1">Total</th><th align="center" valign="top" rowspan="1" colspan="1">Yes</th><th align="center" valign="top" rowspan="1" colspan="1">No</th><th align="center" valign="top" rowspan="1" colspan="1">Total</th></tr><tr><th colspan="10" align="center" valign="top" rowspan="1"><hr/></th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">134</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;45</td><td align="center" valign="top" rowspan="1" colspan="1">179</td><td align="center" valign="top" rowspan="1" colspan="1">132</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;21</td><td align="center" valign="top" rowspan="1" colspan="1">153</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;&#x000a0;&#x000a0;7</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;27</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;34</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">No</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;23</td><td align="center" valign="top" rowspan="1" colspan="1">101</td><td align="center" valign="top" rowspan="1" colspan="1">124</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;25</td><td align="center" valign="top" rowspan="1" colspan="1">101</td><td align="center" valign="top" rowspan="1" colspan="1">126</td><td align="center" valign="top" rowspan="1" colspan="1">142</td><td align="center" valign="top" rowspan="1" colspan="1">107</td><td align="center" valign="top" rowspan="1" colspan="1">249</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Total</td><td align="center" valign="top" rowspan="1" colspan="1">157</td><td align="center" valign="top" rowspan="1" colspan="1">146</td><td align="center" valign="top" rowspan="1" colspan="1">303</td><td align="center" valign="top" rowspan="1" colspan="1">157</td><td align="center" valign="top" rowspan="1" colspan="1">122</td><td align="center" valign="top" rowspan="1" colspan="1">279</td><td align="center" valign="top" rowspan="1" colspan="1">149</td><td align="center" valign="top" rowspan="1" colspan="1">134</td><td align="center" valign="top" rowspan="1" colspan="1">283</td></tr></tbody></table><table-wrap-foot><fn id="TFN1"><p id="P44"><italic>Abbreviations: HDD, hospital discharge data;</italic> ICD-9-CM, International Classification of Diseases, Ninth Revision, Clinical Modification; <italic>NAS, neonatal abstinence syndrome.</italic></p></fn><fn id="TFN2"><label>a</label><p id="P45">Confirmed NAS cases met all 3 of the following criteria: (1) presence of a constellation of clinical signs consistent with NAS, not explained by another etiology, (2) documented history of maternal use of prescription or illicit drugs normally associated with NAS during pregnancy and/or laboratory confirmation of recent maternal drug use or fetal exposure to such drugs, and (3) a level of severity of signs that result in a neonatal hospitalization for more than 2 days.</p></fn></table-wrap-foot></table-wrap><table-wrap id="T2" position="float" orientation="landscape"><label>TABLE 2</label><caption><p id="P46">Sensitivity and Positive Predictive Value (With 95% Confidence Intervals) of Hospital Discharge Data Stratified by Hospital Discharge Data Type and <italic>International Classification of Diseases, Ninth Revision, Clinical Modification</italic> Code, Florida, 2010&#x02013;2011</p></caption><table frame="below" rules="none"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="left" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1">Linked HDD</th><th colspan="3" align="center" valign="top" rowspan="1">Unlinked HDD</th></tr><tr><th align="left" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th></tr><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th align="center" valign="top" rowspan="1" colspan="1">779.5 and/or 760.72</th><th align="center" valign="top" rowspan="1" colspan="1">779.5<sup><xref rid="TFN4" ref-type="table-fn">a</xref></sup></th><th align="center" valign="top" rowspan="1" colspan="1">760.72<sup><xref rid="TFN4" ref-type="table-fn">a</xref></sup></th><th align="center" valign="top" rowspan="1" colspan="1">779.5 and/or 760.72</th><th align="center" valign="top" rowspan="1" colspan="1">779.5<sup><xref rid="TFN4" ref-type="table-fn">a</xref></sup></th><th align="center" valign="top" rowspan="1" colspan="1">760.72<sup><xref rid="TFN4" ref-type="table-fn">a</xref></sup></th></tr><tr><th colspan="7" align="center" valign="top" rowspan="1"><hr/></th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">Sensitivity<sup><xref rid="TFN5" ref-type="table-fn">b</xref></sup></td><td align="center" valign="top" rowspan="1" colspan="1">85.4% (78.8%&#x02013;90.5%)</td><td align="center" valign="top" rowspan="1" colspan="1">84.1% (77.4%&#x02013;89.4%)</td><td align="center" valign="top" rowspan="1" colspan="1">4.7% (1.9%&#x02013;9.4%)</td><td align="center" valign="top" rowspan="1" colspan="1">96.2% (91,9%&#x02013;98.6%)</td><td align="center" valign="top" rowspan="1" colspan="1">94.9% (90.2%&#x02013;97.8%)</td><td align="center" valign="top" rowspan="1" colspan="1">5.4% (2.4%&#x02013;10.3%)</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Positive predictive value<sup><xref rid="TFN6" ref-type="table-fn">c</xref></sup></td><td align="center" valign="top" rowspan="1" colspan="1">74.9% (67.8%&#x02013;81.0%)</td><td align="center" valign="top" rowspan="1" colspan="1">86.3% (79.8%&#x02013;91.3%)</td><td align="center" valign="top" rowspan="1" colspan="1">20.6% (8.7%&#x02013;37.9%)</td><td align="center" valign="top" rowspan="1" colspan="1">75.5% (68.9%&#x02013;81.3%)</td><td align="center" valign="top" rowspan="1" colspan="1">86.1% (80.1 %&#x02013;90.9%)</td><td align="center" valign="top" rowspan="1" colspan="1">22.2% (10.1 %&#x02013;39.2%)</td></tr></tbody></table><table-wrap-foot><fn id="TFN3"><p id="P47">Abbreviation: HDD, hospital discharge data.</p></fn><fn id="TFN4"><label>a</label><p id="P48">ICD-9-CM codes 779.5 and 760.72 are not mutually exclusive of each other.</p></fn><fn id="TFN5"><label>b</label><p id="P49">Sensitivity = (number of confirmed neonatal abstinence syndrome (NAS) cases in the HDD/total number of confirmed NAS cases) &#x000d7; 100 (see <xref rid="T1" ref-type="table">Tables 1</xref> and <xref rid="T3" ref-type="table">3</xref>)</p></fn><fn id="TFN6"><label>c</label><p id="P50">Positive predictive value = (number of confirmed NAS cases in the HDD/total number of potential NAS cases detected in the HDD) &#x000d7; 100 (see <xref rid="T1" ref-type="table">Tables 1</xref> and <xref rid="T3" ref-type="table">3</xref>)</p></fn></table-wrap-foot></table-wrap><table-wrap id="T3" position="float" orientation="landscape"><label>TABLE 3</label><caption><p id="P51">Counts for Confirmed NAS Cases and Noncases by Detection in the Unlinked Hospital Discharge Data Set and <italic>ICD-9-CM</italic> Code Combination, Florida, 2010&#x02013;2011</p></caption><table frame="below" rules="none"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1">779.5 and/or<break/> 760.72 <italic>ICD-9-CM</italic> Codes</th><th colspan="3" align="center" valign="bottom" rowspan="1">779.5 <italic>ICD-9-CM</italic> Code</th><th colspan="3" align="center" valign="bottom" rowspan="1">760.72 <italic>ICD-9-CM</italic> Code</th></tr><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th></tr><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1">Confirmed NAS<sup><xref rid="TFN8" ref-type="table-fn">a</xref></sup></th><th colspan="3" align="center" valign="top" rowspan="1">Confirmed NAS<sup><xref rid="TFN8" ref-type="table-fn">a</xref></sup></th><th colspan="3" align="center" valign="top" rowspan="1">Confirmed NAS<sup><xref rid="TFN8" ref-type="table-fn">a</xref></sup></th></tr><tr><th align="center" valign="top" rowspan="1" colspan="1"/><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th><th colspan="3" align="center" valign="top" rowspan="1"><hr/></th></tr><tr><th align="left" valign="top" rowspan="1" colspan="1">Detected in HDD</th><th align="center" valign="top" rowspan="1" colspan="1">Yes</th><th align="center" valign="top" rowspan="1" colspan="1">No</th><th align="center" valign="top" rowspan="1" colspan="1">Total</th><th align="center" valign="top" rowspan="1" colspan="1">Yes</th><th align="center" valign="top" rowspan="1" colspan="1">No</th><th align="center" valign="top" rowspan="1" colspan="1">Total</th><th align="center" valign="top" rowspan="1" colspan="1">Yes</th><th align="center" valign="top" rowspan="1" colspan="1">No</th><th align="center" valign="top" rowspan="1" colspan="1">Total</th></tr><tr><th colspan="10" align="center" valign="top" rowspan="1"><hr/></th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">151</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;49</td><td align="center" valign="top" rowspan="1" colspan="1">200</td><td align="center" valign="top" rowspan="1" colspan="1">149</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;24</td><td align="center" valign="top" rowspan="1" colspan="1">173</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;&#x000a0;&#x000a0;8</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;28</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;36</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">No</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;&#x000a0;&#x000a0;6</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;97</td><td align="center" valign="top" rowspan="1" colspan="1">103</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;&#x000a0;&#x000a0;8</td><td align="center" valign="top" rowspan="1" colspan="1">&#x000a0;&#x000a0;98</td><td align="center" valign="top" rowspan="1" colspan="1">106</td><td align="center" valign="top" rowspan="1" colspan="1">141</td><td align="center" valign="top" rowspan="1" colspan="1">106</td><td align="center" valign="top" rowspan="1" colspan="1">247</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Total</td><td align="center" valign="top" rowspan="1" colspan="1">157</td><td align="center" valign="top" rowspan="1" colspan="1">146</td><td align="center" valign="top" rowspan="1" colspan="1">303</td><td align="center" valign="top" rowspan="1" colspan="1">157</td><td align="center" valign="top" rowspan="1" colspan="1">122</td><td align="center" valign="top" rowspan="1" colspan="1">279</td><td align="center" valign="top" rowspan="1" colspan="1">149</td><td align="center" valign="top" rowspan="1" colspan="1">134</td><td align="center" valign="top" rowspan="1" colspan="1">283</td></tr></tbody></table><table-wrap-foot><fn id="TFN7"><p id="P52"><italic>Abbreviations: HDD, hospital discharge data;</italic> ICD-9-CM, International Classification of Diseases, Ninth Revision, Clinical Modification; <italic>NAS, neonatal abstinence syndrome.</italic></p></fn><fn id="TFN8"><label>a</label><p id="P53">Confirmed NAS cases met all 3 of the following criteria: (1) presence of a constellation of clinical signs consistent with NAS, not explained by another etiology, (2) documented history of maternal use of prescription or illicit drugs normally associated with NAS during pregnancy and/or laboratory confirmation of recent maternal drug use or fetal exposure to such drugs, and (3) a level of severity of signs that result in a neonatal hospitalization for more than 2 days.</p></fn></table-wrap-foot></table-wrap><boxed-text id="BX1" position="float" orientation="portrait"><caption><title>Implications for Policy &#x00026; Practice</title></caption><list list-type="simple" id="L3"><list-item><label>&#x02585;</label><p id="P54">With the transition to using <italic>ICD-10-CM</italic> codes, long-term trend analysis of NAS prevalence will rely upon an assumption that <italic>ICD-9-CM</italic> data are accurate, yet few studies have assessed whether this assumption holds true.</p></list-item><list-item><label>&#x02585;</label><p id="P55">This study demonstrates that both linked and unlinked HDD perform well at capturing confirmed NAS cases.</p></list-item><list-item><label>&#x02585;</label><p id="P56">The use of the single <italic>ICD-9-CM</italic> code 779.5 resulted in the best profile of sensitivity and positive predictive value compared with other codes or the combination 779.5 and/or 760.72 code.</p></list-item><list-item><label>&#x02585;</label><p id="P57">These results can guide other state health agencies on evaluating and interpreting their own NAS surveillance data.</p></list-item></list></boxed-text></floats-group></article>