J Clin MicrobiolJ. Clin. MicrobioljcmjcmJCMJournal of Clinical Microbiology0095-11371098-660XAmerican Society for Microbiology1752 N St., N.W., Washington, DC25854480443206500875-1510.1128/JCM.00875-15VirologyDetermination of a Viral Load Threshold To Distinguish Symptomatic versus Asymptomatic Rotavirus Infection in a High-Disease-Burden African PopulationRT-PCR Diagnosis of Rotavirus Diarrhea in MalawiBennett et al.BennettA.abBar-ZeevN.abJereK. C.abTateJ. E.cParasharU. D.cNakagomiO.dHeydermanR. S.aeFrenchN.bIturriza-GomaraM.bCunliffeN. A.bMalawi-Liverpool-Wellcome Trust Clinical Research Programme, College of Medicine, University of Malawi, Blantyre, MalawiInstitute of Infection and Global Health, University of Liverpool, Liverpool, United KingdomCenters for Disease Control and Prevention, Atlanta, Georgia, USADepartment of Molecular Microbiology and Immunology, Nagasaki University, Nagasaki, JapanLiverpool School of Tropical Medicine, Liverpool, United KingdomTangY.-W.EditorAddress correspondence to N. A. Cunliffe, n.a.cunliffe@liv.ac.uk.

M.I.-G. and N.A.C. contributed equally to this work.

Citation Bennett A, Bar-Zeev N, Jere KC, Tate JE, Parashar UD, Nakagomi O, Heyderman RS, French N, Iturriza-Gomara M, Cunliffe NA. 2015. Determination of a viral load threshold to distinguish symptomatic versus asymptomatic rotavirus infection in a high-disease-burden African population. J Clin Microbiol 53:1951–1954. doi:10.1128/JCM.00875-15.

8420156201584201553619511954142015142015Copyright © 2015, Bennett et al.2015Bennett et al.This is an open-access article distributed under the terms of the Creative Commons Attribution 3.0 Unported license.

We evaluated quantitative real-time PCR to establish the diagnosis of rotavirus gastroenteritis in a high-disease-burden population in Malawi using enzyme immunoassay as the gold standard diagnostic test. In 146 children with acute gastroenteritis and 65 asymptomatic children, we defined a cutoff point in the threshold cycle value (26.7) that predicts rotavirus-attributable gastroenteritis in this population. These data will inform the evaluation of direct and indirect rotavirus vaccine effects in Africa.

TEXT

Rotavirus gastroenteritis is a major cause of infant morbidity and mortality with 90% of rotavirus-associated deaths occurring in low-income settings (13). Two live, oral vaccines (Rotarix [GlaxoSmithKline Biologicals, Belgium] and RotaTeq [Merck & Co. Inc., USA]) are entering childhood immunization programs worldwide. These have greatly reduced rotavirus-attributable hospitalizations in high-income and middle-income countries (4, 5), and a recently published study from Malawi was the first report of vaccine effectiveness from a low-income country (6).

Laboratory diagnosis of rotavirus gastroenteritis is typically established by detection of rotavirus antigen in stool using enzyme-immunoassay (EIA). This correlates well with clinical disease in developed settings but is less sensitive than real-time reverse transcription-quantitative PCR (qRT-PCR) (7, 8). However, as qRT-PCR can detect rotavirus shedding in the stool in up to 30% of asymptomatic young children in developed settings, the clinical implications of a positive result is uncertain (9, 10). A positive relationship between fecal viral load and EIA-positive rotavirus disease has been demonstrated in children from the United Kingdom and the United States (7, 11) and has been used to define a quantitative cycle threshold (CT) cutoff point in qRT-PCR corresponding to clinical disease (7, 11).

Much of our understanding of the performance of rotavirus diagnostic tests comes from well-resourced settings (1113). However, rotavirus disease patterns in the poorest settings differ from those in the developed world, with higher force of infection, earlier disease onset, and delayed acquisition of immunity, which may impact diagnosis (14, 15). This study in Blantyre, southern Malawi, aimed to evaluate the performance of qRT-PCR and EIA in order to define a cutoff point in the qRT-PCR CT value to define clinical disease in a high-burden, resource-poor African country and was undertaken as part of an assessment of monovalent rotavirus vaccine effectiveness following its introduction into Malawi's national immunization program in October 2012 (6). Children <5 years of age were recruited on presentation to Queen Elizabeth Central Hospital (QECH) with acute diarrhea (the passage of three or more loose stools within a 24-h time period within 14 days of presentation). Age- and neighborhood-matched community controls were enrolled in Blantyre District (6). A single stool sample was collected from each child and tested for rotavirus antigen by EIA (Premier Rotaclone; Meridian Biosciences, Cincinnati, OH) without knowledge of clinical status.

Following nucleic acid extraction from 10% to 20% stool suspensions, cDNA was synthesized using random primers. VP6 qRT-PCR was performed using VP6 gene-specific primers and probes as previously described, using 2× TaqMan Universal Master Mix II (Invitrogen, Paisley, United Kingdom), and a Rotor-Gene Q 5-plex system (Qiagen, Manchester, United Kingdom) (13, 16). A rotavirus qRT-PCR result was deemed positive if the CT value was <40 and negative when the CT value was ≥40.

For amounts of cDNA, >30 copies intra-assay reproducibility was high (Table 1). Samples positive by qRT-PCR that had a CT value below 11 (n = 2) could not be quantified.

VP6 qPCR inter-assay reproducibility in eight separate runs

Standard curve input copy no.CT value
Calculated copy no.
MeanMinimumMaximumMean%CVa
3,000,00015.0814.8616.352,929,2610.13
300,00018.9118.1419.25335,4570.12
30,00023.3422.2924.9927,2360.14
3,00026.8525.9027.733,3200.20
30031.4730.5132.883060.20
3034.9433.4535.98300.15
338.2337.27>40 (neg)4b0.25b

CV, coefficient of variation.

Calculated only for assays in which the result was positive for this sample (<40).

Frequency of detection of rotavirus using EIA and qRT-PCR was described and tested for discordance using McNemar's test. Median CT values were compared between EIA-positive (diarrhea), EIA-negative (diarrhea), and asymptomatic samples using Wilcoxon rank sum tests. Receiver operating characteristics (ROC) analysis was used to evaluate the ability of qRT-PCR CT values to discriminate between the presence and absence of symptomatic gastroenteritis, using EIA as a gold standard (17, 18) and defining the absence of disease as EIA negative without diarrhea. A cutoff point that optimized sensitivity and specificity was identified using Youden's index [(sensitivity + specificity) − 1] (19, 20). Analysis was conducted using Stata 12.1 (StataCorp, USA) and GraphPad Prism 6 (GraphPad Software, Inc., USA). Ethical approval was provided by the National Health Sciences Research Committee, Lilongwe, Malawi (867) and by the Research Ethics Committee of the University of Liverpool, Liverpool, United Kingdom (000490).

A total of 238 fecal samples were collected. Of these, clinical data were available for 225. Fourteen community samples were excluded for intercurrent diarrhea, resulting in 211 samples available for analysis: 77 EIA-positive diarrheal cases, 69-EIA negative diarrheal cases, and 65 asymptomatic children. Of the 211 samples with corresponding clinical data, 77 of the 77 (100%) children with EIA-positive diarrhea were also qRT-PCR positive and 34 (49.3%) of 69 children with EIA-negative diarrhea were qRT-PCR positive. Of the 65 asymptomatic community controls, 1 (1.5%) was EIA positive and 20/65 (30.8%) had virus detected using qRT-PCR.

There was a significant difference in median qRT-PCR CT values between EIA-negative diarrheal cases (median, 35.9; interquartile range [IQR], 31.0 to 38.0) and those of EIA-positive diarrheal cases (median, 19.5; IQR, 16.9 to 23.3; P = <0.001), but there was no significant difference in CT values between EIA-negative diarrheal cases and those of asymptomatic community controls (median, 37.1; IQR, 33.4 to 38.6; P = 0.375) (Fig. 1 and 2). Quantitative real-time PCR CT values discriminated well between the presence and absence of rotavirus gastroenteritis as defined using EIA, with an area under the curve of 0.96 (95% confidence interval [CI], 0.93 to 1.00). The point that maximized the Youden index was at a CT value of 26.7, at which point sensitivity and specificity were 89% and 95%, respectively (corresponding with an average cDNA copy number per reaction of 3,000 [95% CI, 2,657 to 3,514]; Table 1).

Distribution of qRT-PCR CT values between diarrheal cases and asymptomatic controls.

qRT-PCR CT values according to EIA result and clinical category.

We have demonstrated differences in CT values between rotavirus EIA-positive and EIA-negative diarrheal children in a high-burden, low-resource setting and defined an optimal CT cutoff point, which may be utilized to diagnose clinical disease as molecular diagnostics are increasingly rolled out in this region. We found that, consistent with data from the United Kingdom and the United States, a positive rotavirus EIA result was strongly associated with the presence of diarrhea, with only one asymptomatic, EIA-positive child identified (7, 11). However, qRT-PCR was more sensitive at detecting rotavirus in stool than EIA (12), with a high frequency (31%) of low-level viral shedding detected by qRT-PCR in samples from the asymptomatic group. This confirms that detection of rotavirus using qRT-PCR without consideration of viral load is insufficient to attribute disease causation (11). The prevalence of viral shedding in the asymptomatic group is high (31%) but is consistent with that found in young children in the United Kingdom (9).

There were significant differences in the rotavirus CT values between diarrheal children who were EIA positive and those who were EIA negative, with substantially higher CT values (lower viral load) in children who were EIA negative, and no significant difference in qRT-PCR CT values between EIA-negative diarrheal children and those of asymptomatic children. ROC analysis confirmed the discriminatory value of qRT-PCR CT values. The cutoff point in our study is similar to that defined in a United Kingdom population using the same assay (11), suggesting that any difference in frequency of infection or in disease severity between the two settings does not impact distribution of viral loads and that EIA and qRT-PCR perform similarly in the detection of rotavirus gastroenteritis in each environment.

Children were recruited from a referral hospital, and a large number had severe disease. However, the cutoff we identified correlates well with that identified using a cohort of children recruited from primary care in the United Kingdom, in whom less severe disease should be better represented (11). Moreover, since reaction sensitivities may vary between PCR assays conducted in different laboratories, we have provided cDNA copy numbers corresponding to the qRT-PCR CT values to facilitate comparison.

Assessment of rotavirus vaccine effectiveness requires accurate laboratory diagnostics. In high-burden, low-income settings where direct vaccine effectiveness is lower (6), demonstrating indirect (herd) benefits becomes more important. Should rotavirus vaccine reduce asymptomatic shedding, its impact on community rotavirus transmission may be substantial. Future evaluation of vaccine indirect effects will require measurement of impact on asymptomatic shedding and community transmission using the cutoffs we have defined in this paper. Our findings, therefore, inform the evaluation of direct and indirect rotavirus vaccine effects in Africa.

ACKNOWLEDGMENTS

This work was supported by a Wellcome Trust program grant (no. 091909/Z/10/Z) and the Malawi-Liverpool Wellcome Trust clinical research program core award. A.B. was supported by a Wellcome Trust clinical Ph.D. fellowship (grant no. 102466/Z/13/A).

The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the U.S. Centers for Disease Control and Prevention.

N.B.-Z. and N.F. have received research grant support from GlaxoSmithKline Biologicals for work on rotavirus vaccines. M.I.-G. has received research grant support from GlaxoSmithKline Biologicals and Sanofi Pasteur MSD for work on rotavirus. O.N. has received research grant support and honoraria from Japan Vaccine and Merck Sharp & Dohme for lectures on rotavirus vaccines. N.A.C. has received research grant support and honoraria for participation in rotavirus vaccine advisory board meetings from GlaxoSmithKline Biologicals. The other authors declare no conflicts of interest.

REFERENCESParasharUD, NelsonEA, KangG 2013 Diagnosis, management, and prevention of rotavirus gastroenteritis in children. BMJ347:f7204. doi:10.1136/bmj.f7204.24379214LanataCF, Fischer-WalkerCL, OlascoagaAC, TorresCX, AryeeMJ, BlackRE 2013 Global causes of diarrheal disease mortality in children <5 years of age: a systematic review. PLoS One8:e72788. doi:10.1371/journal.pone.0072788.24023773TateJE, BurtonAH, Boschi-PintoC, SteeleAD, DuqueJ, ParasharUD 2012 2008 estimate of worldwide rotavirus-associated mortality in children younger than 5 years before the introduction of universal rotavirus vaccination programmes: a systematic review and meta-analysis. Lancet Infect Dis12:136141. doi:10.1016/S1473-3099(11)70253-5.22030330PatelMM, PatziM, PastorD, NinaA, RocaY, AlvarezL, IniguezV, RiveraR, TamKI, QuayeO, BowenM, ParasharU, De OliveiraLH 2013 Effectiveness of monovalent rotavirus vaccine in Bolivia: case-control study. BMJ346:f3726. doi:10.1136/bmj.f3726.23783434TateJE, HaynesA, PayneDC, CorteseMM, LopmanBA, PatelMM, ParasharUD 2013 Trends in national rotavirus activity before and after introduction of rotavirus vaccine into the national immunization program in the United States, 2000 to 2012. Pediatr Infect Dis J32:741744. doi:10.1097/INF.0b013e31828d639c.23426425Bar-ZeevN, KapandaL, TateJE, JereKC, Iturriza-GomaraM, NakagomiO, MwansamboC, CostelloA, ParasharUD, HeydermanRS, FrenchN, CunliffeNA 2015 Effectiveness of a monovalent rotavirus vaccine in infants in Malawi after programmatic roll-out: an observational and case-control study. Lancet Infect Dis15:422428. doi:10.1016/S1473-3099(14)71060-6.25638521TateJE, Mijatovic-RustempasicS, TamKI, LydeFC, PayneDC, SzilagyiP, EdwardsK, StaatMA, WeinbergGA, HallCB, ChappellJ, McNealM, GentschJR, BowenMD, ParasharUD 2013 Comparison of 2 assays for diagnosing rotavirus and evaluating vaccine effectiveness in children with gastroenteritis. Emerg Infect Dis19:12451252. doi:10.3201/eid1908.130461.23876518AmarCF, EastCL, GrayJ, Iturriza-GomaraM, MaclureEA, McLauchlinJ 2007 Detection by PCR of eight groups of enteric pathogens in 4,627 faecal samples: re-examination of the English case-control Infectious Intestinal Disease Study (1993-1996). Eur J Clin Microbiol Infect Dis26:311323. doi:10.1007/s10096-007-0290-8.17447091PhillipsG, LopmanB, RodriguesLC, TamCC 2010 Asymptomatic rotavirus infections in England: prevalence, characteristics, and risk factors. Am J Epidemiol171:10231030. doi:10.1093/aje/kwq050.20392863CorcoranMS, van WellGT, van LooIH 2014 Diagnosis of viral gastroenteritis in children: interpretation of real-time PCR results and relation to clinical symptoms. Eur J Clin Microbiol Infect Dis33:16631673. doi:10.1007/s10096-014-2135-6.24828003PhillipsG, LopmanB, TamCC, Iturriza-GomaraM, BrownD, GrayJ 2009 Diagnosing rotavirus A associated IID: using ELISA to identify a cut-off for real time RT-PCR. J Clin Virol44:242245. doi:10.1016/j.jcv.2008.12.001.19179107WildeJ, YolkenR, WilloughbyR, EidenJ 1991 Improved detection of rotavirus shedding by polymerase chain reaction. Lancet337:323326. doi:10.1016/0140-6736(91)90945-L.1703618Iturriza-GomaraM, ElliotAJ, DockeryC, FlemingDM, GrayJJ 2009 Structured surveillance of infectious intestinal disease in pre-school children in the community: ‘The Nappy Study'. Epidemiol Infect137:922931. doi:10.1017/S0950268808001556.19017426GladstoneBP, RamaniS, MukhopadhyaI, MuliyilJ, SarkarR, RehmanAM, JaffarS, GomaraMI, GrayJJ, BrownDW, DesselbergerU, CrawfordSE, JohnJ, BabjiS, EstesMK, KangG 2011 Protective effect of natural rotavirus infection in an Indian birth cohort. N Engl J Med365:337346. doi:10.1056/NEJMoa1006261.21793745CunliffeNA, NgwiraBM, DoveW, ThindwaBD, TurnerAM, BroadheadRL, MolyneuxME, HartCA 2010 Epidemiology of rotavirus infection in children in Blantyre, Malawi, 1997-2007. J Infect Dis202(Suppl):S168S174. doi:10.1086/653577.20684698Eurorota.net: European Rotavirus network. 2011 Rotavirus detection and typing. Nucleic acid extraction and reverse transcription virus detection by PCR. Rotavirus VP7, VP4, VP6 and NSP4 genotyping. http://www.eurorota.net/docs.php Accessed 15 February 2015.AltmanDG, BlandJM 1994 Diagnostic tests 3: receiver operating characteristic plots. BMJ309:188. doi:10.1136/bmj.309.6948.188.8044101ZweigMH, CampbellG 1993 Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem39:561577.8472349YoudenWJ 1950 Index for rating diagnostic tests. Cancer3:3235. doi:10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3.15405679FlussR, FaraggiD, ReiserB 2005 Estimation of the Youden index and its associated cutoff point. Biom J47:458472. doi:10.1002/bimj.200410135.16161804