Evaluation of the Cepheid Xpert Flu Assay for Rapid Identification and

0 downloads 0 Views 375KB Size Report
Dec 30, 2011 - day-to-day operation of a clinical laboratory due to low volume. Some institutions ... ical Laboratory Improvement Amendments (CLIA)-waived labo- .... bation for 2 to 7 days, depending on the site, followed by immunofluo- rescence ... samples was required to reach at least 95% power to yield statistically.
Evaluation of the Cepheid Xpert Flu Assay for Rapid Identification and Differentiation of Influenza A, Influenza A 2009 H1N1, and Influenza B Viruses S. M. Novak-Weekley,a E. M. Marlowe,a M. Poulter,b D. Dwyer,c D. Speers,d W. Rawlinson,e C. Baleriola,e and C. C. Robinsonf Southern California Permanente Medical Group, North Hollywood, California, USAa; University of Virginia Health System, Charlottesville, Virginia, USAb; Centre for Infectious Diseases and Microbiology Laboratory Services, ICPMR, Westmead Hospital, Westmead, New South Wales, Australiac; PathWest Laboratory Medicine, Nedlands, Western Australia, Australiad; The Prince of Wales Hospital, Randwick, New South Wales, Australiae; and Children’s Hospital Colorado, Aurora, Colorado, USAf

The Xpert Flu Assay cartridge is a next-generation nucleic acid amplification system that provides multiplexed PCR detection of the influenza A, influenza A 2009 H1N1, and influenza B viruses in approximately 70 min with minimal hands-on time. Six laboratories participated in a clinical trial comparing the results of the new Cepheid Xpert Flu Assay to those of culture or real-time PCR with archived and prospectively collected nasal aspirate-wash (NA-W) specimens and nasopharyngeal (NP) swabs from children and adults. Discrepant results were resolved by DNA sequence analysis. After discrepant-result analysis, the sensitivities of the Xpert Flu Assay for prospective NA-W specimens containing the influenza A, influenza A 2009 H1N1, and influenza B viruses compared to those of culture were 90.0%, 100%, and 100%, respectively, while the sensitivities of the assay for prospective NP swabs compared to those of culture were 100%, 100%, and 100%, respectively. The sensitivities of the Xpert Flu Assay for archived NA-W specimens compared to those of Gen-Probe ProFluⴙ PCR for the influenza A, influenza A 2009 H1N1, and influenza B viruses were 99.4%, 98.4%, and 100%, respectively, while the sensitivities of the Xpert Flu Assay for archived NP swabs compared to those of ProFluⴙ were 98.1%, 100%, and 93.8%, respectively. The sensitivities of the Xpert Flu Assay with archived NP specimens compared to those of culture for the three targets were 97.5%, 100%, and 93.8%, respectively. We conclude that the Cepheid Xpert Flu Assay is an accurate and rapid method that is suitable for on-demand testing for influenza viral infection.

L

ower respiratory tract viral infections, including those due to influenza virus, are among the most common infectious diseases in humans, and they are associated with significant morbidity and mortality. These infections are a major economic burden in terms of both health care costs and lost income and productivity of workers (14, 15). Hospitalization of the very young or very old usually occurs, with increased admission rates for those individuals with underlying medical conditions or comorbidities (5). Antiviral treatment for influenza is available and effective if the disease is identified early in the course of illness, so rapid and accurate laboratory diagnosis is particularly important in both inpatient and outpatient settings (2, 6, 9). Some studies show that even treatment within the first 4 days of illness can have a positive impact on viral clearance and the disease’s course (10). In addition, knowing the etiologic agent of these infections can result in significant improvement of patient management by permitting the judicious use of antiviral agents in an era where antiviral resistance is continuing to increase. The introduction of highly accurate and rapid molecular assays for respiratory virus detection has prompted many laboratories to discontinue traditional culture or rapid, antigen-based techniques for influenza virus testing (3, 4, 11–13, 16, 18, 25). During the 2009 H1N1 influenza A virus pandemic, subtyping of influenza virus strains became important for monitoring the spread of the outbreak and managing high-risk patients. The emergence of this pandemic strain prompted several manufacturers to develop laboratory test systems to detect and subtype influenza viruses. Studies have shown the superior sensitivity of molecular diagnostic assays compared to that of other assays for the detection of respiratory viruses (8, 23, 24). Accurate assays with a short turnaround time (TAT) would promote appropriate antiviral therapy, potentially reduce antibiotic use, and

1704

jcm.asm.org

initiate proper clinical management of patients in both inpatient and outpatient settings. To date, five commercial molecular assays have received FDA clearance for the detection of viral respiratory pathogens, including the xTAG Respiratory Viral Panel (Luminex Corp., Austin, TX), Prodesse ProFlu⫹ (Gen-Probe Inc., San Diego CA), Film Array (Idaho Technology Inc., Salt Lake City, UT), Liat Influenza A/B (Iquum, Marlborough, MA), and the Cepheid Xpert Flu Assay (Cepheid, Sunnyvale, CA). Commercial assays range from those that detect only influenza A and B viruses to those that detect as many as 15 viral pathogens (18–20, 22). The identification of other viral respiratory pathogens can still be important in the inpatient setting, since knowledge of the etiologic agent can be a factor relevant to the overall clinical management of a patient. From a work flow perspective, conventional molecular assays in the United States not only require a licensed skilled technologist to run test batches but may require up to 8 h or more to complete. Complexity and a longer hands-on time for an assay are typically associated with a higher cost per test, especially when low numbers of specimens are tested. As the respiratory virus season wanes, maintaining higher-complexity assays may be challenging in the

Received 6 December 2011 Returned for modification 30 December 2011 Accepted 22 February 2012 Published ahead of print 29 February 2012 Address correspondence to Susan Novak-Weekley, [email protected]. Copyright © 2012, American Society for Microbiology. All Rights Reserved. doi:10.1128/JCM.06520-11 The authors have paid a fee to allow immediate free access to this article.

0095-1137/12/$12.00

Journal of Clinical Microbiology

p. 1704 –1710

Evaluation of the Cepheid Xpert Flu Assay

TABLE 1 Age distribution of the patients in this study No. (%) of samples Patient age (yr)

Prospective

Archived

ⱕ5 6–21 22–59 ⱖ60 Unknown

379 (59.31) 103 (16.12) 108 (16.90) 49 (7.67)

224 (29.95) 243 (32.49) 148 (19.79) 29 (3.88) 104 (13.90)

day-to-day operation of a clinical laboratory due to low volume. Some institutions may choose to develop population-specific testing algorithms, for example, by testing only inpatients using assays that cover a broader range of virus types. Currently, the only Clinical Laboratory Improvement Amendments (CLIA)-waived laboratory tests for influenza virus are point-of-care antigen detection assays that typically lack sensitivity and have variable specificity (1, 8). The American Society for Microbiology does not recommend rapid antigen tests for primary screening for influenza virus because of their suboptimal positive predictive value (PPV) and low sensitivity. (Algorithm available at www.asm.org). In addition, the Centers for Disease Control and Prevention also warn physicians of the limited sensitivity of rapid antigen assays and that a negative result should be interpreted with caution (1a). However, the desire for short TAT and accuracy still exists. High-complexity molecular methods, despite using PCR, do not necessarily satisfy the need for a short TAT. Cepheid has developed a moderately complex integrated nucleic acid amplification system that automates sample preparation and real-time PCR and detects the influenza A, influenza A 2009 H1N1, and influenza B viruses. This new Xpert Flu Assay is similar to the previous influenza A 2009 H1N1 virus test from Cepheid, which was released for emergency use only during the 2009 pandemic (7, 21). The newer assay provides enhanced detection of influenza A virus, separately identifies the pandemic 2009 H1N1 strain, and detects influenza B virus. The assay can be used in a routine clinical microbiology laboratory or nearer to a patient, which might have an impact on patient management. In this study, we compared the performance of the Cepheid Xpert Flu Assay to that of culture or an alternate PCR method in a clinical trial using both prospective and archived respiratory samples. MATERIALS AND METHODS Study population and sample collection. The prospective arm of this study was conducted at five health care institutions across the United States and Australia during 13 May 2010 through 29 October 2010. In the archived arm of the study, specimens were collected from three institutions from 23 February 2007 through 19 March 2010. One site collected only NP swabs, and the other two sites collected NA-W specimens. Eligible patients included children and adults with suspected influenza virus infection from whom NA-W specimens or NP swab specimens were collected according to the institutions’ standard practices. Table 1 shows the age distribution of the study population. Only residuals of specimens submitted for such testing were used; therefore, informed consent was waived by the institutional review board (IRB) at each site. Duplicate specimens from the same patient were excluded. For the fresh, prospectively collected specimens, after the establishment of patient eligibility and following the standard testing performed at each institution, a portion of the specimen was used for Xpert Flu Assay testing. Inclusion criteria for fresh prospective specimens included those NA-W or NP specimens for which there was sufficient excess material for

May 2012 Volume 50 Number 5

testing by the Xpert Flu Assay, culture (if not previously conducted as part of the standard-of-care testing), and DNA sequence analysis. Fresh prospective specimens that were excluded were those specimens from subjects enrolled previously in the study. Inclusion criteria for archived specimens included those NA-W or NP specimens that had been stored at ⫺70°C. Sufficient excess specimen had to be available for Xpert testing, Xpert retesting, DNA sequence analysis, and Prodesse ProFlu⫹ testing (if viral culture was not performed at the time of sample collection). Specimens requiring DNA sequence analysis were shipped to a single reference laboratory for testing. Investigational sites. Prospective samples were collected at three Australian and two U.S. sites. Archived specimens were obtained from three U.S. sites. The enrollment sites were North Hollywood, CA; Charlottesville, VA; Westmead, Australia; Nedlands, Australia; Randwick Australia; and Aurora, CO. The study was performed with the approval or waiver of the IRB at each investigational site. Molecular detection. The Xpert Flu Assay was performed at each participating institution as instructed by the manufacturer. Briefly, for NA-W specimens, 600 ␮l of sample was placed into a 3-ml UTM (universal transport medium) tube. The sample was inverted three times, 300 ␮l was added to the Xpert cartridge, and binding reagent 1 was added. For nasal swab specimens, 300 ␮l of the UTM containing the swab was added to the cartridge and then binding reagent 1 was added. For each day of study testing, three positive controls (one for influenza A virus, one for influenza A 2009 H1N1 virus, and one for influenza B virus) and one negative control provided by the sponsor were tested with the Xpert Flu Assay prior to the testing of patient samples. Any Xpert Flu Assay not yielding results on the first attempt was repeated once using new reagents and a new cartridge according to the manufacturer’s instructions. If a result was not obtained upon retesting, the results were reported as indeterminate. The Prodesse ProFlu⫹ assay was run with only a portion of the archived specimens (Table 2). Two sites performed the ProFlu⫹ assay. One site used the bioMérieux EasyMag and followed the procedure according to the manufacturer’s instructions. The other site used the Qiagen EZ1 with the Virus 2.0 protocol using a 200-␮l input and a 60-␮l elution volume. The Prodesse samples were subjected to the same freeze-thaw cycle as the Xpert Flu Assay. Controls for the ProFlu⫹ assay were run according to the manufacturer’s package insert. During the study, one site observed inhibition rates of approximately 4% (NA-W) and 0% (NP) using the ProFlu⫹ assay. Viral culture. Viral culture was performed at four of the testing sites. Viral culture was performed with a subset of the archived specimens (Table 3) and all of the prospective specimens (Tables 4 and 5). Three sites employed Madin-Darby canine kidney cell shell vial cultures with incubation for 2 to 7 days, depending on the site, followed by immunofluorescence assay utilizing reagents from Light Diagnostics (Millipore), Billerica, MA; Boots-Celltech Diagnostics, Plainview, NY; or Chemicon International (Millipore), Billerica, MA, and different staining protocols. One site used R-Mix Too Ready Cells for rapid culture of influenza virus (Diagnostic Hybrids, Athens, OH). The R-Mix assay was performed as directed by the manufacturer. Collection in UTM or viral transport medium was used at those sites that collected NP swabs. DNA sequence analysis. All specimens positive for influenza A virus by culture or the ProFlu⫹ assay were sequenced to identify the 2009 H1N1 strain. All influenza B virus discrepant samples were also sequenced. Sequences for analysis were generated with primers that flank the genomic sequences targeted by the Xpert Flu Assay. Specimens were received at Cepheid on dry ice (frozen). Samples were thawed, and RNA extractions were performed using the Viral RNA Mini Isolation kit (Qiagen catalog no. 50906). cDNA was generated from purified RNA using the One Step reverse transcription-PCR Mini Isolation kit (Qiagen catalog no. 210212) with target-specific primers on a PTC200 DNA PCR thermal cycler (48-well dual module; MJ Research). The amplicon was analyzed for purity and concentration using an Agilent Bioanalyzer (catalog no. G2938C). The cDNA was aliquoted into 96-

jcm.asm.org 1705

Novak-Weekley et al.

TABLE 2 Comparison of Xpert Flu Assay with ProFlu⫹ on archived specimens No. of specimensa Sample type and isolate NA-W Influenza A virus Influenza A virus 2009 H1N1 strain Influenza B virus NP swab Influenza A virus Influenza A virus 2009 H1N1 strain Influenza B virus

Total

P⫹ X⫹

P⫺ X⫹

P⫹ X⫺

P⫺ X⫺

% Sensitivity (95% CI)

% Specificity (95% CI)

% PPV (95% CI)

% NPV (95% CI)

425 422

159 124

0 1c

1b 2d

265 295

99.4 (96.6–100) 98.4 (94.4–99.8)

100 (98.6–100) 99.7 (98.1–100)

100 (97.7–100) 99.2 (95.6–100)

99.6 (97.9–100) 99.3 (97.6–99.9)

425

40

0

0

385

100 (91.2–100)

100 (99.0–100)

100 (91.2–100)

100 (99.0–100)

173 172

51 29

1e 1e

1 0

120 142

98.1 (89.7–100) 100 (88.1–100)

99.2 (95.5–100) 99.3 (96.2–100)

98.1 (89.7–100) 96.7 (82.8–99.9)

99.2 (95.5–100) 100 (97.4–100)

173

15

0

1e

157

93.8 (69.8–99.8)

100 (97.7–100)

100 (78.2–100)

99.4 (96.5–100)

P⫹/⫺, ProFlu⫹ positive/negative and sequencing of 2009 H1N1 strain target; X⫹/⫺, Xpert Flu Assay positive/negative. b Negative by sequencing. c Influenza A virus (not 2009 H1N1 strain) positive by sequencing. d Two of two 2009 H1N1 strain positive by sequencing. e Sequencing data not available. a

well microtiter plates and shipped to the vendor for sequencing. The cDNA amplicons were used as templates for bidirectional sequencing using Applied Biosystems BigDye Terminator Cycle Sequencing Kit. A positive-control sequencing reaction (pGEM) was included in each batch of sequencing runs. Sequencing reaction products were analyzed on AB13730xl automated DNA analyzers. The fluorescence data were automatically analyzed using Sequence Analysis software (Applied Biosystems). Sequencher software (Gene Codes) was used to assemble the sequence data generated for each PCR product. Acceptable sequence reads that were used to construct the consensus sequences met the following criteria: they (i) contained a minimum of 100 contiguous bases and (ii) had an average base-specific quality value or Phred quality score of ⱖ20. The consensus sequences were generated from base reads, which provided 4⫻ sequence coverage. The identity of the consensus was determined by comparison against the viral database through the National Center for Biotechnology Information using the BLASTALL program. In order to be considered a match to a sequence within the database, the E value had to be ⬍10e⫺20 for the specific target. DNA sequencing results were reported as either matching (H1N1) or not matching (not H1N1) for 2009 H1N1 sequences. Statistical analysis. The sample size used for this study was calculated using the binomial distribution with the lower confidence interval (CI) as the acceptance criterion. For the DNA sequence analysis of influenza A virus-positive culture isolates, two-sided CIs were used to be conservative with respect to statistical power for both sensitivity to and specificity for the influenza A, influenza A 2009 H1N1, and influenza B viruses relative to viral culture or the ProFlu⫹ assay. A sample size of at least 66 positive samples was required to reach at least 95% power to yield statistically

significant results for comparison of the Xpert Flu Assay to the reference test. Statistical analyses were performed using Fisher’s exact test. Fisher’s exact tests showed homogeneity of the Xpert Flu Assay results across the study sites, three test lots, four age categories, and both genders. Therefore, data were pooled across these groups for calculations of assay performance characteristics. Performance characteristics were calculated for the Xpert Flu Assay relative to viral culture or ProFlu⫹ if viral culture was not performed at the time of sample collection.

RESULTS

A total of 1,506 specimens were evaluated for this trial, including 700 prospective specimens and 806 archived specimens (Fig. 1). Of the 700 prospective specimens, 9 were ineligible and 52 were excluded from analysis, leaving a total of 639. Of the 806 archived specimens, 39 were ineligible and 19 were excluded, leaving a total of 748. Gender was not appreciably different among the groups, although the patient gender for 104 archived specimens was unknown (Table 1). The age distribution in both groups is shown in Table 1. The Xpert Flu Assay results were compared to the viral culture results for prospectively collected and archived clinical samples and the ProFlu⫹ assay results for archived specimens. Sensitivity and specificity data are shown in Tables 2 to 5 for the comparisons evaluated. Table 2 summarizes the results of testing archived specimens by the Xpert Flu Assay and ProFlu⫹. The PPV for influenza A 2009 H1N1 virus was 96.7% due to one Xpert Flu Assay-positive,

TABLE 3 Comparison of Xpert Flu Assay with culture on archived specimens No. of specimensa NA-W isolate

Total

C⫹ X⫹

C⫺ X⫹

C⫹ X⫺

C⫺ X⫺

% Sensitivity (95% CI)

% Specificity (95% CI)

% PPV (95% CI)

% NPV (95% CI)

Influenza A virus Influenza A virus 2009 H1N1 strain Influenza B virus

150 149

115 84

0 0

3b 0

32 65

97.5 (92.7–99.5) 100 (95.7–100)

100 (89.1–99.5) 100 (94.5–100)

100 (96.8–100) 100 (95.7–100)

91.4 (76.9–98.2) 100 (94.5–100)

150

30

1c

2d

117

93.8 (79.2–99.2)

99.2 (95.4–100)

96.8 (83.3–99.9)

98.3 (94.1–99.8)

C⫹/⫺, culture positive/negative and sequencing of 2009 H1N1 strain target; X⫹/⫺, Xpert Flu Assay positive/negative. b Two of three negative by sequencing; one of three influenza B virus positive. c Influenza B virus positive by sequencing. d Two of two negative by sequencing. a

1706

jcm.asm.org

Journal of Clinical Microbiology

Evaluation of the Cepheid Xpert Flu Assay

TABLE 4 Comparison of Xpert Flu Assay with culture on prospective specimens No. of specimensa Sample type and isolate NA-W Influenza A virus Influenza A virus 2009 H1N1 strain Influenza B virus NP swab Influenza A virus Influenza A virus 2009 H1N1 strain Influenza B virus

Total

C⫹ X⫹

C⫺ X⫹

C⫹ X⫺

C⫺ X⫺

% Sensitivity (95% CI)

% Specificity (95% CI)

% PPV (95% CI)

% NPV (95% CI)

342 342

6 4

3b 4c

1 0

332 334

85.7 (42.1–99.6) 100 (39.8–100)

99.1 (97.4–99.8) 98.8 (97.0–99.7)

66.7 (29.9–92.5) 50.0 (15.7–84.3)

99.7 (98.3–100) 100 (98.9–100)

342

7

2d

0

333

100 (65.2–100)

99.4 (98.1–99.9)

77.8 (45.0–95.9)

100 (99.1–100)

297 297

7 5

5e 3f

0 0

285 289

100 (59.0–100) 100 (47.8–100)

98.3 (93.3–99.0) 99.0 (97.0–99.8)

58.3 (27.7–84.8) 62.5 (24.5–91.5)

100 (98.7–100) 100 (98.7–100)

297

7

1g

1h

288

87.5 (47.3–99.7)

99.7 (98.1–100)

87.5 (47.3–99.7)

99.7 (98.1–100)

C⫹/⫺, culture positive/negative and sequencing of 2009 H1N1 strain target; X⫹/⫺, Xpert Flu Assay positive/negative. b Three of three novel H1N1 strain positive by sequencing. c Three of four novel H1N1 strain positive by sequencing; one of four influenza A virus positive. d Two of two influenza B virus positive by sequencing. e Three of five 2009 H1N1 strain positive by sequencing; two of five influenza A virus positive. f Two of three 2009 H1N1 strain positive by sequencing; one of three influenza A virus positive. g Influenza B virus positive by sequencing. h Influenza A virus (not influenza B virus) positive by sequencing. a

ProFlu⫹-negative strain for which confirmatory tests were not available. All other Xpert Flu Assay performance measures for NP swabs or NA-W specimens (sensitivity, specificity, PPV, and negative predictive value [NPV]) exceeded 98%. Only 3 of 425 specimens were Xpert Flu Assay positive and ProFlu⫹ negative. Sequencing data were available for only one NA-W specimen. This specimen was influenza A virus positive and identified as 2009 H1N1 by the GeneXpert assay. The strain could not be confirmed by sequencing. Four specimens were Xpert Flu Assay negative and ProFlu⫹ assay positive for influenza A virus. One specimen was negative for influenza virus by sequence analysis (false-positive ProFlu⫹ assay result), whereas two were 2009 H1N1 positive. Two specimens were unavailable for sequencing. Of the NP samples, only 16 were influenza B virus positive; contributing to the sensitivity of 93.8% based on one specimen that was ProFlu⫹ assay positive and Xpert Flu Assay negative but unavailable for sequencing. Table 3 summarizes the results of the testing the archived specimens by the Xpert Flu Assay and culture. The one specimen with inconsistent results for influenza B virus (Xpert Flu Assay influ-

enza B virus positive and culture negative) was shown by sequencing to be truly positive for influenza B virus. There were three specimens that were influenza A virus culture positive but Xpert Flu Assay negative. One of these specimens was actually sequenced as an influenza B virus. One specimen was culture negative and Xpert Flu Assay positive, and two specimens were culture positive and Xpert Flu Assay negative. The two specimens that were Xpert Flu Assay negative were also negative by sequencing. Why this occurred is unknown; the virus culture may have been contaminated, or the viruses may have degenerated during storage. The overall sensitivity, specificity, PPV, and NPV were very high (Table 3) when the Xpert Flu Assay was compared to culture for NP swabs. Table 4 summarizes the results of testing of prospectively collected specimens by the Xpert Flu Assay and culture. There were 18 specimens (9 NA-W and 9 NP swabs) that were Xpert Flu Assay positive but culture negative. Sequence analysis indicated that 16 samples contained influenza A virus RNA; however, two specimens that were identified as containing 2009 H1N1 by the Xpert Flu Assay did not contain sequences compatible with 2009 H1N1.

TABLE 5 Comparison of Xpert Flu Assay with culture on prospective specimens, corrected after discrepant-result analysis by sequencing No. of specimensa Sample type and isolate NA-W Influenza A virus Influenza A virus novel H1N1 strain Influenza B virus NP swab Influenza A virus Influenza A virus novel H1N1 strain Influenza B virus a

Total

Cs⫹ X⫹

Cs⫺ X⫹

Cs⫹ X⫺

Cs⫺ X⫺

% Sensitivity (95% CI)

% Specificity (95% CI)

% PPV (95% CI)

% NPV (95% CI)

342 342

9 7

0 1

1 0

332 334

90.0 (55.5–99.8) 100 (65.2–100.0)

100 (99.1–100.0) 99.7 (98.3–100.0)

100 (71.7–100.0) 87.5 (47.4–99.7)

99.7 (98.3–100.0) 100 (99.1–100.0)

342

9

0

0

333

100 (71.7–100.0)

100 (99.1–100.0)

100 (71.7–100.0)

100 (99.1–100.0)

297 297

12 7

0 1

0 0

285 289

100 (77.9–100.0) 100 (65.2–100.0)

100 (99.0–100.0) 99.7 (98.1–100.0)

100 (77.9–100.0) 87.5 (47.4–99.7)

100 (99.0–100.0) 100 (99.0–100.0)

297

8

0

0

289

100 (68.8–100.0)

100 (99.0–100)

100 (68.8–100.0)

100 (99.0–100.0)

Cs⫹/⫺, culture positive/negative, sequencing of 2009 H1N1 strain target and sequencing of specimens that disagree with Xpert results; X⫹/⫺, Xpert Flu Assay positive/negative.

May 2012 Volume 50 Number 5

jcm.asm.org 1707

Novak-Weekley et al.

FIG 1 Algorithm for specimen evaluation.

In addition, three specimens that were identified as influenza A virus positive by the Xpert assay were actually 2009 H1N1 positive by sequencing. There were two specimens that were Xpert Flu Assay negative and culture positive (Table 4). Of those specimens, one contained sequences consistent with influenza A virus even though it was identified as influenza B virus by culture. PPV in this data set was low but increased considerably after discrepant-result analysis was performed (Table 5). One explanation of the slightly lower sensitivity (compared with that of a reference method) of fresh samples is the possibility that freezing of samples may enhance sensitivity by releasing viral nucleic acid from intracellular sites. The PPV for the H1N1 subtype was only 87.5% in this data set due to the lower number of influenza A virus-positive samples encountered in the prospective specimens during the clinical trial. DISCUSSION

Early detection of circulating viruses can help hospitals prepare for each respiratory virus season. Subtyping of influenza viruses was an important focus for clinical laboratories during the pandemic because this information allowed laboratories to quickly assess the extent of the 2009 H1N1 virus’s prevalence in their community. There were also subtype-dependent treatment considerations, because the 2009 H1N1 virus is sensitive to oseltamivir, whereas seasonal H1N1 influenza A virus was resistant to the drug. In the 2010-2011 season, the 2009 H1N1 strain replaced the seasonal H1N1 influenza A virus strain, reducing the clinical need to separately identify the pandemic virus. Rapid detection of in-

1708

jcm.asm.org

fluenza virus allows health care providers to treat patients with oseltamivir, limit the use of unnecessary antimicrobial agents, assign respiratory isolation resources more efficiently, and potentially decrease lengths of stay in the hospital. If patients in the outpatient setting are diagnosed with influenza and treated in a timely fashion, this may decrease the morbidity and mortality, as well as the economic burden, due to this illness by reducing the spread of the disease. To have this impact, however, testing would need to be performed expeditiously so that patients could get their antiviral medications in time to impact the course of the disease. Molecular assays can be competitive in terms of cost per test compared to culture-based techniques while providing an improved turnaround time and increased sensitivity over viral culture. Nevertheless, one study has shown that even with the implementation of molecular respiratory virus testing, hospital costs may not be impacted (17). More outcome studies are needed to fully understand the impact of molecular testing in the clinical setting. Favorable results for cost avoidance will help laboratories convince administrators of the value of molecular testing for respiratory viruses. The advantages of PCR over viral culture were readily demonstrated in this study, where the Xpert Flu Assay detected 18 additional (prospective) positive specimens containing influenza virus, all of which were confirmed by sequence analysis as containing influenza A or B virus. However, the Xpert Flu Assay identified two samples as 2009 H1N1 that could not be confirmed by sequence analysis. We speculate that this might be due to the greater efficiency of PCR used in the Xpert Flu Assay than PCR

Journal of Clinical Microbiology

Evaluation of the Cepheid Xpert Flu Assay

used prior to sequence analysis or to degradation of RNA in the samples before sequencing. To date, only four other respiratory virus assays are FDA cleared in addition to the Cepheid Xpert Flu Assay. Analyte-specific reagents (ASRs) are also available from several manufacturers. Some laboratory-developed tests for respiratory viruses (i.e., home-brew assays) may cost less than FDA-cleared tests, but they do not have clinical trial data supporting their performance characteristics. Reimbursement for these assays is less likely than for FDA-cleared assays. In addition, adequate validation of lab-developed tests, even those using ASRs, becomes challenging, especially for laboratories that do not have access to sufficiently large numbers of samples appropriate for validation protocols. Another drawback of both ASRs and high-complexity molecular diagnostic testing in general is TAT; since testing is typically performed in batches, a possible 1-h analytical procedure often takes several days before a clinically actionable result is reported. In summary, this clinical trial comparing the newly FDAcleared Xpert Flu Assay to two current reference methods for influenza virus testing, the ProFlu⫹ assay and culture, found that performance of the Xpert Flu Assay was comparable to that of the molecular reference standard. Consistent with previous studies using molecular methods, we found a higher assay sensitivity of PCR than of viral culture in the prospective specimen set for which culture results were available. Although the PPV shown in Table 4 for prospective NA-W specimens compared to that of culture was low before resolution, bidirectional sequencing of the specimens indicated that the results of the Xpert Flu Assay were correct (Table 5). The assay is easy to use; all reagents are contained in the cartridge, and the assay requires only approximately 2 min of hands-on time. This allows deployment in facilities where licensed technologists may not be available or where technologists are unfamiliar with high-complexity PCR assays. Not only is the test relatively rapid (the time to a result is approximately 70 min), but the closed system helps mitigate the cross-contamination issues that can be problematic with other molecular-analysis-based assays. The format of the assay makes integration into a routine clinical laboratory reasonably simple. A major advantage of rapid molecular testing with moderately complex assays, such as the Xpert Flu Assay, is that they can be deployed in rapid-response laboratories (STAT labs or core labs) in order to maximize the medical impact of the results. STAT labs, although open 24 h a day 7 days a week to provide rapid results in most hospitals, are not typically staffed by laboratory personnel with molecular diagnostic training, nor would such technologists have time to perform complex testing. The Xpert Flu Assay fits the profile of many tests currently being offered by STAT labs; it is rated as being of moderate complexity under CLIA, it is not batch dependent, it can easily be performed upon receipt of the specimen (on demand), and results are available in less than 2 h. Placement of an Xpert system in areas such as emergency departments may be a solution to the replacement of inaccurate antigen tests. The availability of FDA-cleared assays greatly enhances the ability of PCR technology to be deployed in a spectrum of laboratories, especially those that do not have the ability to develop their own assays or to use ASR-based assays. Administrators have to make many decisions when determining how molecular respiratory viral assays will be integrated into their laboratories and institutions. The analytical performance of the assay needs to be a primary consideration. In addition, cost, ease of use, and the avail-

May 2012 Volume 50 Number 5

able menu must be assessed before making any final decisions to move to a molecular assay. More FDA-cleared platforms allow laboratories expanded choices for the implementation of respiratory viral testing assays. For laboratories that do not have the skill set to maintain adequate cell culture techniques, a simple, accurate PCR assay may afford some institutions the ability to offer expanded testing services for respiratory viruses with the Xpert platform. The list price of the Xpert Flu Assay is approximately $50 per cartridge, although pricing would vary based on volume in the institution. The Xpert Flu Assay provides a rapid, reliable, and easily deployable way to test for influenza A and B viruses and identifies the presence of the novel 2009 H1N1 strain as well. ACKNOWLEDGMENTS This work was supported by a grant from Cepheid, Inc. We thank Kristin Pretty, Darcy Velasquez, and Joven Cumpio for their technical assistance during this study. S. M. Novak-Weekley, E. M. Marlowe, C. C. Robinson, and M. Poulter have received grants from Cepheid related to other projects.

REFERENCES 1. Blyth CC, Iredell JR, Dwyer DE. 2009. Rapid-test sensitivity for novel swine-origin influenza A (H1N1) virus in humans. N. Engl. J. Med. 361: 2493. 1a.Centers for Disease Control and Prevention. 2009. Evaluation of rapid influenza diagnostic tests for detection of novel influenza A (H1N1) Virus—United States, 2009. MMWR Morbid. Mortal. Wkly. Rep. 58:526 – 529. 2. Garbino J, et al. 2004. Lower respiratory viral illnesses: improved diagnosis by molecular methods and clinical impact. Am. J. Respir. Crit. Care Med. 170:1197–1203. 3. Ginocchio CC, St George K. 2009. Likelihood that an unsubtypeable influenza A virus result obtained with the Luminex xTAG respiratory virus panel is indicative of infection with novel A/H1N1 (swine-like) influenza virus. J. Clin. Microbiol. 47:2347–2348. 4. Ginocchio CC, et al. 2009. Evaluation of multiple test methods for the detection of the novel 2009 influenza A (H1N1) during the New York City outbreak. J. Clin. Virol. 45:191–195. 5. Ison MG. 2009. Influenza in hospitalized adults: gaining insight into a significant problem. J. Infect. Dis. 200:485– 488. 6. Jennings LC, Anderson TP, Werno AM, Beynon KA, Murdoch DR. 2004. Viral etiology of acute respiratory tract infections in children presenting to hospital: role of polymerase chain reaction and demonstration of multiple infections. Pediatr. Infect. Dis. J. 23:1003–1007. 7. Jenny SL, Hu Y, Overduin P, Meijer A. 2010. Evaluation of the Xpert Flu A Panel nucleic acid amplification-based point-of-care test for influenza A virus detection and pandemic H1 subtyping. J. Clin. Virol. 49:85– 89. 8. Kok J, et al. 2010. Comparison of a rapid antigen test with nucleic acid testing during cocirculation of pandemic influenza A/H1N1 2009 and seasonal influenza A/H3N2. J. Clin. Microbiol. 48:290 –291. 9. Lee BE, et al. 2006. Enhanced identification of viral and atypical bacterial pathogens in lower respiratory tract samples with nucleic acid amplification tests. J. Med. Virol. 78:702–710. 10. Lee N, et al. 2009. Viral loads and duration of viral shedding in adult patients hospitalized with influenza. J. Infect. Dis. 200:492–500. 11. Liao RS, Tomalty LL, Majury A, Zoutman DE. 2009. Comparison of viral isolation and multiplex real-time reverse transcription-PCR for confirmation of respiratory syncytial virus and influenza virus detection by antigen immunoassays. J. Clin. Microbiol. 47:527–532. 12. Mahony J, et al. 2007. Development of a respiratory virus panel test for detection of twenty human respiratory viruses by use of multiplex PCR and a fluid microbead-based assay. J. Clin. Microbiol. 45:2965– 2970. 13. Marshall DJ, et al. 2007. Evaluation of a multiplexed PCR assay for detection of respiratory viral pathogens in a public health laboratory setting. J. Clin. Microbiol. 45:3875–3882. 14. Neuzil KM, Mellen BG, Wright PF, Mitchel EF, Jr, Griffin MR. 2000.

jcm.asm.org 1709

Novak-Weekley et al.

15. 16. 17.

18.

19.

The effect of influenza on hospitalizations, outpatient visits, and courses of antibiotics in children. N. Engl. J. Med. 342:225–231. Neuzil KM, Wright PF, Mitchel EF, Jr, Griffin MR. 2000. The burden of influenza illness in children with asthma and other chronic medical conditions. J. Pediatr. 137:856 – 864. Nolte FS, et al. 2007. MultiCode-PLx system for multiplexed detection of seventeen respiratory viruses. J. Clin. Microbiol. 45:2779 –2786. Oosterheert JJ, et al. 2005. Impact of rapid detection of viral and atypical bacterial pathogens by real-time polymerase chain reaction for patients with lower respiratory tract infection. Clin. Infect. Dis. 41: 1438 –1444. Pabbaraju K, Tokaryk KL, Wong S, Fox JD. 2008. Comparison of the Luminex xTAG respiratory viral panel with in-house nucleic acid amplification tests for diagnosis of respiratory virus infections. J. Clin. Microbiol. 46:3056 –3062. Popowitch EB, Rogers E, Miller MB. 2011. Retrospective and prospective verification of the Cepheid Xpert influenza virus assay. J. Clin. Microbiol. 49:3368 –3369.

1710

jcm.asm.org

20. Rand KH, Rampersaud H, Houck HJ. 2011. Comparison of two multiplex methods for detection of respiratory viruses: FilmArray RP and xTAG RVP. J. Clin. Microbiol. 49:2449 –2453. 21. Sambol AR, et al. 2010. Validation of the Cepheid Xpert Flu A real time RT-PCR detection panel for emergency use authorization. J. Clin. Virol. 48:234 –238. 22. Selvaraju SB, Selvarangan R. 2010. Evaluation of three influenza A and B real-time reverse transcription-PCR assays and a new 2009 H1N1 assay for detection of influenza viruses. J. Clin. Microbiol. 48:3870 –3875. 23. Szewczuk E, et al. 2010. Rapid semi-automated quantitative multiplex tandem PCR (MT-PCR) assays for the differential diagnosis of influenzalike illness. BMC Infect. Dis. 10:113. 24. Weinberg GA, et al. 2004. Superiority of reverse-transcription polymerase chain reaction to conventional viral culture in the diagnosis of acute respiratory tract infections in children. J. Infect. Dis. 189:706 –710. 25. Wong S, Pabbaraju K, Lee BE, Fox JD. 2009. Enhanced viral etiological diagnosis of respiratory system infection outbreaks by use of a multitarget nucleic acid amplification assay. J. Clin. Microbiol. 47:3839 –3845.

Journal of Clinical Microbiology