<!DOCTYPE article
PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD with MathML3 v1.3 20210610//EN" "JATS-archivearticle1-3-mathml3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="1.3" xml:lang="en" article-type="research-article"><?properties open_access?><?properties manuscript?><processing-meta base-tagset="archiving" mathml-version="3.0" table-model="xhtml" tagset-family="jats"><restricted-by>pmc</restricted-by></processing-meta><front><journal-meta><journal-id journal-id-type="nlm-journal-id">101708638</journal-id><journal-id journal-id-type="pubmed-jr-id">46693</journal-id><journal-id journal-id-type="nlm-ta">J Open Source Softw</journal-id><journal-id journal-id-type="iso-abbrev">J Open Source Softw</journal-id><journal-title-group><journal-title>Journal of open source software</journal-title></journal-title-group><issn pub-type="epub">2475-9066</issn></journal-meta><article-meta><article-id pub-id-type="pmid">39624182</article-id><article-id pub-id-type="pmc">11611387</article-id><article-id pub-id-type="doi">10.21105/joss.06850</article-id><article-id pub-id-type="manuscript">HHSPA2030246</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>primerForge: a Python program for identifying primer pairs capable of distinguishing groups of genomes from each other</article-title></title-group><contrib-group><contrib contrib-type="author"><contrib-id contrib-id-type="orcid" authenticated="false">http://orcid.org/0000-0002-9750-2845</contrib-id><name><surname>Wirth</surname><given-names>Joseph S.</given-names></name><xref rid="A1" ref-type="aff">1</xref><xref rid="A2" ref-type="aff">2</xref></contrib><contrib contrib-type="author"><contrib-id contrib-id-type="orcid" authenticated="false">http://orcid.org/0000-0002-2533-9161</contrib-id><name><surname>Katz</surname><given-names>Lee S.</given-names></name><xref rid="A1" ref-type="aff">1</xref></contrib><contrib contrib-type="author"><contrib-id contrib-id-type="orcid" authenticated="false">http://orcid.org/0000-0002-6033-485X</contrib-id><name><surname>Williams</surname><given-names>Grant M.</given-names></name><xref rid="A1" ref-type="aff">1</xref></contrib><contrib contrib-type="author"><contrib-id contrib-id-type="orcid" authenticated="false">http://orcid.org/0000-0002-9320-6774</contrib-id><name><surname>Chen</surname><given-names>Jessica C.</given-names></name><xref rid="A1" ref-type="aff">1</xref></contrib></contrib-group><aff id="A1"><label>1</label>Enteric Diseases Laboratory Branch, Centers for Disease Control and Prevention, Atlanta, GA, United States</aff><aff id="A2"><label>2</label>Oak Ridge Institute for Science and Education, Oak Ridge, TN, United States</aff><pub-date pub-type="nihms-submitted"><day>15</day><month>11</month><year>2024</year></pub-date><pub-date pub-type="ppub"><day>16</day><month>9</month><year>2024</year></pub-date><pub-date pub-type="pmc-release"><day>02</day><month>12</month><year>2024</year></pub-date><volume>9</volume><issue>101</issue><elocation-id>10.21105/joss.06850</elocation-id><permissions><license><ali:license_ref xmlns:ali="http://www.niso.org/schemas/ali/1.0/" specific-use="textmining" content-type="ccbylicense">https://creativecommons.org/licenses/by/4.0/</ali:license_ref><license-p>Authors of papers retain copyright and release the work under a Creative Commons Attribution 4.0 International License (CC BY 4.0).</license-p></license><license><license-p>License</license-p></license></permissions><abstract id="ABS1"><title>Summary</title><p id="P1">In both molecular epidemiology and microbial ecology, it is useful to be able to categorize specific strains of microorganisms in either an ingroup or an outgroup in a given population, e.g. to distinguish a pathogenic strain of interest from its non-virulent relatives. An &#x0201c;ingroup&#x0201d; refers to a group of microbes that are the primary focus of study or interest. Conversely, an &#x0201c;outgroup&#x0201d; consists of microbes that are closely-related to, but have evolved separately from, the ingroup. While whole genome sequencing and downstream phylogenetic analyses can be employed to do this, these techniques are often slow and can be resource intensive. Additionally, the laboratory would have to sequence the whole genome to use these tools to determine whether or not a new sample is part of the ingroup or outgroup. Alternatively, polymerase chain reaction (PCR) can be used to amplify regions of genetic material that are specific to the strain(s) of interest. PCR is faster, less expensive, and more accessible than whole genome sequencing, so having a PCR-based approach can accelerate the detection of specific strain(s) of microbes and facilitate diagnoses and/or population studies.</p></abstract></article-meta></front><body><sec id="S1"><title>Statement of need</title><p id="P2">In order to perform PCR, a pair of DNA primers capable of amplifying a region of interest is required. Traditional primer design involves the selection of a target region of DNA to amplify, followed by primer pair selection and subsequent validation of the primer pair. Identifying a good pair of primers and a suitable target region often requires several iterations of the primer design process, which can be tedious and time consuming.</p><p id="P3"><monospace>primerForge</monospace> seeks to assist biologists with the process of primer design. Instead of requiring the identification of specific target sequences (as is required with existing tools), <monospace>primerForge</monospace> identifies all suitable pairs of primers capable of producing PCR products of a specific size in a set of whole genome sequences. Optionally, it can also filter those primer pairs and limit the output to primer pairs that can be used to distinguish one set of genomes from another set of genomes via PCR amplification. <monospace>primerForge</monospace> relies on the <monospace>khmer</monospace> package to extract k-mers from genomic sequences and the <monospace>primer3-py</monospace> package to evaluate specific characteristics of primer pairs including melting temperature, hairpin potential, and dimer formation (<xref rid="R1" ref-type="bibr">Crusoe et al., 2015</xref>; <xref rid="R4" ref-type="bibr">Untergasser et al., 2012</xref>). It also uses <italic toggle="yes">in silico</italic> PCR via the <monospace>isPcr</monospace> program to validate and filter the primer pairs (<xref rid="R3" ref-type="bibr">Khun et al., 2012</xref>).</p><p id="P4">There are many use cases for what <monospace>primerForge</monospace> offers. One use case would be surveillance of an outbreak clone of a particular pathogen. A laboratory could develop a set of PCR reactions to track the population of this outbreak clone which could help inform if the population were to grow, shrink, or migrate.</p></sec><sec id="S2"><title>Comparing primerForge to swga2</title><p id="P5">Another software package, <monospace>swga2</monospace>, was developed to choose sets of primers that selectively amplify PCR products in one set of genomes (the ingroup) but not in another set of genomes (the outgroup) (<xref rid="R2" ref-type="bibr">Dwivedi-Yu et al., 2023</xref>). Given this similarity, it was important to compare the performance of <monospace>primerForge</monospace> to that of <monospace>swga2</monospace>. To do this, the sequence files listed in <xref rid="T1" ref-type="table">Table 1</xref> were used as inputs. The default parameters were used except that the melting temperature range was set at 55&#x000b0;C to 68&#x000b0;C and only a single processor was used. The primer pairs identified by <monospace>swga2</monospace> and <monospace>primerForge</monospace> were evaluated using <monospace>isPcr</monospace> with the following additional parameters: <monospace>-tileSize=8</monospace>, <monospace>-minGood=8</monospace>, and <monospace>-minPerfect=8</monospace>. These parameters were necessary because the primers identified by <monospace>swga2</monospace> were too short to use the default value of 15. The results of these comparisons are shown in <xref rid="T2" ref-type="table">Table 2</xref>.</p><p id="P6">Although many of the primer pairs predicted by <monospace>primerForge</monospace> were not validated by <monospace>isPcr</monospace>, this can be attributed to the fact that <monospace>primerForge</monospace> allows primer pairs to produce PCR products in the outgroup provided they are outside of the user-specified range. For example, all of the 847,045 primer pairs identified by <monospace>primerForge</monospace> in the <italic toggle="yes">E. coli</italic> dataset that were compatible with, but not validated by, <monospace>isPcr</monospace> were predicted to produce a PCR product in one or more of the outgroup genomes. Similarly, all 154 primer pairs identified by <monospace>primerForge</monospace> but not validated by <monospace>isPcr</monospace> in the <italic toggle="yes">M. mycoides</italic> dataset were not validated for the same reason. The decreased number of optimized primer pairs can be attributed to the fact that the <monospace>isPcr</monospace> parameters <monospace>tileSize</monospace>, <monospace>minGood</monospace>, and <monospace>minPerfect</monospace> were set to low values in order to directly compare the results of <monospace>primerForge</monospace> with those produced by <monospace>swga2</monospace>.</p><p id="P7">In addition to the improvements observed in <xref rid="T2" ref-type="table">Table 2</xref>, <monospace>primerForge</monospace> also allows the user to specify desired PCR product size ranges, specify primer size ranges, specify melting temperature ranges, specify the allowed difference in melting temperature between the forward and reverse primers, exclude certain PCR product sizes from the outgroup genomes, and use sequences in genbank file format. Both <monospace>primerForge</monospace> and <monospace>swga2</monospace> can take advantage of parallel processing, which speeds up runtimes. For example, <monospace>primerForge</monospace> ran on the <italic toggle="yes">E. coli</italic> dataset in 37 minutes and 7 seconds and used 10.07 GB RAM when using 8 cpus.</p></sec></body><back><ack id="S3"><title>Acknowledgements</title><p id="P8">This work was made possible by support from the Advanced Molecular Detection initiative at the Centers for Disease Control and Prevention and is covered by activities approved by the Centers for Disease Control and Prevention Internal Review Board (approval no. 7172).</p></ack><ref-list><title>References</title><ref id="R1"><mixed-citation publication-type="journal"><name><surname>Crusoe</surname><given-names>MR</given-names></name>, <name><surname>Alameldin</surname><given-names>HF</given-names></name>, <name><surname>Awad</surname><given-names>S</given-names></name>, <name><surname>Bucher</surname><given-names>E</given-names></name>, <name><surname>Caldwell</surname><given-names>A</given-names></name>, <name><surname>Cartwright</surname><given-names>R</given-names></name>, <name><surname>Charbonneau</surname><given-names>A</given-names></name>, <name><surname>Constantinides</surname><given-names>B</given-names></name>, <name><surname>Edvenson</surname><given-names>G</given-names></name>, <name><surname>Fay</surname><given-names>S</given-names></name>, <name><surname>Fenton</surname><given-names>J</given-names></name>, <name><surname>Fenzl</surname><given-names>T</given-names></name>, <name><surname>Fish</surname><given-names>J</given-names></name>, <name><surname>Garcia-Gutierrez</surname><given-names>L</given-names></name>, <name><surname>Garland</surname><given-names>P</given-names></name>, <name><surname>Gluck</surname><given-names>J</given-names></name>, <name><surname>Gonz&#x000e1;lez</surname><given-names>I</given-names></name>, <name><surname>Guermond</surname><given-names>S</given-names></name>, <name><surname>Guo</surname><given-names>J</given-names></name>, &#x02026; <name><surname>Brown</surname><given-names>CT</given-names></name> (<year>2015</year>). <article-title>The khmer software package: enabling efficient nucleotide sequence analysis [version 1; peer review: 2 approved, 1 approved with reservations]</article-title>. <source>F1000Research</source>, <volume>4</volume>. <pub-id pub-id-type="doi">10.12688/f1000research.6924.1</pub-id></mixed-citation></ref><ref id="R2"><mixed-citation publication-type="journal"><name><surname>Dwivedi-Yu</surname><given-names>JA</given-names></name>, <name><surname>Oppler</surname><given-names>ZJ</given-names></name>, <name><surname>Mitchell</surname><given-names>MW</given-names></name>, <name><surname>Song</surname><given-names>YS</given-names></name>, &#x00026; <name><surname>Brisson</surname><given-names>D</given-names></name> (<year>2023</year>). <article-title>A fast machine-learning-guided primer design pipeline for selective whole genome amplification</article-title>. <source>PLOS Computational Biology</source>, <volume>19</volume>(<issue>4</issue>). <pub-id pub-id-type="doi">10.1371/journal.pcbi.1010137</pub-id></mixed-citation></ref><ref id="R3"><mixed-citation publication-type="journal"><name><surname>Khun</surname><given-names>RM</given-names></name>, <name><surname>Haussler</surname><given-names>D</given-names></name>, &#x00026; <name><surname>Kent</surname><given-names>J</given-names></name> (<year>2012</year>). <article-title>The UCSC genome browser and associated tools</article-title>. <source>Briefings in Bioinformatics</source>, <volume>14</volume>(<issue>2</issue>). <pub-id pub-id-type="doi">10.1093/bib/bbs038</pub-id></mixed-citation></ref><ref id="R4"><mixed-citation publication-type="journal"><name><surname>Untergasser</surname><given-names>A</given-names></name>, <name><surname>Cutcutache</surname><given-names>I</given-names></name>, <name><surname>Koressaar</surname><given-names>T</given-names></name>, <name><surname>Ye</surname><given-names>J</given-names></name>, <name><surname>Faircloth</surname><given-names>BC</given-names></name>, <name><surname>Remm</surname><given-names>Maido</given-names></name>, &#x00026; <name><surname>Rozen</surname><given-names>SG</given-names></name> (<year>2012</year>). <article-title>Primer3&#x02014;new capabilities and interfaces</article-title>. <source>Nucleic Acids Research</source>, <volume>40</volume>(<issue>15</issue>), <fpage>e115</fpage>&#x02013;<lpage>e115</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gks596</pub-id><pub-id pub-id-type="pmid">22730293</pub-id>
</mixed-citation></ref></ref-list></back><floats-group><table-wrap position="float" id="T1"><label>Table 1:</label><caption><p id="P9">Datasets used to compare <monospace>primerForge</monospace> to <monospace>swga2</monospace>.</p></caption><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th align="left" valign="top" rowspan="1" colspan="1">Dataset</th><th align="center" valign="top" rowspan="1" colspan="1">Name</th><th align="center" valign="top" rowspan="1" colspan="1">NCBI Accession</th><th align="center" valign="top" rowspan="1" colspan="1">Group<sup><xref rid="TFN1" ref-type="table-fn">1</xref></sup></th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">plasmid<sup><xref rid="TFN2" ref-type="table-fn">2</xref></sup></td><td align="center" valign="top" rowspan="1" colspan="1">pcDNA</td><td align="center" valign="top" rowspan="1" colspan="1">not provided</td><td align="center" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">plasmid<sup><xref rid="TFN2" ref-type="table-fn">2</xref></sup></td><td align="center" valign="top" rowspan="1" colspan="1">pLTR</td><td align="center" valign="top" rowspan="1" colspan="1">not provided</td><td align="center" valign="top" rowspan="1" colspan="1">outgroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">M. mycoides</italic>
<sup>
<xref rid="TFN3" ref-type="table-fn">3</xref>
</sup>
</td><td align="center" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Mycoplasma mycoides</italic> subsp. mycoides str. KH3J</td><td align="center" valign="top" rowspan="1" colspan="1">GCF_003034305.1</td><td align="center" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">M. mycoides</italic>
<sup>
<xref rid="TFN3" ref-type="table-fn">3</xref>
</sup>
</td><td align="center" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Mycoplasma mycoides</italic> subsp. mycoides str. B345/93</td><td align="center" valign="top" rowspan="1" colspan="1">GCF_003034275.1</td><td align="center" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">M. mycoides</italic>
<sup>
<xref rid="TFN3" ref-type="table-fn">3</xref>
</sup>
</td><td align="center" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Mycoplasma mycoides</italic> subsp. mycoides str. Gemu Goffa</td><td align="center" valign="top" rowspan="1" colspan="1">GCF_003034345.1</td><td align="center" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">M. mycoides</italic>
<sup>
<xref rid="TFN3" ref-type="table-fn">3</xref>
</sup>
</td><td align="center" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Mycoplasma mycoides</italic> subsp. capri str. GM12</td><td align="center" valign="top" rowspan="1" colspan="1">GCF_900489555.1</td><td align="center" valign="top" rowspan="1" colspan="1">outgroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">M. mycoides</italic>
<sup>
<xref rid="TFN3" ref-type="table-fn">3</xref>
</sup>
</td><td align="left" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Mycoplasma mycoides</italic> subsp. capri str. 80/93</td><td align="left" valign="top" rowspan="1" colspan="1">GCF_018389745.1</td><td align="left" valign="top" rowspan="1" colspan="1">outgroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">E. coli</italic>
</td><td align="left" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Escherichia coli</italic> O157 str. 644-PT8</td><td align="left" valign="top" rowspan="1" colspan="1">GCF_001650295.1</td><td align="left" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">E. coli</italic>
</td><td align="left" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Escherichia coli</italic> O157 str. AR-0428</td><td align="left" valign="top" rowspan="1" colspan="1">GCF_008727175.1</td><td align="left" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">E. coli</italic>
</td><td align="left" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Escherichia coli</italic> O157 str. FDAARGOS_293</td><td align="left" valign="top" rowspan="1" colspan="1">GCF_002208865.2</td><td align="left" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">E. coli</italic>
</td><td align="left" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Escherichia coli</italic> K12 str. MG1655</td><td align="left" valign="top" rowspan="1" colspan="1">GCF_000005845</td><td align="left" valign="top" rowspan="1" colspan="1">outgroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">E. coli</italic>
</td><td align="left" valign="top" rowspan="1" colspan="1"><italic toggle="yes">Salmonella enterica</italic> subsp. enterica serovar Typhimurium str. LT2</td><td align="left" valign="top" rowspan="1" colspan="1">GCF_000006945</td><td align="left" valign="top" rowspan="1" colspan="1">outgroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">SARS-CoV-2</td><td align="left" valign="top" rowspan="1" colspan="1">SARS-CoV-2 isolate human/USA/MA_MGH_00230/2020</td><td align="left" valign="top" rowspan="1" colspan="1">MT520374</td><td align="left" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">SARS-CoV-2</td><td align="left" valign="top" rowspan="1" colspan="1">SARS-CoV-2 isolate human/USA/MA_MGH_00229/2020</td><td align="left" valign="top" rowspan="1" colspan="1">MT520263</td><td align="left" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">SARS-CoV-2</td><td align="left" valign="top" rowspan="1" colspan="1">SARS-CoV-2 isolate human/USA/MA_MGH_00257/2020</td><td align="left" valign="top" rowspan="1" colspan="1">MT520479</td><td align="left" valign="top" rowspan="1" colspan="1">ingroup</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">SARS-CoV-2</td><td align="left" valign="top" rowspan="1" colspan="1">SARS-CoV-2 isolate Wuhan-Hu-1</td><td align="left" valign="top" rowspan="1" colspan="1">NC_045512</td><td align="left" valign="top" rowspan="1" colspan="1">outgroup</td></tr></tbody></table><table-wrap-foot><fn id="TFN1"><label>1</label><p id="P10">The group indicates which set of genomes should be distinguished from each other within each dataset. The &#x0201c;ingroup&#x0201d; indicates genomes that should produce PCR products when amplified with the primer pairs identified by the software. The &#x0201c;outgroup&#x0201d; indicates genomes that should that should not produce PCR products, or should produce PCR product sizes outside a user-specified range.</p></fn><fn id="TFN2"><label>2</label><p id="P11">The plasmid dataset is provided as an example in the <monospace>swga2</monospace> repository.</p></fn><fn id="TFN3"><label>3</label><p id="P12">The <italic toggle="yes">M. mycoides</italic> dataset is provided as an example in the <monospace>primerForge</monospace> repository.</p></fn></table-wrap-foot></table-wrap><table-wrap position="float" id="T2"><label>Table 2:</label><caption><p id="P13">Comparing <monospace>swga2 v&#x00398;.&#x00398;.1</monospace> to <monospace>primerForge v1.3.5</monospace></p></caption><table frame="hsides" rules="groups"><colgroup span="1"><col align="center" valign="middle" span="1"/><col align="center" valign="middle" span="1"/><col align="center" valign="middle" span="1"/><col align="center" valign="middle" span="1"/><col align="center" valign="middle" span="1"/><col align="center" valign="middle" span="1"/><col align="center" valign="middle" span="1"/><col align="center" valign="middle" span="1"/></colgroup><thead><tr><th align="center" valign="bottom" rowspan="1" colspan="1">Program</th><th align="center" valign="bottom" rowspan="1" colspan="1">Dataset</th><th align="center" valign="bottom" rowspan="1" colspan="1">Runtime (mm:ss)</th><th align="center" valign="bottom" rowspan="1" colspan="1">RAM (GB)</th><th align="center" valign="bottom" rowspan="1" colspan="1">Primer Pairs<sup><xref rid="TFN4" ref-type="table-fn">1</xref></sup></th><th align="center" valign="bottom" rowspan="1" colspan="1"><monospace>isPcr</monospace>-compatible Pairs<sup><xref rid="TFN5" ref-type="table-fn">2</xref></sup></th><th align="center" valign="bottom" rowspan="1" colspan="1">Validated Pairs<sup><xref rid="TFN6" ref-type="table-fn">3</xref></sup></th><th align="center" valign="bottom" rowspan="1" colspan="1">Optimized Pairs<sup><xref rid="TFN7" ref-type="table-fn">4</xref></sup></th></tr></thead><tbody><tr><td align="center" valign="top" rowspan="1" colspan="1">
<monospace>swga2</monospace>
</td><td align="center" valign="top" rowspan="1" colspan="1">plasmid</td><td align="center" valign="top" rowspan="1" colspan="1">23:21</td><td align="center" valign="top" rowspan="1" colspan="1">0.136</td><td align="center" valign="top" rowspan="1" colspan="1">94</td><td align="center" valign="top" rowspan="1" colspan="1">22</td><td align="center" valign="top" rowspan="1" colspan="1">22</td><td align="center" valign="top" rowspan="1" colspan="1">11</td></tr><tr><td align="center" valign="top" rowspan="1" colspan="1">
<monospace>primerForge</monospace>
</td><td align="center" valign="top" rowspan="1" colspan="1">plasmid</td><td align="center" valign="top" rowspan="1" colspan="1">00:10</td><td align="center" valign="top" rowspan="1" colspan="1">0.054</td><td align="center" valign="top" rowspan="1" colspan="1">3,004</td><td align="center" valign="top" rowspan="1" colspan="1">3,004</td><td align="center" valign="top" rowspan="1" colspan="1">2,977</td><td align="center" valign="top" rowspan="1" colspan="1">2,934</td></tr><tr><td align="center" valign="top" rowspan="1" colspan="1">
<monospace>swga2</monospace>
</td><td align="center" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">M. mycoides</italic>
</td><td align="center" valign="top" rowspan="1" colspan="1">05:13</td><td align="center" valign="top" rowspan="1" colspan="1">0.221</td><td align="center" valign="top" rowspan="1" colspan="1">run failed</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td></tr><tr><td align="center" valign="top" rowspan="1" colspan="1">
<monospace>primerForge</monospace>
</td><td align="center" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">M. mycoides</italic>
</td><td align="center" valign="top" rowspan="1" colspan="1">02:25</td><td align="center" valign="top" rowspan="1" colspan="1">1.490</td><td align="center" valign="top" rowspan="1" colspan="1">1,096</td><td align="center" valign="top" rowspan="1" colspan="1">1,096</td><td align="center" valign="top" rowspan="1" colspan="1">942</td><td align="center" valign="top" rowspan="1" colspan="1">884</td></tr><tr><td align="center" valign="top" rowspan="1" colspan="1">
<monospace>swga2</monospace>
</td><td align="center" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">E. coli</italic>
</td><td align="center" valign="top" rowspan="1" colspan="1">21:10</td><td align="center" valign="top" rowspan="1" colspan="1">4.452</td><td align="center" valign="top" rowspan="1" colspan="1">run failed</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td></tr><tr><td align="center" valign="top" rowspan="1" colspan="1">
<monospace>primerForge</monospace>
</td><td align="center" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">E. coli</italic>
</td><td align="center" valign="top" rowspan="1" colspan="1">81:09</td><td align="center" valign="top" rowspan="1" colspan="1">10.645</td><td align="center" valign="top" rowspan="1" colspan="1">1,150,858</td><td align="center" valign="top" rowspan="1" colspan="1">1,148,425</td><td align="center" valign="top" rowspan="1" colspan="1">301,380</td><td align="center" valign="top" rowspan="1" colspan="1">125,357</td></tr><tr><td align="center" valign="top" rowspan="1" colspan="1">
<monospace>swga2</monospace>
</td><td align="center" valign="top" rowspan="1" colspan="1">SARS-CoV-2</td><td align="center" valign="top" rowspan="1" colspan="1">10:38</td><td align="center" valign="top" rowspan="1" colspan="1">0.141</td><td align="center" valign="top" rowspan="1" colspan="1">63</td><td align="center" valign="top" rowspan="1" colspan="1">7</td><td align="center" valign="top" rowspan="1" colspan="1">0</td><td align="center" valign="top" rowspan="1" colspan="1">0</td></tr><tr><td align="center" valign="top" rowspan="1" colspan="1">
<monospace>primerForge</monospace>
</td><td align="center" valign="top" rowspan="1" colspan="1">SARS-CoV-2</td><td align="center" valign="top" rowspan="1" colspan="1">00:20</td><td align="center" valign="top" rowspan="1" colspan="1">0.118</td><td align="center" valign="top" rowspan="1" colspan="1">15</td><td align="center" valign="top" rowspan="1" colspan="1">15</td><td align="center" valign="top" rowspan="1" colspan="1">15</td><td align="center" valign="top" rowspan="1" colspan="1">15</td></tr></tbody></table><table-wrap-foot><fn id="TFN4"><label>1</label><p id="P14">The number of primer pairs identified by the program.</p></fn><fn id="TFN5"><label>2</label><p id="P15">The number of primer pairs that generated PCR products with <monospace>isPcr</monospace>.</p></fn><fn id="TFN6"><label>3</label><p id="P16">The number of primer pairs that produced a PCR product in every ingroup genome and no products in any of the outgroup genomes.</p></fn><fn id="TFN7"><label>4</label><p id="P17">The number of valid primer pairs that produced exactly one PCR product in each ingroup genome.</p></fn></table-wrap-foot></table-wrap></floats-group></article>