<!DOCTYPE article
PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD with MathML3 v1.3 20210610//EN" "JATS-archivearticle1-3-mathml3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="1.3" xml:lang="en" article-type="research-article"><?properties manuscript?><processing-meta base-tagset="archiving" mathml-version="3.0" table-model="xhtml" tagset-family="jats"><restricted-by>pmc</restricted-by></processing-meta><front><journal-meta><journal-id journal-id-type="nlm-journal-id">0370507</journal-id><journal-id journal-id-type="pubmed-jr-id">473</journal-id><journal-id journal-id-type="nlm-ta">Am J Trop Med Hyg</journal-id><journal-id journal-id-type="iso-abbrev">Am J Trop Med Hyg</journal-id><journal-title-group><journal-title>The American journal of tropical medicine and hygiene</journal-title></journal-title-group><issn pub-type="ppub">0002-9637</issn><issn pub-type="epub">1476-1645</issn></journal-meta><article-meta><article-id pub-id-type="pmid">39808829</article-id><article-id pub-id-type="pmc">11964823</article-id><article-id pub-id-type="doi">10.4269/ajtmh.24-0255</article-id><article-id pub-id-type="manuscript">HHSPA2064690</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>Revisiting the Relationship between Weather and Interannual Variation in Human Plague Cases in the Southwestern United States</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Holcomb</surname><given-names>Karen M.</given-names></name><xref rid="A1" ref-type="aff">1</xref><xref rid="CR1" ref-type="corresp">*</xref></contrib><contrib contrib-type="author"><name><surname>Biggerstaff</surname><given-names>Brad J.</given-names></name><xref rid="A1" ref-type="aff">1</xref></contrib><contrib contrib-type="author"><name><surname>Johansson</surname><given-names>Michael A.</given-names></name><xref rid="A2" ref-type="aff">2</xref></contrib><contrib contrib-type="author"><name><surname>Mead</surname><given-names>Paul S.</given-names></name><xref rid="A1" ref-type="aff">1</xref></contrib><contrib contrib-type="author"><name><surname>Kugeler</surname><given-names>Kiersten J.</given-names></name><xref rid="A1" ref-type="aff">1</xref></contrib><contrib contrib-type="author"><name><surname>Eisen</surname><given-names>Rebecca J.</given-names></name><xref rid="A1" ref-type="aff">1</xref></contrib></contrib-group><aff id="A1"><label>1</label>Division of Vector Borne Diseases, Centers for Disease Control and Prevention, Fort Collins, Colorado;</aff><aff id="A2"><label>2</label>Division of Vector Borne Diseases, Centers for Disease Control and Prevention, San Juan, Puerto Rico</aff><author-notes><corresp id="CR1"><label>*</label>Address correspondence to Karen M. Holcomb, Division of Vector Borne Diseases, Centers for Disease Control and Prevention, 3156 Rampart Rd., Fort Collins, CO 80526. <email>kholcomb@cdc.gov</email></corresp></author-notes><pub-date pub-type="nihms-submitted"><day>12</day><month>3</month><year>2025</year></pub-date><pub-date pub-type="ppub"><day>02</day><month>4</month><year>2025</year></pub-date><pub-date pub-type="epub"><day>14</day><month>1</month><year>2025</year></pub-date><pub-date pub-type="pmc-release"><day>02</day><month>12</month><year>2025</year></pub-date><volume>112</volume><issue>4</issue><fpage>840</fpage><lpage>844</lpage><abstract id="ABS1"><p id="P2">Plague is a rare, potentially fatal flea-borne zoonosis endemic in the western United States. A previous model described interannual variation in human cases based on temperature and lagged precipitation. We recreated this model in northeastern Arizona (1960&#x02013;1997) to evaluate its capacity to predict recent cases (1998&#x02013;2022). In recreating the original model, we found that future instead of concurrent temperature had inadvertently been used for the presented fit. Prediction from our revised models with lagged precipitation and temporally plausible temperature relationships aligned with low observed cases in 1998&#x02013;2022. Elevated precipitation associated with high cases in historical data (&#x0003e;6 inches combined precipitation over two previous springs) was only observed once in the last quarter century, so we could not assess if these conditions were reliably associated with elevated (four or more) human plague cases. Observed weather conditions were similar to those previously associated with low (fewer than or equal to two) case counts, suggesting &#x0201c;baseline&#x0201d; conditions in the last quarter century.</p></abstract></article-meta></front><body><p id="P3">Plague is a rare but potentially fatal flea-borne zoonosis caused by <italic toggle="yes">Yersinia pestis</italic>. In the United States, plague occurs episodically in western states, with most cases reported from the Southwest.<sup><xref rid="R1" ref-type="bibr">1</xref></sup> Human plague is often associated with sporadically occurring epizootics, periods of time when <italic toggle="yes">Y. pestis</italic> spreads rapidly in susceptible rodent populations. Widespread rodent mortality during epizootics forces infected rodent fleas to seek new hosts, including humans.<sup><xref rid="R2" ref-type="bibr">2</xref></sup></p><p id="P4">The timing of epizootics and increases in human plague cases have often been associated with increased rainfall and moderate summer temperatures.<sup><xref rid="R3" ref-type="bibr">3</xref></sup> In the American Southwest, above-average precipitation was associated with higher-than-average reported cases.<sup><xref rid="R4" ref-type="bibr">4</xref>,<xref rid="R5" ref-type="bibr">5</xref></sup> Similar trends were described for plague cases among companion animals, which were significantly correlated with human cases in New Mexico.<sup><xref rid="R6" ref-type="bibr">6</xref></sup> Temperature also played a significant role,<sup><xref rid="R5" ref-type="bibr">5</xref>,<xref rid="R6" ref-type="bibr">6</xref></sup> with cooler summer temperatures favoring transmission and very hot temperatures having a negative impact. The trophic cascade hypothesis provides a biological rationale for these associations. Specifically, increased precipitation is hypothesized to set the stage for epizootic transmission by building up food sources that promote increased rodent reproduction and populations in the next summer and that provide favorable conditions for the survival and reproduction of fleas. Increased contact between fleas and rodents is thought to increase the rate of <italic toggle="yes">Y. pestis</italic> transmission, resulting in epizootics. Extreme heat is proposed to counteract this by decreasing flea survival, <italic toggle="yes">Y. pestis</italic> transmission, and human&#x02013;flea encounters, thereby reducing the number of human plague cases.<sup><xref rid="R3" ref-type="bibr">3</xref>,<xref rid="R7" ref-type="bibr">7</xref></sup></p><p id="P5">Understanding the relationship between weather and plague occurrence (weather&#x02013;plague relationship) could be useful for forecasting periods of elevated risk. Given the generalizability of the trophic cascade hypothesis in the Southwest, we sought to 1) recreate a previous well-fitting model<sup><xref rid="R5" ref-type="bibr">5</xref></sup> from northeastern Arizona (Climate Division 2; 1960&#x02013;1997) and 2) assess if these relationships could predict observed case counts in the next 25 years (1998&#x02013;2022). Although separate models were previously developed for Arizona and New Mexico,<sup><xref rid="R5" ref-type="bibr">5</xref></sup> changes in case reporting prevented us from identifying which cases occurred in the New Mexico climate division in the recent 25 years (see <xref rid="SD1" ref-type="supplementary-material">Supplemental Text</xref>), so we focus only on Arizona.</p><p id="P6">To recreate this trophic cascade model,<sup><xref rid="R5" ref-type="bibr">5</xref></sup> we fitted a Poisson generalized linear model (GLM; using the stats R package<sup><xref rid="R8" ref-type="bibr">8</xref></sup>) of human plague cases per plague year (defined previously<sup><xref rid="R5" ref-type="bibr">5</xref></sup> as June 16&#x02013;June 15) relative to temperature and lagged precipitation. We used lagged February to March precipitation (one- and two-plague year lags), lagged July to August precipitation (one-plague year lag), and &#x0201c;degree days&#x0201d; (90&#x000b0;F [32.2&#x000b0;C] and 95&#x000b0;F [35&#x000b0;C] thresholds) as covariates (<xref rid="F1" ref-type="fig">Figure 1A</xref>, schematic). For this, we acquired monthly precipitation data for the climate division<sup><xref rid="R9" ref-type="bibr">9</xref></sup> and calculated &#x0201c;degree days&#x0201d; (the annual number of days at least certain temperature thresholds) using maximum daily temperatures from Winslow Municipal Airport.<sup><xref rid="R10" ref-type="bibr">10</xref></sup> We tabulated human plague data from case reports sent to CDC.<sup><xref rid="R1" ref-type="bibr">1</xref>,<xref rid="R11" ref-type="bibr">11</xref></sup> See <xref rid="SD1" ref-type="supplementary-material">Supplemental Figure 1</xref> and <xref rid="SD1" ref-type="supplementary-material">Supplemental Text</xref> for case, temperature, and precipitation data details.</p><p id="P7">We were unable to recreate the model fit (<xref rid="F1" ref-type="fig">Figure 1B</xref>, fit) using the presented description<sup><xref rid="R5" ref-type="bibr">5</xref></sup> (<xref rid="F1" ref-type="fig">Figure 1A</xref>, schematic). To produce the previous fit, degree days needed to correspond to the calendar year in which the June-to-June plague year ended (i.e., shifted forward in time) (compare <xref rid="F1" ref-type="fig">Figure 1A</xref> and <xref rid="F1" ref-type="fig">B</xref>). This resulted in a temporal mismatch between case and temperature data, with plague cases associated with future temperatures; each year, most days with temperatures &#x02265;32.3&#x000b0;C (mean: 87.6%, range: 78.0&#x02013;100%) and &#x02265;35&#x000b0;C (mean: 93.3%, range: 75.8&#x02013;100%) occurred after June 16 (1960&#x02013;1997). Additionally, one-plague year lagged July to August precipitation was included in the original model, but we found it to be not significant here (<italic toggle="yes">P</italic> = 0.86) and thus, dropped the variable (<xref rid="F1" ref-type="fig">Figure 1C</xref>) without degradation of fit (<xref rid="SD1" ref-type="supplementary-material">Supplemental Table 1</xref>). See <xref rid="SD1" ref-type="supplementary-material">Supplemental Text</xref> for additional details.</p><p id="P8">With the described temporal mismatch, the implemented model (<xref rid="F1" ref-type="fig">Figure 1B</xref>) used future conditions that could not impact case occurrence. Therefore, we fitted a variety of models with biologically plausible relationships of temperature and plague occurrence to assess their relative fit and predictive performance (<xref rid="T1" ref-type="table">Table 1</xref>). These models included degree days for the calendar year in which the June-to-June plague year began (as intended in the original model; model 1) (<xref rid="F1" ref-type="fig">Figure 1C</xref>), for the winter/spring of the plague year (January 1&#x02013;June 15; model 3) (<xref rid="F1" ref-type="fig">Figure 1D</xref>), for the summer of the plague year (June 16&#x02013;September 30; model 4) (<xref rid="F1" ref-type="fig">Figure 1E</xref>), and aligned to the plague year (June 16&#x02013;June 15; model 5) (<xref rid="F1" ref-type="fig">Figure 1F</xref>). The precipitation covariates as originally presented were not impacted by the mismatched timing, so we included both one- and two-plague year lagged February to March precipitation; one-plague year lagged July to August precipitation was not significant in any model and thus, was dropped (<xref rid="SD1" ref-type="supplementary-material">Supplemental Table 1</xref>). We also fitted a version of the model with the plague data aligned to the calendar year (January 1&#x02013;December 31; model 8) (<xref rid="F1" ref-type="fig">Figure 1G</xref>) for more intuitive temporal relationships and because it aligns with broad plague seasonality in the United States (<xref rid="SD1" ref-type="supplementary-material">Supplemental Figure 2</xref>). This model included lagged February to March precipitation (one- and two-year lags) and concurrent degree days (90&#x000b0;F and 95&#x000b0;F). Covariates for July to August precipitation were not significant at either one-year (<italic toggle="yes">P</italic> = 0.13) or two-year lags (<italic toggle="yes">P</italic> = 0.53) and were removed (<xref rid="SD1" ref-type="supplementary-material">Supplemental Table 1</xref>). Using both the June-to-June and calendar plague years, we fitted models without degree days (only lagged precipitation; models 6 and 9) and no weather covariates (&#x0201c;simple&#x0201d;; models 7 and 10) as comparisons for model training performance with less weather information. Model 7 was an autoregressive order-1 Poisson model to remove residual autocorrelation. Model 10 was an intercept-only Poisson GLM because we did not detect residual autocorrelation (<xref rid="SD1" ref-type="supplementary-material">Supplemental Text</xref>). We used each fitted model to predict human plague cases for 1998&#x02013;2022, calculating training (1960&#x02013;1997) and testing (1998&#x02013;2022) error (<xref rid="T1" ref-type="table">Table 1</xref>). We assessed predictive accuracy of all models by determining the proportion of observations contained within 95% prediction intervals (PIs) (<xref rid="SD1" ref-type="supplementary-material">Supplemental Text</xref>).</p><p id="P9">Across models, the magnitude and direction of fitted coef-ficients were similar (<xref rid="SD1" ref-type="supplementary-material">Supplemental Figure 4</xref>; <xref rid="SD1" ref-type="supplementary-material">Supplemental Tables 2</xref>&#x02013;<xref rid="SD1" ref-type="supplementary-material">11</xref>) and aligned with the trophic cascade hypothesis; increased February to March precipitation, more days &#x02265;32.3&#x000b0;C, and fewer days &#x02265;35&#x000b0;C were associated with increased plague cases. All models had similar fit and predictive capacity as measured by mean absolute error (MAE) (<xref rid="T1" ref-type="table">Table 1</xref>). For example, with all training MAE between 0.79 and 1.36 cases, average fitted values differed from observed values by &#x02264;1.36 plague cases per year.</p><p id="P10">Inclusion of future temperature (our recreation of the originally presented model<sup><xref rid="R5" ref-type="bibr">5</xref></sup>; model 2), inclusion of temperature from the summer of the plague year (model 4), or using a calendar plague year (model 8) resulted in the lowest training error (&#x0201c;best&#x0201d; model) (<xref rid="T1" ref-type="table">Table 1</xref>) and fitted well to the spikes in plague years 1983 and 1994 (<xref rid="SD1" ref-type="supplementary-material">Supplemental Figure 3A</xref> and <xref rid="SD1" ref-type="supplementary-material">C</xref>). Other models underpredicted the 1983 spike. For models with June-to-June plague years, model 1, our correctly time-matched recreation of the originally intended model<sup><xref rid="R5" ref-type="bibr">5</xref></sup> (<xref rid="F2" ref-type="fig">Figure 2A</xref>), had the best predictive performance (lowest testing MAE) (<xref rid="T1" ref-type="table">Table 1</xref>). For models that used a calendar plague year, model 8 had the best prediction (<xref rid="F2" ref-type="fig">Figure 2B</xref>). &#x0201c;Simple&#x0201d; models had the worst fit (poor training performance), so we did not focus on their predictive capacity.</p><p id="P11">All models accurately predicted few human cases (fewer than or equal to two) with all observations within the 95% point-wise PIs, indicating &#x0201c;good&#x0201d; prediction. There were no instances when models failed to predict or incorrectly predicted elevated cases (four or more). Weather conditions associated with elevated cases (four or more) during the training period (1960&#x02013;1997), &#x0003e;6 inches of combined precipitation over the two previous springs, were only observed in 2021 in the testing time frame (<xref rid="SD1" ref-type="supplementary-material">Supplemental Figure 7</xref>). No cases were reported that plague year, as was the case in 1980. We did not identify a difference in degree days between years with low or elevated cases (<xref rid="SD1" ref-type="supplementary-material">Supplemental Text</xref>). Thus, although this cumulative amount of spring precipitation may represent a threshold for increased human plague risk, additional factors are needed for elevated cases to occur. Identification of such conditions would provide useful information for public health.</p><p id="P12">In the original study,<sup><xref rid="R5" ref-type="bibr">5</xref></sup> models were developed to describe historical trends and were not intended for prediction. The good fit of the trophic cascade model to the historical data included plausible biological relationships (increased precipitation before years with increased case counts mediated by high temperatures during the transmission season) but relied on an inadvertent temporal shift in degree day covariates. Our model recreation using the intended, biologically plausible relationships agreed with the trophic cascade hypothesis and accurately predicted low counts. Weather conditions were similar between low (fewer than or equal to two cases) years in the training and testing periods. As elevated precipitation totals previously associated with elevated cases (four or more) did not occur in the recent quarter century, we were unable to fully test the predictive accuracy of proposed trophic cascade associations in these more extreme cases. Thus, although weather appears to impact <italic toggle="yes">Y. pestis</italic> transmission,<sup><xref rid="R12" ref-type="bibr">12</xref>&#x02013;<xref rid="R16" ref-type="bibr">16</xref></sup> conditions in northeastern Arizona did not enable us to fully test the accuracy of the proposed weather drivers of elevated plague cases; the impact and any underlying thresholds might be more apparent if evaluated in counties across the western United States where plague is endemic. Consideration of human socioeconomic risk factors might also improve prediction.<sup><xref rid="R17" ref-type="bibr">17</xref>,<xref rid="R18" ref-type="bibr">18</xref></sup> Additional work to identify factors associated with above-average cases across a wider area could further improve the usefulness of predictions for public health.</p><sec sec-type="supplementary-material" id="SM1"><title>Supplementary Material</title><supplementary-material id="SD1" position="float" content-type="local-data"><label>Supplementary_material</label><media xlink:href="NIHMS2064690-supplement-Supplementary_material.pdf" id="d67e380" position="anchor"/></supplementary-material></sec></body><back><ack id="S1"><title>Acknowledgments:</title><p id="P13">We thank the public health professionals and CDC personnel who have reported human plague cases and performed exposure site investigations. We also thank Ryan Harp (Climate and Health postdoc with the National Oceanic and Atmospheric Administration and CDC) for his discussions around climate, weather, and vector-borne disease prediction.</p></ack><fn-group><fn id="FN2"><p id="P14">Note: Supplemental materials appear at <ext-link xlink:href="http://www.ajtmh.org/" ext-link-type="uri">www.ajtmh.org</ext-link>.</p></fn><fn fn-type="COI-statement" id="FN3"><p id="P15">Disclosures: We declare that we have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. The findings and conclusions in this report are those of the author(s) and do not necessarily represent the views of CDC.</p></fn></fn-group><ref-list><title>REFERENCES</title><ref id="R1"><label>1.</label><mixed-citation publication-type="journal"><name><surname>Kugeler</surname><given-names>KJ</given-names></name>, <name><surname>Staples</surname><given-names>JE</given-names></name>, <name><surname>Hinckley</surname><given-names>AF</given-names></name>, <name><surname>Gage</surname><given-names>KL</given-names></name>, <name><surname>Mead</surname><given-names>PS</given-names></name>, <year>2015</year>. <article-title>Epidemiology of human plague in the United States, 1900&#x02013;2012</article-title>. <source>Emerg Infect Dis</source>
<volume>21</volume>: <fpage>16</fpage>&#x02013;<lpage>22</lpage>.<pub-id pub-id-type="pmid">25529546</pub-id>
</mixed-citation></ref><ref id="R2"><label>2.</label><mixed-citation publication-type="journal"><name><surname>Eisen</surname><given-names>RJ</given-names></name>, <name><surname>Gage</surname><given-names>KL</given-names></name>, <year>2009</year>. <article-title>Adaptive strategies of <italic toggle="yes">Yersinia pestis</italic> to persist during inter-epizootic and epizootic periods</article-title>. <source>Vet Res</source>
<volume>40</volume>: <fpage>1</fpage>.<pub-id pub-id-type="pmid">18803931</pub-id>
</mixed-citation></ref><ref id="R3"><label>3.</label><mixed-citation publication-type="journal"><name><surname>Gage</surname><given-names>KL</given-names></name>, <name><surname>Burkot</surname><given-names>TR</given-names></name>, <name><surname>Eisen</surname><given-names>RJ</given-names></name>, <name><surname>Hayes</surname><given-names>EB</given-names></name>, <year>2008</year>. <article-title>Climate and vectorborne diseases</article-title>. <source>Am J Prev Med</source>
<volume>35</volume>: <fpage>436</fpage>&#x02013;<lpage>450</lpage>.<pub-id pub-id-type="pmid">18929970</pub-id>
</mixed-citation></ref><ref id="R4"><label>4.</label><mixed-citation publication-type="journal"><name><surname>Parmenter</surname><given-names>RR</given-names></name>, <name><surname>Yadav</surname><given-names>EP</given-names></name>, <name><surname>Parmenter</surname><given-names>CA</given-names></name>, <name><surname>Ettestad</surname><given-names>P</given-names></name>, <name><surname>Gage</surname><given-names>KL</given-names></name>, <year>1999</year>. <article-title>Incidence of plague associated with increased winter-spring precipitation in New Mexico</article-title>. <source>Am J Trop Med Hyg</source>
<volume>61</volume>: <fpage>814</fpage>&#x02013;<lpage>821</lpage>.<pub-id pub-id-type="pmid">10586917</pub-id>
</mixed-citation></ref><ref id="R5"><label>5.</label><mixed-citation publication-type="journal"><name><surname>Enscore</surname><given-names>RE</given-names></name>, <etal/>, <year>2002</year>. <article-title>Modeling relationships between climate and the frequency of human plague cases in the Southwestern United States, 1960&#x02013;1997</article-title>. <source>Am J Trop Med Hyg</source>
<volume>66</volume>: <fpage>186</fpage>&#x02013;<lpage>196</lpage>.<pub-id pub-id-type="pmid">12135292</pub-id>
</mixed-citation></ref><ref id="R6"><label>6.</label><mixed-citation publication-type="journal"><name><surname>Brown</surname><given-names>HE</given-names></name>, <name><surname>Ettestad</surname><given-names>P</given-names></name>, <name><surname>Reynolds</surname><given-names>PJ</given-names></name>, <name><surname>Brown</surname><given-names>TL</given-names></name>, <name><surname>Hatton</surname><given-names>ES</given-names></name>, <name><surname>Holmes</surname><given-names>JL</given-names></name>, <name><surname>Glass</surname><given-names>GE</given-names></name>, <name><surname>Gage</surname><given-names>KL</given-names></name>, <name><surname>Eisen</surname><given-names>RJ</given-names></name>, <year>2010</year>. <article-title>Climatic predictors of the intra- and inter-annual distributions of plague cases in New Mexico based on 29 years of animal-based surveillance data</article-title>. <source>Am J Trop Med Hyg</source>
<volume>82</volume>: <fpage>95</fpage>&#x02013;<lpage>102</lpage>.<pub-id pub-id-type="pmid">20065002</pub-id>
</mixed-citation></ref><ref id="R7"><label>7.</label><mixed-citation publication-type="journal"><name><surname>Gage</surname><given-names>KL</given-names></name>, <name><surname>Kosoy</surname><given-names>MY</given-names></name>, <year>2005</year>. <article-title>Natural history of plague: Perspectives from more than a century of research</article-title>. <source>Annu Rev Entomol</source>
<volume>50</volume>: <fpage>505</fpage>&#x02013;<lpage>528</lpage>.<pub-id pub-id-type="pmid">15471529</pub-id>
</mixed-citation></ref><ref id="R8"><label>8.</label><mixed-citation publication-type="book"><collab>R Core Team</collab>, <year>2023</year>. <source>R: A Language and Environment for Statistical Computing</source>. <publisher-loc>Vienna, Austria</publisher-loc>: <publisher-name>R Foundation for Statistical Computing</publisher-name>.</mixed-citation></ref><ref id="R9"><label>9.</label><mixed-citation publication-type="webpage"><collab>NOAA National Centers for Environmental Information</collab>, <year>2023</year>. <source>Climate at a Glance: Divisional Time Series</source>. <comment>Available at</comment>: <comment><ext-link xlink:href="https://www.ncei.noaa.gov/access/monitoring/climate-at-a-glance/divisional/time-series" ext-link-type="uri">https://www.ncei.noaa.gov/access/monitoring/climate-at-a-glance/divisional/time-series</ext-link>.</comment>
<comment>Accessed</comment>
<date-in-citation>September 21, 2023</date-in-citation>.</mixed-citation></ref><ref id="R10"><label>10.</label><mixed-citation publication-type="webpage"><collab>NOAA National Centers for Environmental Information</collab>, <year>2023</year>. <source>Climate Data Online Search: Daily Summaries</source>. <comment>Available at</comment>: <comment><ext-link xlink:href="https://www.ncdc.noaa.gov/cdo-web/search" ext-link-type="uri">https://www.ncdc.noaa.gov/cdo-web/search</ext-link>.</comment>
<comment>Accessed</comment>
<date-in-citation>September 21, 2023</date-in-citation>.</mixed-citation></ref><ref id="R11"><label>11.</label><mixed-citation publication-type="webpage"><collab>Centers for Disease Control and Prevention</collab>, <year>2024</year>. <source>About National Notifiable Diseases Surveillance System</source>. <comment>Available at</comment>: <comment><ext-link xlink:href="https://www.cdc.gov/nndss/index.html" ext-link-type="uri">https://www.cdc.gov/nndss/index.html</ext-link>.</comment>
<comment>Accessed</comment>
<date-in-citation>April 7, 2023</date-in-citation>.</mixed-citation></ref><ref id="R12"><label>12.</label><mixed-citation publication-type="journal"><name><surname>Stapp</surname><given-names>P</given-names></name>, <name><surname>Antolin</surname><given-names>MF</given-names></name>, <name><surname>Ball</surname><given-names>M</given-names></name>, <year>2004</year>. <article-title>Patterns of extinction in prairie dog metapopulations: Plague outbreaks follow El Ni&#x000f1;o events</article-title>. <source>Front Ecol Environ</source>
<volume>2</volume>: <fpage>235</fpage>&#x02013;<lpage>240</lpage>.</mixed-citation></ref><ref id="R13"><label>13.</label><mixed-citation publication-type="journal"><name><surname>Stenseth</surname><given-names>NC</given-names></name>, <etal/>, <year>2006</year>. <article-title>Plague dynamics are driven by climate variation</article-title>. <source>Proc Natl Acad Sci USA</source>
<volume>103</volume>: <fpage>13110</fpage>&#x02013;<lpage>13115</lpage>.<pub-id pub-id-type="pmid">16924109</pub-id>
</mixed-citation></ref><ref id="R14"><label>14.</label><mixed-citation publication-type="journal"><name><surname>Moore</surname><given-names>SM</given-names></name>, <name><surname>Monaghan</surname><given-names>A</given-names></name>, <name><surname>Griffith</surname><given-names>KS</given-names></name>, <name><surname>Apangu</surname><given-names>T</given-names></name>, <name><surname>Mead</surname><given-names>PS</given-names></name>, <name><surname>Eisen</surname><given-names>RJ</given-names></name>, <year>2012</year>. <article-title>Improvement of disease prediction and modeling through the use of meteorological ensembles: Human plague in Uganda</article-title>. <source>PLoS One</source>
<volume>7</volume>: <fpage>e44431</fpage>.<pub-id pub-id-type="pmid">23024750</pub-id>
</mixed-citation></ref><ref id="R15"><label>15.</label><mixed-citation publication-type="journal"><name><surname>Collinge</surname><given-names>SK</given-names></name>, <name><surname>Johnson</surname><given-names>WC</given-names></name>, <name><surname>Ray</surname><given-names>C</given-names></name>, <name><surname>Matchett</surname><given-names>R</given-names></name>, <name><surname>Grensten</surname><given-names>J</given-names></name>, <name><surname>Cully</surname><given-names>JF</given-names></name>, <name><surname>Gage</surname><given-names>KL</given-names></name>, <name><surname>Kosoy</surname><given-names>MY</given-names></name>, <name><surname>Loye</surname><given-names>JE</given-names></name>, <name><surname>Martin</surname><given-names>AP</given-names></name>, <year>2005</year>. <article-title>Testing the generality of a trophic-cascade model for plague</article-title>. <source>Eco-Health</source>
<volume>2</volume>: <fpage>102</fpage>&#x02013;<lpage>112</lpage>.</mixed-citation></ref><ref id="R16"><label>16.</label><mixed-citation publication-type="journal"><name><surname>Ben Ari</surname><given-names>T</given-names></name>, <name><surname>Gershunov</surname><given-names>A</given-names></name>, <name><surname>Gage</surname><given-names>KL</given-names></name>, <name><surname>Sn&#x000e4;ll</surname><given-names>T</given-names></name>, <name><surname>Ettestad</surname><given-names>P</given-names></name>, <name><surname>Kausrud</surname><given-names>KL</given-names></name>, <name><surname>Stenseth</surname><given-names>NC</given-names></name>, <year>2008</year>. <article-title>Human plague in the USA: The importance of regional and local climate</article-title>. <source>Biol Lett</source>
<volume>4</volume>: <fpage>737</fpage>&#x02013;<lpage>740</lpage>.<pub-id pub-id-type="pmid">18765356</pub-id>
</mixed-citation></ref><ref id="R17"><label>17.</label><mixed-citation publication-type="journal"><name><surname>Schotthoefer</surname><given-names>AM</given-names></name>, <etal/>, <year>2012</year>. <article-title>Changing socioeconomic indicators of human plague, New Mexico, USA</article-title>. <source>Emerg Infect Dis</source>
<volume>18</volume>: <fpage>1151</fpage>&#x02013;<lpage>1154</lpage>.<pub-id pub-id-type="pmid">22709463</pub-id>
</mixed-citation></ref><ref id="R18"><label>18.</label><mixed-citation publication-type="journal"><name><surname>Eisen</surname><given-names>RJ</given-names></name>, <etal/>, <year>2007</year>. <article-title>Human plague in the Southwestern United States, 1957&#x02013;2004: Spatial models of elevated risk of human exposure to <italic toggle="yes">Yersinia pestis</italic></article-title>. <source>J Med Entomol</source>
<volume>44</volume>: <fpage>530</fpage>&#x02013;<lpage>537</lpage>.<pub-id pub-id-type="pmid">17547242</pub-id>
</mixed-citation></ref></ref-list></back><floats-group><fig position="float" id="F1"><label>Figure 1.</label><caption><p id="P16">Temporal relationship of model parameters and the resulting fitted number of human plague cases in Arizona Climate Division 2 (1960&#x02013;1997). The original model is as (<bold>A</bold>) described and (<bold>B</bold>) likely implemented. Recreated models (<bold>C</bold>) are based on the original description, (<bold>D&#x02013;F</bold>) are shown with biologically plausible temperature relationships, and (<bold>G</bold>) use plague cases on a calendar year. Recreated models annotated with model numbers correspond to <xref rid="T1" ref-type="table">Table 1</xref>. In the panels, the schematics in the upper panels illustrate the temporal relationships between model parameters, and the lower panels illustrate the observed vs. fitted number of human plague cases for the indicated parameters: <italic toggle="yes">FM</italic><sub><italic toggle="yes">t-x</italic></sub> (February to March total precipitation [inches], <italic toggle="yes">x</italic>-plague year lag), <italic toggle="yes">JA</italic><sub><italic toggle="yes">t-1</italic></sub> (July to August total precipitation [inches], one-plague year lag), <italic toggle="yes">D</italic><sup><italic toggle="yes">T</italic></sup> (days at least temperature <italic toggle="yes">T</italic>, &#x0201c;degree days&#x0201d;), and the plague year <italic toggle="yes">t</italic>. The lagged July to August precipitation covariate was not significant in model recreations, so it was not included in the models presented in <bold>C&#x02013;G</bold>. Vertical dashed lines in the schematic indicate the start of a calendar year for context.</p></caption><graphic xlink:href="nihms-2064690-f0001" position="float"/></fig><fig position="float" id="F2"><label>Figure 2.</label><caption><p id="P17">Fitted and predicted estimates of human plague cases using degree days and lagged spring precipitation. Case data are from a (<bold>A</bold>) June-to-June or (<bold>B</bold>) calendar plague year. The panels are annotated with model numbers from <xref rid="T1" ref-type="table">Table 1</xref>. Insets provides scatterplots of observed vs. expected (fitted or predicted) cases, with the diagonal representing the 1:1 relationship. The schematics in the upper panels illustrate the temporal relationships between model parameters: <italic toggle="yes">FM</italic><sub><italic toggle="yes">t-x</italic></sub> (February to March total precipitation, <italic toggle="yes">x</italic>-plague year lag), <italic toggle="yes">D</italic><sup><italic toggle="yes">T</italic></sup> (days at least temperature <italic toggle="yes">T</italic>, &#x0201c;degree days&#x0201d;), and the plague year <italic toggle="yes">t</italic>. See <xref rid="T1" ref-type="table">Table 1</xref> for more details on model performance metrics. PI = prediction interval.</p></caption><graphic xlink:href="nihms-2064690-f0002" position="float"/></fig><table-wrap position="float" id="T1" orientation="landscape"><label>Table 1:</label><caption><p id="P18">Composition and metrics of models of human plague cases in Arizona Climate Division 2 (1960&#x02013;2022)</p></caption><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/><col align="left" valign="middle" span="1"/></colgroup><thead><tr><th rowspan="2" align="left" valign="bottom" colspan="1">Model</th><th rowspan="2" align="center" valign="bottom" colspan="1">Plague Year</th><th rowspan="2" align="center" valign="bottom" colspan="1">Precipitation Covariates<xref rid="TFN2" ref-type="table-fn">*</xref> Included</th><th rowspan="2" align="center" valign="bottom" colspan="1">Time Frame for Degree Days<sup><xref rid="TFN3" ref-type="table-fn">&#x02020;</xref></sup></th><th rowspan="2" align="center" valign="bottom" colspan="1">AIC (&#x00394;)<sup><xref rid="TFN4" ref-type="table-fn">&#x02021;</xref></sup></th><th rowspan="2" align="center" valign="bottom" colspan="1">R<sup>2</sup><sup><xref rid="TFN5" ref-type="table-fn">&#x000a7;</xref></sup></th><th colspan="2" align="center" valign="bottom" style="border-bottom: solid 1px" rowspan="1">MAE</th><th rowspan="2" align="center" valign="bottom" colspan="1">Prop. 95% PIs Contain Truth<sup><xref rid="TFN8" ref-type="table-fn">#</xref></sup></th></tr><tr><th align="center" valign="bottom" rowspan="1" colspan="1">Training<sup><xref rid="TFN6" ref-type="table-fn">&#x02225;</xref></sup></th><th align="center" valign="bottom" rowspan="1" colspan="1">Testing<sup><xref rid="TFN7" ref-type="table-fn">&#x000b6;</xref></sup></th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">1</td><td align="center" valign="top" rowspan="1" colspan="1">June-to-June</td><td align="center" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">Original intended calendar year</td><td align="center" valign="top" rowspan="1" colspan="1">161.75 (57.74)</td><td align="center" valign="top" rowspan="1" colspan="1">0.34</td><td align="center" valign="top" rowspan="1" colspan="1">0.99</td><td align="center" valign="top" rowspan="1" colspan="1">0.59</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">2</td><td align="center" valign="top" rowspan="1" colspan="1">June-to-June</td><td align="center" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">Original actual calendar year</td><td align="center" valign="top" rowspan="1" colspan="1">104.01 (0.00)</td><td align="center" valign="top" rowspan="1" colspan="1">0.52</td><td align="center" valign="top" rowspan="1" colspan="1">0.75</td><td align="center" valign="top" rowspan="1" colspan="1">0.92</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">3</td><td align="center" valign="top" rowspan="1" colspan="1">June-to-June</td><td align="center" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">Winter/spring of original plague year (January 1-June 15)</td><td align="center" valign="top" rowspan="1" colspan="1">120.42 (16.41)</td><td align="center" valign="top" rowspan="1" colspan="1">0.32</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td><td align="center" valign="top" rowspan="1" colspan="1">0.77</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">4</td><td align="center" valign="top" rowspan="1" colspan="1">June-to-June</td><td align="center" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">Summer of original plague year (June 16-September 30)</td><td align="center" valign="top" rowspan="1" colspan="1">103.80 (20.21)</td><td align="center" valign="top" rowspan="1" colspan="1">0.52</td><td align="center" valign="top" rowspan="1" colspan="1">0.79</td><td align="center" valign="top" rowspan="1" colspan="1">0.79</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">5</td><td align="center" valign="top" rowspan="1" colspan="1">June-to-June</td><td align="center" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">Original plague year (June 16-June 15)</td><td align="center" valign="top" rowspan="1" colspan="1">112.10 (8.09)</td><td align="center" valign="top" rowspan="1" colspan="1">0.42</td><td align="center" valign="top" rowspan="1" colspan="1">0.98</td><td align="center" valign="top" rowspan="1" colspan="1">0.68</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">6</td><td align="center" valign="top" rowspan="1" colspan="1">June-to-June</td><td align="center" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td><td align="center" valign="top" rowspan="1" colspan="1">123.10 (19.09)</td><td align="center" valign="top" rowspan="1" colspan="1">0.24</td><td align="center" valign="top" rowspan="1" colspan="1">1.05</td><td align="center" valign="top" rowspan="1" colspan="1">0.73</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">7</td><td align="center" valign="top" rowspan="1" colspan="1">June-to-June</td><td align="center" valign="top" rowspan="1" colspan="1">No</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td><td align="center" valign="top" rowspan="1" colspan="1">116.09 (12.08)</td><td align="center" valign="top" rowspan="1" colspan="1">
<italic toggle="yes">NA</italic>
</td><td align="center" valign="top" rowspan="1" colspan="1">1.08</td><td align="center" valign="top" rowspan="1" colspan="1">0.67</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">8</td><td align="center" valign="top" rowspan="1" colspan="1">Calendar</td><td align="center" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">Calendar year</td><td align="center" valign="top" rowspan="1" colspan="1">110.96 (6.95)</td><td align="center" valign="top" rowspan="1" colspan="1">0.47</td><td align="center" valign="top" rowspan="1" colspan="1">0.95</td><td align="center" valign="top" rowspan="1" colspan="1">0.80</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">9</td><td align="center" valign="top" rowspan="1" colspan="1">Calendar</td><td align="center" valign="top" rowspan="1" colspan="1">Yes</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td><td align="center" valign="top" rowspan="1" colspan="1">125.58 (21.57)</td><td align="center" valign="top" rowspan="1" colspan="1">0.26</td><td align="center" valign="top" rowspan="1" colspan="1">1.08</td><td align="center" valign="top" rowspan="1" colspan="1">0.99</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">10</td><td align="center" valign="top" rowspan="1" colspan="1">Calendar</td><td align="center" valign="top" rowspan="1" colspan="1">No</td><td align="center" valign="top" rowspan="1" colspan="1">NA</td><td align="center" valign="top" rowspan="1" colspan="1">144.17 (40.16)</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td><td align="center" valign="top" rowspan="1" colspan="1">1.36</td><td align="center" valign="top" rowspan="1" colspan="1">1.09</td><td align="center" valign="top" rowspan="1" colspan="1">1.00</td></tr></tbody></table><table-wrap-foot><fn id="TFN1"><p id="P19">AIC = Akaike information criterion; MAE = mean absolute error; NA = not applicable; PI = prediction interval; Prop. = proportion. The interpretation of pseudo-<italic toggle="yes">R</italic><sup>2</sup> values differs between modeling frameworks such that values are not directly comparable (NA). Therefore, we did not present a value for the June-to-June plague year &#x0201c;simple&#x0201d; model as it used an autoregressive framework (autoregressive order-1), whereas the other models used a generalized linear modeling framework. See <xref rid="F1" ref-type="fig">Figure 1</xref> for schematics of the temporal relationships between model parameters. See <xref rid="F2" ref-type="fig">Figure 2</xref> and <xref rid="SD1" ref-type="supplementary-material">Supplemental Figure 3</xref> for model fits during training and testing periods. See <xref rid="SD1" ref-type="supplementary-material">Supplemental Tables 2</xref>&#x02013;<xref rid="SD1" ref-type="supplementary-material">11</xref> for fitted coefficients.</p></fn><fn id="TFN2"><label>*</label><p id="P20">Precipitation covariates for February to March total precipitation (inches) at one-plague year lag (<italic toggle="yes">FM</italic><sub><italic toggle="yes">t-1</italic></sub>) and two-plague years lag (<italic toggle="yes">FM</italic><sub><italic toggle="yes">t-2</italic></sub>).</p></fn><fn id="TFN3"><label>&#x02020;</label><p id="P21">Covariates for the numbers of days at 90&#x000b0;F (32.2&#x000b0;C) and 95&#x000b0;F (35&#x000b0;C) thresholds during the indicated time frame. Models without degree day covariates are indicated with NA.</p></fn><fn id="TFN4"><label>&#x02021;</label><p id="P22">Mean AIC of three models fitted to imputed datasets. No imputation is needed when degree day covariates are not included (models 6, 7, 9, and 10), so a single model is fitted in these instances. The difference in mean AIC is calculated relative to our recreation of the originally presented<sup><xref rid="R5" ref-type="bibr">5</xref></sup> model fit (model 2), the model that most closely represented the original.</p></fn><fn id="TFN5"><label>&#x000a7;</label><p id="P23">Mean of pseudo-<italic toggle="yes">R</italic><sup>2</sup> of models fitted to imputed datasets. No imputation is needed when degree day covariates are not included (models 6, 7, 9, and 10), so a single model fitted in these instances. Pseudo-<italic toggle="yes">R</italic><sup>2</sup> is a goodness-of-fit metric where a value of zero indicates that the model captures no interannual variation (i.e., predicts the same number each year) and a value of one indicates that the model perfectly matches the observed cases (i.e., fully captures interannual variation).</p></fn><fn id="TFN6"><label>&#x02225;</label><p id="P24">MAE of the model fitted to data from plague years 1960&#x02013;1997. Lower MAE indicates better fit. The average number of cases for this period was 1.32 cases/year (June-to-June plague year) or 1.34 cases/year (calendar plague year).</p></fn><fn id="TFN7"><label>&#x000b6;</label><p id="P25">MAE of model predictions for plague year 1998&#x02013;2022. Lower MAE indicates better prediction. The average number of cases for this period was 0.40 cases/year (June-to-June plague year) or 0.36 cases/year (calendar plague year).</p></fn><fn id="TFN8"><label>#</label><p id="P26">Proportion of 95% PIs containing reported human plague cases (1998&#x02013;2022). PIs containing observations indicate reliable predictions. All generalized linear modeling had point-wise prediction intervals, whereas the PIs for the autoregressive order-1 model (model 7) were calculated recursively.</p></fn></table-wrap-foot></table-wrap></floats-group></article>