To validate assumptions about the length of the distribution–replacement cycle for long-lasting insecticidal nets (LLINs) in Rwanda, the Malaria and other Parasitic Diseases Division, Rwanda Ministry of Health, used World Health Organization methods to independently confirm the three-year LLIN serviceable life span recommendation of WHO.
Approximately 3,000 coded LLINs, distributed as part of a national campaign, were monitored in six sites, by means of six–monthly visits to selected houses. Two indicators, survivorship/attrition, a measure of the number of nets remaining, and fabric integrity, the proportion of remaining nets in either ‘good’, ‘serviceable’ or ‘needs replacement’ condition, based on holes in the net material, were tracked. To validate the assumption that the intervention would remain effective for three years, LLIN coverage, calculated using either survivorship, or integrity, by removing nets in the ‘needs replacement’ category from the survivorship total, was compared with the predicted proportion of nets remaining, derived from a net loss model, that assumes an LLIN serviceable life of three years.
After two years, there was close agreement between estimated LLIN survivorship at all sites, 75% (range 64-84%), and the predicted proportion of nets remaining, 75%. However, when integrity was considered, observed survivorship at all sites, declined to 42% (range 10-54%).
More than half, 58%, of the LLINs fell into the ‘needs replacement’ category after two years. While these nets were counted for survivorship, they were judged to be of little-to-no benefit to a user. Therefore, when integrity was taken into account, survivorship was significantly lower than predicted, suggesting that net serviceable life was actually closer to two, rather than three years, and, by extension, that the impact of the intervention during year three of the LLIN distribution-replacement cycle could be well below that seen in years one and two.
Large-scale distribution of LLINs to achieve universal net coverage has been associated with highly successful malaria control outcomes in Rwanda. When insecticide-treated net ownership increased from 15% to 82%, alongside scale-up of other malaria control interventions, there was a 50% decrease in all-cause mortality of children less than five years old [
In addition to achieving high coverage, the Rwanda LLIN distribution programme is also focused on timely replacement of existing nets. That is maximizing the time between distribution and replacement (for optimum use of resources), while, at the same time, avoiding loss of impact, associated with net failure. Based on LLIN durability monitoring norms [
LLIN durability monitoring focuses on three indicators: net survivorship, an estimate of coverage, that is, the percentage of nets still present and in use in the house hold to which they were distributed; fabric integrity, a quantification of the number and size of holes in the LLIN netting and bio-efficacy, a measure of net insecticidal effect. The term ‘hole’ is used as a general term to describe all damage: tears, burn holes, rodent (chewing)-associated damage, rips in corners and seams. While all three indicators are assessed in Rwanda, two: survivorship and fabric integrity are discussed here. The two should be assessed together, because if a net is present and counted for survivorship, but in such poor physical condition that it offers the user little-to-no protection, then survivorship data alone will, most likely, under estimate net loss. This report presents the results from a prospective, longitudinal assessment of LLIN durability, undertaken by the Malaria and Other Parasitic Diseases Division (MAL & OPDD) to monitor both survivorship and fabric integrity.
Monitoring was based on a prospective longitudinal assessment, with six-monthly follow up, of six LLIN cohorts. Administrative units, cells (the Rwanda Constitution divides the country into provinces, districts, cities, municipalities, towns, sectors and
**polyester thread - denier 100, polyethylene thread - denier 150.
***Each LLIN enrolled in the tracking assessment was bar coded. A second site-specific ink code, one or two colored (black, red or green) dot(s), 0.5 cm in diameter, drawn with indelible-ink laundry marker, was also used.
Characteristics Thread Sector (setting*) Cell Polyethylene** Polyester** Masaka (peri-urban, endemic*) Rusheshe 500 nets Ink code: one black dot Bar codes A001-A500 Cyimo 500 nets Ink code: two black dots Bar codes B001-B500 Kinazi (rural, endemic*) Burima 500 nets Ink code: one red dot Bar codes C001-C500 Rutabo 500 nets Ink code: two red dots Bar codes D001-D500 Bungwe (rural, hypo-endemic*) Bushenye 500 nets Ink code: one green dot Bar codes E001-E500 Bungwe 500 nets Ink code: two green dots Bar codes F001-F500
LLINs were distributed to the selected sites as part of a 2010, countrywide, mass net distribution campaign. After one month, LLIN tracking teams visited 500 houses at each site. If the house was open and at least one campaign net was in use, the head of the household was asked to approve participation in the assessment, which included four follow up visits at six (T6), 12 (T12), 18 (T18), and 24 (T24) months post distribution. Upon approval, one of the recently distributed LLINs/household was bar and color coded (Table
*Households were dropped at T0 because they were either closed, or open, but had not received an. LLIN during the national campaign.
**Households re-visited during T6 follow up visit.
***By definition, the percentage (%) of enrolled households with a coded LLIN at T0 is 100%.Setting Cell Thread House-holds visited dropped
*
LLINs (households) enrolled
**
% LLIN survivorship
*** T
0
Peri-urban/endemic Cyimo Polyester 500 93 407 100 Rusheshe Polyethylene 500 32 468 Rural/hypo- endemic Bungwe Polyester 500 24 476 Bushenya Polyethylene 500 17 483 Rural/endemic Rutabo Polyester 500 63 437 Burima Polyethylene 500 26 474
During six-monthly follow up visits, T6, T12, T18, and T24, all households, open for inspection, were re-visited to assess LLIN survivorship, which was estimated using the equation:
Fabric integrity was also assessed during each visit. The condition of all nets was derived from an examination of 30 assessment LLINs per site. The nets, randomly-selected from all households inspected, were examined for holes and a pHI, the weighted summary of observed damage (holes), was calculated. In this study a method described at a WHO Vector Control Working Group (VCWG) work stream [ A circle with an estimated diameter of 0.5-2 cm (for a hole judged to be ’smaller than one’s thumb’) A circle with an estimated diameter of 2–10 cm (for a hole judged to be ’larger than one’s thumb, but smaller than one’s fist’) A circle with an estimated diameter of 10–25 cm (for a hole judged to be ’larger than one’s fist but smaller than one’s head’) A circle with an estimated diameter of >25 cm (for a hole judged to be ’larger than one’s head’)
To calculate the pHI, the number of holes in each category was multiplied by a category weight: 1 for category (1), 23 for category (2), 196 for category (3) and 578 for category (4).
Integrity data were entered into the following formula to estimate a pHI for each LLIN:
pHI = (1) (number of category 1 holes) + (23) (number of category 2 holes) + (196) (number of category 3 holes) + 578 (number of category 4 holes).
PHI thresholds [ A net with a pHI < 64 was classified as being ‘in good condition’. A net in the 64 ≤ pHI ≤ 768 range, was classified as being ‘in serviceable condition’ (repairable). A net with a pHI > 768, was judged to be ’in need of replacement’ and of questionable benefit to user’ [
The estimated median size of a single hole corresponding to each category is: 1.6 cm2 for category (1) - good 168 cm2 for category (2) - serviceable 1,190 cm2 for category (3) - replace
To express the impact of change in fabric integrity on survivorship (net loss), the estimated number of nets in category 3 was removed, and survivorship was recalculated based on the number of nets in categories 1 and 2 only.
Estimates of survivorship, based on coverage and integrity, are shown in tabular form, and are plotted against time for comparison with the NetCALC -predicted proportion of nets, based on a three-year serviceable life assumption.
This observational study was planned with, and approved by, the Ministry of Health. Community leaders were consulted before the study began, and all gave verbal consent in advance. Head of households gave their written consent prior to being enrolled.
On average, LLIN survivorship declined to a mean of 75% (all sites), range 64-84%, after two years (Table
1,2
*NetCALC predicted percent of nets remaining after two years, based on a 3-year serviceable life assumption.Cell Setting Thread Observed Predicted* T
0
T
12
T
24
Cyimo Peri-urban Polyester 100 89 641
75 Rusheshe Endemic Polyethylene 100 93 841
Bungwe Rural Polyester 100 92 77 Bushenya Endemic Polyethylene 100 94 79 Rutabo Rural Polyester 100 95 702
Burima Hypo-endemic Polyethylene 100 90 782
Figure
In summary, observed survivorship at most of the assessment sites appear to track the NetCALC curve based on a three-year serviceable life assumption.
Fabric integrity results (Table
Cell Cyimo Rusheshe Bungwe Bushenya Rutabo Burima LLIN thread p-ester p-ethylene p-ester p-ethylene p-ester p-ethylene
Good 100 100 100 100 100 100 Serviceable 0 0 0 0 0 0 Replace 0 0 0 0 0 0
Good 47 20 67 37 27 60 Serviceable 20 43 13 13 37 27 Replace 33 37 20 50 13 13
Good 10 3 3 3 10 6 Serviceable 27 7 47 50 37 47 Replace 63 90 50 47 53 47
When the T24 integrity measurements were converted to survivorship, by discounting LLINs in the ‘replace’ category, the resulting survivorship estimates (mean values) were between 21 and 65 percentage points below the 75% value predicted by the 3-year serviceable life model (Figure
LLIN durability monitoring in Rwanda indicated lower survivorship,
Karema
In this analysis, a ‘missing’ net reduces survivorship. However, such ‘missing’ nets could have been present in another house, not visited by the tracking team, and, therefore, still have contributed to coverage and impact. On the other hand, the poor fabric integrity results after two years, suggest that, regardless of whether or not a net was present and in use somewhere in the community, it was as likely to be torn, in need of replacement, and of little use to the user, as to be in good or serviceable condition.
When poor fabric integrity results for surviving nets are considered, survivorship after two years is nearly one half of that predicted by a NetCALC model (41% versus 75%). The assumption that most of these damaged nets probably provided ‘questionable benefit to users’ [
NetCALC curves, based on a three-to-five year serviceable life, are thought to be realistic estimates for programme planning. However, the results reported here, suggest that many, perhaps most of LLINs, in use in Rwanda, are of questionable benefit to users, due to poor fabric integrity, after two years. If one assumes that such nets, more appropriately, belong in the nets lost (associated with survivorship) category, then LLIN survivorship estimates decrease dramatically. When such results are compared with expected survivorship, derived from NetCALC predictions, the discrepancy is significant.
Factors that affect LLIN durability, act to a greater or lesser extent, in different settings. For example, in the present assessment, the rate at which holes appear (loss of fabric integrity) in nets is higher in urban locations. Given the number of factors that affect LLIN durability, and the variation between settings where they are distributed, it is not surprising that reliance on generalizations about how long nets last could be misleading. LLIN monitoring based on the approach outlined by WHO, is recommended as the best way to address the programmatic question of how long nets last.
If faster-than-expected fabric degradation is a significant determinant of LLIN impact, what are the possible ways to ameliorate its effect? Unfortunately, reducing the time to LLIN replacement is problematic, based on current funding models (nonetheless, the Ministry of Health, Rwanda is considering LLIN replacement every 30 months, versus the current 36–40 months). Other alternatives: working with manufacturers to develop and test more durable net products, fostering a stronger net care and repair culture, and ‘pushing’ more nets to communities via routine channeling and social marketing, as well as national campaigns, are also planned to close the gap between observed and expected net loss rates. Finally, as stated earlier, a comprehensive programme of LLIN durability monitoring to reduce reliance on assumptions, that may not apply everywhere, is needed to accurately inform programme about ‘on-the-ground’ net loss rates.
When LLINs remain in use after ‘failing’ due to loss of fabric integrity, communities, where LLIN coverage, as well as compliance with nightly net use, appears to be adequate, may still experience a resurgence of malaria. For this reason, indicators of LLIN coverage, based on questions such as “did you sleep under a bed net last night?” [
This study did not address the third WHO durability indicator, bio-efficacy. Could, for example, insecticidal effect compensate for poor fabric integrity? Unpublished data from Rwanda suggests that after two years, when net loss associated with fabric integrity has taken its toll, LLIN bio-efficacy also declines, permitting some vector survival following exposure to nets. As vector survival increases, vector entry via holes, man-vector contact and transmission rates also increase [
It is important to note that the thresholds used to evaluate fabric integrity in this study, e.g. pHI-based fabric integrity condition categories, reflect limited observations and should be thought of as more arbitrary than evidence-based. Therefore, their accuracy with respect to the question of net replacement merits additional evaluation. Nonetheless, what pHI threshold-based monitoring does document, regardless of the interpretation,
Two years after a national LLIN campaign, as many as three in ten LLINs had been removed from the houses where they were hung at distribution. However, more surprising, was the fact that five to as many as nine of every ten remaining LLINs showed loss of fabric integrity to a degree that called into question their ongoing serviceability, during year three of the planned distribution-replacement cycle. If loss of fabric integrity also means loss of protection from man-vector contact, as assumed, then adjustments to LLIN distribution planning are needed, along with more comprehensive monitoring of LLIN durability. As countries continue to scale-up LLIN coverage, it will be important to have specific information on LLIN durability in a variety of settings. This information should be generated in as short a time frame as possible to ‘inform’ decisions on how best to replace failing LLINs before they compromise the efficacy of the intervention.
The authors declare that they have no competing interests.
EH: principal investigator, CK: co-principal investigator, BC: co-ordinator and field supervisor, AR: data base management, AK: information technology, AM: mapping, JET, RP: implementation, RB: technical assistance. All of the authors have read and approved the final version of the manuscript.
Our thanks are addressed to the Ministry of Health, local leaders, health providers, community health workers and residents at the LLIN monitoring sites. This work was supported by the Government of Rwanda and funded by the President’s Malaria Initiative (PMI) via the Bureau for Global Health, United States Agency for International Development (USAID) and the Global Fund malaria SSF. The opinions expressed herein are those of the authors and do not necessarily reflect the views of the Government of Rwanda or USAID.