10124722434601Health Econ Policy LawHealth Econ Policy LawHealth economics, policy, and law1744-13311744-134X31109388686829710.1017/S1744133119000136HHSPA1048918ArticleHPV vaccine status and sexual behavior among young sexually-active women in the US: evidence from the National Health and Nutrition Examination Survey, 2007–2014LeidnerAndrew J.http://orcid.org/0000-0001-8869-55611*ChessonHarrell W.2TalihMakram3Health Economist/Berry Technology Solutions, Federal contractor for Immunization Services Division, National Center for Immunization and Respiratory Disease, Centers for Disease Control and Prevention, 1600 Clifton Road, NE, MS A-19, Atlanta, GA 30333, USADivision of STD Prevention, National Center HIV/AIDS, Viral Hepatitis, STD, and TB Prevention, Centers for Disease Control and Prevention, 1600 Clifton Road, NE, Atlanta, GA 30333, USAUniversity of Porto Institute of Public Health, Rua das Taipas 135, 4050-600 Porto, PortugalCorrespondence to: aleidner@cdc.gov492019215201910202001102021154477495

Concern has been expressed that human papillomavirus (HPV) vaccination programs might promote risky sexual behavior through mechanisms such as risk compensation, behavioral disinhibition, or perceived endorsement of sexual activity. This study assesses whether HPV vaccination status is associated with any differences in selected sexual behaviors among young sexually-active women in the US. Our dataset includes young, adult female respondents from questionnaire data collected in the National Center for Health Statistics’ National Health and Nutrition Examination Survey from 2007 to 2014. The empirical approach implements a doubly robust estimation procedure, based on inverse probability of treatment weighting. For robustness, we implement several specifications for the propensity model and the outcomes model. We find no consistent association between HPV vaccination and condom usage or frequency of sex. Specifically, we find no evidence that HPV vaccination is associated with condom usage or with whether a person had sex more than 52 or more than 104 times per year. We find inconsistent evidence that HPV vaccination is associated with a person having sex more than 12 times per year. As in previous research, HPV vaccination does not appear to have a substantive effect on sexual behavior among young sexually-active women in the US.

Condom usagefrequency of sexhealth riskHPV vaccinerisk perceptionsexual behaviorI12I10D81D83D80

Human papillomavirus (HPV) is the most common sexually transmitted infection (STI) in the US with approximately 79 million persons currently infected and 14 million new infections every year (Satterwhite et al., 2013). While the majority of HPV infections resolve on their own with no sequelae, HPV infection can persist and cause disease. HPV has been associated with cancer at several anatomic sites: cervical, vaginal, and vulvar cancer in females; penile cancer in males; and anal and oropharyngeal cancer in both sexes. HPV can also cause cervical precancers, anogenital warts and recurrent respiratory papillomatosis (Petrosky et al., 2015). Currently, three HPV vaccines have been approved for use in the US: bivalent (Food and Drug Administration, 2009), quadrivalent (Food and Drug Administration, 2006) and nonavalent (Food and Drug Administration, 2014). These vaccines differ in the number of HPV types, or serotypes, that are prevented. All three vaccines prevent HPV types 16 and 18, which cause the majority of HPV-related cancers (Meites et al., 2016). For the nonavalent vaccine, recommendations were updated in 2016 to a two-dose series for those who initiate vaccination before their 15th birthday (Meites et al., 2016). Routine HPV vaccination at 11–12 years of age has been recommended in the US for females since 2006 and males since 2011 (Markowitz et al., 2014).

Despite the health benefits of HPV vaccination, coverage rates are short of the Healthy People 2020 target of 80% coverage for three or more doses of HPV vaccine (Stokley et al., 2014). Coverage rates for HPV vaccination also lag behind coverage rates for other adolescent vaccines (Stokley et al., 2014). As of 2015, 3-dose HPV vaccine coverage rates among 13–15-year-olds in the US were estimated at 37% for females and 27% for males (Reagan-Steiner et al., 2016). Factors associated with HPV vaccine uptake include the strength of physician recommendation (Rosenthal et al., 2011), parent preferences (Brown et al., 2010; Freed et al., 2010) and child preferences (Brown et al., 2014). In the President’s Cancer Panel, one of the major goals that was discussed was to increase HPV vaccine coverage in the US. This goal is supported by the strategy of increasing acceptance of HPV vaccines among parents, caregivers, and adolescents (Rimer et al., 2014).

A related reason that has been suggested for relatively low HPV vaccine coverage is the perception that HPV vaccination might promote risky sexual behavior through mechanisms such as risk compensation, behavioral disinhibition, or perceived endorsement of sexual activity. These concerns are consistent to some degree with economic theory, where lowering the cost of risky sex (such as with HPV vaccination) would be expected to increase the demand for risky sex. Previous public health researchers have found little evidence to support this claim (Bednarczyk et al., 2012; Liddon et al., 2012; Mayhew et al., 2014; Smith et al., 2014; Jena et al., 2015). Our study investigates this claim using a methodological approach and dataset that are new to this issue. In particular, this is the first study we are aware of that implements a propensity score-based approach to investigate the relationship between vaccination status and sexual behavior. We also investigate relatively subtle changes in sexual behavior, including frequency of condom usage and frequency of sexual intercourse, available from the National Health and Nutrition Examination Survey (NHANES) dataset, which has not been used to investigate the issue of HPV vaccination status and risky sexual behavior.

Relevant background and literature

The benefits and costs of HPV vaccination have been an object of discussion in the research literature (Goldie et al., 2004; Chesson et al., 2008) as well as in the popular media (Brody, 2007), with a fair amount of attention paid to aspects of sexual behavior and sexual activity (Bednarczyk et al., 2012; Liddon et al., 2012; Mullins et al., 2012; Mayhew et al., 2014; Offit, 2014; Smith et al., 2014; Jena et al., 2015). Several studies investigate the relationship between vaccination status and medical conditions that are related to sexual behavior, such as the diagnosis of other STIs, as captured by electronic health record databases (Bednarczyk et al., 2012; Smith et al., 2014; Jena et al., 2015). Other studies use surveys to estimate the relationship between vaccination status and levels of specific sexual behaviors, such as a number of sexual partners and condom usage (Liddon et al., 2012; Mayhew et al., 2014). While the majority of studies in this area have been narrow in geographic scope, focusing on a single (Bednarczyk et al., 2012; Mayhew et al., 2014; Jena et al., 2015) or regional health system (Smith et al., 2014), at least one recent study analyzed a nationally-representative sample, using the National Center for Health Statistics’ (NCHS’) National Survey of Family Growth (Liddon et al., 2012). Recent prevalence assessments of HPV in the US came from NCHS’ NHANES (Markowitz et al., 2013, 2016), the data source used in our study. The prevalence study found decreasing rates of HPV associated with HPV vaccination status but did not investigate into all of the sexual behaviors reported in NHANES (i.e., frequency of condom use and frequency of sexual encounters) (Markowitz et al., 2013).

In contexts other than HPV vaccination, changes in sexual behaviors have been noted in response to changes in factors that affect the potential risks, or ‘costs’, of sexual activity. For example, the availability of long-acting reversible contraception can lead to reductions in condom use (Steiner et al., 2016). As another example, substantial reductions in risky behavior in response to the HIV/AIDS epidemic have been well-documented (Stolte et al., 2004). The emergence of highly active anti-retroviral therapy for HIV, which could lower the perceived consequences of acquiring HIV, was associated with increased frequency of unprotected sex and outbreaks of syphilis among men who have sex with men (Chesson and Gift, 2008). Concerns about risk compensation and behavioral change complicate many prevention efforts of HIV/AIDS (Cassell et al., 2006). While we acknowledge that improvements in the prevention and treatment of HIV/AIDS are likely to have much greater impacts on the perceived health-risks of sexual activity than would improvements in the prevention of HPV, the possibility that the HPV vaccine may change some level of perception, attitude, or incentive regarding sexual behavior seems plausible.

Two recent studies (Smith et al., 2014; Moghtaderi and Dor, 2016) have investigated the effects that the receipt of the HPV vaccine may have on the subsequent health-risk perceptions and health-related behaviors of young women. Both of these studies measured subsequent health behaviors by encounters with the health care system related to Pap tests (Moghtaderi and Dor, 2016) and related to non-HPV STIs or pregnancy (Smith et al., 2014). The Pap test is a cervical screening test used to detect precancers and cancers, which can be related to specific types of HPV (Moghtaderi and Dor, 2016). Both of these studies implemented regression discontinuity research designs that utilized the adoption of age-specific HPV vaccination policy as a treatment assignment variable.

While these empirical approaches rely on the plausibly exogenous assignment of treatment (i.e., exposure to HPV vaccination) due to the age threshold of vaccination recommendations, the approach used in our study relies on minimizing confounder bias through propensity score weighting. Our contribution to this literature includes (1) the application of a new methodological approach to this problem, propensity score-based empirical approach, and (2) assessment of relatively subtle, or marginal, changes in health risk-related behavior including frequency of sexual intercourse and frequency of condom usage.

Methods

This study assembles an analytical dataset using data from NHANES (Johnson et al., 2013; Centers for Disease Control and Prevention, 2015). NHANES is a repeated cross-sectional questionnaire survey and medical examination. NHANES respondents are from a probability-based sample that is drawn to be nationally representative. The survey questionnaire component of NHANES elicits a multitude of factors related to demographics, behavioral characteristics and health insurance and utilization, including whether or not a respondent received selected vaccinations; see Data section, below, for more information.

For this study, we estimate the probability of an individual receiving an HPV vaccine, measured in our data as having received at least one dose of the vaccine. Then using the predicted probabilities of vaccination, we construct inverse probability of treatment weights (IPTWs). Using an IPTW-balanced sample, we estimate an outcomes model. This estimation procedure is said to be doubly robust due to the characteristic that if either the propensity model or the outcome model is properly specified, the procedure yields unbiased estimates for an average treatment effect (ATE) (Funk et al., 2011; Kaiser and Schmid, 2014). Generally, this approach is based on the potential-outcomes framework (Rubin, 1974).

Conceptual approach

Estimating causal effects using propensity models has been described in detail in the literature many times (Hirano and Imbens, 2001; Imbens, 2004; Kaiser and Schmid, 2014). Propensity score-based methods have been used in the economic and health research literature for many years, investigating critical health issues such issues as cardiovascular disease (Deb et al., 2016), drug addiction (Griffin et al., 2014), health communications (Leidner, 2014) and cancer treatment (Fujii et al., 2015; Jung et al., 2015). Researchers have investigated a variety of issues utilizing methods that combine both propensity score-based methods and data from NHANES, such as lead exposure among children (Ahrens et al., 2016), obesity (Goossens et al., 2015; Ahrens et al., 2016), cancer-related health behavior (Jabson et al., 2015) and oral health (Murphy et al., 2014). Using the predicted probability of vaccination as an observation weight, two samples are constructed that are comparable across all the variables in the model except for vaccination status. Because the only observable difference between the two constructed samples is in the treatment variable, this approach can illustrate potentially causal associations. The ATE estimates are computed following the estimation of an outcomes regression model that controls for a variety of relevant individual characteristics, many of which are also used to estimate the propensity model. The major limitation of this approach is that the similarities or balance between the two constructed samples among attributes that are unmeasurable cannot be assessed. The balance between the two constructed samples and the effect estimates depends on the specifications of the propensity score model and the outcomes model. To further ensure our estimates are robust to specification choice, we estimate two propensity score models and several outcomes models. Another complication of our study is that NHANES data are collected from a complex survey design. Building on the work of other propensity-score-based studies that use complex survey data (DuGoff et al., 2014; Ridgeway et al., 2015), both the propensity model and the outcomes model are adjusted for the complex survey design of NHANES.

Propensity model

The treatment assignment variable in this study is whether or not an NHANES respondent reported ever receiving at least one dose of HPV vaccine. This variable is represented by zi, where zi = 1 indicates that individual i was a vaccine recipient and zi = 0 indicates no vaccine was received. The vector Xi contains the individual characteristics that predict the probability of treatment assignment. In the regression models, these individuals are weighted to represent a national sample, using the medical exam weights from NHANES. In general, the propensity score (pi(Xi)), or the probability of individual i receiving a vaccine conditional on the individual’s characteristics, can be represented with the following equations: pi(Xi)=Pr(zi=1|Xi) where 0<pi(Xi)<1.

The probability of treatment assignment is a function of the vector of covariates Xi and the vector of estimated coefficients A, as in the following: Pr(zi=1|Xi)=α0+α1x1,i+α2x2,i+⋯+αkxk,i where k is the number of covariates in Xi. After estimating the propensity model, the predicted values for each individual (p^i, predictions are denoted with a hat) are used to construct the IPTWs (wip) (Hirano and Imbens, 2001). This construction of the IPTWs corresponds to the estimation of an ATE.

wip=zip^i+1−zi1−p^i

The final analytical weight (wi) for each individual that is used in the final outcomes regression model is the sampling weight from the complex survey design (wis) multiplied by the IPTW (wip) (Ridgeway et al., 2015): wi=wis×wip

Doubly robust estimator

The outcomes model estimates the relationship between the outcomes of interest (Yj) and the treatment variable (zi). In addition to the treatment variable, a vector of other covariates, denoted as Vi, are also included the outcomes model: Pr(Yj,ζ=1|zi, Vi)=β0,j,ζ+β1,j,ζv1,i+β2,j,ζv2,i+⋯+βk,j,ζvk,i=mζ(Vi,Bζ) where ζ = 0 for controls and ζ = 1 for treated, and j is the index for each outcome we investigated. The predicted values from the outcomes model are represented by the term m^ζ(Vi, Bζ), with either treatment or control imposed on the model. The complete specification of the doubly robust estimator Δ^DR is as follows: Δ^DR=1n∑i=1nziyi−(zi−p^i)m^1(Vi, B1)p^i       −1n∑i=1n(1−zi)Yi−(zi−p^i)m^0(Vi, B0)1−p^i where n is the sample size; p^i is the predicted propensity score; m^ζ(Vi, Bζ) are the predictions from the outcome model with the treatment variable ζ set to 0 or 1 for the entire sample; Vi is the set of covariates; and Bζ are the estimated coefficients from the outcome model with the treatment variable ζ set to 0 or 1 (Funk et al., 2011).

Empirical approach

The dependent variables in the propensity model and outcomes model are all binary. So both sets of models can be estimated with any binary limited dependent statistical regression, such as a logit or probit. For this study, we use a logit model.

Potential causation model

The general relationships between factors and outcomes that are assumed by our empirical specifications are depicted in a conceptual diagram (Figure 1). One issue of particular relevance to this study is the relationship between prior sexual behavior, HPV vaccination, and sexual behaviors that occur after a vaccination is received. For some young women, the decision to receive an HPV vaccination might depend on whether or not she is sexually active. For sexually active women, past sexual activity is likely correlated to present sexual activity, independent of vaccination status. For this reason, we include age at first sexual encounter, intended to control for past sexual activity, as a covariate in the propensity model. Other variables, such as having ever taken an HIV test and having ever taken birth control pills, are included in health system utilization section of Figure 1, but these may also be considered as indicators of sexual behavior. In the IPTW samples, the treated and controls are balanced with respect to age at first sexual encounter, having taken an HIV test, and having taken birth control pills. The propensity model also includes several variables that we believe are plausibly unrelated to sexual behavior decisions, but would likely impact the probability of an individual receiving the HPV vaccine. These variables include an indicator variable for the past receipt of additional vaccines, including hepatitis A and hepatitis B. While it is possible that hepatitis A and B can be transmitted sexually, these are not particularly common events and likely constitute a smaller influence on the perceived health risks of sexual activity than would an HPV vaccination or concerns over other STIs.

Model specifications

To address the potential for mis-specification, we select two specifications for the propensity model (equation (3)) and three or four specifications for the outcomes model (equation (6)), depending on the outcome variable. Therefore, for each outcome variable, we estimate six or eight regressions, two different propensity models and three or four different outcomes models. We refer to the two specifications of the propensity model as ‘basic’ and ‘expanded’. In the basic propensity model, the covariate vector Xi contains characteristics about each respondent. These characteristics include race/ethnicity indicators, age in years at the time of the survey, high school completion status, marital status, household poverty-line status, health insurance status, history of taking birth control pills, vaccination history for hepatitis A and hepatitis B, history of being tested for HIV, smoking status, alcohol consumption status, age in years at time of first sexual experience and a time trend. All variables are defined in Table 1. In the expanded propensity model, the covariate vector Xi contains the same conceptual components as the basic propensity model, but with more refined resolution in some of the variables, where such data are available. As one example, the behavioral variables in the basic propensity model include if a respondent has ever drank alcohol or ever smoked 100 cigarettes. In the expanded propensity models, additional variables, which in this example captured the number of alcohol drinks consumed by a respondent per day and if a respondent currently smokes cigarettes every day, are also included. Additional details on the model specifications are given in the Supplemental Appendix.

We implement up to four specifications of the outcomes model. The labels we give to these specifications are ‘basic’, ‘expanded’, ‘basic with sex frequency’, and ‘basic with age fixed effects’. Due to limited degrees of freedom, we could not implement the expanded outcomes model with sex frequency or with age fixed effects (Table 1). As with the expanded propensity model, the expanded outcomes model contains many of the same conceptual components as the basic outcomes model but several variables are structured to capture a more detailed resolution. The full specification of the basic and expanded models is presented in the Supplemental Appendix. Additional specifications of the outcomes model include the basic model with sex frequency and the basic model with age fixed effects. The basic model with sex frequency includes all the covariates from the basic outcomes model with the addition of the three sex frequency indicator variables. The basic model with age fixed effects includes indicator variables for every age level.

Inference

Inference for these models is based on 500 bootstrapped replications (Wooldridge, 2009), with a replication method based on a rescaled bootstrap procedure described in previous studies (Rao et al., 1992; Cheng et al., 2008) and recently used to analyze NHANES data (Talih, 2013, 2015). The upper and lower 95% confidence intervals were estimated using the 97.5th and the 2.5th percentiles of the bootstrapped estimates’ distribution, respectively. Standard errors were computed directly using the square root of the sample variance of the bootstrapped estimates.

Data

NHANES is a cross-sectional, complex, multistage probability sampling survey. The survey is designed to assess the health and nutritional status of noninstitutionalized civilian US residents through interviews and physical examinations. The survey examines a nationally representative sample of about 5000 persons each year, and data are released in 2-year cycles (Johnson et al., 2013). The dataset used in this study comes from four NHANES cycles, 2007–2008, 2009–2010, 2011–2012 and 2013–2014. This study looks at a subset of the NHANES sample designed to include individuals who would have been targeted by the ACIP recommendations for an HPV catch-up vaccine among females aged 13–26 years. This recommendation was adopted in the June 2006 meeting of the ACIP (Markowitz et al., 2007). Our sample includes females who were age 27 years or younger in 2007–2008 NHANES cycle, 29 or younger in 2009–2010, 31 or younger in 2011–2012, 33 or younger 2013–2014, and who were also at least 18-years-old at the time of the survey.

Starting from an initial adult sample size of 24,113, restricting our sample to include only females yields a smaller sample size of 12,370. Further restrictions based on the NHANES cycles and age groups described above yields an even smaller sample of 2355. Finally, we excluded observations of individuals who did not have sex in the last 12 months and who did not remember or did not report necessary characteristics for the model such as their immunization status, their age of first sexual experience, risky behaviors such as smoking and alcohol consumption, or other. These steps resulted in a final sample that contains 991 individuals with 767 (77%) non-vaccinated and 224 (23%) vaccinated for HPV. This corresponds to observation counts from the NHANES cycles of 2007–2008, 2009–2010, 2011–2012, and 2013–2014 that are equal to 157 individuals with 16 vaccinated and 141 non-vaccinated, 257 individuals with 46 vaccinated and 211 non-vaccinated, 273 individuals with 78 vaccinated and 195 non-vaccinated, and 304 individuals with 84 vaccinated and 220 non-vaccinated, respectively. The outcomes under consideration are the number of times a respondent had sex in the last 12 months and the frequency of condom usage during the last 12 months. These outcomes were elicited from respondents in a private room using a self-administered computer-based questionnaire, the Audio Computer Assisted Self Interview system. We focus on these outcomes because they represent relatively minor, or marginal, changes in sexual behavior when compared to other markers of sexual behavior such as acquiring an STI or changing sex partners. In addition, other outcome variables that we considered, such as the number of sex partners and the status of any STIs, were not selected because including them yielded an even more limited analytical sample size.

Common support

Treatment effects should only be estimated using the subsample of observations where the estimated propensity score overlaps between the treated and control groups (Crump et al., 2009; Kaiser and Schmid, 2014). These observations are defined as being from the region of common support, p^∈[γ^, 1−γ^]. We use an established procedure (Crump et al., 2009) to estimate the optimal value for γ^. Since our empirical approach implements two propensity score models, we identify two different values for γ^, which is 0.085 for the basic propensity model and 0.084 for the expanded propensity model. After dropping observations that did not have common support, the basic propensity model yields a sample that contains 589 (73%) non-vaccinated and 213 (27%) vaccinated individuals (Table 2). The expanded propensity model yields a slightly smaller sample that contains 569 (73%) non-vaccinated and 209 (27%) vaccinated individuals (Table 2).

Sample balance

Covariate balance between the treatment and control groups is assessed using the normalized difference of means (Table 3). The normalized difference of means is the difference of means across the treatment and control groups divided by the standard deviation of the pooled treatment and control groups. A normalized difference >0.25 can be used as a threshold to identify excessive imbalance across treatment and control groups (Imbens and Wooldridge, 2009). The sample balance is acceptable for both propensity models. The greatest (absolute value) normalized difference among covariates after balancing with the basic propensity model and the expanded propensity model was 0.042 and 0.106, respectively (Table 3). An acceptable sample balance means that the observed characteristics of the treated and control groups are similar, which makes the inference of an effect of vaccination more plausible.

Results

We find no evidence that at least one dose of HPV vaccination contributes to changes in condom usage among young sexually-active women. Looking at the results for condom usage, the estimated ATE is not found to be statistically significant forany of the model specifications considered (Table 4). The direction of the estimated ATE, while not statistically significant, is negative among higher levels of condom usage and among the lowest reported level of condom usage, i.e., for respondents who reported ever using a condom, using a condom more than half of the time, or every time they had sex. Among respondents who reported condom usage half of the time they had sex, the direction of the ATE is less consistent as well as not being found to be statistically significant.

In the models looking at the frequency of sexual encounters, we find inconsistent statistical evidence that at least one dose of HPV vaccination contributes to changes in sexual activity among young sexually-active women (Table 5). This evidence varies across specifications of the propensity and outcomes models. In the majority of the sex frequency models and in particular when the outcome represents whether a respondent had sex more than 52 or 104 times per year, the ATE is not found to be statistically significant. In one subset of models, where the outcome is whether a respondent had sex more than 12 times in the last year, the ATE was found to be statistically significant in several models with an estimate ranging from 0.055 to 0.071, which implies an individual was 5.5–7.1 percentage points more likely to have sex at least 12 times if she received an HPV vaccine. The effect is found to be not statistically significant in one model (Basic-Basic), statistically significant at the 0.10 significance level for three models (Basic-Expanded, Basic-Basic with age fixed effects and Expanded-Basic) and the 0.05 level for two models (Expanded-Expanded and Expanded-Basic with age fixed effects).

Discussion

The most important finding from our study is that at least one dose of HPV vaccination does not appear to have a substantive effect on the sexual behavior of young sexually-active women. This study reinforces the findings of other studies on this topic, which also found negligible changes in sexual behavior following vaccination for HPV (Bednarczyk et al., 2012; Liddon et al., 2012; Smith et al., 2014; Jena et al., 2015). The main contribution of our study was the use of a different dataset and a different methodological approach to investigate this issue. This study demonstrates the usefulness of propensity-score-based methods to assess potential behavioral responses to health interventions that could conceivably change health-risk perceptions. The persistence of our result of no discernable effect, in spite of this approach, underscores the need to better understand how individuals process changes in health-risk.

We hypothesized that a small change in perceived health risk could incentivize a proportionally small change in behavior. We also hypothesized that any behavioral response to HPV vaccination would be minor, and would thus best be measured in terms of incremental changes in behavior. For this reason, we focused on two key changes in behavior: condom use and frequency of sex. Given the theoretical grounds for a change in sexual behavior after the availability of the HPV vaccine, several plausible reasons remain as to why an effect cannot be measured in this study. First, even though the HPV vaccine is very effective in preventing adverse health outcomes attributable to HPV, the perceived risk of HPV might be small relative to all other STIs, such as HIV and genital herpes. As a result, the influence of the HPV vaccine on the perceived health risks associated with sexual behavior might be too small to incentivize a change in sexual behavior. Moreover, any change in perceived health risk may be even smaller if recipients of the vaccine were unfamiliar with HPV or the adverse health outcomes associated with HPV.

A previous study of HPV vaccine impact and effectiveness using NHANES data from the early vaccine era (2007–2010) found that the lifetime number of sexual partners appeared to be greater among those who received the HPV vaccine, as compared to those not vaccinated for HPV (Markowitz et al., 2013). This finding was correlational and the study did not assess whether a vaccination leads to changes sexual behavior or whether sexual behavior or expected sexual behavior, leads to decisions about vaccination (Rimer et al., 2014). A subsequent study that used NHANES data from a later time period found no statistically significant association between vaccination status and if a respondent had three or more lifetime sexual partners (Markowitz et al., 2016). These studies focused primarily on assessing changes in HPV prevalence in the vaccine era and did not investigate condom usage. A recent study found no association between risk perceptions after HPV vaccination and riskier sexual behaviors (Mayhew et al., 2014). Another study found low levels of knowledge and perceived risks related to HPV and cervical cancer (Denny-Smith et al., 2006). These findings support the findings in our study and, taken together, might suggest that the limited awareness or low perceived risk associated with HPV and cervical cancer may at least partially explain the null effect found for HPV vaccination on sexual behavior.

In some model specifications, our study finds a statistically significant treatment effect for respondents reporting having sex more than 12 times in the past year (sexTimesAtLeast12). These effects were statistically significant at the 10% level in three models and at the 5% level in two models. We interpret this result as inconsistent and providing fairly weak statistical evidence for a relationship between vaccination and sexual behavior. However, a plausible explanation for a relationship could be that low levels of sexual frequency, or any other measurements that would reflect sexual inexperience may be more sensitive to changes in sex-related health risks than other outcomes. The other two measures of frequency of sex (>52 and >104 times in the past year) that we investigated might only be able to detect behavioral changes among individuals with more sexual experience, similar to individuals with a higher frequency of sexual encounters, higher numbers of sexual partners, or diagnosis with other STIs. An individual with a greater amount of sexual experience may perceive a smaller change in health risk following an HPV vaccination than an individual who is less experienced sexually. Both the outcome groups investigated in this study, condom use and frequency of sex, were contingent on a respondent having reported having had sex at least one time in the last 12 months. As a result, this study could assess frequency of sexual behaviors, but not assess initiation of sexual activity.

Data from NHANES is published in 2-year cycles, so the exact age in a given year, for example, the age of a respondent at June 2006 is not known with perfect precision. While we designed our sample to include the most individuals who were plausibly in the target age range of the first ACIP recommendation on HPV vaccination, in some cases an individual could be included in our sample who was not subject to the recommendations. As an example, a woman who was 27 in the 2007–2008 NHANES cycle may have turned 27 before the ACIP recommendation was approved in June 2006. We conducted a sensitivity analysis, where the maximum age from each NHANES cycle was reduced by 1 year (26 or younger in 2007–2008 NHANES cycle, 28 or younger in 2009–2010 NHANES cycle, etc.), and this more restrictive age requirement had no qualitative impact on our results. Data analyzed in this study are from respondent reports, and respondents may not have perfect recall regarding their history of vaccinations, sexual activity, or other relevant behaviors. Additional sexual behavior variables, such as the history of STIs and the number of sexual partners, were considered as outcome variables, but these variables were not selected due to relatively lower response rates for those questions compared with the condom use and sex frequency questions, which resulted in analytical samples too small for inference.

Since the exact date of the vaccination is unknown, this analysis does have a potential endogeneity issue, where we cannot ensure the temporality of the assumed causal pattern. At least some number of individuals in our dataset were likely to have received their HPV vaccine in the last 12 months, which would imply that their reported sexual behaviors represent their decisions, circumstances and risk-perceptions prior to receiving the vaccine. The nature of the questions asked in NHANES offers some assurance that the majority of vaccinations occur prior to surveyed sexual activities of the outcomes variables. In particular, the NHANES question about HPV vaccination elicited if a vaccination had ever occurred whereas for the outcome variables the survey elicited behaviors that occurred in the last 12 months. Data from the 2008 to 2014 National Health Interview Surveys indicate that the average annual increase in HPV vaccination coverage among females who were 19–26-years-old in 2007 or 2008 was 13% and may have been as great as 56% of vaccinated individuals, with higher values found among cohorts in earlier survey years (from 2008 and 2009) and among older females (aged 23–26) (O’Halloran et al., 2016). To evaluate this potential source of bias, in the Supplemental Appendix we included sensitivity analyses, where the earlier cycles of NHANES were excluded from the analytical dataset. These sensitivity analyses showed qualitatively similar results as those presented in the main text. In a related issue, any behavioral responses to HPV immunization may occur or may be stronger after having received the complete dosing series of the HPV vaccine. Our study focused on whether a respondent reported receiving at least one dose of an HPV vaccine, not the complete series. Finally, immunization programs and sexual education curriculum can vary across states. These state-level practices may have a strong impact on sexual behavior and any behavior response to receiving a vaccine. Unfortunately, state-level variables are not available in the NHANES public use datasets used in this study. Furthermore, due to the probabilistic sampling method used by NHANES, the number of locations where NHANES data is collected is somewhat small during any given NHANES cycle, so there is unlikely to be substantial variation in any state-level indicators or variables. Investigations into any effect of state-level practices would be a worthwhile area for future research.

In this study, both vaccination status and the sexual behavior outcomes were self-reported. In the case of vaccination status, one previous study found a reasonable amount of concordance between self-reported vaccination status of the HPV vaccine among 18–26-year-olds, when compared to vaccination status documented in electronic health records (Rolnick et al., 2013). A number of studies have investigated self-reported condom usage with biological measures of unprotected sexual activity (Rose et al., 2009) and incidence of sexually transmitted diseases (Weir et al., 1999; Gallo et al., 2007). In general, studies assessing the validity of self-reported condom use found less concordance than was found in the HPV vaccination study. However, the studies on the validity of self-reported condom use investigated populations that were from smaller geographic areas, included adolescents and were at higher risk for STIs, and so may have different self-reporting tendencies than the general population. Possible measurement error stemming from self-reported data is a common limitation among survey-based research, particularly when the survey is conducted across several years and sampled from a nation-wide population.

In spite of these limitations, this study provides empirical evidence on the relationship between HPV vaccination and sexual behavior. With results that comport well with other results in the literature, this study finds no apparent effect of HPV vaccine receipt on the sexual behavior of young sexually-active women.

Supplementary MaterialAcknowledgements/Disclaimer.

The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the Centers for Disease Control and Prevention. The authors would like to thank Alissa O’Halloran, Peng-Jun Lu, Walter Williams, Carla Black, and Jim Singleton for help with vaccine coverage data from NHIS. The authors report they have no financial or personal conflicts of interest to disclose. This study used a publically-available dataset from the National Center for Health Statistics. No ethical review was required. Makram Talih contributed to this work while a full-time employee of the Office of Analysis and Epidemiology, National Center for Health Statistics, CDC.

Supplementary material. The supplementary material for this article can be found at https://doi.org/10.1017/S1744133119000136

ReferencesAhrensKA, HaleyBA, RossenLM, LloydPC and AokiY (2016) Housing assistance and blood lead levels: children in the United States, 2005–2012. American Journal of Public Health 106, 2049–2056.27631737BednarczykRA, DavisR, AultK, OrensteinW and OmerSB (2012) Sexual activity–related outcomes after human papillomavirus vaccination of 11-to 12-year-olds. Pediatrics 130, 798–805.23071201BrodyJE (2007) HPV vaccine: few risks, many benefits. New York Times, 15.BrownDS, Reed JohnsonF, PoulosC and MessonnierML (2010) Mothers’ preferences and willingness to pay for vaccinating daughters against human papillomavirus. Vaccine 28, 1702–1708.20044060BrownDS, PoulosC, Reed JohnsonF, Chamiec-CaseL and MessonnierML (2014) Adolescent girls’ preferences for HPV vaccines: a discrete choice experiment. In Preference Measurement in Health (Advances in Health Economics and Health Services Research, Volume 24) Bingly, UK: Emerald Group Publishing Limited, pp. 93–121.CassellMM, HalperinDT, SheltonJD and StantonD (2006) Risk compensation: the Achilles’ heel of innovations in HIV prevention. BMJ 332, 605–607.16528088Centers for Disease Control and Prevention (2015) National Health and Nutrition Examination Survey Data, U.S. Department of Health and Human Services, Editor. Hyattsville, MD.ChengNF, HanPZ and GanskySA (2008) Methods and software for estimating health disparities: the case of children’s oral health. American Journal of Epidemiology 168, 906–914.18779387ChessonHW and GiftTL (2008) Decreases in AIDS mortality and increases in primary and secondary syphilis in men who have sex with men in the United States. JAIDS Journal of Acquired Immune Deficiency Syndromes 47, 263–264.18223365ChessonHW, EkwuemeDU, SaraiyaM and MarkowitzLE (2008) Cost-effectiveness of human papillomavirus vaccination in the United States. Emerging Infectious Diseases 14, 244–251.18258117CrumpRK, Joseph HotzV, ImbensGW and MitnikOA (2009) Dealing with limited overlap in estimation of average treatment effects. Biometrika 96, 187–199.DebS, AustinPC, TuJV, KoDT, David MazerC, KissA and FremesSE (2016) A review of propensity-score methods and their use in cardiovascular research. Canadian Journal of Cardiology 32, 259–265.26315351Denny-SmithT, BairanA and PageMC (2006) A survey of female nursing students’ knowledge, health beliefs, perceptions of risk, and risk behaviors regarding human papillomavirus and cervical cancer. Journal of the American Academy of Nurse Practitioners 18, 62–69.16460412DuGoffEH, SchulerM and StuartEA (2014) Generalizing observational study results: applying propensity score methods to complex surveys. Health Services Research 49, 284–303.23855598Food and Drug Administration (2006) June 8, 2006 Approval Letter - Human Papillomavirus Quadrivalent (Types 6, 11, 16, 18) Vaccine, Recombinant [cited 2015 12/18/2015]; Available from: http://www.fda.gov/BiologicsBloodVaccines/Vaccines/ApprovedProducts/ucm111283.htm.Food and Drug Administration (2009) October 16, 2009. Approval Letter - Cervarix [cited 2015 12/18/2015]; Available from: http://www.fda.gov/BiologicsBloodVaccines/Vaccines/ApprovedProducts/ucm186959.htm.Food and Drug Administration (2014) December 10, 2014 Approval Letter - GARDASIL 9 Available from: http://www.fda.gov/BiologicsBloodVaccines/Vaccines/ApprovedProducts/ucm426520.htm.FreedGL, ClarkSJ, ButchartAT, SingerDC and DavisMM (2010) Parental vaccine safety concerns in 2009. Pediatrics 125, 654–659.20194286FujiiT, YamadaS, MurotaniK, KandaM, SugimotoH, NakaoA and KoderaY (2015) Inverse probability of treatment weighting analysis of upfront surgery versus neoadjuvant chemoradiotherapy followed by surgery for pancreatic adenocarcinoma with arterial abutment. Medicine 94, 1–9.FunkMJ, WestreichD, WiesenC, StürmerT, Alan BrookhartM and DavidianM (2011) Doubly robust estimation of causal effects. American Journal of Epidemiology 173, 761–767.21385832GalloMF, SteinerMJ, WarnerL, Hylton-KongT, Peter FigueroaJ, HobbsMM and BehetsFM (2007) Self-reported condom use is associated with reduced risk of chlamydia, gonorrhea, and trichomoniasis. Sexually Transmitted Diseases 34, 829–833.17579339GoldieSJ, KohliM, GrimaD, WeinsteinMC, WrightTC, Xavier BoschF and FrancoE (2004) Projected clinical benefits and cost-effectiveness of a human papillomavirus 16/18 vaccine. Journal of the National Cancer Institute 96, 604–615.15100338GoossensN, HoshidaY, SongWM, JungM, MorelP, NakagawaS, ZhangB, FrossardJ-L, SpahrL, FriedmanSL, NegroF, Rubbia-BrandtL and GiostraE (2015) Nonalcoholic hepatitis is associated with increased mortality in obese patients undergoing bariatric surgery. Clinical Gastroenterology and Hepatology 14, 1619–1628.26492845GriffinBA, RamchandR, AlmirallD, SlaughterME, BurgetteLF and McCafferyDF (2014) Estimating the causal effects of cumulative treatment episodes for adolescents using marginal structural models and inverse probability of treatment weighting. Drug and Alcohol Dependence 136, 69–78.24440050HiranoK and ImbensGW (2001) Estimation of causal effects using propensity score weighting: an application to data on right heart catheterization. Health Services and Outcomes Research Methodology 2, 259–278.ImbensGW (2004) Nonparametric estimation of average treatment effects under exogeneity: a review. Review of Economics and Statistics 86, 4–29.ImbensGW and WooldridgeJM (2009) Recent developments in the econometrics of program evaluation. Journal of Economic Literature 47, 5–86.JabsonJM, FarmerGW and BowenDJ (2015) Health behaviors and self-reported health among cancer survivors by sexual orientation. LGBT Health 2, 41–47.26790017JenaAB, GoldmanDP and SeaburySA (2015) Incidence of sexually transmitted infections after human papillomavirus vaccination among adolescent females. JAMA Internal Medicine 175, 617–623.25664968JohnsonCL, Paulose-RamR, OgdenCL, CarrollMD, Kruszan-MoranD, DohrmannSM and CurtinLR (2013) National health and nutrition examination survey: analytic guidelines, 1999–2010. Vital and Health Statistics. Series 2, Data evaluation and methods research, 161, 1–24.JungP-S, KimD-Y, LeeS-W, ParkJ-Y, SuhD-S, KimJ-H, KimY-M, KimY-T and NamJ-H (2015) Clinical role of adjuvant chemotherapy after radical hysterectomy for FIGO stage IB-IIA cervical cancer: comparison with adjuvant RT/CCRT using inverse-probability-of-treatment weighting. PloS One 10, e0132298.26176626KaiserB and SchmidC (2014) Does physician dispensing increase drug expenditures? Empirical evidence from Switzerland. Health Economics 25, 71–90.25393362LeidnerAJ (2014) Estimating the effectiveness of health-risk communications with propensity-score matching: application to arsenic groundwater contamination in four US locations. Journal of Environmental and Public Health 2014, 1–9, Article ID 783902, 10.1155/2014/783902.LiddonNC, LeichliterJS and MarkowitzLE (2012) Human papillomavirus vaccine and sexual behavior among adolescent and young women. American Journal of Preventive Medicine 42, 44–52.22176845MarkowitzLE, DunneEF, SaraiyaM, LawsonHW, ChessonH and UngerER (2007) Centers for Disease Control and Prevention (CDC); Advisory Committee on Immunization Practices (ACIP). Quadrivalent Human Papillomavirus Vaccine: Recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep 56(RR-2), 1–24.MarkowitzLE, HaririS, LinC, DunneEF, SteinauM, McQuillanG and UngerER (2013) Reduction in human papillomavirus (HPV) prevalence among young women following HPV vaccine introduction in the United States, National Health and Nutrition Examination Surveys, 2003–2010. Journal of Infectious Diseases 208, 385–393.23785124MarkowitzLE, DunneEF, SaraiyaM, ChessonHW, Robinette CurtisC, GeeJ, BocchiniJAJr and UngerER (2014) Human papillomavirus vaccination: recommendations of the Advisory Committee on Immunization Practices (ACIP). Morbidity and Mortality Weekly Report 63, 1–30.24402465MarkowitzLE, LiuG, HaririS, SteinauM, DunneEF and UngerER (2016) Prevalence of HPV after introduction of the vaccination program in the United States. Pediatrics 137, 1–9 (e20151968).MayhewA, Kowalczyk MullinsTL, DingL, RosenthalSL, ZimetGD, MorrowC and KahnJA (2014) Risk perceptions and subsequent sexual behaviors after HPV vaccination in adolescents. Pediatrics 133, 404–411.24488747MeitesE, KempeA and MarkowitzLE (2016) Use of a 2-dose schedule for human papillomavirus vaccination - updated recommendations of the Advisory Committee on Immunization Practices. Morbidity and Mortality Weekly Report 65, 1405–1408.27977643MoghtaderiA and DorA (2016) Immunization and Moral Hazard: The HPV Vaccine and Uptake of Cancer Screening. National Bureau of Economic ResearchMullinsTLK, ZimetGD, RosenthalSL, MorrowC, DingL, ShewM, Dennis FortenberryJ, BernsteinDI and KahnJA (2012) Adolescent perceptions of risk and need for safer sexual behaviors after first human papillomavirus vaccination. Archives of Pediatrics &Adolescent Medicine 166, 82–88.22213755MurphyDA, HarrellL, FintzyR, BelinTR, GutierrezA, ViteroSJ and ShettyV (2014) A comparison of methamphetamine users to a matched NHANES cohort: propensity score analyses for oral health care and dental service need. The Journal of Behavioral Health Services & Research 43, 676–690.OffitPA (2014) Let’s not talk about sex, in New York Times https://www.nytimes.com/2014/08/20/opinion/lets-not-talk-about-sex-HPV-vaccine.html (August 19, 2014).O’HalloranA, LuP, WilliamsW, BlackC, SingletonJA (2016) HPV vaccination coverage among women by birth cohort and age, NHIS 2008–2014 [Unpublished data]. Centers for Disease Control and PreventionPetroskyE, BocchiniJA, HaririS, ChessonH, Robinette CurtisC, SaraiyaM, UngerER and MarkowitzLE (2015) Use of 9-valent human papillomavirus (HPV) vaccine: updated HPV vaccination recommendations of the Advisory Committee on Immunization Practices. Morbidity and Mortality Weekly Report 64, 300–304.25811679RaoJ, WuC and YueK (1992) Some recent work on resampling methods for complex surveys. Survey Methodology 18, 209–217.Reagan-SteinerS, YankeyD, JeyarajahJ, Elam-EvansLD, CurtisCR, MacNeilJ, MarkowitzLE and SingletonJA (2016) National, regional, state, and selected local area vaccination coverage among adolescents aged 13–17 years—United States, 2015. Morbidity and Mortality Weekly Report 65, 784–792.RidgewayG, KovalchikSA, GriffinBA and KabetoMU (2015) Propensity score analysis with survey weighted data. Journal of Causal Inference 3, 237–249.29430383RimerB, HarperH and WitteO (2014) Accelerating HPV Vaccine Uptake: Urgency for Action to Prevent Cancer. A Report to the President of the United States from the President’s Cancer Panel Bethesda, MD: National Cancer Institute.RolnickSJ, ParkerED, NordinJD, HedblomBD, WeiF, KerbyT, JacksonJM, CrainAL and EulerG (2013) Self-report compared to electronic medical record across eight adult vaccines: do results vary by demographic factors? Vaccine 31, 3928–3935.23806243RoseE, DiClementeRJ, WingoodGM, SalesJD, LathamTP, CrosbyRA, ZenilmanJ, MelendezJ and HardinJ (2009) The validity of teens’ and young adults’ self-reported condom use. Archives of Pediatrics & Adolescent Medicine 163, 61–64.19124705RosenthalSL, WeissTW, ZimetGD, MaL, GoodMB and VichninMD (2011) Predictors of HPV vaccine uptake among women aged 19–26: importance of a physician’s recommendation. Vaccine 29, 890–895.20056186RubinDB (1974) Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology 66, 688–701.SatterwhiteCL, TorroneE, MeitesE, DunneEF, MahajanR, Bañez OcfemiaMC, SuJ, XuF and WeinstockH (2013) Sexually transmitted infections among US women and men: prevalence and incidence estimates, 2008. Sexually Transmitted Diseases 40, 187–193.23403598SmithLM, KaufmanJS, StrumpfEC and LévesqueLE (2014) Effect of human papillomavirus (HPV) vaccination on clinical indicators of sexual behaviour among adolescent girls: the Ontario Grade 8 HPV Vaccine Cohort Study. Canadian Medical Association Journal 187, E74–E81.25487660SteinerRJ, LiddonN, SwartzendruberAL, RasberryCN and SalesJM (2016) Long-acting reversible contraception (LARC) and condom use among female US high school students: implications for STI prevention in the context of adolescent LARC scale-up. Journal of Adolescent Health 58, S5–S6.StokleyS, JeyarajahJ, YankeyD, CanoM, GeeJ, RoarkJ, Robinette CurtisC and MarkowitzL (2014) Human papillomavirus vaccination coverage among adolescents, 2007–2013, and post-licensure vaccine safety monitoring, 2006–2014-United States. Morbidity and Mortality Weekly Report 63, 620–624.25055185StolteIG, DukersNHTM, GeskusRB, CoutinhoRA and WitJB (2004) Homosexual men change to risky sex when perceiving less threat of HIV/AIDS since availability of highly active antiretroviral therapy: a longitudinal study. AIDS (London, England) 18, 303–309.TalihM (2013) A reference-invariant health disparity index based on Rényi divergence. The Annals of Applied Statistics 7, 1217–1243.26568778TalihM (2015) Examining socioeconomic health disparities using a rank-dependent Rényi index. The Annals of Applied Statistics 9, 992–1023.26566419WeirSS, RoddyRE, ZekengL and RyanKA (1999) Association between condom use and HIV infection: a randomised study of self reported condom use measures. Journal of Epidemiology & Community Health 53, 417–422.10492735WooldridgeJM (2009) Estimating average treatment effects: Unconfoundedness, in Lecture notes BGSE/IZA Course in Microeconometrics

Conceptual diagram of HPV vaccination and risky behavior model.

HAV refers to hepatitis A virus; HBV refers to hepatitis B virus; HPV refers to human papillomavirus.

Description of data compiled from the National Health and Nutrition Examination Surveys from 2007 to 2014

Variable groupVariable nameValues
HPV vaccine statushpvVax1 if vaccinated; 0 if not vaccinated
AgeageAge in years
Race/ethnicitywhite1 if white, non-Hispanic; 0 otherwise
black1 if black, non-Hispanic; 0 otherwise
hispanic1 if Hispanic; 0 otherwise
other1 if not white, black or Hispanic; 0 otherwise
SchoolinggradHighSchool1 if completed grade 12th; 0 otherwise
gradCollege1 if completed college; 0 otherwise
Income relative to poverty lineeqOrAbPovLine1 if income ⩾ Poverty line; 0 otherwise
eqOrAb2×PovLine1 if income ⩾ 2 × Poverty line; 0 otherwise
eqOrAb3×PovLine1 if income ⩾ 3 × Poverty line; 0 otherwise
Insurance statusanyInsurance1 if covered by any insurance or payer; 0 otherwise
medicaid1 if covered by Medicaid; 0 otherwise
Immunization historyhavVax1 if ever received the hepatitis A vaccine; 0 otherwise
anyHbv1 if ever received any dose of hepatitis B vaccine; 0 otherwise
allHbv1 if received all doses of hepatitis B vaccine; 0 otherwise
Other factors related to health system utilizationbirthControlPills1 if ever used birth control pills; 0 otherwise
hivTest1 if ever been tested for HIV/AIDS; 0 otherwise
routineHealth1 if have at least one routine place to go for healthcare; 0 otherwise
Partner statusmarried1 if married; 0 otherwise
partnered1 if partnered and not married; 0 otherwise
Other behavioral factorseverDrinkAlc1 if ever drank alcohol; 0 otherwise
drinksPerDayAverage number of alcohol drinks per day
smoked100Cigarettes1 if ever smoked 100 cigarettes; 0 otherwise
smokesEveryDay1 if smokes cigarettes every day; 0 otherwise
everMarijuana1 if ever smoked marijuana; 0 otherwise
ageFirstSexAge in years when first had sex
Temporal effectsyear07081 if NHANES cycle is 2007–2008; 0 otherwise
year09101 if NHANES cycle is 2009–2010; 0 otherwise
year11121 if NHANES cycle is 2011–2012; 0 otherwise
biannualTrendTrend corresponding with 2 year NHANES cycles
Number of times had sex during last 12 monthsasexTimesAtLeast121 if number of times had sex ⩾ 12; 0 otherwise
sexTimesAtLeast521 if number of times had sex ⩾ 52; 0 otherwise
sexTimesAtLeast1041 if number of times had sex ⩾ 104; 0 otherwise
Condom usage during last 12 monthsbeverUseCondom1 if used a condom at least once; 0 otherwise
halfUseCondom1 if used a condom half of the time; 0 otherwise
mostUseCondom1 if used a condom most of the time; 0 otherwise
alwaysUseCondom1 if used a condom always; 0 otherwise

Verbatim question from NHANES: ‘In the past 12 months, about how many times have you had (vaginal or anal/vaginal/anal) sex?’ Possible responses to this question were categorical: ‘Never’, ‘Once’, ‘2–11 times’, ‘12–51 times’, ‘52–103 times’, ‘104–364 times’, ‘365 times or more’, ‘Refused’ to give a response, and ‘Don’t know’.

Verbatim question from NHANES: ‘In the past 12 months, about how often have you had (vaginal or anal/vaginal/anal) sex without using a condom?’ Possible responses to this question were categorical: ‘Never’, ‘Less than half of the time’, ‘About half of the time’, ‘Not always, but more than half of the time’, ‘Always’, ‘Refused’ to give a response, and ‘Don’t know’. To simplify interpretation, the responses for this question were converted to values indicating the portion of times the respondent had sex with a condom, as opposed to without a condom. HPV refers to human papillomavirus.

Weighted summary statisticsa of individual characteristics among common support observations from a sample of young women, National Health and Nutrition Examination Surveys 2007–2014

Basic propensity model, survey weighted andIPT weighted with common support
Expanded propensity model, survey weighted andIPT weighted with common support
Non-vaccinated
Vaccinated
Non-vaccinated
Vaccinated
Variable nameMeanSEMeanSEMeanSEMeanSE
hpvVax0.0000.0001.0000.0000.0000.0001.0000.000
age24.9630.21024.9770.32324.9820.21824.7050.301
white0.6300.0310.6320.0480.6320.0310.6510.044
black0.1500.0210.1520.0300.1510.0210.1600.031
hispanic0.1350.0160.1210.0240.1280.0160.1210.024
other0.0850.0130.0950.0270.0890.0140.0690.017
gradHighSchool0.9320.0090.9260.0260.9270.0100.9210.028
gradCollege0.3010.0280.3440.0560.3170.0310.3190.051
eqOrAbPovLine0.7460.0230.7330.0330.7480.0240.7320.031
eqOrAb2×PovLine0.5310.0280.5600.0450.5590.0300.5440.043
eqOrAb3×PovLine0.3850.0270.4260.0510.4160.0300.4210.048
anyInsurance0.7700.0230.7660.0430.7760.0240.7630.042
medicaid0.1060.0150.0990.0260.1040.0150.1050.027
everUseBirthControl0.7700.0230.7600.0400.7740.0260.7570.039
hivTest0.5520.0310.5630.0400.5560.0310.5340.042
havVax0.5980.0220.5960.0510.6030.0250.5820.052
anyHbv0.7660.0190.7630.0500.7680.0190.7410.054
allHbv0.7330.0200.7480.0490.7520.0190.7370.054
routineHealth0.8190.0170.9010.0210.8630.0150.8700.028
married0.2760.0260.2860.0490.2840.0270.2380.039
partnered0.1830.0200.1980.0470.1860.0210.2000.049
everDrinkAlc0.9020.0190.8950.0260.9010.0180.8990.024
drinksPerDay2.5050.0962.5770.1992.5590.1022.5780.168
smoked100Cigarettes0.3040.0250.3100.0430.3030.0250.3290.043
smokesEveryDay0.1670.0190.1620.0350.1480.0180.1660.034
everMarijuana0.6270.0290.6410.0450.6330.0290.6500.041
ageFirstSex16.7890.12816.8450.22616.7620.12316.8240.202
year07080.1310.0280.1240.0450.1170.0270.1370.049
year09100.2080.0210.1990.0420.2130.0210.2100.043
year11120.3050.0280.3740.0560.3300.0310.3350.050
year13140.3560.0330.3030.0450.3400.0350.3180.045
biannualTrend3.8850.0783.8550.1133.8920.0783.8350.123
sexTimesAtLeast120.7830.0200.8120.0320.7860.0220.8290.028
sexTimesAtLeast520.4410.0280.4070.0410.4400.0290.4420.043
sexTimesAtLeast1040.2120.0220.1900.0300.2130.0220.1980.031
everUseCondom0.6060.0280.5610.0450.6010.0290.5930.043
halfUseCondom0.4590.0270.4140.0390.4510.0260.4500.039
mostUseCondom0.3680.0260.3400.0400.3660.0250.3370.037
alwaysUseCondom0.1700.0190.1480.0380.1690.0190.1460.033
Sample size589213569209

Summary statistics are weighted to adjust for complex survey design of NHANES and are weighted by inverse probability of treatment weights that correspond to either the Basic or the Expanded propensity model.

IPT refers to inverse probability of treatment; SE refers to standard error.

Balance table results after weighting for the inverse probability of treatment, using two propensity models, Basic and Expanded

Propensity model
Basic
Expanded
Variable nameNormalized differenceaP valuebNormalized differenceaP valueb
age0.0040.970−0.0820.427
whiteREFREFREFREF
black0.0040.9640.0240.792
hispanic−0.0420.561−0.0220.755
other0.0350.711−0.0740.326
gradHighSchool−0.0260.809−0.0200.859
gradCollege0.0040.975
eqOrAbPovLine−0.0310.691−0.0380.617
eqOrAb2×PovLine−0.0300.744
eqOrAb3×PovLine0.0100.911
anyInsurance−0.0100.934−0.0320.789
medicaid0.0050.966
everUseBirthControl−0.0250.838−0.0410.734
hivTest0.0220.818−0.0440.656
havVax−0.0050.967−0.0450.706
anyHbv−0.0090.940−0.0630.625
allHbv−0.0330.793
routineHealth0.0210.824
married0.0240.833−0.1060.288
partnered0.0370.792
everDrinkAlc−0.0230.832−0.0070.941
drinksPerDay0.0090.918
smoked100Cigarettes0.0140.8790.0560.526
smokesEveryDay0.0510.633
everMarijuana0.0340.748
ageFirstSex0.0220.8410.0240.814
year07080.0590.700
year0910−0.0070.951
year11120.0100.927
year1314REFREF
biannualTrend−0.0290.807

Normalized difference is the difference between vaccinated and not vaccinated means, divided by the pooled standard deviation.

Differences in means between the weighted vaccinated and unvaccinated samples were tested using t-test with p values reported. REF refers the referent variable of the categorical group of variables.

Estimated effects on HPV vaccination status with respect to outcome variables on condom usage from a doubly robust estimation procedure

PropensitymodelOutcome:everUseCondom
halfUseCondom
Outcome modelaATEbSEP valueATESEP value
BasicBasic−0.0240.0410.561−0.0250.0400.547
BasicExpanded−0.0260.0390.512−0.0190.0390.633
BasicBasic w sex times−0.0150.0410.718−0.0120.0390.772
BasicBasic w age FEs−0.0100.0390.804−0.0160.0360.670
ExpandedBasic−0.0080.0400.8560.0080.0400.851
ExpandedExpanded−0.0190.0400.654−0.0030.0400.937
ExpandedBasic w sex times−0.0010.0400.9870.0200.0400.631
ExpandedBasic w age FEs−0.0050.0390.9070.0060.0370.881
mostUseCondomalwaysUseCondom
BasicBasic−0.0330.0420.439−0.0370.0330.258
BasicExpanded−0.0280.0420.518−0.0370.0300.218
BasicBasic w sex times−0.0210.0400.612−0.0320.0330.327
BasicBasic w age FEs−0.0190.0390.645−0.0360.0300.241
ExpandedBasic−0.0450.0390.249−0.0320.0320.315
ExpandedExpanded−0.0560.0400.161−0.0370.0310.233
ExpandedBasic w sex times−0.0330.0390.415−0.0260.0320.426
ExpandedBasic w age FEs−0.0340.0370.360−0.0320.0310.305

The basic outcome model includes as covariates: black, hispanic, other, age, gradHighSchool, married, eqOrAbPovLine, anyInsurance, birthControlPills, hivTest, everDrinkAlc, drinksPerDay, smoked100Cigarettes, smokesEveryDay, ageFirstSex, biannualTrend. The expanded outcome model includes as covariates: black, hispanic, other, age, gradHighSchool, gradCollege, married, partnered, eqOrAbPovLine, eqOrAb2xPovLine, eqOrAb3xPovLine, anyInsurance, routineHealth, birthControlPills, hivTest, everDrinkAlc, drinksPerDay, smoked100Cigarettes, smokesEveryDay, everMarijuana, ageFirstSex, year0708, year0910. The basic w sex times outcome model includes all the covariates of the basic model and the following: sexTimesAtLeast12, sexTimesAtLeast52, sexTimesAtLeast104. The basic w age FEs outcome model includes all the covariates of the basic model and indicator variables for each age level in years.

The average treatment effects were calculated using doubly robust estimator.

HPV refers to human papillomavirus; ATE refers to average treatment effect; SE refers to standard error; FEs refers to fixed effects.

Estimated effects on HPV vaccination status with respect to outcome variables on frequency of sex, measured as the number of times a person had sex in the last 12 months, using a doubly robust estimation procedure

OutcomesexTimesAtLeast12
sexTimesAtLeast52
Propensity modelOutcome modelaATEbSEP valueATESEP value
BasicBasic0.0550.0350.1150.0100.0440.836
BasicExpanded0.0580.0330.082*0.0140.0430.749
BasicBasic w age Fes0.0610.0310.052*0.0180.0440.700
ExpandedBasic0.0680.0350.052*0.0150.0500.777
ExpandedExpanded0.0710.0340.035**0.0170.0500.742
ExpandedBasic w age FEs0.0710.0320.028**0.0140.0480.777
sexTimesAtLeast104
BasicBasic−0.0090.0360.825
BasicExpanded−0.0050.0360.897
BasicBasic w age Fes−0.0100.0350.778
ExpandedBasic−0.0190.0380.638
ExpandedExpanded−0.0140.0380.720
ExpandedBasic w age FEs−0.0190.0370.625

The basic outcome model includes as covariates: black, hispanic, other, age, gradHighSchool, married, eqOrAbPovLine, anyInsurance, birthControlPills, hivTest, everDrinkAlc, drinksPerDay, smoked100Cigarettes, smokesEveryDay, ageFirstSex, biannualTrend. The expanded outcome model includes as covariates: black, hispanic, other, age, gradHighSchool, gradCollege, married, partnered, eqOrAbPovLine, eqOrAb2xPovLine, eqOrAb3xPovLine, anyInsurance, routineHealth, birthControlPills, hivTest, everDrinkAlc, drinksPerDay, smoked100Cigarettes, smokesEveryDay, everMarijuana, ageFirstSex, year0708, year0910. The basic w age FEs outcome model includes all the covariates of the basic model and indicator variables for each age level in years.

The average treatment effects were calculated using double-robust estimator.

HPV refers to human papillomavirus; ATE refers to average treatment effect; SE refers to standard error; FEs refer to fixed effects.