Evaluation of the Lung Cancer Risks at Which to Screen Ever- and Never-Smokers: Screening Rules Applied to the PLCO and NLST Cohorts
Background:
Lung cancer risks at which individuals should be screened with computed tomography (CT) for lung cancer are undecided. This study's objectives are to identify a risk threshold for selecting individuals for screening, to compare its efficiency with the U.S. Preventive Services Task Force (USPSTF) criteria for identifying screenees, and to determine whether never-smokers should be screened. Lung cancer risks are compared between smokers aged 55–64 and ≥65–80 y.
Methods and Findings:
Applying the PLCOm2012 model, a model based on 6-y lung cancer incidence, we identified the risk threshold above which National Lung Screening Trial (NLST, n = 53,452) CT arm lung cancer mortality rates were consistently lower than rates in the chest X-ray (CXR) arm. We evaluated the USPSTF and PLCOm2012 risk criteria in intervention arm (CXR) smokers (n = 37,327) of the Prostate, Lung, Colorectal and Ovarian Cancer Screening Trial (PLCO). The numbers of smokers selected for screening, and the sensitivities, specificities, and positive predictive values (PPVs) for identifying lung cancers were assessed. A modified model (PLCOall2014) evaluated risks in never-smokers. At PLCOm2012 risk ≥0.0151, the 65th percentile of risk, the NLST CT arm mortality rates are consistently below the CXR arm's rates. The number needed to screen to prevent one lung cancer death in the 65th to 100th percentile risk group is 255 (95% CI 143 to 1,184), and in the 30th to <65th percentile risk group is 963 (95% CI 291 to −754); the number needed to screen could not be estimated in the <30th percentile risk group because of absence of lung cancer deaths. When applied to PLCO intervention arm smokers, compared to the USPSTF criteria, the PLCOm2012 risk ≥0.0151 threshold selected 8.8% fewer individuals for screening (p<0.001) but identified 12.4% more lung cancers (sensitivity 80.1% [95% CI 76.8%–83.0%] versus 71.2% [95% CI 67.6%–74.6%], p<0.001), had fewer false-positives (specificity 66.2% [95% CI 65.7%–66.7%] versus 62.7% [95% CI 62.2%–63.1%], p<0.001), and had higher PPV (4.2% [95% CI 3.9%–4.6%] versus 3.4% [95% CI 3.1%–3.7%], p<0.001). In total, 26% of individuals selected for screening based on USPSTF criteria had risks below the threshold PLCOm2012 risk ≥0.0151. Of PLCO former smokers with quit time >15 y, 8.5% had PLCOm2012 risk ≥0.0151. None of 65,711 PLCO never-smokers had PLCOm2012 risk ≥0.0151. Risks and lung cancers were significantly greater in PLCO smokers aged ≥65–80 y than in those aged 55–64 y. This study omitted cost-effectiveness analysis.
Conclusions:
The USPSTF criteria for CT screening include some low-risk individuals and exclude some high-risk individuals. Use of the PLCOm2012 risk ≥0.0151 criterion can improve screening efficiency. Currently, never-smokers should not be screened. Smokers aged ≥65–80 y are a high-risk group who may benefit from screening.
Please see later in the article for the Editors' Summary
Published in the journal:
Evaluation of the Lung Cancer Risks at Which to Screen Ever- and Never-Smokers: Screening Rules Applied to the PLCO and NLST Cohorts. PLoS Med 11(12): e32767. doi:10.1371/journal.pmed.1001764
Category:
Research Article
doi:
https://doi.org/10.1371/journal.pmed.1001764
Summary
Background:
Lung cancer risks at which individuals should be screened with computed tomography (CT) for lung cancer are undecided. This study's objectives are to identify a risk threshold for selecting individuals for screening, to compare its efficiency with the U.S. Preventive Services Task Force (USPSTF) criteria for identifying screenees, and to determine whether never-smokers should be screened. Lung cancer risks are compared between smokers aged 55–64 and ≥65–80 y.
Methods and Findings:
Applying the PLCOm2012 model, a model based on 6-y lung cancer incidence, we identified the risk threshold above which National Lung Screening Trial (NLST, n = 53,452) CT arm lung cancer mortality rates were consistently lower than rates in the chest X-ray (CXR) arm. We evaluated the USPSTF and PLCOm2012 risk criteria in intervention arm (CXR) smokers (n = 37,327) of the Prostate, Lung, Colorectal and Ovarian Cancer Screening Trial (PLCO). The numbers of smokers selected for screening, and the sensitivities, specificities, and positive predictive values (PPVs) for identifying lung cancers were assessed. A modified model (PLCOall2014) evaluated risks in never-smokers. At PLCOm2012 risk ≥0.0151, the 65th percentile of risk, the NLST CT arm mortality rates are consistently below the CXR arm's rates. The number needed to screen to prevent one lung cancer death in the 65th to 100th percentile risk group is 255 (95% CI 143 to 1,184), and in the 30th to <65th percentile risk group is 963 (95% CI 291 to −754); the number needed to screen could not be estimated in the <30th percentile risk group because of absence of lung cancer deaths. When applied to PLCO intervention arm smokers, compared to the USPSTF criteria, the PLCOm2012 risk ≥0.0151 threshold selected 8.8% fewer individuals for screening (p<0.001) but identified 12.4% more lung cancers (sensitivity 80.1% [95% CI 76.8%–83.0%] versus 71.2% [95% CI 67.6%–74.6%], p<0.001), had fewer false-positives (specificity 66.2% [95% CI 65.7%–66.7%] versus 62.7% [95% CI 62.2%–63.1%], p<0.001), and had higher PPV (4.2% [95% CI 3.9%–4.6%] versus 3.4% [95% CI 3.1%–3.7%], p<0.001). In total, 26% of individuals selected for screening based on USPSTF criteria had risks below the threshold PLCOm2012 risk ≥0.0151. Of PLCO former smokers with quit time >15 y, 8.5% had PLCOm2012 risk ≥0.0151. None of 65,711 PLCO never-smokers had PLCOm2012 risk ≥0.0151. Risks and lung cancers were significantly greater in PLCO smokers aged ≥65–80 y than in those aged 55–64 y. This study omitted cost-effectiveness analysis.
Conclusions:
The USPSTF criteria for CT screening include some low-risk individuals and exclude some high-risk individuals. Use of the PLCOm2012 risk ≥0.0151 criterion can improve screening efficiency. Currently, never-smokers should not be screened. Smokers aged ≥65–80 y are a high-risk group who may benefit from screening.
Please see later in the article for the Editors' Summary
Introduction
The National Lung Screening Trial (NLST) demonstrated that annual low-dose computed tomography (LDCT) screening reduces lung cancer mortality by 20% when applied to high-risk smokers (age 55–74 y, ≥30 pack-years, and <15 y of quit time [for former smokers, time since ceasing smoking]) [1]. Consequently, several institutions have recommended LDCT lung cancer screening of high-risk populations [2]–[7], and many health-care institutions have started or are planning LDCT screening programs. Most recommendations and programs rely on NLST risk criteria or variants of these criteria for selecting individuals for screening [8]. The U.S. Preventive Services Task Force (USPSTF) recommends annual screening of high-risk individuals, i.e., those who are 55–80 y, have smoked ≥30 pack-years, and have <15 y of smoking quit time [9]. Some of these criteria, which are similar to the NLST criteria, were based on microsimulation models developed by the Cancer Intervention and Surveillance Modeling Network (CISNET) lung group [10]. However, it has been shown that selecting individuals for screening based on accurate lung cancer risk prediction models is significantly more sensitive in detecting individuals who will be diagnosed with lung cancer and would save more lives than using the NLST criteria [11],[12]. Important issues regarding selection of individuals for lung cancer screening remain. It is unclear at what risk individuals should be screened, how efficient the USPSTF criteria are compared to model-based risk criteria, and into what risk threshold USPSTF recommendations translate.
Never-smokers have been excluded from lung cancer screening trials and programs, but this has not been based on quantitative evidence. Lung cancer in never-smokers is a major public health problem, accounting for approximately 10%–15% of lung cancers, and if considered separately, would rank seventh as a cause of cancer death [13],[14]. Although a survey found that a sizeable proportion of never-smokers would consider computed tomography (CT) screening [15], it has not been demonstrated that never-smokers can be at high enough risk to warrant screening.
In the United States on April 30, 2014, the Centers for Medicare & Medicaid Services convened the Medicare Evidence Development & Coverage Advisory Committee (MEDCAC) to evaluate the use of LDCT lung cancer screening in the Medicare population, primarily aged 65 y and older [16]. The MEDCAC panel gave low confidence scores for screening, and if its recommendation is followed, Medicare will not reimburse the cost of lung cancer screening in those 65 y and older. In contrast, because the USPSTF gave LDCT lung cancer screening a “B recommendation” in favor of screening high-risk individuals, the Patient Protection and Affordable Care Act will lead to reimbursement for screening of high-risk individuals aged 55–64 y. The impact of these discordant strategies is unclear.
In the current study, we extend evaluation and application of our PLCOm2012 model [11]. It is a logistic regression lung cancer risk prediction model based on 6-y incidence of lung cancer occurring in smokers in the control arm of the Prostate, Lung, Colorectal and Ovarian Cancer Screening Trial (PLCO). The model consists of four smoking variables (smoking intensity, smoking duration, quit time in former smokers, and current smoking status [current versus former]) and seven non-smoking variables (age, race/ethnicity, socioeconomic circumstance estimated by education level, body mass index, personal history of cancer, chronic obstructive pulmonary disease, family history of lung cancer). The PLCOm2012 model demonstrated high predictive performance, both discrimination and calibration, in external validation in PLCO intervention arm smokers.
This study further analyzes data from two major screening trials, the NLST and PLCO. Our study aims are as follows: (1) identify a risk threshold for selecting lung cancer screenees based on the PLCOm2012 [11] risk at which mortality rates in the NLST CT screening arm are consistently lower than those in the chest X-ray (CXR) screening arm; (2) compare performance of USPSTF versus PLCOm2012 risk criteria for selecting screenees, based on lung cancer incidence and mortality; (3) as an alternate PLCOm2012 risk threshold, estimate the PLCOm2012 risk that selects a proportion of smokers equal to that selected by USPSTF criteria; (4) determine whether high-risk never-smokers exceed screening risk thresholds and thus might be considered for screening; and (5) compare the PLCOm2012 risks and lung cancer rates in high-risk PLCO smokers aged 54–64 y versus ≥65–80 y.
Methods
Design Overview, Setting, and Participants
PLCO and NLST study designs and results have been described previously [1],[17]–[21]. For both trials, institutional review board approvals were obtained at all study centers, and written informed consent was obtained from all participants. In this study we use PLCO (control arm n = 77,455, CXR arm n = 77,445) and NLST (CXR arm n = 26,730, CT arm n = 26,722) data. This study included histologically confirmed lung cancers and lung cancer deaths, which were identified from medical record reviews, death certificates, and National Death Index retrieval, and a death review committee classified causes of death. Predictor variable data were collected through epidemiological questionnaires administered at baseline.
Statistical Analysis
We determined two different thresholds for using PLCOm2012 risk to identify screening candidates. For the first, we determined the PLCOm2012 risk threshold above which lung cancer mortality rates in the NLST CT arm appear to be consistently lower than those in the NLST CXR arm (named TPLCOm2012). This yields a threshold above which there is reliable evidence of mortality benefit.
As an alternative threshold, we applied the USPSTF criteria to the PLCO intervention (CXR) arm smokers and estimated the proportion of the cohort that would be selected for screening. We then found the PLCOm2012 risk threshold that identified a proportion of smokers equivalent to that of the USPSTF criteria (named TUSPSTF). If one planned to screen the same proportion of the population as recommended by the USPSTF but using PLCOm2012 risk to select screenees, then it seems reasonable to use TUSPSTF.
For TPLCOm2012 and TUSPSTF, we estimated the sensitivity, specificity, and positive predictive values (PPVs) for lung cancer incident cases and deaths using PLCO intervention arm participants, and compared them to those observed for the USPSTF criteria. Because the PLCOm2012 model was developed in the PLCO control arm smokers, using the PLCO intervention arm smokers for comparisons with USPSTF criteria made for fairer comparisons. Although the PLCO age criteria for enrollment were similar to those in the NLST (ages 55 to 74 y inclusive), 14,678 of 40,447 (36.3%) of PLCO intervention arm smokers with exit time data contributed follow-up times for age range 75–80 y (USPSTF age criteria difference from NLST criteria), and these data were included in this analysis, making possible some evaluation of the USPSTF criteria.
The PLCOm2012 model was developed using lung cancer incidence occurring in 6 y of follow-up so as to make it applicable to NLST participants, the majority of whom had 6 y of follow-up but not much more. In the current study of lung cancer incidence, we truncated follow-up to 6 y. To adequately evaluate the impact of lung cancer on mortality, we extended the follow-up in the PLCO for an additional 5 y. All PLCO lung cancer deaths in 11 y of follow-up were studied. In the PLCO, 99.9% of lung cancer deaths were preceded by a documented lung cancer diagnosis.
To guide interpretation of risk values, we produced kernel density plots (“smoothed histograms” prepared using the Epanechnikov function [22]) that describe the distributions of PLCOm2012 risks in a variety of groups.
To determine whether high-risk never-smokers exceed our screening risk thresholds, we could not use the PLCOm2012 model because it was prepared for smokers. We prepared a model analogous to the PLCOm2012 model that included never-smokers. The resulting model, PLCOall2014, was validated using the PLCO intervention arm data by assessing the area under the receiver operator characteristic curve (AUC) and assessing calibration by plotting observed and predicted probabilities by deciles of model risk. Additionally, we assessed calibration by evaluating the median and 90th percentiles of absolute error between model-predicted probability and observed probability, where the latter was estimated from a lowess (locally weighted scatterplot smoothing) plot of lung cancer versus risk [23],[24]. Model calibration was further evaluated by Cox recalibration (synonym logistic recalibration) in PLCO intervention arm (validation) data. This method evaluates the amount of adjustment that is required in the intercept and beta coefficient of the original model logits (log odds) when predicting lung cancer using the original model logits in a logistic regression model in validation data [25],[26].
For the AUCs and summary statistics for absolute errors, 95% confidence intervals were estimated using bias-corrected percentile intervals in 1,000 bootstrap re-samplings [27]. Bootstrap samples were the same size as the original estimation sample, and sampling was done with replacement.
New studies might want to evaluate differences in the efficiency of screenee sample selection by applying both the USPSTF and PLCOm2012 criteria to enroll individuals. We produced sample size calculations for finding significant differences between the USPSTF and PLCOm2012 criteria in the proportion of individuals selected for screening, the proportion of lung cancers detected, and PPV. Sample size calculations were based on two-sample paired proportions and large-sample McNemar's test [28].
Confidence intervals and p-values were prepared using methods described by Brown and colleagues [29] and by Miettinen [30] for tests of proportions and rates, respectively. To test for a difference in a skewed continuous variable between two groups, we used a non-parametric test of trend [31]. To test for a difference in continuous variables with roughly normal distributions between two groups, we used Student's t-test not assuming equal variances, and to test for differences in proportions, we used the chi-square test. The number needed to screen (NNS) to prevent one lung cancer death and 95% confidence intervals were prepared by methods described by Bender [32]. For all hypothesis testing, we used two-sided p-values <0.05. Statistics were prepared using Stata 13.1 MP (StataCorp, College Station, Texas).
Results
The study populations and PLCOm2012 model and its performance statistics have been described previously [11], and the PLCOm2012 model is summarized in Table S1.
Risk Threshold for Screening Selection
Lung cancer mortality rates by NLST intervention arm and by decile of PLCOm2012 risk are presented in Figure 1 and Table 1. PLCOm2012 decile cutpoints were based on PLCO control arm smokers, not the NLST sample, which is unrepresentative of the general population because it was selected to comprise high-risk individuals. Consistently lower lung cancer mortality for CT-screened NLST participants compared to CXR-screened participants is observed in the eighth, ninth, and tenth PLCOm2012 risk deciles. According to the mortality rate ratio and rate difference for CT versus CXR, at the midpoint of the seventh decile there is no strong effect in either direction (Table 1). In the fourth, fifth, and sixth deciles, two estimates suggest CT screening has a protective effect, and one estimate suggests no protective effect. For these three deciles, findings are inconsistent, and because estimates are based on only 46 deaths in six trial arm–decile strata, no firm conclusions can be drawn. In the first three deciles, there are no lung cancer deaths in either trial arm. The lung cancer mortality reduction (rate difference) for CT versus CXR in the NLST in the 30th to <65th percentile risk range is small and not statistically significant: 1.60 per 10,000 person-years of follow-up (95% CI –1.96 to 5.16, p = 0.38), and in the 65th to 100th percentile risk range is 4-fold larger and is statistically significant: 6.43 per 10,000 person-years of follow-up (95% CI 1.53 to 11.33, p = 0.010). Although the CT minus CXR mortality difference was not statistically significant in any single decile of risk, such comparisons were not expected to be significant, as the statistical power of small subset analyses is limited, and the analyses were not designed for independent hypothesis testing.
The NNS to prevent one lung cancer death in the 65th to 100th percentile risk group is 255 (95% CI 143 to 1,184), which is statistically significant, and is a 25% improvement over the NNS of 320 reported for the NLST as a whole [1]. The NNS in the 30th to <65th percentile risk group is 963 (95% CI 291 to −754), which is not statistically significant. The NNS could not be calculated in the <30th percentile risk group because no lung cancer deaths were observed.
In PLCO smokers, the PLCOm2012 65th percentile represents a risk of 0.0151 (95% CI 0.0149 to 0.0153) (TPLCOm2012), and for this threshold the sensitivity, specificity, and PPV for lung cancer incidence in 6 y are 80.9% (95% CI 78.6%–83.0%), 65.9% (95% CI 65.5%–66.2%), and 4.1% (95% CI 3.9%–4.3%), respectively, and for lung cancer mortality in 11 y are 78.6% (95% CI 76.5%–80.5%), 66.0% (95% CI 65.7%–66.4%), and 5.1% (95% CI 4.8%–5.3%), respectively. The PLCOm2012 risk ≥0.0151 threshold captures most but not all lung cancer cases and deaths in the PLCO and NLST (Figure 2). Figure 3 demonstrates that (1) the number of competing causes of death does not differ substantially between the NLST arms, (2) competing causes of death are substantially greater in number than lung cancer deaths, (3) elevated risks of competing causes of death start occurring around the 35th percentile of PLCOm2012 model risk, and (4) beneficial screening effects (mortality reductions) are present in the highest three deciles, notwithstanding high competing risks.
USPSTF versus PLCOm2012 Risk ≥0.0151 Criteria for Selecting Screenees
When the USPSTF and PLCOm2012 risk ≥0.0151 criteria were applied to the PLCO intervention arm smokers (n = 37,327), 20,712 individuals (55.5%) were classified as negative (not selected for screening) by both approaches, and 10,475 (28.1%) individuals were classified as positive (selected for screening) by both criteria (Table 2, cells a and d). The discordant classifications are informative (Table 2, cells b and c). Compared to the USPSTF criteria, if the PLCOm2012 risk ≥0.0151 criterion were applied to select individuals for screening in PLCO intervention arm smokers, 8.8% (12,920 versus 14,170, p<0.001) fewer individuals would be selected, and 12.4% (542 versus 482, p<0.001) more lung cancers would be detected (Table 2). For identifying lung cancer cases, PLCOm2012 risk ≥0.0151 and USPSTF criteria sensitivities were 80.1% (95% CI 76.8%–83.0%) versus 71.2% (95% CI 67.6%–74.6%) (p<0.001), specificities were 66.2% (95% CI 65.7%–66.7%) versus 62.7% (95% CI 62.2%–63.1%) (p<0.001), and PPVs were 4.2% (95% CI 3.9%–4.6%) versus 3.4% (95% CI 3.1%–3.7%) (p<0.001), respectively.
Many USPSTF-criteria-positive PLCO smokers and NLST participants had risks below the PLCOm2012 risk ≥0.0151 threshold (Figure 4). Of NLST participants and USPSTF-criteria-positive PLCO intervention arm participants, 26.6% and 26.1% had PLCOm2012 risks below 0.0151, respectively. For example, individuals who are age 55 y, have a graduate degree, have body mass index of 32 kg/m2, have no personal history of cancer, have no family history of lung cancer, do not have chronic obstructive pulmonary disease, are white, and are former smokers who quit smoking 14 y ago and smoked on average 20 cigarettes a day for 30 y have a 6-y lung cancer risk of 0.004, or 4 in 1,000, but would meet NLST/USPSTF criteria for CT screening. Other scenarios can be explored using the risk calculator available at http://www.brocku.ca/lung-cancer-risk-calculator.
The USPSTF recommends that lung cancer screening stop once an individual's smoking quit time exceeds 15 y. The PLCOm2012 model demonstrates that some high-risk individuals can remain at elevated risk that justifies screening well past 15 y after cessation (Figure 5). Of the 35,897 PLCO smokers who had smoking quit time >15 y, 3,064 (8.5%) met the PLCOm2012 risk ≥0.0151 threshold for screening, and of these 89, or 2.9%, had lung cancer diagnosed in 6 y of follow-up.
USPSTF Criteria Risk Equivalent
Of 37,327 PLCO intervention arm smokers, 14,170 (38.0%) were USPSTF-criteria-positive. To select the same proportion of smokers based on highest PLCOm2012 risk—the alternate threshold we determined—requires a threshold at the 62.0th percentile of risk, a PLCOm2012 risk of 0.0134 (TUSPSTF). Comparing screenee selection by this PLCOm2012 risk ≥0.0134 threshold and USPSTF criteria in PLCO intervention arm smokers for detecting lung cancer, the sensitivities were 83.2% (95% CI 80.1%–85.9%) versus 71.2% (95% CI 67.6%–74.6%) (p<0.001), specificities were 62.9% (95% CI 62.4%–63.4%) versus 62.7% (95% CI 62.2%–63.1%) (p = 0.38), and PPVs were 4.0% (95% CI 3.7%–4.3%) versus 3.4% (95% CI 3.1%–3.7%) (p<0.001), respectively. Screenee selection based on the PLCOm2012 TUSPSTF is superior to screenee selection based on USPSTF criteria in all performance categories measured.
Calibration at Risk Thresholds
If the PLCOm2012 risk ≥0.0151 or PLCOm2012 risk ≥0.0134 thresholds are to be used for selecting screenees, it is important that model calibration is high around these risks. At risks from 0.0100 to 0.0185 inclusive, the median, mean, and 90th percentiles of absolute error between observed and predicted risks were 0.00194 (95% CI 0.00194–0.00195), 0.00156 (95% CI 0.00154–0.00157), and 0.00210 (95% CI 0.00209–0.00210), respectively, suggesting reasonable calibration for decision-making risks. For example, for a model-predicted risk of 0.0151, we expect on average the calibration-corrected model-predicted risk to be 0.0151±0.00156, or between 0.0135 and 0.0167.
Distributions of Risks
The distributions of PLCOm2012 risks in PLCO intervention arm smokers by lung cancer status are presented in Figure 6. The PLCOm2012 risk ≥0.0151 threshold lies close to the intersection point above which the density of risk is greater in individuals diagnosed with lung cancer than in those not diagnosed with lung cancer. Of the 1,307 PLCO smokers who had lung cancer diagnosed during 6 y of follow-up, 250 (19.1%) had risks <0.0151, 1,025 (78.4%) had risks in the range 0.0151–0.1500 inclusive, and 32 (2.5%) had risks >0.1500; further, 221 (16.9%) had risks <0.0134 (TUSPSTF), and 1,054 (80.6%) had risks in the range 0.0134–0.1500 inclusive.
Of the 1,667 PLCO smokers who died due to lung cancer during 11 y of follow-up, 357 (21.4%) had risks <0.0151, 1,279 (76.7%) had risks between 0.0151 and 0.1500 inclusive, and 31 (1.9%) had risks >0.1500; 300 (18.0%) had risks <0.0134 (TUSPSTF), and 1,336 (80.1%) had risks between 0.0134 and 0.1500. In conclusion, whether using TUSPSTF or TPLCOm2012, the large majority of lung cancer cases and deaths occur between the risk threshold and a risk of 0.1500.
Never-Smokers' Risk Model
A model analogous to the PLCOm2012 was developed in PLCO control arm never- and ever-smokers, and was validated in the PLCO intervention arm. The model, PLCOall2014, is described in Table S1. PLCOall2014 demonstrated high discrimination in the PLCO intervention group (validation data) (AUC = 0.848, 95% 0.833–0.861). The median and 90th percentiles of absolute errors in the PLCO control and intervention arms, and PLCO intervention arm smokers and never-smokers, were all 0.0014 or smaller. Cox recalibration analysis found that the PLCOall2014 and the PLCOm2012 intercepts and original model logits (log odds) were overestimated slightly when evaluated in the PLCO intervention arm data, but none of the differences were statistically significant (Table S1). However, the PLCOall2014 logit was overestimated by 5.6%, and the test of whether this value differed from zero approached significance (p = 0.0502). Figure S1 presents the mean observed and predicted risks by decile of PLCOall2014 predicted risk in PLCO participants. Figures S2 and S3 present the relationship between observed and predicted probabilities and absolute errors as they change with risk in PLCO control and intervention arm participants. These figures demonstrate that PLCOall2014 calibration is good for risks below 0.10, which include important decision-making thresholds. At risks above 0.15, the model overestimates risks. However, only a very small proportion of the population falls into this high-risk group (0.2% of PLCO participants had risks >0.15), and these individuals would be selected for screening based on elevated risk regardless.
Simple-to-use spreadsheet calculators for PLCOm2012 and PLCOall2014 are available at http://www.brocku.ca/lung-cancer-risk-calculator.
Maximum Risks in Never-Smokers
According to the PLCOall2014 model, the theoretical maximum possible 6-y lung cancer risk in never-smokers is 3.5%. This model ceiling risk is estimated for a never-smoker who is 80 y, has not graduated from high school, has a body mass index of 18 kg/m2, is African-American, has chronic obstructive pulmonary disease, has a personal history of cancer, and has a family history of lung cancer. This theoretical maximum exceeds our screening thresholds. However, this combination of risk factors is expected to be rare. The maximum PLCOall2014 risk observed in 65,711 PLCO never-smokers was 0.0147, which is below our recommended PLCOm2012 risk ≥0.0151 threshold for lung cancer screening.
Lung Cancer Risk and Incidence in Smokers Stratified by Age Dichotomized at 65 y
Because reimbursement for LDCT lung cancer screening may be provided to those 55–64 y of age through the Patient Protection and Affordable Care Act, and may not be provided by Medicare for those ≥65–80 y of age, we stratified analysis of risks and lung cancer incidence by these age strata. PLCOm2012 risk, lung cancer cumulative incidence overall, lung cancer cumulative incidence in those who had PLCOm2012 risk ≥0.0151 , and PPV were all statistically significantly greater in the older age stratum (Table 3; Figure 7).
Discussion
Tammemägi et al. [11] and Kovalchik et al. [12] presented evidence supporting the idea that risk models are more efficient for selecting individuals for LDCT lung cancer screening than the NLST criteria. However, neither study indicated where a suitable risk threshold for selecting screenees might be. The current study demonstrates that the PLCOm2012 model with a PLCOm2012 risk ≥0.0151 threshold for selecting individuals for screening is statistically and clinically more efficient than the USPSTF criteria, because it leads to a smaller number of individuals being screened, identifies significantly more lung cancers, and has higher PPV. In PLCO intervention arm smokers, compared to the USPSTF criteria, the PLCOm2012 risk ≥0.0151 criterion selects an 8.8% smaller sample and detects 12.4% more lung cancers, and because specificity is significantly improved, fewer false-positive screens are expected. Based on PLCO smokers, to sample the same proportion for screening as is selected by USPSTF criteria, a PLCOm2012 risk ≥0.0134 threshold is required. Bach and Gould [33] and others have emphasized the importance of limiting screening to high-risk individuals [12],[33]. We recommend use of TPLCOm2012 over TUSPSTF. Also, because the proportion of smokers at high risk will change over time [34], we discourage screening selection based on a flat proportion of smokers ranked by risk.
If selection of individuals for lung cancer screening is to use model-based risk thresholds, it is critical that the model is well calibrated near the threshold. Unlike the PLCOm2012 model, some prediction models demonstrate poor calibration. For example, the Liverpool Lung Project model's [35] overall expected/observed ratio indicates 24% calibration error, and around the 0.0151 threshold its calibration error is 57% (Appendix Figure 1 in [36]).
With regard to interpreting risk probabilities, it is important to appreciate that PLCOm2012 risks between 0.0151 and 0.1500 may not appear to be high in absolute terms, but are clinically important because the vast majority of lung cancers occur in this range.
Based on PLCO data and the PLCOall2014 model, analyses indicate that the general population of never-smokers should not be screened given our current state of knowledge. Although the PLCOall2014 model demonstrated that, in theory, the highest possible risks in never-smokers exceed our risk threshold, none of the large number of never-smokers in the PLCO had risks exceeding PLCOm2012 ≥0.0151.
Our analysis found that lung cancer risk, lung cancer cumulative incidence overall, and lung cancer cumulative incidence in those with PLCOm2012 risk ≥0.0151 were statistically significantly greater in PLCO smokers aged ≥65–80 y than in those aged 55–64 y. These findings are as expected, because the older age stratum had longer opportunity for exposure, it had additional risk contributed by age alone, and members belonged to cohorts with higher smoking rates. Findings reported by Kovalchik et al. [12] and in the current study (Table 1) indicate that the LDCT screening benefits for mortality reduction are greatest in high-risk individuals. This evidence argues that lung cancer screening should not be withheld from the older group of smokers.
Evaluation based on cost-effectiveness was not possible in this study because of absence of data. However, because the PLCOm2012 risk ≥0.0151 criterion for selecting screenees for lung cancer screening selects fewer screenees, and improves sensitivity and specificity, it should translate into improved cost-effectiveness over the USPSTF criteria. Risk factors, in particular smoking behavior, might have changed during study follow-up, but such changes were not included in the modeling, because high-quality and complete data on many important factors from the follow-up period were not available. Our study has strengths. This study was carried out using the PLCOm2012 and PLCOall2014 models, both of which were developed in a large prospectively followed population-based sample, and both models demonstrated high discrimination and calibration in validation data.
Use of the PLCOm2012 risk ≥0.0151 threshold for screening should result in more efficient and cost-effective screening programs. This should make lung cancer screening more attractive for policy-makers and more affordable for health systems. Some jurisdictions may not be able to afford lung cancer screening for the number of screenees that a PLCOm2012 risk ≥0.0151 threshold would indicate and may use higher thresholds. Use of extremely high-risk thresholds may have limitations. Figure 1 demonstrates that the screening effect does not continue to widen substantially beyond the 75th percentile. Figure 3 demonstrates that deaths from competing causes rise sharply with PLCOm2012 risk, increasing the probability of death in lung cancer screenees selected from the highest risk group. Furthermore, current heavy smokers are more likely to be non-participants, non-adherents, or dropouts [37]–[40].
Practical implementation of the PLCOm2012 model or similar models for selecting individuals for lung cancer screening need not be onerous. For example, the Pan-Canadian Early Detection of Lung Cancer Study was successful in identifying and recruiting individuals at high risk for lung cancer by applying a prototype of the PLCO risk prediction model, using a central, free 1-800 call-in number and a spreadsheet risk calculator to identify individuals who met study risk-level entry criteria [41]. Smart-phone apps, which will become available in the near future, will further improve the utility of complex, but accurate and valuable, prediction algorithms.
Given USPSTF recommendations, how can the PLCOm2012 risk ≥0.0151 criterion be implemented into lung cancer screening programs? One investigative approach is to enroll individuals into screening programs if they qualify by either USPSTF or PLCOm2012 risk criteria. This approach is justifiable because it should be more cost-effective than using the USPSTF criteria alone. With this program design, a sample size of 7,000 will have ≥0.80 power (alpha error = 0.05) to identify clinically important differences in proportions selected for screening, proportions of lung cancers detected, and PPVs for PLCOm2012 risk ≥0.0151 versus USPSTF criteria. Findings from different centers can be pooled to quickly allow meta-analyses. Findings from such investigations can guide future selection procedures.
Conclusions
Selection of individuals for LDCT lung cancer screening programs using the PLCOm2012 risk ≥0.0151 criterion should improve screening efficiency compared to selection by USPSTF criteria. Currently, never-smokers should not be screened. Lung cancer screening of high-risk older smokers (≥65–80 y) should be encouraged.
Supporting Information
Zdroje
1. AberleDR, AdamsAM, BergCD, BlackWC, ClappJD, et al. (2011) Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med 365: 395–409.
2. BachPB, MirkinJN, OliverTK, AzzoliCG, BerryDA, et al. (2012) Benefits and harms of CT screening for lung cancer: a systematic review. JAMA 307: 2418–2429 doi:10.1001/jama.2012.5521
3. JaklitschMT, JacobsonFL, AustinJH, FieldJK, JettJR, et al. (2012) The American Association for Thoracic Surgery guidelines for lung cancer screening using low-dose computed tomography scans for lung cancer survivors and other high-risk groups. J Thorac Cardiovasc Surg 144: 33–38.
4. WoodDE, EapenGA, EttingerDS, HouL, JackmanD, et al. (2012) Lung cancer screening. J Natl Compr Canc Netw 10: 240–265.
5. WenderR, FonthamET, BarreraEJr, ColditzGA, ChurchTR, et al. (2013) American Cancer Society lung cancer screening guidelines. CA Cancer J Clin 63: 106–117.
6. CouraudS, CortotAB, GreillierL, GounantV, MennecierB, et al. (2013) From randomized trials to the clinic: is it time to implement individual lung-cancer screening in clinical practice? A multidisciplinary statement from French experts on behalf of the French Intergroup (IFCT) and the Groupe d'Oncologie de Langue Francaise (GOLF). Ann Oncol 24: 586–597.
7. RobertsH, Walker-DilksC, SivjeeK, UngY, YasufukuK, et al. (2013) Screening high-risk populations for lung cancer—guideline recommendations. J Thorac Oncol 8: 1232–1237.
8. BoisellePM, WhiteCS, RavenelJG (2013) Computed tomographic screening for lung cancer: current practice patterns at leading academic medical centers. JAMA Intern Med 174: 286–287 doi:10.1001/jamainternmed.2013.12693
9. MoyerVA (2013) U.S. Preventive Services Task Force (2013) Screening for lung cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med 160: 330–338 doi:10.7326/M13-2771
10. de KoningHJ, MezaR, PlevritisSK, Ten HaafK, MunshiVN, et al. (2013) Benefits and harms of computed tomography lung cancer screening strategies: a comparative modeling study for the U.S. Preventive Services Task Force. Ann Intern Med 160: 311–320 doi:10.7326/M13-2316
11. TammemägiMC, KatkiHA, HockingWG, ChurchTR, CaporasoN, et al. (2013) Selection criteria for lung-cancer screening. N Engl J Med 368: 728–736.
12. KovalchikSA, TammemagiM, BergCD, CaporasoNE, RileyTL, et al. (2013) Targeting of low-dose CT screening according to the risk of lung-cancer death. N Engl J Med 369: 245–254.
13. SametJM, Avila-TangE, BoffettaP, HannanLM, Olivo-MarstonS, et al. (2009) Lung cancer in never smokers: clinical epidemiology and environmental risk factors. Clin Cancer Res 15: 5626–5645.
14. ThunMJ, HannanLM, Adams-CampbellLL, BoffettaP, BuringJE, et al. (2008) Lung cancer occurrence in never-smokers: an analysis of 13 cohorts and 22 cancer registry studies. PLoS Med 5: e185.
15. SilvestriGA, NietertPJ, ZollerJ, CarterC, BradfordD (2007) Attitudes towards screening for lung cancer among smokers and their non-smoking counterparts. Thorax 62: 126–130.
16. Centers for Medicare & Medicaid Services (2014) MEDCAC Meeting 4/30/2014—lung cancer screening with low dose computed tomography. Available: http://www.cms.gov/medicare-coverage-database/details/medcac-meeting-details.aspx?MEDCACId=68&bc=AAAIAAAAAAAAAA%3d%3d&. Accessed 25 July 2014.
17. ProrokPC, AndrioleGL, BresalierRS, BuysSS, ChiaD, et al. (2000) Design of the Prostate, Lung, Colorectal and Ovarian (PLCO) Cancer Screening Trial. Control Clin Trials 21: 273S–309S.
18. OkenMM, MarcusPM, HuP, BeckTM, HockingW, et al. (2005) Baseline chest radiograph for lung cancer detection in the randomized Prostate, Lung, Colorectal and Ovarian Cancer Screening Trial. J Natl Cancer Inst 97: 1832–1839.
19. OkenMM, HockingWG, KvalePA, AndrioleGL, BuysSS, et al. (2011) Screening by chest radiograph and lung cancer mortality: the Prostate, Lung, Colorectal, and Ovarian (PLCO) randomized trial. JAMA 306: 1865–1873.
20. AberleDR, BergCD, BlackWC, ChurchTR, FagerstromRM, et al. (2011) The National Lung Screening Trial: overview and study design. Radiology 258: 243–253.
21. AberleDR, AdamsAM, BergCD, ClappJD, ClinganKL, et al. (2010) Baseline characteristics of participants in the randomized national lung screening trial. J Natl Cancer Inst 102: 1771–1779.
22. Silverman BW (1998) Density estimation for statistics and data analysis. Boca Raton (Florida): Chapman & Hall/CRC. 175 p.
23. Harrell FE (2001) Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer. 568 p.
24. Harrell FE (2014) Regression modeling strategies: rms package—version 4.2-0 (manual date 2 July 2014, package date 13 April 2014). Vienna: R Foundation for Statistical Computing.
25. CoxDR (1958) Two further applications of a model for binary regression. Biometrika 45: 562–565.
26. Woodward M (2014) Epidemiology: study design and data analysis, 3rd edition. Boca Raton (Florida): CRC Press. 832 p.
27. PepeMS, LongtonG, JanesH (2009) Estimation and comparison of receiver operating characteristic curves. Stata J 9: 1–16.
28. ConnorRJ (1987) Sample size for testing differences in proportions for the paired-sample design. Biometrics 43: 207–211.
29. BrownLD, CaiTT, DasGuptaA (2001) Interval estimation for a binomial proportion. Stat Sci 16: 101–133.
30. MiettinenO (1976) Estimability and estimation in case-referent studies. Am J Epidemiol 103: 226–235.
31. CuzickJ (1985) A Wilcoxon-type test for trend. Stat Med 4: 87–90.
32. BenderR (2001) Calculating confidence intervals for the number needed to treat. Control Clin Trials 22: 102–110.
33. BachPB, GouldMK (2012) When the average applies to no one: personalized decision making about potential benefits of lung cancer screening. Ann Intern Med 157: 571–573.
34. HenleyJS, RichardsTB, UnderwoodMJ, SunderamCR, PlesciaM, et al. (2014) Lung cancer incidence trends among men and women—United States, 2005-2009. MMWR Morb Mortal Wkly Rep 63: 1–5.
35. CassidyA, MylesJP, van TongerenM, PageRD, LiloglouT, et al. (2008) The LLP risk model: an individual risk prediction model for lung cancer. Br J Cancer 98: 270–276.
36. RajiOY, DuffySW, AgbajeOF, BakerSG, ChristianiDC, et al. (2012) Predictive accuracy of the Liverpool Lung Project risk model for stratifying patients for computed tomography screening for lung cancer: a case-control and cohort validation study. Ann Intern Med 157: 242–250.
37. FordME, HavstadSL, FlickingerL, JohnsonCC (2003) Examining the effects of false positive lung cancer screening results on subsequent lung cancer screening adherence. Cancer Epidemiol Biomarkers Prev 12: 28–33.
38. MontesU, SeijoLM, CampoA, AlcaideAB, BastarrikaG, et al. (2007) Factors determining early adherence to a lung cancer screening protocol. Eur Respir J 30: 532–537.
39. OvhedI, OdebergH, RastamL (1993) Opportunistic screening for hypercholesterolaemia: characterization of two different drop-out groups and status after 2 years. Fam Pract 10: 439–443.
40. GroeneveldIF, ProperKI, van der BeekAJ, HildebrandtVH, van MechelenW (2009) Factors associated with non-participation and drop-out in a lifestyle intervention for workers with an elevated risk of cardiovascular disease. Int J Behav Nutr Phys Act 6: 80.
41. McWilliamsA, TammemagiMC, MayoJR, RobertsH, LiuG, et al. (2013) Probability of cancer in pulmonary nodules detected on first screening CT. N Engl J Med 369: 910–919.
Štítky
Interné lekárstvoČlánok vyšiel v časopise
PLOS Medicine
2014 Číslo 12
- Parazitičtí červi v terapii Crohnovy choroby a dalších zánětlivých autoimunitních onemocnění
- Pleiotropní účinky statinů na kardiovaskulární systém
- Statiny indukovaná myopatie: Jak na diferenciální diagnostiku?
- Zástava srdce u pacienta se střelnými ranami – kazuistika
- Statinová intolerance
Najčítanejšie v tomto čísle
- Home-Based Versus Mobile Clinic HIV Testing and Counseling in Rural Lesotho: A Cluster-Randomized Trial
- A Stronger Post-Publication Culture Is Needed for Better Science
- Metabolic Signatures of Adiposity in Young Adults: Mendelian Randomization Analysis and Effects of Weight Change
- Artemisinin-Naphthoquine versus Artemether-Lumefantrine for Uncomplicated Malaria in Papua New Guinean Children: An Open-Label Randomized Trial