Article Text

Download PDFPDF

Evaluation of the overdiagnosis in breast screening programmes using a Monte Carlo simulation tool: a study of the influence of the parameters defining the programme configuration
  1. Cristina Forastero1,
  2. Luis I Zamora2,
  3. Damián Guirado1,3,
  4. Antonio M Lallena4
  1. 1 Unidad de Radiofísica, Hospital Univ. San Cecilio, Granada, Spain
  2. 2 Servicio de Física y Protección Radiológica, Hospital Reg. Univ. Virgen de las Nieves, Granada, Spain
  3. 3 CIBER de Epidemiología y Salud Pública (CIBERESP), Granada, Spain
  4. 4 Departamento de Física Atómica, Molecular y Nuclear, Universidad de Granada, Granada, Spain
  1. Correspondence to Professor Antonio M Lallena; lallena{at}ugr.es

Abstract

Objectives To build up and test a Monte Carlo simulation procedure for the investigation of overdiagnosis in breast screening programmes (BSPs).

Design A Monte Carlo tool previously developed has been adapted for obtaining the quantities of interest in order to determine the overdiagnosis: the annual and cumulative number of cancers detected by screening, plus interval cancers, for a population following the BSP, and detected clinically for the same population in the absence of screening. Overdiagnosis is obtained by comparing these results in a direct way.

Results Overdiagnosis between 7% and 20%, depending on the specific configuration of the programme, have been found. These range of values is in agreement with some of the results available for actual BSPs. In the cases analysed, a reduction of 11% at most has been found in the number of invasive tumours detected by screening in comparison to those clinically detected in the control population. It has been possible to establish that overdiagnosis is almost entirely linked to ductal carcinoma in situ tumours.

Conclusions The use of Monte Carlo tools may facilitate the analysis of overdiagnosis in actual BSPs, permitting to address the role played by various quantities of relevance for them.

  • overdiagnosis
  • breast screening programmes
  • invasive/in-situ tumors
  • Monte Carlo

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • Overdiagnosis values quoted in the present study may be slightly overestimated because we have chosen 70 years as the maximum age of the women following the breast screening programmes (BSPs).

  • Simulations require the use of data corresponding to a reference population (eg, the breast cancer incidence) that may differ to some extent with those of specific populations and that introduces a certain uncertainty in the results.

  • The use of the present Monte Carlo tool permits to investigate the influence of the parameters defining the BSP as well as their results (such as overdiganosis) without involving actual populations and avoiding the economical, logistic and ethical problems that it usually entails.

  • Specifically, overdiagnosis may be addressed in an easy way overcoming the limitations of the randomized essays in this respect.

  • Possible changes in the diagnostic or procedural methodologies can be included in the simulation, thus allowing to anticipate the results of the new BSPs before their implementation.

Introduction

Breast screening programmes (BSPs) have become usual in developed countries and this has stimulated an intense debate about the potential risks and benefits for the women invited to follow them. One of their main consequences is the change of the breast cancer incidence in the population. This is due to the advance in the diagnosis of the disease, which increases the incidence rates at earlier ages. In addition, other facts, such as those derived from the use of hormone replacement therapy, may modify the prevalence and, eventually increase the underlying incidence.1

However, this apparent incidence excess should not be confused with overdiagnosis, an aspect that, together with overtreatment, has focused part of the discussion in the last years.2 BSPs are supposed to enhance the ability for detecting tumours in their early growth stages, which are those associated with a better prognosis and survival of patients. However, some of the cancers found in the screening grow so slowly that they would never manifest clinical symptoms before the women will die due to causes other than breast cancer. The detection of these tumours is called overdiagnosis of the BSP.2 3 Due to the impossibility of knowing, a priori, the cancer evolution, the available therapeutic machinery is switched on and the women overdiagnosed become subject of overtreatment (eg, surgery, radiotherapy and even chemotherapy) with the consequent possible adverse effects, even in those cases that would not evolve towards malignancy. Besides, some degree of spontaneous remission or asymptomatic latency, in case of invasive cancers, has been observed, and this would increase overdiagnosis.4 5

The determination of the overdiagnosis extent is in practice of a complicated task. Some estimations have been provided on the basis of the results obtained in BSPs running after several years. In this case, overdiagnosis is obtained by comparing the incidence of breast cancer in the women following the BSP with that in a population with similar characteristics (age, exposure to risk factors for breast cancer, availability of treatment, follow-up until death, etc.) and that does not undergo screening. Overdiagnosis would be linked to the cancer excess in the BSP group but the direct interpretation of the incidence data in women following a BSP is not straightforward because of the fluctuations in the incidences of the populations that are compared, the differences in the configurations of the BSPs considered (age ranges of the women following the programme, mammography frequencies, follow-up times), as well as the ways how the lead time (understood as the time between the tumour detection by screening and the clinical one) is considered.2 6

A priori, a most consistent estimate of overdiagnosis may be obtained in combined analyses of the results of various randomised controlled trials (RCTs). However, a huge variability in the quoted overdiagnosis data, mainly due to different methodologies in observational studies, has been pointed out.6 7 In any case, the RCTs developed to date8–15 were not designed to determine overdiagnosis and, as most of them began in the 1980s, have not included most of the recent advances in therapy and have not taken into account the impact of the higher image quality and the reduction in the detection thresholds on it.

In these circumstances, Monte Carlo simulation appears to be as a good alternative to overcome the difficulties pointed out. In previous works,16–18 we have developed a mammographic screening model based on Monte Carlo techniques and aiming at evaluating screening programmes. This simulation tool has allowed us to reproduce the results of actual BSPs concerning the invasive/in situ tumour detection rates with and without screening, the ranges of interval cancers, and other magnitudes associated with detection. By introducing the survival following local-regional treatment has enabled us to make estimates of the mortality reduction attributable to BSPs. Finally, the internal validity of the main RCTs included in the Cochrane meta-analysis3 was analysed by using the Monte Carlo tool adequately adapted to take into account the specific characteristics of each of them. In all the situations studied, the Monte Carlo simulation has proven to be an efficient instrument.

The purpose of the present work is to develop a new Monte Carlo tool to investigate the overdiagnosis of BSPs according to their particular configurations, these are age ranges of the women following the programme and mammography frequencies. To do that we have used the tool previously built up and tested16 that involves generic distributions that may be adapted to each specific population in order to reach enough precision in the simulation. The programme will provide us with the annual and cumulative number of cancers detected by screening, as well as the number of cancers clinically detected during the programme running (interval cancers) of the population undergoing screening. The comparison of these results with those obtained for the same population in the absence of screening has allowed us to estimate the overdiagnosis in a direct way.

Material and methods

Our Monte Carlo tool allows carrying out simulations based on a minimum number of parameters having clinical or physical significance: tumour average size for symptomatic detection, mammography sensitivity (as a function of the thickness, histological type and density of the breast) and the proportion of invasive/in situ tumours. It is worth reminding the differences between these two histological types of cancers entering in our analysis. Ductal carcinoma in situ (DCIS), or intraductal carcinoma, involves the clonal proliferation of malignant cells. They grow in the mammary duct lumens, do not invade the adjacent breast stroma and are usually diagnosed by mammography. On the contrary, invasive tumours do multiply in normal tissues and constitute much of the cases of the clinically detected breast cancers. Besides, we do not include any ad-hoc assumption such as that related to the higher aggressivity of tumours in their early growth stages.

Other simulation models are either overparameterised or based on distributions of parameters that are difficult to observe or show non-negligible correlations with the mammography sensitivity.19 Other approaches, such as those linked to Markov models, may generate results that strongly depend on the defined states.20

In the simulation tool we developed,16 that is the base of the present Monte Carlo approach, the history of each woman participating in a BSP is simulated individually, considering a model that includes parameters and characteristics that may be gathered in one of the following categories.

  • Parameters describing the target population of the BSP. Here we have the incidence distribution of breast cancer as a function of the age of the women. In our simulations we have used that of the Canary Islands before BSP as representative of an occidental population not submitted to screening. As the incidence actually needed is that of the tumour onset, the incidence curve was shifted towards smaller ages using the average time between the tumour detection by any diagnostic technique and the tumour onset, employing a logistic growth model.

  • Tumour properties that influence the probability of detection by mammography. Tumour size, histological type and breast density are the three fundamental characteristics in this group. In addition, a model describing the evolution of the tumour size as a function of time and a model of the detection probability of breast cancer by mammography are required.

  • Configuration of the BSP. Here we included the frequency of mammography, the age range of the women participating in the programme and the follow-up time for each participant.

The simulation of a history begins by sampling, within the corresponding population distribution, the age of a candidate to participate in the BSP. If the age obtained is within the range established for the virtual BSP, the women history continues by sampling whether the woman has developed a cancer at some moment since her birth. This is done according to the cumulative incidence distribution. If the answer is affirmative, then the women breast density, the initial histological type of the tumour, the moment when it occurred and its size when the woman enters into the BSP are obtained by sampling the corresponding distributions. It is worth pointing out that both the tumour histological type and the breast density may change throughout the simulated history. The histological type may evolve from DCIS to invasive cancers. Also the breast density may reduce with age. These transitions are hypotheses taken into account in our model.

The moment at which the tumour arises is sampled according to the incidence curve, which shows the probability of tumour occurrence as a function of the woman age. The tumour size is estimated by using a realistic tumour growth model that describes the increase of the tumour diameter with the time elapsed since its inception. This growth is simulated by using a model21 with a single free parameter that we assume to follow a log-normal distribution, an initial proportion of invasive/DCIS tumours, and given transition probabilities between these two tumour histological types. This proportion is chosen according the results obtained for detection in the various screening rounds. No additional hypotheses about tumour evolution are included.

In those cases in which women have developed a tumour, the detection probability is sampled to consider whether the tumour is detected or not after the mammography. For women who do not present disease, the specificity is used. If a true positive case occurs, the history is finished and a new one is started. In any other case, successive rounds are simulated either because the tumour was not detected in the previous one (false negative) or the woman is healthy but continues in the BSP until the age limit is reached (true negative). If, in this last case, the woman was erroneously classified as positive, we would deal with a false positive case and it is understood that the woman is called again for a further test that will confirm the error in the diagnosis and that she will continue within the BSP.

In false negative cases, which suppose the continuation of the history, the simulation takes into account the growth of the tumour between the different rounds, including the probability of clinical detection between them. This means that interval cancers are considered. Also the possible changes in the tumour histological type and breast density are taken into account. Likewise, for the cases of healthy women, the probability of cancer occurrence during follow-up is simulated.

With this methodology, the Monte Carlo tool permits to simulate the introduction of a BSP in a given population, carry out its follow-up during a certain time and determine with the selected periodicity the total number of tumours detected by screening in the sample of women that attend the programme, as well as those detected clinically (interval cancers if they occur in women who follow the BSP). If the prevalence of breast cancer is stable over time, the incidence curves corresponding to the population undergoing screening should converge, after a time of the order of the lead time, to those found for the same population without screening, and the whole procedure would not show overdiagnosis. If this does not happen, and after the lead time, the two cumulative incidence curves would remain parallel and the difference between both would provide us with an estimate of the overdiagnosis.

Specifically, the overdiagnosis was calculated as2:

Embedded Image (1)

where Embedded Image is the cumulative number of cancers detected in women who have followed the BSP during a total time  t , including interval cancers, Embedded Image  is the cumulative number of tumour detected clinically in an equivalent group of women who have not followed a BSP, Embedded Image  is the duration of the BSP or time course and Embedded Image is a time required to avoid the transient period associated to the lead time. Except for a very small number of cancers, the average lead time is ~3–4 years2 and we have considered Embedded Image .

In our simulations we ran 50 million of woman histories in each BSP. Two age ranges [a l,a u] = [50,70] and [40,70] (with age values given in years) were analysed with Embedded Image and 20 years, respectively. Time intervals between consecutive mammographies of Embedded Image , 2 and 3 years were considered. In all cases simulated, an attendance rate of 100% was assumed, though estimations for 80% attendance were also performed.

The first running year of the BSP, all women with ages in the selected age range [a l,a u] enter the programme; in the following years, women who reach the minimum age of participation a l are incorporated. They are followed within the BSP until they reach a u. If the programme finishes, woman’s histories continue to be simulated, considering the possibility of tumour clinical detection. In our simulations we chose 20 years for this period after the programme: this permitted estimating the time necessary for the programme effects to disappear.

Patient and public involvement

The present study deals with a Monte Carlo simulation. Then, neither patients nor public were involved.

Results

Figure 1 shows the cumulative incidences for invasive plus DCIS tumour, normalized to the average number of women participating in the BSP, (per thousand women), as a function of the time elapsed since the beginning of the BSP, for the configurations of [50-70] with Embedded Image years (panel 1a) and [40-70] with Embedded Image years (panel 1b). For these configurations, the results obtained for mammography frequencies Embedded Image (green solid circles), 2 (blue solid squares) and 3 (red solid triangles) years are shown. The attendance is assumed to be 100%. Open squares correspond to the values found for the population of women who do not followed the BSP.

Figure 1

Cumulative invasive + ductal carcinoma  in situ  tumour incidence, normalised to the average number of women participating in the breast screening programme (BSP), as a function of the time elapsed since the beginning of the BSP. Solid symbols show the results obtained for the configurations (A) [50–70] with a BSP duration of Embedded Image years and (B) [40–70] with Embedded Image years, with 100% attendance. The values corresponding to intervals between mammographies of Embedded Image , 2 and 3 years are shown with green solid circles, blue solid squares and red solid triangles, respectively. Open squares indicate the results found for the woman population who do not follow the BSP.

The overdiagnosis estimates for 100% attendance, calculated according to equation (1), are shown in table 1.

Table 1

Values of overdiagnosis, as defined in equation (1), for the two configurations studied and the three mammography intervals Embedded Image considered in each case

The corresponding incidences for invasive plus DCIS tumours, normalised to the average number of women participating in the BSP and for 100% attendance, are shown in figure 2.

Figure 2

Invasive+ductal carcinoma in situ tumour incidence, normalised to the average number of women participating in the breast screening programme (BSP), as a function of the time elapsed since the beginning of the BSP. Solid symbols show the results obtained for the configurations (A) [50–70] with a BSP duration of Embedded Image years and (B) [40– 70] with Embedded Image years, with 100% attendance. The values corresponding to intervals between mammographies of t int=1, 2 and 3 are shown with green solid circles, blue solid squares and red solid triangles, respectively. Open squares indicate the results found for the woman population who do not follow the BSP.

Finally, in figure 3 the cumulative incidence for invasive cancers in the screened woman sample for Embedded Image year and 100% attendance (green solid circles) is compared to the results obtained for a population of women who did not follow a BSP (open squares). The values are normalised to the average number of women participating in the BSP.

Figure 3

Cumulative incidence for invasive tumours, normalised to the average number of women participating in the breast screening programme (BSP), as a function of the time elapsed since the beginning of the BSP. Green solid circles show the results obtained for the configurations (A) [50–70] with a BSP duration of Embedded Image years and (B) [40–70] with Embedded Image years, with an interval between mammographies of Embedded Image year and 100% attendance. Open squares indicate the results found for the woman population who do not follow the BSP.

Discussion

The effect of the overdiagnosis is clearly seen in figure 1: once a time equal to the lead time Embedded Image years has passed after the BSP finished (this means, respectively, 20 and 30 years after the beginning of the programme for the two configurations studied), the results obtained in the case of the women who have followed the BSP behave parallel to those of the unscreened woman.

As shown in table 1, the corresponding overdiagnosis estimates found for the [50–70] configuration are significantly larger (between 15% and 21%) than those obtained for the [40–70] one. This is due to the fact that the tumour detection by screening at earlier ages, as it occurs in the second configuration, would have more time to grow and reach a size exceeding the clinical detection threshold in the absence of screening.

On the other hand, and as it was expected, the increase of the time interval between mammographies reduces the overdiagnosis, the reduction being ~40% when Embedded Image changes from 1 to 3 years.

When the BSP finishes (after 10 years in the case of the configuration [50–70] and 20 years for the [40–70] one of its beginning), a transient period occurs. In figure 1 this is better seen in the case of Embedded Image year (green solid circles) and it shows up as a change in the slope of the corresponding data. This behaviour may be observed in a more clear way by looking at the corresponding incidences, shown in figure 2. Therein the trend described appears as a strong reduction of the incidence rate and is a consequence of the detection deficit once the BSP is no longer active. As we can see, the incidence rate requires about 10 years to reach the incidence corresponding to the unscreened population (shown with open squares). It is worth mentioning that the reduction observed is inherent to the BSP itself and it occurs even if overdiagnosis is absent. To isolate in the incidence curves these changes from those due to overdiagnosis, it is mandatory waiting for the lead time Embedded Image years after the BSP has finished.

As seen in figure 3, for the configuration [50-70], the cumulative incidence for invasive cancers in the screened woman sample (shown by green solid circles in the panel 3a) coincide with that obtained for the reference population of women not following a BSP (open squares) after a period of ~5 years once the programme has finished. As the number of invasive tumours is the same in the populations with and without screening, the overdiagnosis above discussed relies completely on DCIS tumours. The same does not occur in the case of the configuration [40-70] (panel 3b) where a deficit of 11% in the cumulative incidence of invasive tumours with respect to the unscreened population is found after BSP finished.

Once the importance of DCIS tumours in overdiagnosis has been pointed out, it is worth noting that it is not a consequence of a slower growth of these tumours compared with invasive ones, since our model does not include any difference according to their histological type. The reason is rather that there is a greater abundance of DCIS cancers in the early stages in which they can be efficiently detected by screening.

As said above, overdiagnosis estimations from actual BSPs are difficult. Puliti et al 22 analysed 13 observational studies and concluded that overdiagnosis would reach up to 10%. In the case of the British National Health System BSP, with a follow-up of 20 years and for women older than 50 years,2 the mammographic screening avoided a death each 250 invited women. Therefore, assuming an acceptance/participation rate of around 80% and a detection rate in the incidence rounds of 4 cancers detected per 1000 women and year, one would have 3 cases of overdiagnosis/overtreatment per death avoided, that is, 1% of women invited to BSP are expected to be overdiagnosed.

The situation of the RCT estimations is also unclear. The Cochrane report established an absolute risk of overdiagnosis/overtreatment of 0.5%.3 Much smaller values,~0.025% per year, were established by Moss23 according again to the data of the Canadian trials,9 10 while for the relative risk in the intervention arms of these RCTs he found values between 11% and 14%. The reasons of these discrepancies may be linked to the serious methodological problems shown by these RCTs.24

On the other hand, the 2009 revision for the US Preventive Task Force25 quoted that overdiagnosis was within 1% and 10%.

Testing the results of these actual BSPs or RCTs with our Monte Carlo tool would require detailed simulations in which the various specifications of each of them are included. In the case of BSPs, one of the main inputs is the attendance that in our calculations has been assumed to be 100%. However, it is possible to estimate the overdiagnosis for lower attendances using the results we have obtained by assuming that the number of detected tumours remains approximately constant after the screening has finished. In table 1 the values obtained in this way for 80% attendance are shown. A smaller attendance give rise to lower values of the overdiagnosis: a reduction of ~5% has been found for 80% attendance with respect to 100% one, the overdiagnosis ranging between 7% and 14% depending on the configuration. These estimations give an idea of the magnitude of overdiagnosis in BSPs with attendances around 80%.

To finish, it should be noted that our simulations may be affected by some limitations because we have not the incidence curves corrected by the average detection time for women over 70 years and the simulated histories stopped at that age. This may imply a small overestimation of overdiagnosis. On the other hand, the fact that the simulations carried out require information corresponding to a reference population (eg, the breast cancer incidence) introduces a certain uncertainty in the results because these data may differ to some extent with those of the specific populations investigated.

Conclusions

We have developed a model based on Monte Carlo simulation techniques that allows us to reproduce consistently the known results about overdiagnosis on BSPs. It varies from 7% to 20% depending the programme configuration (age range of women involved and frequency of mammography).

It has been found that, after the end of the screening programme, the incidence of invasive cancers is similar to that found for an unscreened control group: this implies that overdiagnosis is mainly associated with DCIS tumours. This is due to the fact that this type of cancers are more abundant than the invasive ones when they reach the size that make them to be detectable by mammography.

In any case, Monte Carlo tools appear to be very helpful for analysing the role of the various parameters defining the BSP configurations as well as their results (such as overdiagnosis) without involving actual populations and avoiding the economical, logistic and ethical problems that it usually entails. Even more, changes in the diagnostic or procedural methodologies can be included in the simulation, thus allowing to anticipate the results of the new programmes before their implementation.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.

Footnotes

  • Patient consent for publication Not required.

  • Contributors All the authors contributed to the conception and design of the study. CF and LIZ wrote the simulation codes and ran them for the various configurations analysed. All the authors performed the analysis of the simulation results, contributed to the writing and editing of the original version of the manuscript, responded to the reviewers’ reports and wrote the revised version of the article.

  • Funding Work partially supported by the Biomedical Research Networking Center-CIBER de Epidemiología y Salud Pública (CIBERESP), the Spanish Ministerio de Ciencia y Competitividad (FPA2015-67694), the European Regional Development Fund (ERDF) and the Junta de Andalucía (FQM0387).

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement There are not additional data from the present study to be shared. Information about the details of the simulations can be obtained from any of the authors.