Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Involving a Citizens’ Jury in Decisions on Individual Screening for Prostate Cancer

Abstract

Aims

Most public health agencies and learned societies agree that the prostate-specific antigen (PSA) test in asymptomatic men should not be recommended, on account of its potential for harm. Yet PSA is still widely used as a screening test and is not being abandoned. This remains a significant public health issue, and citizens’ engagement is needed. This study was designed to produce a deliberation on the PSA screening test by a citizens’ jury.

Methods

Fifteen citizens were selected and balanced for sex, age, and education. They received an information booklet and participated in a two-day meeting with experts to reach a deliberation on the question “Should the National Health Service discourage or recommend PSA as an individual screening test for prostate cancer in men 55–69 years old?”. A facilitator ran the jurors’ discussion.

Results

All except three of the jurors decided that the National Health Service should discourage the use of PSA as an individual screening test for prostate cancer in 55–69 year-old men. The jury was particularly convinced by the uncertainty of the test outcomes, the utility of the test, and its cost/benefit ratio. Before the meeting 60% of jurors would have recommended the test to a relative, and all the male jurors would have done so. After the meeting these percentages fell to 15% and 12%.

Conclusions

This experience confirms the feasibility and effectiveness of delegating to a group of citizens the responsibility to decide on public health issues on behalf of the community. Public health authorities should invest in information campaigns aimed at the public and in educational initiatives for physicians. This also provided an opportunity to disseminate information on screening, over-diagnosis, and over-treatment.

Introduction

Prostate cancer is one of the most widely diagnosed malignancies among men in developed countries. In Italy, about 36,000 new cases and about 7,800 deaths were recorded in 2012 [1]. The benefits and harms of the prostate-specific antigen (PSA) screening test to reduce specific mortality have been debated for a long time.A recent Cochrane systematic review [2], combining data from five randomized clinical trials (RCT) with more than 340,000 participants, including two important recent RCTs in Europe [3] and USA [4], found that PSA screening did not reduce the specific mortality for prostate cancer, and tended to lead to over-diagnosis and consequent over-treatment. Similar conclusions have been drawn by two other reviews [5,6], one showing a small or no reduction [6], the other no significant effect [5] on prostate cancer-specific mortality A recently population-based cohort study showed a possible greater benefit in high-risk men aged 60 with PSA ≥ 2 ng/mL [7]. Nevertheless, in view of the nature of the study, this finding must be taken with caution.

Most clinicians, [810] learned societies [11,12] and public health committees [13,14], as the US Preventive Service Task Force and the UK National Screening Committee, now agree that the PSA test should not be recommended as screening for prostate cancer in asymptomatic men [15]. At the individual level the PSA decision should be based on a clear understanding of the benefits and harms, with respect for personal values, in the framework of shared decision-making [16], as strongly recommended by scientific societies, institutional and independent groups [1214].

The discrepancy between the widespread use of the PSA test in clinical practice and the recommendations of several international guidelines against it is widely debated [17,18]. The suggestion for judicious use of PSA remains largely unheeded [12,19,20], and the PSA incidence rates rise year by year, particularly in some categories of men. In Italy, about half the men over fifty had at least one PSA test [21]. The National Health Service (NHS) published a summary of the evidence [22], leaving each Regional Health Service free to decide how to implement it. The PSA test, as a screening tool, therefore remains a significant public health issue, and not surprisingly it is on the American Academy of Family Physicians’ list of the 15 things physicians and patients should question, according to Choosing Wisely [20].

This screening could be viewed in the context of the debate on the increasing “medicalization” of society [23] where the estimated benefits may be overwhelmed by the drawbacks (over-diagnosis, over-treatment) in public health, social and economic terms. As the benefits and harms of screening involve the whole community, but are hard to assess at the individual and community levels, and PSA opportunistic screening is a controversial issue this debate cannot be solved solely on the basis of scientific evidence or expert opinions, without consulting the general population for its preferences and values [24]. A different approach to establishing public involvement is required [24].

The Citizens’ jury is a method of deliberative democracy where a group of lay citizens with different backgrounds, values and attitudes is given adequate and independent information, then deliberates on an issue of interest to the community [25,26].

This article reports the results of a Citizens’ jury on the PSA individual screening test for prostate cancer.

Methods

This project was coordinated by researchers involved in community empowerment initiatives [27], in collaboration with science communication experts and clinicians. The promoters were IRCCS Istituto di Ricerche Farmacologiche Mario Negri, Agenzia di Editoria Scientifica Zadig, and Agenas—the Italian National Agency for regional health services [28]. The process was supervised by a multidisciplinary steering committee, where advocate groups of patients were involved. According to Italian law, ethical approval is not required for this kind of study. The jurors, after receiving a leaflet giving information about the project, signed a letter of agreement to participate, and consented to the use of their data for research purposes.

The questions for the jury

The main question, discussed and agreed among promoters and the steering committee, was: “Should the NHS discourage or recommend PSA as an individual screening test for prostate cancer in 55–69 years old men?”. The question was formulated in the name of the NHS with the aim to making the jury deliberate from the point of view of the common good—not the individual good.

The main question was accompanied by four sub-questions.

Selection of the jury

The jury was selected among the members of the “Laboratorio dei cittadini competenti di Modena” (Laboratory of competent citizens of Modena), a voluntary group of lay adults with no specific competence in health/medicine issues, active in support of institutional health information campaigns [29].

Men and women over 18 years old, with no personal or family history of prostate cancer—so as not to deliberate as patients—were eligible. Among those willing to participate, a group of 15 members balanced for sex, age and education was selected. Each member received a fee of 100 Euros.

The information for the jury

An ad hoc booklet was prepared on the basis of a review of the literature. To collect any pertinent document, a public call was launched on the PartecipaSalute website [27]; learned societies, patients’ and consumers’ associations and public health offices were directly invited by e-mail. The 25 documents submitted were examined. A sample of consumer/patient organizations’ websites was also visited to catch topics of interest. The draft of the booklet was discussed by the promoters, the steering group and with the PartecipaSalute-GRAL, a group of patients and consumers’ representatives [27]. The topics of the 30-page booklet are reported in Appendix A.

Nine experts were invited to the two-day meeting with jurors: four epidemiologists—some of them part of a national screening group—a urologist, a general practitioner, an oncologist, a health policy maker, and an expert in health economics. Topics covered are reported in Appendix A. Interviews with three middle-aged men were presented in videos (Appendix A).

The two-day meeting and the deliberation session

The first and second days the experts gave their talks and discussed with the jurors. A final debate was organized between a clinician and a health policy maker on the pros and cons of opportunistic PSA screening. In the afternoon of the second day, a four-hour closed-doors session was dedicated to the discussion among the jurors to deliberate. Before the session two participants, for strictly personal reasons, decided to leave the Citizens’ jury. The discussion was assisted by a psychologist expert in group facilitation, to create a favourable climate for jurors, to share their points of view freely, and discuss amongst themselves until they reached a consensus, if possible. The facilitator used an argumentative style for conducting the meeting.

One representative of the jurors was responsible for drafting the deliberation, presenting it to the experts and promoters at the end of the second day, and writing the final document in collaboration with the facilitator. The final document, describing the deliberation and its reasons, was circulated, amended and approved by all the jurors.

The questionnaires for the jury

The jurors were asked to complete two self-administered questionnaires.

The first was answered before the start of the jury meeting, the second at the end. The first comprised ten closed questions on knowledge of prostate cancer and the Citizen’s jury method, on the quality of the information booklet, on the individual’s attitude toward PSA testing, and on additional information seen before the meeting. The second comprised 13 closed questions on the quality of the experts’ presentations, the time dedicated to the jury discussion meeting, the role of the facilitator, the attitude toward PSA testing, and opinions about the Citizen’s jury.

To assess the changes before and after the jury, some questions were repeated in both questionnaires. Free comments were also collected.

Descriptive statistics, mainly proportions, were used to analyze all data collected. Data were collected and analyzed using Microsoft Excel.

To collect feedback also from the experts involved in the project, the promoters asked them to share their opinions about the strengths and limits of this experience by e-mail. Comments were analyzed by promoters, and discussed in a meeting with the experts.

Results

Fifteen jurors participated, two thirds were male (67%), with middle and high school education (73%), and mean age 58 years.

All except three of the jurors decided that the NHS should advise against the use of PSA as an individual screening test for prostate cancer in 55-69-year-old men. The reasons are collected in a deliberation literally reported in Box 1. The answers to the four sub-questions are reported in Appendix B.

Box 1. The jury’s deliberation and its reasons

The Citizens’ jury is aware of the importance of the problem, as prostate cancer is the most common cancer among men, directly affecting 36,000 people each year. The jury is also aware that the demand for several million PSA tests per year indicates a widespread need for reassurance. However, although PSA is the only available test for early diagnosis of prostate cancer, the majority of jurors—having consulted the experts and drawn their own conclusions—agree that currently the NHS should not recommend PSA as an individual screening test. The jury stresses that discouraging is not tantamount to banning, but expresses a general indication. In such a controversial field, this choice works in favour of the doctor's freedom without affecting the freedom of the citizens/patients. The recommendation does not prevent doctors prescribing PSA to an asymptomatic patient. However, it does protect a doctor who does not deem the test necessary, without fear of a lawsuit. It may also provide an opportunity for doctors to get further information about the test and the results of studies so far, and facilitates an open and honest discussion with the citizens who request the test. The Citizens’ jury motivates the recommendation with reasons concerning the uncertainty of the test outcomes, the individual and social utility of the test, and its cost/benefit ratio.

Uncertainty of the test outcomes

Like any diagnostic test, PSA has its own sensitivity and specificity, which the jurors do not consider optimal. In the case of a negative outcome, the test gives the patient a false sense of security, but many men with cancer have normal PSA levels (false negatives), and many with high PSA do not actually have cancer (false positives). This exposes a potentially very large number of men—more than half of those who have the test—to concerns and further tests, sometimes invasive such as a biopsy, which involve a certain risk.

Individual and social utility

In addition to false positives and false negatives, the test leads to over-diagnosis, i.e. the identification of cancers that would never have developed or that would have developed so slowly as to not significantly affect the person’s quality or quantity of life. Then too, if a cancer is diagnosed, the treatment may severely affect the quality of life of a large number of people, causing concern, urinary incontinence, erectile dysfunction, etc.

Cost/benefit ratio

The number of healthy individuals, or those with a slowly progressing cancer, who are likely to be treated unnecessarily, with consequences such as those described above, is considered too high in relation to the number of lives that early detection—in the best scenario—may actually save. This negative balance, in terms of harms for health, is further worsened when the costs of unnecessary treatments are added. These sums could be more usefully invested in information and research for more reliable tests.

The Citizen’s jury acknowledge that giving up on the idea of a test for early detection of such a widespread disease as prostate cancer is not easy. However, this test does not seem to be performing adequately and is likely to deceive or discourage a large number of people. Considering also the current limitations on resources, it is all the harder to justify recommending the test. The Citizens’ jury recommend that the outcomes of PSA tests done as individual screening in the 55-69-year-old group be carefully checked.

The jurors’ discussion

During the meeting the jurors had lively discussions with experts and promoters. A couple of jurors was at first cautious about the aim of the project, asking for more information about the “real” interest of the promoters, as if they might have had a pre-set position about the jury’s outcome. The promoters—as underlined at the beginning of the meeting—reaffirmed their total neutrality, clarifying the aim of the project. Most of the jurors felt free to deliberate and personally responsible for the final deliberation.

During the closed-doors session, the discussion was introduced by asking the jurors to express reasons supporting the positions reported in the main question. The jurors’ reasons supporting the position “the NSH should recommend…” referred to the fact that prostate cancer is common, PSA tests are widely used, and “even if the PSA test is not perfect, it is the only one available”. Early diagnosis was considered a good thing in any case because “thanks to it the development of a cancer can be stopped”–not knowing a priori how it might develop over time. Another reason was personal autonomy: “a person has to be free to ask for the PSA test even if the doctor does not agree—to reduce anxiety (even considering the limits of the test) and to prevent the disease”.

The jurors’ reasons supporting “the NSH should discourage…” were mainly driven by the cost-benefit ratio, unfavorable due to the limits of the PSA test in terms of accuracy. The main issues considered were the severity of the adverse effects of the diagnostic process, the number of men treated or worried unnecessarily, compared with the uncertainty of the benefit in terms of lives saved.

The main consideration that settled the different views was that supporting the position “the NSH should discourage …” would foster the possibility of deciding freely to do a PSA test or not, both for general practitioners—relieving them of any defensive stand—and for citizens who would have access to balanced information from their general practitioners.

The questionnaire results

All jurors rated this experience positively and most considered the Citizens’ jury method useful. Many jurors felt actually involved in a decision about a public health topic that matters to them, underlining the need to make the deliberation widely known.

Regarding the national screening programs, most jurors (93%) had participated in those organized locally (colon, breast and cervical cancer). Before the meeting, most of the jurors believed the PSA screening test was useful (71%) and would have recommended it to a relative (60%); all the men would have done so. After the meeting most jurors had changed their attitude (respectively 31%, 15%, and 12%).

Most judged the information provided good or satisfactory; only a few felt there was too much, and sometimes the language was too technical. A few jurors commented that they lacked the information to answer the question, commenting: “I would need more plain information”; “I wonder why the PSA test as for individual screening is so widely used in clinical practice considering the limits indicated in the scientific knowledge available…”. A selection of questionnaire responses is reported in Table 1.

thumbnail
Table 1. Questionnaires submitted before and after the jury met.

https://doi.org/10.1371/journal.pone.0143176.t001

The experts’ feedback

The main issues identified were the representativeness of the jurors, the quality and balance of the information, the opportunity for the jurors to put questions and participate in the debate with the experts, the impact of deliberation. These points have been matched against the jurors’ feedback and commented in the discussion.

Discussion

The Citizens’ jury deliberated to discourage PSA testing by the NHS as individual screening for prostate cancer in 55-69-year-old men. The deliberation was agreed even though most of the jurors individually had been favorable to PSA screening before the meeting. In particular, all the men jurors were in favor of the test, but this dropped to 12% after the meeting. It is important to note that the jurors were able to take the point of view of public interest, leaving aside their individual preferences, and to reach a shared deliberation. This might have been due to the construction of the question itself (asking about NHS), the selection criteria of the jurors, the explicit demand—made by the promoters during the two-day meeting—to take the point of view of the common interest, and the topics covered during the two-day meeting, referring to the public effects of opportunistic PSA screening.

This confirms that, given truthful, complete information backed by arguments and referenced sources, and sufficient time for discussion, lay people can deliberate on a complex, uncertain issue like prostate cancer screening from a public point of view [30,31,32]. The main items underlined by the experts and by some of the jurors agree with the four key criteria of Abelson [33] for judging the efficacy of a Citizens’ jury. We can look at them here point by point.

Representativeness

The jurors were selected from a group of people calling themselves the “Laboratory of competent citizens”. This might be considered a limit for their representativeness, because they are not completely naive, may share information about specific healthcare topics, and may already be used to working in healthcare settings, and dealing with healthcare topics. However, the people in this citizens’ jury must be willing to deliberate for the community, and had represent no individual interest or stakeholders. For this reason we included men who did not have prostate cancer, and some women too. In addition, the jury members did not all know each other, and this sampling method was the most cost-effective in this project. Finally, the small number of participants—another issue relating to the representativeness—is a common feature of this kind of method [34].

Procedure and processes

All the steps were carefully monitored, and transparency and sharing was guaranteed throughout the project. The promoters moderated the debates so as to foster the jurors’ participation, and get jurors involved in the discussion. A few jurors asked for more time to discuss with experts; most felt they were truly involved in a decision on a public health topic, reinforcing the sense of responsibility in their deliberation.

The quality of information

It was an important challenge to provide balanced information on a topic on which scientific knowledge is almost unanimous (against it), but clinical practice takes another direction. To face this challenge, the jurors were exposed to information covering the systematic reviews [2,6]—and their limits; experts illustrating the possible future of the PSA test and the complexity of decision making in the clinical setting; videos of men satisfied with their decision to do the PSA test, and, finally, a debate about the pros and cons of the test as screening.

Involving lay people in the production and review of information material is a key strategy, also in the dissemination of scientific information to lay people, especially when asking for a deliberation.

Outcome

The impact on healthcare policies was intended to be approached by disseminating the deliberation among the decision networks. Agenas sent it to the leading NHS institutions and to several pertinent learned societies. The deliberation was circulated to the general population through the media and discussed at a public meeting.

To boost its impact, we invited various learned societies to participate in the project. Although several members of the steering and the scientific committees were affiliated to different medical associations, the promoters did not obtain any official endorsement. Only one society of GPs fully participated in the project and spread the deliberation [35]. The scant participation of learned societies is a limit of the project.

Conclusions

The authors were uncertain about what the jury would deliberate, but the result is similar to that issued by an Australian Community jury [30], conducted in the same period of 2013 in a very different cultural and social context, and with a quite different composition of the jury (only men 50–70 years old). Both juries deliberated that the national health service should provide general practitioners with a scheme to give high-quality, complete information on the PSA screening test.

It is interesting that the main difference is that the Italian jury deliberated to reach the general public as well, while the Australians did not. The Italian jurors believe that providing the public with complete information through a national campaign could foster awareness in a possible decision on PSA screening; while the Australian jurors believe it could cause unnecessary anxiety and alarm among men not interested in doing the test. To assess the generalizability of these opinions other juries need to be organized in different settings and countries—comparing the process, the information provided and the rationale for deliberation.

The jury’s deliberation agrees with most of the literature, learned societies, and public health orientation, but contrasts with clinical practice [9,11,13,14,20,36]. Evidence-based information campaigns and projects for health workers and the general population are needed to increase awareness about this kind of healthcare topics [37].

Appendix A The Information for the Jury

The sections of the booklet

  • Description of the project and main question for deliberation
  • What is the PSA test
  • PSA test for prostate cancer screening—benefits and harms, estimate of costs, a table summarizing international and national guidelines
  • General information about screening and over-diagnosis
  • General information about prostate cancer, its incidence and prevalence in Italy
  • What a citizen jury is and why it was organized on this topic
  • Suggestions on how to find more information with links to web sites
  • Glossary.

Topics covered by experts during the two-day meeting

  • Introduction to the project and the Jury method, the roles and responsibilities of individuals and society relating to health decisions
  • What is prostate cancer, and the epidemiology
  • What is PSA, the decision-making in the clinical setting
  • What is the screening, scientific evidence on the PSA test and screening
  • PSA: early diagnosis and opportunistic screening
  • PSA: results on mortality
  • PSA: overdiagnosis and overtreatment
  • Economic impact of the PSA screening test.

During the two-day meeting speakers tried to use plain language, with easy-to-read slides, following a few simple instructions such as no acronyms, no technical terms without explanation, openness to answer all questions from the jurors, etc.

Overview of the stories presented in the video interviews

All the men interviewed received an opportunistic PSA screening, ultrasound examination, and biopsy. One was given a low-risk diagnosis of cancer and agreed to follow an active surveillance program; the others had a negative result. All described the psychological impact of the clinical process: the first and second were very satisfied at having had the PSA test, the third was more critical. The videos of the two-day meeting are available at http://www.partecipasalute.it/cms_2/giurie-cittadini/prostata/2015.

All the steps and materials were available in a section of the website PartecipaSalute (Giurie dei cittadini: screening per il cancro alla prostata) http://www.partecipasalute.it/cms_2/giurie-cittadini/prostata.

Appendix B

What initiatives should the National Health Service employ to discourage or recommend PSA testing: recommendations, guidelines, awareness campaigns, information brochures, incentives or disincentives, other?

Awareness campaigns through the media (public service announcement) about the controversial results of the test.

Actively encouraging a healthy lifestyle as a form of prevention of prostate cancer through the written prescription of preventive measures, such as physical exercise.

Jurors were against asking a patient to sign informed consent before the PSA test because they believed, it would be of little value if not accompanied by good information. Jurors wanted to avoid citizens without an adequate basis for making a choice having to bear the burden of the decision.

Establishing that PSA tests done as individual screening for prostate cancer are to be paid by the citizen.

To whom should the NHS initiatives be targeted: family doctors, specialists, patients' or citizens' associations, general public, other?

Awareness campaigns through the media and directly addressed to the public. Dissemination of information through meetings with citizens promoted by voluntary associations. Information campaigns aimed at general practitioners, through conferences and training courses. Information to urologists was not considered necessary as they were supposed to be already informed.

What information should the NHS provide on PSA as a screening test and to whom should it be addressed?

Information should be provided on the uncertainty of the diagnosis made from the PSA test, false positives and false negatives. It is necessary to explain the consequences of over-diagnosis that may lead to deterioration in the patient's quality of life with no real benefits in terms of life expectancy. However, it is important that the information is complete, mentioning that the PSA test can save lives but that for every life saved dozens of people will face over-diagnosis and over-treatment and may suffer urinary incontinence and impotence. It is also useful to provide information on the lifestyles that have proved useful in reducing the incidence of prostate cancer such as not smoking, exercising, eating a balanced diet and so on.

How should the quality and the independence from commercial or industry interests of the initiatives and information provided by the NHS be ensured?

Information should only be provided by public services concerned only with health. On informative tools no brands of pharmaceutical companies or manufacturers of devices or other medical products should appear.

Acknowledgments

We thank Dr. Nadia Oprandi for facilitating the Citizens’ jury process, the members of the Jury [Armando Alberghini, Fabio Bellelli, Alberto Bignardi, Daniela Capoferri, Ousmane Cisse, Enio Concari, Paolo Diazzi, Sonia Ferrarini, Roberta Maggiolo, G. Franco Malavasi, Patrizia Pavoni, Amerigo Soranna, Loredana Valentini], the Promoters [Fulvio Moirano, Agenas • Roberto D’Amico, Centro Cochrane Italiano • Giovanni Caracci, Agenas], the Steering Committee [Roberto Bordonaro, Regione Sicilia • Roberta Bottai, Regione Toscana, Settore Qualità dei servizi e partecipazione del cittadino • Giulia Candiani, Agenzia di editoria scientifica Zadig • Monica Daghio, ASL Modena, Laboratorio Cittadino Competente, Sistema Comunicazione e Marketing Sociale • Gianfranco Domenighetti, Università Svizzera Italiana, Comunicazione ed Economia Sanitaria • Giuseppe Fattori, ASL Modena, Sistema Comunicazione e Marketing Sociale • Alfonso Mele, Istituto Superiore di Sanità, Sistema Nazionale Linee Guida • Marco Menchini, Regione Toscana, Settore Qualità dei servizi e partecipazione del cittadino • Giuseppe Murolo, Regione Sicilia • Augusta Nicoli, Agenzia Sanitaria e Sociale Regionale Emilia-Romagna • Luigi Reale, Fondazione ISTUD], and the Scientific Committee [Maurizio Cancian, SIMG Società Italiana di Medicina Generale • Daniela Condorelli, giornalista • Gennaro De Cristofaro, Associazione Europa Uomo • Alberto Donzelli, Azienda ASL Milano • Francesco Francesca, Azienda Ospedaliero Universitaria Pisana (U.O. Urologia) • Claudia Galassi, A.O. Città della Salute e della Scienza, CPO Piemonte • Antonio Gaudioso, Cittadinanzattiva Onlus • Giovanni MandolitiAssociazione Italiana Radioterapia Oncologica, AIRO • Silvana Quadrino, Istituto Change • Francesco Ricci, Associazione Italiana di Oncologia Medica AIOM • Massimo Tombesi, Centro Studi e Ricerche in Medicina Generale • Riccardo Valdagni, Istituto Nazionale Tumori programma Prostata, Società Italiana di Urologia Oncologica SIURO • Marco Zappa, ONS Osservatorio Nazionale Screening] for their participation.

Author Contributions

Conceived and designed the experiments: PM RS. Performed the experiments: PM CC. Analyzed the data: PM CC. Wrote the paper: PM CC RS SC.

References

  1. 1. Globocan. Available: http://globocan.iarc.fr/Pages/fact_sheets_population.aspx. Accessed 12 March 2015.
  2. 2. Ilic D, Neuberger MM, Djulbegovic M, Dahm P. Screening for prostate cancer. Cochrane Database of Systematic Reviews 2013; Issue 1. Art. No.: CD004720.
  3. 3. Schroder FH, Hugosson J, Roobol MJ, Tammela TLJ, Ciatto S, Nelen V, et al for the ERSPC Investigators. Screening and prostate-cancer mortality in a randomized European study. N Engl J Med 2009; 360:1320–1328.
  4. 4. Andriole GL, Crawford ED, Grubb RL III, Buys SS, Chia D, Church TR, et al. PLCO Project Team. Mortality Results from a Randomized Prostate-Cancer Screening Trial. N Engl J Med 2009; 360:1310–1319. pmid:19297565
  5. 5. Djulbegovic M, Beyth RJ, Neuberger MM, Stoffs TL, Vieweg J, Djulbegovic B, et al. Screening for prostate cancer: systematic review and metanalysis of randomized controlled trials. BMJ 2010; 341:c4543. pmid:20843937
  6. 6. Chou R, Croswell JM, Dana T, Bougatsos C, Blazina I, Fu R, et al. Screening for prostate cancer; a review of the evidence for the US Preventive Services Task Force. Ann Intern Med 2011; 155:762–771. pmid:21984740
  7. 7. Carlsson S, Assel M, Sjoberg D, Ulmert D, Hugosson J, Lilja H, et al. Influence of blood prostate specific antigen levels at age 60 on benefits and harms of prostate cancer screening: population based cohort study. BMJ 2014;348:g2296. pmid:24682399
  8. 8. Andriole GL. Screening for prostate cancer. BMJ 2010; 341:c4538. pmid:20843936
  9. 9. McCarthy M. Evidence does not support routine PSA testing, say experts. BMJ 2013; 346:f2982. pmid:23661116
  10. 10. Lenzer J, Brownlee S. US expert panel recommends against prostate cancer screening. BMJ 2011; 343:d6479. pmid:21987717
  11. 11. American Urological Association. AUA. Releases new clinical guideline on prostate cancer screening. Available https://www.auanet.org/advnews/press_releases/article.cfm?articleNo=290. Accessed 10 March 2015.
  12. 12. Heidenreich A, Abrahamsson PA, Artibani W, Catto J, Montorsi F, Van Poppe H, et al. Early detection of prostate cancer. European Association of Urology recommendation. Eur Urol 2013; 64:347–354. pmid:23856038
  13. 13. Moyer VA. US Preventive Service Task Force. Screening for prostate cancer: US Preventive Service Task Force recommendation statement. Ann Inter Med 2012; 157:120–134.
  14. 14. The UK NSC policy on Prostate cancer screening/PSA testing in men over the age of 50. Available: http://www.screening.nhs.uk/prostatecancer. Accessed 4 March 2015.
  15. 15. Wilt TJ, Dahm P. PSA screening for prostate cancer. BMJ 2014; 348:g2559. pmid:24736396
  16. 16. Stiggelbout AM, Van der Weijden T, De Wit MPT, Frosch D, Légaré F, Montori VM, Trevena L, Elwyn G. Shared decision making: really putting patients at the centre of healthcare. BMJ 2012; 344
  17. 17. Hayes JH, Barry MJ. Screening for prostate cancer with the prostate-specific Antigen Test. A review of current evidence. JAMA 2014; 311:1143–1149. pmid:24643604
  18. 18. Merestein D. A piece of mind. Winners and losers. JAMA 2004; 291:15–16.
  19. 19. Hamoen EHJ, Reukers DFM, Numans ME, Barentsz JO, Witjes JA, Rovers MM. Discrepancies between guidelines and clinical practice regarding prostate-specific antigen testing. Family Practice 2013; 30:648–654. pmid:24107269
  20. 20. American Academy of Family Physicians. Fifteen Things Physicians and Patients Should Question # 13. Available: http://www.choosingwisely.org/doctor-patient-lists/american-academy-of-family-physicians/. Accessed 10 March 2015.
  21. 21. D'Ambrosio GG, Campo S, Cancian M, Pecchioli S, Mazzaglia G. Opportunistic prostate-specific antigen screening in Italy: 6 years of monitoring from the Italian general practice database. Eur J Cancer Prev 2010; 19:413–416. pmid:20679895
  22. 22. Management of early detection for prostate cancer (in Italian Gestione dei percorsi di diagnosi precoce per il tumore alla prostata). Available: http://www.osservatorionazionalescreening.it/content/gestione-dei-percorsi-di-diagnosi-precoce-il-tumore-alla-prostata. Accessed 9 March 2015.
  23. 23. Mosconi P, Castellani C, Villani W, Satolli R. Cystic fibrosis: to screen or not to screen? Involving a Citizens’ jury in decisions on screening carrier. Health Expect 2014
  24. 24. Rychetnik L, Carter SM, Abelson J, Thornton H, Barratt A, Entwistle VA, et al. Enhancing citizen engagement in cancer screening through deliberative democracy. J Natl Cancer Inst 2013; 105(6):380–386. Epub 1 February 2013.
  25. 25. Lenaghan J New B, Mitchell E. Setting priorities: is there a role for citizens’ juries. BMJ 1996; 312:1591–1593. pmid:8664672
  26. 26. Elwood P, Longley M. My health: whose responsibility? A jury decides. J Epidemiol Community Health 2010; 64:761–764. pmid:19897471
  27. 27. Mosconi P, Colombo C, Satolli R, Liberati A. PartecipaSalute, an Italian project to involve lay people, patients’ associations and scientific-medical representatives on the health debate. Health Expect 2007; 10:194–204.
  28. 28. Agenas. Available: http://www.agenas.it/. Accessed 5 March 2015.
  29. 29. Daghio MM, Fattori G. Citizens involvement in health communication. The experience of the Laboratory for the competent citizens AUSL Modena (in Italian: Il coinvolgimento dei cittadini nella comunicazione per la salute. L'esperienza del laboratorio per il cittadino competente dell'Ausl di Modena). Salute e Società 2007; 10:158–167.
  30. 30. Rychetnik L, Doust J, Thomas R, Gardiner R, MacKenzie G, Glasziou P. A Community Jury on PSA screening: what do well-informed men want the government to do about prostate cancer screening—a qualitative analysis. BMJ Open 2014, 4:e004682.
  31. 31. Henderson J, House E, Coveney J, Meyer S, Ankeny R, Ward P, et al. Evaluating the use of citizens’ juries in food policy: a case study of food regulation. BMC Public Health 2013; 13:596. pmid:23782688
  32. 32. Paul C, Nicholls R, Priest P, McGee R. Making policy decisions about population screening for breast cancer: the role of citizens' deliberation. Health Policy 2008; 85:314–320. Epub 2007 Oct 10. pmid:17931738
  33. 33. Abelson J, Forset PG, Eyles J, Smith P, Martin E, Gauvin FP. Deliberations about deliberative methods: issues in the design and evaluation of public participation processes. Social Science & Medicine 2003; 57:239–251.
  34. 34. Citizens jury handbook. The Jefferson Center 2004. Available: http://www.epfound.ge/files/citizens_jury_handbook.pdf. Accessed 5 March 2015.
  35. 35. Mosconi P, Satolli R, Colombo C, Carzaniga S, Caracci G on behalf to the Steering Committee and the Scientific Committee. Citizens' juries in health: the case of the model of screening for prostate cancer (in Italian: Giurie di cittadini per la salute: il caso modello dello screening per il carcinoma della prostata). Rivista Società Italiana di Medicina Generale 2013; 3:11–13.
  36. 36. Katz MH. Can we stop ordering prostate-specific antigen screening tests? JAMA Intern Med 2013; 173:847–848. pmid:23588841
  37. 37. Domenighetti G, D'Avanzo B, Egger M, Berrino F, Perneger T, Mosconi P, et al. Women's perception of the benefits of mammography screening: Population-based survey in four countries. Int J Epidemiol 2003; 32:816–821. pmid:14559757