ORIGINAL ARTICLES AND REVIEWS

 

HPV vaccination acceptability in young boys

 

 

Giancarlo Tisi; Federica Salinaro; Pietro Apostoli; Raffaella Bassani; Anna Bellicini; Lavinia Groppi; Paolo Donarini; Sergio Pecorelli

Università degli Studi di Brescia, Brescia, Italy

Address for correspondence

 

 


ABSTRACT

PURPOSE: The aim of this study was to evaluate the comprehension and acceptance of HPV vaccination in parents of adolescent boys aged 11 to 15 years.
METHODS: A cross-sectional survey was conducted by means of questionnaires sent directly to the homes of all families with young males aged between 11 and 15, residents of three municipalities of the Province of Brescia, Italy. The documentation also contained an informative leaflet summarizing the HPV-related disease characteristics, the burden of disease and the available strategies for prevention and treatment, illustrating the rationale of vaccination and describing the project and its phases. The questionnaire included questions on demographic data, acceptance and motivations for HPV vaccination. The collected data was analyzed using descriptive statistics. At the end of the study, parents who received the questionnaires were also offered the possibility of vaccinating their male sons for free.
RESULTS: From a total of 1072 questionnaires sent, 161 where returned from the three selected municipalities (average response rate 15%); 97% of adolescent males involved in the study were Italian and 91% Catholic; 97% of parents declared themselves to be willing to vaccinate their sons: the principal motivation given (92%) was prevention of the disease, cancerous or not, related to viral infection. Among the respondents not willing to vaccinate their sons, the motivation was lack of information about the vaccine and the disease. At the end of the study, around 71 boys were vaccinated.
DISCUSSION: To our knowledge, this is the first survey in Italy exclusively conducted on parents of adolescent males about the acceptability and feasibility of vaccination against HPV: a very high percentage of respondents was favorable to accept the vaccination for their sons, the main motivation being the fact that parents considered protecting their sons from HPV-related diseases highly important. Of the 161 boys targeted by the questionnaire, 71 decided to receive the 3 doses of HPV vaccination (44%). Data suggests that HPV vaccination is acceptable to families for their male sons and that information is important in the decision-making process.

Key words: HPV vaccine, young male, cervical cancer, vaccine acceptability, public health system HPV vaccination, STI


 

 

INTRODUCTION

Human Papilloma Virus (HPV) is the cause of the most common sexually transmitted infection in the world. Males, as well as females, have an important role in the transmission of HPV. HPV DNA can be detected in the cervical tissue in up to 45% of women 20-24 years of age [1-5]. In men, the prevalence ranges from 20 to 65% and is high at all ages [6, 7-10] and are related to oral cancers in around 25-35% of cases, anal cancer in 90% of cases, and penile cancer in 40% of cases [9]. In a recent publication it has been estimated that in Europe more than 340 000 cases/year of HPV vaccine-preventable diseases affect only women. A similar number is also evidenced in men (including more than 320 000 cases of genital warts, 12 000 cases of head and neck cancer, more than 1600 cases of anal cancer and around 1000 cases of the penile cancer [8, 9, 11, 12].

In the USA in October 2011, following the approval of the quadrivalent vaccine use also on males, the American Centers for Diseases Prevention and Control (CDC) recommended that young boys as well as girls should get immunised against HPV [13]. The same was recommended in Canada by the National Advisory Committee on Immunization (NACI) [14] and in Australia [15] by the Pharmaceutical Benefits Advisory Committee (PBAC), even if Australia had high vaccine coverage in females and herd immunity was expected and demonstrated. Surveys conducted with different methodologies on the general male population at risk or over 18 years have shown varying degrees of knowledge and acceptability of HPV vaccination [16-25]. In Italy, in a survey conducted among high school students and their parents, both mothers and fathers (68% and 65% respectively) were willing to vaccinate their children.

In order to propose new vaccination strategies and ensure high acceptability and coverage, research is essential in terms of population needs and acceptability in order to better understand and implement vaccination strategies accordingly. Current research about the attitudes and acceptance of an HPV vaccine has largely focused on females [26-28]. As regards females, studies also correlate awareness with acceptability and demonstrate that awareness campaigns of any kind consistently raised acceptability to vaccinate [29]. Considerably less is known about acceptance of HPV vaccine for males although every day new data is being produced worldwide. A recent study review of available published literature on acceptability among parents, health care providers and young males concluded that acceptability median was around 74%. It also stressed the small number of studies available on males and the urgent need for new studies that incorporate more recent data on HPV-related diseases and recent vaccine efficacy in order to correctly evaluate acceptability [30]. Another study found that acceptability improved when parents received information about the diseases, advantages and importance of vaccination [31]. When information was given to males between 18-26 years of age, results showed that irrespective of the HPV message (whether it was centred on genital warts, female HPV diseases or head and neck HPV cancers) intent to be vaccinated increased [32]. In the USA parents seem to want to vaccinate their male sons. Recently a study showed that from a sample of parents, 62% answered the questionnaires about intention to vaccinate, from which 90% declared they wanted to vaccinate their sons [33]. Recently in England there has been a change in the use of HPV vaccine; now they use the quadrivalent vaccine, which is approved for use in males and females, primarily to offer also protection against genital warts. This has raised several questions about male vaccination possibility in England and from a recent survey conducted among boys between 16-18 years old attending school, showed that HPV vaccine is also accepted among this population and that information about disease implications is vital to increase acceptance [34].

In Italy data about HPV vaccination acceptability in females is scarce and little is known about males. One study, centred on females aged 18 to 26 years to evaluate acceptability feasibility in Italy, showed that where vaccination was offered for free to this age range at least 56% of the population interviewed received one vaccine shot when offered actively by the local health system [35]. Previous Italian research data about vaccination offer to both genders conducted by school based questionnaire about HPV knowledge and vaccine acceptability concluded that Italian students and parents tend to underestimate the likelihood of HPV infection and the importance of the burden of HPV-related diseases [36]. The purpose of this study was to evaluate the understanding and acceptance of HPV vaccination on parents of adolescent boys aged 11 to 15 years by means of questionnaires sent directly to their homes.

 

METHODS

The Ethics Committee of the Hospital of Brescia approved the survey on January 11, 2011 as a no-profit, no-sponsorized study.

A questionnaire was prepared by the authors of the study, and was printed by INFORMA-CRO srl. A copy of this questionnaire, both in Italian and in English, can be sent on request contacting the corresponding author at: dott.tisi@gmail.com.

From March 2011 to September 2011 information leaflets on HPV burden of disease and questionnaires to evaluate vaccine acceptability were sent to all families with young males aged between 11 and 15, residents of three municipalities of the Province of Brescia, Italy (Montichiari, Orzinuovi and Roncadelle).

The list of families with male adolescents was obtained from the registry lists of Brescia residents, provided by the previously selected municipalities. Families were also made aware that their local pediatricians and general practitioners were informed that the survey was taking place. A free phone line was also activated, operated by trained physicians coordinated by the department of gynecology and obstetrics, in case further information on HPV-related diseases was required by the families receiving the questionnaire. Taking into consideration that some families already had a basic acquired knowledge of HPV diseases and of the vaccination offered to girls by the National Health System yet none or little on the possibility of also vaccinating males, the educational content was centered on males and their burden of disease, The information leaflet was divided into different sections summarizing the disease characteristics, the burden of disease and the available strategies for prevention and treatment, illustrating the rationale of vaccination, the project and its phases and listing in detail what was being asked to the families about the project. All of this was supported by detailed information and didactic diagrams.

The questionnaire contained questions on demographics data (place of birth, municipality of residence, education, profession and age of the parents), willingness to accept or not the proposed vaccination and provided several options for returning the finished questionnaire: either to the hospital help desk, by fax, through a dedicated internet based website or by phone calling the toll-free number, which was also activated to offer answers to all doubts about the disease or the project. Each questionnaire was anonymous, although a unique numeric code was necessary in order to identify the study's population cohort that answered the questionnaire. The collected data was analyzed using descriptive statistics (mean, standard deviation for continuous variables and absolute and percentage distributions for discrete variables).

In January 2011, the quadrivalent anti HPV vaccine summary product characteristic (SPC) already included vaccine immunogenicity data on children and adolescents irrespective of the sex ("Il vaccino produce inoltre la formazione di anticorpi in bambini ed adolescenti di eta compresa tra 9 e 15 anni") this evidence of immunogenicity also in males younger than 14 years of age permitted that parents who received the questionnaires

were also offered the possibility of vaccinating their male sons for free with the quadrivalent HPV vaccine (types 6, 11, 16, 18). In June 23 2011, "Gardasil" was authorized for males up to 26 years of age and in September 2011, following the survey, we started to vaccinate all responders willing to receive the vaccine.

 

RESULTS

A total of 161 completed questionnaires were returned, from a total of 1072 questionnaires sent. The average response rate, regardless of municipality of residence, was 15%: 15.5% specific to the Montichiari municipality (87/562), 12.7% for Orzinuovi municipality (41/322) and 17.5% for Roncadelle municipality (33/188).

Table 1 shows the distribution of parents in relation to selected socio-demographic characteristics. The questionnaire was completed mainly by mothers, around 85%. The fathers resulted to be in general older than the mothers, respectively, 54% of fathers and 32% of mothers reported an age > 45 years. 57% of the mothers and 52% of the fathers had a high school diploma and the majority of the mothers declared themselves to be housewives (38%) while the majority of fathers (33%) were workers.

Table 2 shows the characteristics of the adolescent males between 11 and 15 years of age involved in the study: 96% were Italian and 91% Catholic. The average age was 13 years of age, 67% attended middle school. The majority, 60%, had only one other sibling, 22% were an only child, the remaining 20% had more than one brother or sister. From the whole population, 43% declared themselves to have at least one sister already vaccinated against HPV.

 

 

A big proportion of parents, 97%, declared themselves to be willing to vaccinate their sons if the vaccine was proposed or available to them for free: the principal given motivation was prevention of any disease, this included pre-cancerous lesions, cancer or benign lesions such as genital warts, related to HPV infection (92%), followed by feeling that it was right to offer the vaccine equally to both genders (5%). Only 6 families, (3%) rejected the proposed vaccine giving as motivation that there is not enough information available about the vaccine. In 80% of cases the only available information they had the chance to come upon, in order to understand HPV infection and impact, was the informational leaflet attached to the questionnaire itself.

At the end of the study (October 31, 2011), all subjects that actively contacted our call center were vaccinated. We were not allowed to directly invite any subject because the questionnaires returned were anonymous. Around 71 boys were vaccinated (44% of all answered questionnaires).

All received 3 dose vaccination schedules. Doses of the vaccine where provided by the Regional Public Health Office of Lombardy who also authorized this vaccination program on May 23, 2011.

 

DISCUSSION

Extending vaccination to boys will not only protect males but it will also reduce rates of HPV related cases among females (via herd immunity). In some countries, local health authorities have already taken into consideration the previous unknown HPV burden in males and have started to offer vaccination campaigns also for males. The United States of America, Australia and Canada are among the first countries to recommend and offer routine vaccination in boys too [13-15].

This is the first survey in Italy exclusively conducted on parents of adolescent males about the acceptability and feasibility of vaccination against HPV infection: it was possible to propose an active offer of vaccination, even if only through a written communication, involving families of the three municipalities. A total response rate of 15%, for a questionnaire that was sent by traditional mail can be considered a good rate [22], also considering that no other active intervention was programmed to remind families to complete the questionnaire, such as telephone calls or an eventual reminder letter, nor any type of information about the possibility of vaccination offer of males; in this sense studies have observed that additional actions exponentially increase the answer rates of a survey [37]. According to the observational target of the study, returned questionnaires were anonymous, so a second call was not performed to non responders.

The study was designed by University of Brescia according to Spedali Civili of Brescia Ethic Committee. The source of information from public health Institutions probably determined a very high (97%) proportion of respondents willing to vaccinate their male sons. The main motivation being the fact that they considered the disease of high importance also for males having the right to receive the vaccine. It should be noted that, at present, the medical community and public opinion in Italy consider HPV vaccination to be a vaccine needed and indicated exclusively to females. The results also showed that among respondents not willing to vaccinate their sons, the motivation was lack of information about the vaccine and the disease. We have also to affirm that the high proportion of parents in favour of vaccination may be a bias due to the high percentage of ones having a daughter already vaccined: probably only already sensibilized people participated the survey. On these bases, we suppose that a more invasive campaign, than a simple informative leaflet on the disease risks, might obtain a better response rate.

The results obtained emphasize some aspects, which are at the base of the external limits found in order to implement a working vaccination offer. Due to the fact that the information campaign was necessarily and deliberately non-invasive (no further actions were taken to increase response rates), it was not possible to collect socio-demographic information on the non respondents. Also, the fact that the results relate to a small, selected area of Italy makes it difficult to extend the results to the entire country. Moreover, the high rate of acceptance of vaccination among respondents creates a bias: usually families that find the time to answer the questionnaire have already a predisposition to the importance of the vaccine, showing interest about the disease predisposes them to answer positively to a possible offer. In the future greater efforts are needed to inform the population about the disease burden and importance of vaccination campaigns. Overall acceptability in males seems to be quite high in this particular area of Italy.

Following the survey, we also measured feasibility by offering the vaccine free of charge to the families that declared to be willing to vaccinate their male sons. Out of 161 boys potentially eligible for the HPV vaccination and targeted through the questionnaire, 71 have decided to receive the 3 doses of HPV vaccination (44%).

The relatively low percentage of vaccinated subjects, which also declared themselves in favour of vaccination, could be explained as follows:

1) a direct call was not performed: all the questionnaires returned were anonymous so we were not able to directly call the subjects. We offered the vaccinations to all the subjects that actively have called our Center (the procedure was clearly explained in the information given with the questionnaires);

2) the vaccination offer were performed when the collection of all questionaires was concluded, so we started the vaccinations about 4-6 motnhs after the subjects had responded. Without the possibility to remember them about this offer, it was easy to forget it after 4-6 months. In reality, a large number of subjects called our Center after the closure of the Study asking to be vaccinated, unluckily they self declared to have not received the letter and that they found out from classmates that were vaccinated, so we were not able to offer them the vaccination for free.

We suppose that a better percentage of response could have been improved by an active invitation with a direct call to subjects' parents.

Throughout the vaccinated population, no adverse effects were reported and all of them completed the 3 dose schedule. This proves acceptability from parents and sons who demonstrated high interest in getting vaccinated after an invitation letter and in turn makes us think that an active and free offer also to males, which would make HPV vaccination a non-gender based vaccination, could be quite feasible taking into consideration the good response obtained. Most likely, having a universal vaccination would also boost female coverage. Request for vaccination did not only come from the informed families, but after the study ended, several requests from other families of the three municipalities were received to vaccinate their sons. The good feedback of all participating subjects and the absence of any adverse or unexpected event could have increased the interest of parents of classmates and friends of vaccinated young males. This change of mind in parents that did not respond to our initial vaccination purpose suggests that an active call program could obtain good acceptance.

Given the importance shown by the informative material sent to the families about the disease epidemiology and importance of vaccination, it seems necessary to start promoting educational interventions on the population more actively, in order to increase and improve knowledge about the disease and the benefits that a universal anti-HPV vaccination can produce.

Acknowledgements

The study was conducted with the sponsorship and support of the University of Brescia and with funding made available by private entities (Sanofi Pasteur MSD) and the Lombardy Region (AO Civil Hospital of Brescia).

Conflict of interest statement

The authors declare that no competing interests exist.

 

REFERENCES

1. Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, Snijders PJ, Peto J, Meijer CJ, Muñoz N. Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol 1999;189(1):12-9. DOI: 10.1002/(SICI)1096- 9896(199909)189:1<12::AID-PATH431>3.0.CO;2-F        

2. Onon TS. History of human papillomavirus, warts and cancer: what do we know today? Best Pract Res Clin Obstet Gynaecol 2011;25(5):565-74. DOI: 10.1016/j.bpobgyn. 2011.05.001        

3. De Vuyst H, Clifford GM, Nascimento MC, Madeleine MM, Franceschi S. Prevalence and type distribution of human papillomavirus in carcinoma and intraepithelial neoplasia of the vulva, vagina and anus: a meta-analysis. Int J Cancer 2009;124(7):1626-36. DOI: 10.1002/ ijc.24116        

4. Dunne EF, Unger ER, Sternberg M, McQuillan G, Swan DC, Patel SS, Markowitz LE. Prevalence of HPV infection among females in the United States. JAMA 2007;297(8):813-9. DOI: 10.1001/jama.297.8.813        

5. Smith JS, Melendy A, Rana RK, Pimenta JM. Agespecific prevalence of infection with human papillomavirus in females: a global review. J Adolesc Health 2008t;43(4 Suppl):S5-25, S25.e1-41. DOI: 10.1016/j. jadohealth.2008.07.009        

6. Giuliano AR, Lee JH, Fulp W, Villa LL, Lazcano E, Papenfuss MR, Abrahamsen M, Salmeron J, Anic GM, Rollison DE, Smith D. Incidence and clearance of genital human papillomavirus infection in men (HIM): a cohort study. Lancet 2011;377(9769):932-40. DOI: 10.1016/ S0140-6736(10)62342-2        

7. Barroso LF 2nd, Wilkin T. Human papillomavirus vaccination in males: the state of the science. Curr Infect Dis Rep 2011;13(2):175-81. DOI: 10.1007/s11908-010- 0163-7        

8. World Health Organization. WHO-WORLD Human Papillomavirus and related cancers ssummary report update. WHO; 2010. Available from: www.who.int/hpvcentre.         

9. Parkin M. The burden of HPV-related cancers. Vaccines 2006;S3/11-S3/25. DOI: 10.1016/j.vaccine.2006.05.111        

10. Hoots BE, Palefsky JM, Pimenta JM, Smith JS. Human papillomavirus type distribution in anal cancer and anal intraepithelial lesions. Int J Cancer 2009;124(10):2375- 83. DOI: 10.1002/ijc.24215        

11. Hartwig S, Syrjänen S, Dominiak-Felden G, Brotons M, Castellsagué X. Estimation of the epidemiological burden of human papillomavirus-related cancers and nonmalignant diseases in men in Europe: a review. BMC Cancer 2012;12:30. DOI: 10.1186/1471-2407-12-30        

12. Centers for Disease Control and Prevention. MMWR 2012;61(15):253-80.         

13. Advisory Committee on Immunization Practices (ACIP). Recommendations in the use of quadrivalent human papillomavirus vaccine in males. MMWR 2011;60(50):1705-78.         

14. An advisory Committee Statement (ACS), National Advisory Committee on Immunization (NACI). Update on human papillomavirus (HPV) vaccines. CCDR 12;37:1-62.         

15. Australian Government Department of Health and Ageing. Immunise Australia Program. Human papillomavirus (HPV). Australian Government. Available from: www.immunise. heath.gov.au/internet/immunise/publishing.nsf/ Content/immunise-hpv.         

16. Reiter PL, Brewer NT, McRee AL, Gilbert P, Smith JS. Acceptability of HPV vaccine among a national sample of gay and bisexual men. Sex Transm Dis 2010;37(3):197- 203. DOI: 10.1097/OLQ.0b013e3181bf542c        

17. Dahlström LA, Sundström K, Young C, Lundholm C, Sparén P, Tran TN. Awareness and knowledge of human Papillomavirus in the Swedish adult population. J Adolesc Health 2012;50(2):204-6. DOI: 10.1016/j.jadohealth. 2011.05.009        

18. Hernandez BY, Wilkens LR, Thompson PJ, Shvetsov YB, Goodman MT, Ning L, Kaopua L. Acceptability of prophylactic human papillomavirus vaccination among adult men. Human Vaccines 2010;6(6):467-75. DOI: 10.4161/ hv.6.6.11279        

19. Young AM, Crosby RA, Jagger KS. Influences on HPV vaccine acceptance among men in the Philippines. JMH 2011;8(2):126-35. DOI: 10.1016/j.jomh.2011.01.007        

20. Gerend MA, Barley J. Human pappilomavirus vaccine acceptability among young adult men. Sex Transm Dis 2009;36(1):58-62. DOI: 10.1097/OLQ.0b013e31818606fc        

21. Sundström K, Tran TN, Lundholm C, Young C, Sparén P, Dahlström LA. Acceptability of HPV vaccination among young adults aged 18-30 population based survey in Sweden. Vaccine 2010;28(47):7492-500. DOI: 10.1016/j.vaccine. 2010.09.007        

22. Di Giuseppe G, Abbate R, Liguori G, Albano L, Angelillo IF. Human papillomavirus and vaccination: knowledge, attitudes, and behavioural intention in adolescents and young women in Italy. British Journal of Cancer 2008;99:225-9. DOI:10.1038/sj.bjc.6604454        

23. Waller J, Marlow LA, Wardle J. Mothers' attitudes towards preventing cervical Cancer through human papillomavirus vaccination: A qualitative study. Cancer Epidemiol Biomarkers Prev 2006;15(7);1257-61. DOI: 10.1158/1055-9965.EPI-06-0041        

24. Trim K, Nagji N, Elit L, Roy K. Parental knowledge, attitudes, and behaviours towards human papillomavirus vaccination for their children: A Systematic Review from 2001 to 2011. Obstet Gynecol Int 2012;921236. DOI: 10.1155/2012/921236        

25. Brisson M, van de Velde N, Franco EL, Drolet M, Boily MC. Incremental impact of adding boys to current human papillomavirus vaccination programs: role of herd immunity. J Infect Dis 2011;204(3):372-6. DOI: 10.1093/ infdis/jir285        

26. Black LL, Zimet GD, Short MB, Sturm L, Rosenthal SL. Literature review of human papillomavirus vaccine acceptability among women over 26 years. Vaccine 2009;27(11):1668- 73. DOI: 10.1016/j.vaccine.2009.01.035        

27. Brewer NT, Fazekas KI. Predictors of HPV vaccine acceptability: a theory-informed, systematic review. Prev Med 2007;45(2-3):107-14. DOI: 10.1016/j. ypmed.2007.05.013        

28. Zimet GD, Liddon N, Rosenthal SL, Lazcano-Ponce E, Allen B. Chapter 24: Psychosocial aspects of vaccine acceptability. Vaccine 2006;24(Suppl 3):S3/201-9. DOI: 10.1016/j.vaccine.2006.06.017        

29. Kyung Do Y, Ker Yi Wong. Awareness and acceptability of human papillomavirus vaccine: an application of the instrumental variables bivariate probit model. BMC public health 2012;12:31. DOI: 10.1186/1471-2458-12-31        

30. Reiter PL, Brewer NT, Smith JS. Human papillomavirus knowledge and vaccine acceptability among a national sample of heterosexual men. Sex Transm Infect 2010;86(3):241-6. DOI: 10.1136/sti.2009.039065        

31. Gainforth HL, Cao W, Latimer-Cheung AE. Message framing and parents intentions to have their children vaccinated against HPV. Public Health Nursing 2012;29(6):542- 52. DOI: 10.1111/j.1525-1446.2012.01038.x        

32. DiClemente RJ, Crosby RA, Salazar LF, Nash R, Younge S. Is male intent to be vaccinated against HPV a function of the promotion message? Int J STD AIDS 2011;22:332- 4. DOI: 10.1258/ijsa.2011.010429        

33. Dempsey AF, Butchart A, Singer D, Clark S, Davis M. Factors associated with parental intentions for male Human Papillomavirus vaccination: Results of a national survey. Sex Transmit Dis 2011;38(8):769-76. DOI: 10.1097/ OLQ.0b013e318211c248        

34. Forster AS, Marlow LA, Wardle J, Stephenson J, Waller J. Interest in having HPV vaccination among adolescent boys in England. Vaccine 2012;30:4505-10. DOI: 10.1016/j.vaccine.2012.04.066        

35. Giambi C, Donati S, Declich S, Salmaso S, Degli Atti ML, Alibrandi MP, Brezzi S, Carozzi F, Collina N, Franchi D, Lattanzi A, Meda M, Minna MC, Nannini R, Scherillo I, Bella A; PreGio Working Group. Estimated acceptance of HPV vaccination among Italian women aged 18-26 years. Vaccine 2011;29(46):8373-80. doi:10.1016/j.vaccine.2011.08.079. DOI: 10.1016/j.vaccine. 2011.08.079        

36. Pelucchi C, Esposito S, Galeone C, Semino M, Sabatini C, Picciolli I, Consolo S, Milani G, Principi N. Knowledge of human papilloma virus infection and its prevention among adolescents and parents in the greater Milan area, Northern Italy. BMC Public Health 2010;10:378. DOI: 10.1186/1471-2458-10-378        

37. Busse JW, Walji R, Wilson K. Parents' experiences discussing pediatric vaccination with healthcare providers: A survey of Canadian naturopathic patients. PLoS One 2011;6(8):e22737. DOI: 10.1371/journal.pone.0022737        

 

 

Address for correspondence:
Giancarlo Tisi
Spedali Civili di Brescia
Piazzale Spedali Civili 1
25123 Brescia, Italy
E-mail: dott.tisi@gmail.com

Received on 6 February 2013.
Accepted on 19 June 2013.

Istituto Superiore di Sanità Roma - Rome - Italy
E-mail: annali@iss.it