ORIGINAL

 

Cultural adaptation of the Latin American version of the World Health Organization Composite International Diagnostic Interview (WHO-CIDI) (v 3.0) for use in Spain

Adaptación cultural de la versión latinoamericana de la WHO Composite International Diagnostic Interview (WHO-CIDI) (v 3.0) para su uso en España

 

 

Fernando Navarro-Mateua,b, Inés Morán-Sáncheza, Jordi Alonsob,c, Ma José Tormob,d, Ma Luisa Pujaltea, Ascensión Garrigaa, Sergio Aguilar-Gaxiolae and Carmen Navarrob,d

aUnidad de Docencia, Investigación y Formación en Salud Mental (UDIF-SM), Subdirección General de Salud Mental y Asistencia Psiquiátrica, Servicio Murciano de Salud, Murcia, Spain
bCIBER de Epidemiología y Salud Pública (CIBERESP), Spain
cInstitut d'Investigació Médica de l'Hospital del Mar (IMIM), Barcelona, Spain
dServicio de Epidemiología, Consejería de Sanidad y Consumo de Murcia, Murcia, Spain
eCenter for Reducing Health Disparities and Department of Internal Medicine, University of California, Davis, Sacramento, CA, USA

This work has been financed by the Murcian Health Service, the Cajamurcia Foundation and the Foundation for Healthcare Training and Research (FFIS) of the Murcia Region.

Correspondence

 

 


ABSTRACT

Objective: To develop a Spanish version of the WHO-Composite International Diagnostic Interview (WHO-CIDI) applicable to Spain, through cultural adaptation of its most recent Latin American (LA v 20.0) version.
Methods: A 1-week training course on the WHO-CIDI was provided by certified trainers. An expert panel reviewed the LA version, identified words or expressions that needed to be adapted to the cultural or linguistic norms for Spain, and proposed alternative expressions that were agreed on through consensus. The entire process was supervised and approved by a member of the WHO-CIDI Editorial Committee. The changes were incorporated into a Computer Assisted Personal Interview (CAPI) format and the feasibility and administration time were pilot tested in a convenience sample of 32 volunteers.
Results: A total of 372 questions were slightly modified (almost 7% of approximately 5000 questions in the survey) and incorporated into the CAPI version of the WHO-CIDI. Most of the changes were minor - but important - linguistic adaptations, and others were related to specific Spanish institutions and currency. In the pilot study, the instrument's mean completion administration time was 2h and 10min, with an interquartile range from 1.5 to nearly 3h. All the changes made were tested and officially approved.
Conclusions: The Latin American version of the WHO-CIDI was successfully adapted and pilot-tested in its computerized format and is now ready for use in Spain.

Key words: Adaptation. WHO-CIDI diagnostic interview. Mental health. Epidemiology. Survey.


RESUMEN

Objetivo: Desarrollar la versión española de la WHO-Composite International Diagnostic Interview (WHO-CIDI) para su uso en España mediante la adaptación cultural de la versión latinoamericana más reciente disponible (LA; v 20.0).
Métodos: Se realizó un curso de una semana impartido por entrenadores certificados. Un panel de expertos revisó la versión latinoamericana e identificó las palabras o expresiones que requerían ser adaptadas a las normas culturales o linguísticas de España y se propusieron, por consenso, palabras o expresiones alternativas. El proceso fue supervisado y aprobado por un miembro del Comité Editorial de la WHO-CIDI. Los cambios fueron implementados en el formato informatizado CAPI (Computer Assisted Personal Interview). Un estudio piloto en una muestra de conveniencia de 32 voluntarios permitió calcular los tiempos de administración y viabilidad.
Resultados: 372 preguntas fueron modificadas (alrededor de un 7% del total de 5000 preguntas del instrumento completo) e implementadas en la versión CAPI de la WHO-CIDI. La mayoría de las modificaciones fueron adaptaciones lingüísticas menores, pero importantes, y otras se relacionaron con los recursos específicos de España y adaptaciones a la moneda utilizada. En el estudio piloto, la mediana del tiempo de duración de la WHO-CIDI completa fue de 2 horas y 10 minutos, con un rango intercuartil entre 1 hora y 25 minutos y casi 3 horas. Todos los cambios implementados fueron comprobados y aprobados oficialmente.
Conclusiones: La version latinoamericana de la WHO-CIDI ha sido adaptada y el formato informático ha sido pilotado con éxito, estando disponible para su utilización en España.

Palabras clave: Adaptación. WHO-CIDI entrevista diagnóstica. Salud mental. Epidemiología. Encuesta.


 

Introduction

In the last three decades, the field of psychiatric epidemiology has rapidly expanded. One of the contributing factors to this development has been the progressive design, development and application of various highly structured and standardized diagnostic interviews which can be used by lay interviewers with no formal clinical training.1, 2 In the early 1980s, the Diagnostic Interview Schedule (DIS) was the first structured clinical diagnostic interview specifically designed for use by lay trained interviewers who were not clinicians and its purpose was to generate accurate clinical psychiatric diagnoses using computerized algorithms based on the American Psychiatric Association (APA) Diagnostic and Statistical Manual of Mental Disorders 3rd edition (DSM-III) criteria. This instrument was used in the Epidemiologic Catchment Area (ECA) study, the first United States (U.S.) national survey conducted from 1981 to 1984 that ascertained prevalence rates and risk factors of mental disorders in the U.S.3 This landmark project led to replications in other countries as well as to the development of other structured diagnostic interviews, most notably the World Health Organization Composite International Diagnostic Interview (WHO-CIDI, hereafter referred to as CIDI), currently the most widely used mental health diagnostic interview worldwide.4 The CIDI was designed by the World Health Organization (WHO) for the purpose of ascertaining diagnoses based on definitions and criteria based on the WHO International Classification of Disease (ICD) and not exclusively on DSM definitions and criteria. This was particularly important for cross-national comparative research of epidemiological studies of mental illnesses since the ICD is the most widely used international classification system.

The International Consortium of Psychiatric Epidemiology, ICPE (http://www.hcp.med.harvard.edu/icpe/),5 funded by the U.S. National Institute of Mental Health (NIMH) used the CIDI as the diagnostic tool to facilitate cross-national comparisons of epidemiological surveys of mental illness in the general population. The ICPE was the precursor to the WHO sponsored World Mental Health (WMH) Surveys, which initiated in 1999. The primary aim of the WMH Surveys Consortium is to obtain objective estimates of the prevalence of mental disorders, their associated disability, and patterns of treatment by: (1) assessing the global burden of mental disorders; (2) determining the psychosocial risk factors and correlates of mental disorders; (3) establishing mental health utilization patterns; and (4) identifying modifiable barriers to help-seeking by carring out surveys in a representative number of countries in all major regions of the world.6 This consortium has coordinated the performance of CIDI surveys in the general population in more than 28 countries in all continents (http://www.hcp.med.harvard.edu/wmh), including many in Latin America such as México,7, 8 Colombia9 and Perú.10 In this context, the European Study of the Epidemiology of Mental Disorders (ESEMeD) surveys11,12 coordinated the participation of six European countries (Belgium, France, Germany, Italy, Holland and Spain), which was a result of the ICPE experience.

The WHO-Composite International Diagnostic Interview (WHO-CIDI)

The CIDI is a comprehensive and highly-structured interview that comprises nearly 5000 questions divided into 42 sections,4,5,10 and these, in turn, are grouped into two main parts: diagnostic and other sections (Tables 1 and 2). The first includes the clinical part of the interview with an introductory screening section and 22 diagnostic sections that assess different psychiatric conditions. Unlike the rest of the clinical sections which provide ICD or DSM diagnoses, it is recommended that the psychosis section (section number 25)13 and the personality I and II (sections 14 and 27) are used only as screening instruments in the detection of psychosis and personality disorders in general population surveys. The second part includes various (non-clinical) sections which assess utilization of services, use of psychopharmacs, various kinds of functioning, physical chronic conditions, risk factors, social networks, caregiver burden and sociodemographic variables. Some of the sections are used to help establish methodological aspects, such as the selection of the interviewee from the previously chosen household. CIDI is available in two formats: the paper form or PAPI (Paper and Pencil Interviewing) and the computerized form or CAPI. The latter was designed to ease the handling of elaborate skip and complex randomization patterns and to facilitate data entry with a resulting reduction in interview time and errors in data collection and recording.

 

The most recent version of the CIDI (version 3.0) is the end result of a number of international studies and adaptations made since 2000 when the CIDI was first used in the WMH Surveys. It was first created in English and has been translated to more than 30 different languages using the standard WHO protocol with a rigorous process of adaptation in order to obtain conceptually and cross-culturally comparable versions in each of the target countries/languages that included forward and backward translations, review by expert panels, pre-testing using cognitive interview, debriefing techniques, and focus groups.11,14 Several clinical reappraisal studies have been carried out and the concordance of the CIDI version 3.0 has been evaluated in different probability samples of the WMH surveys (France, Italy, Spain and US) with the Structured Clinical Interview for DSM-IV (SCID) as the standardized clinical assessment. A moderate to excellent CIDI-SCID concordance has been found of most mental disorders.15,16 The original Spanish version used in Spain had not been updated since it was used in the context of the ESEMeD project ten years ago. All improvements to the instrument had been added to the Latin American (LA) version, so that the CIDI Latin American (LA) v 20.0 is the CIDI version 3.0 currently used in Spanish-speaking countries (e.g., Colombia). However, due to linguistic and cultural differences in Spanish-speaking target populations, there are some adaptations that needed to be made in applying the CIDI LA v 20.0 in Spain to take into account these differences and to ensure the semantic, idiomatic, experimental and conceptual equivalence.17,18

The aim of our work was the cultural adaptation of the LA CAPI version (v.20.0) of the CIDI instrument (version 3.0) for use in Spain. This was carried out as the first step of the PEGASUS-Murcia (Psychiatric Enquiry to General Population in Southeast Spain-Murcia) project, a general adult population survey of the prevalence of mental illness and its associated psychological, biological and social risk factors in the Murcia Region of Spain.

 

Methods

The cultural and linguistic adaptation process of the CIDI follows a protocol-based pathway and has to be accepted and supervised by the editorial committee of WHO-CIDI.14 In brief, it comprises the following stages (Fig. 1): (1) formal training and accreditation for its use; (2) evaluation of the diagnostic interview by an expert panel; (3) formal acceptance of the proposed changes; (4) adaptation of the software for the CAPI format; and (5) pilot testing the instrument.


Fig. 1. Flow chart of the cultural and linguistic adaptation
of the Latin American WHO-CIDIa version for use in Spain.

 

Stage 1: Formal training and accreditation

The training course for the researchers and interviewers was held in Murcia in December 2008 and was led by a trainer from the WHO-CIDI Training and Reference Centre (TRC) of Mexico and California (http://www.hcp.med.harvard.edu/wmhcidi/trc_americas.php). It comprised a five-day intensive course in which 15 interviewers and supervisors were trained in the use of the instrument. Four researchers were, simultaneously, accredited as trainers for future interviewers exclusively within the PEGASUS-Murcia project. Similarly, an information technology (IT) expert from the National Psychiatric Institute of Mexico trained a Bioestatistician and two IT experts in the use of the software, quality control algorithms and ascertaining diagnosis and statistics.

Stage 2: Evaluation of the questionnaire

Full and meticulous review of the CIDI was carried out in three phases. First, one of the researchers carefully reviewed the instrument before the training course, identifying words or phrases which, in her opinion, did not fit with Spanish cultural and linguistic norms and customs. Second, the instrument was again reviewed during the CIDI training course by the four participating researchers. All of the interview sections were carefully examined during the intensive course, under the supervisión of the Latin-American WHO-CIDI expert, permitting a productive interaction between all of them. Finally, at the end of the course, another panel of experts from the research project carried out a further review of the document which had incorporated all the proposed changes. When disagreement about some of the suggested alternatives emerged, a consensus was reached and the final document was approved by the research team. During the entire process, the expert committee had complete access to both original English and Spanish versions (used in the ESEMeD project) of the CIDI (version 3.0).

Stage 3: Formal approval of the proposed changes

This final document was further examined by the Latin American and Caribbean coordinator of the WMH Survey Initiative and member of the CIDI editorial committee, and, following some minor revisions, it received full approval.

Stage 4: Adaptation of the software for the Computer Assisted Personal Interview (CAPI) version

This revised final version was implemented in the CAPI format by the IT expert using the Blaise program, a flexible interviewing application used as a survey processing tool and developed by Statistics Netherlands (http://www.blaise.com/).

Stage 5: Pilot study

Between May and June 2009, a sample of 32 volunteers was contacted to pilot test the diagnostic instrument. The researchers chose volunteers of different ages and emotional states to check any word or concept that should be clarified and to allow the testing of all the sections of the instrument. As not having a sufficient knowledge of Spanish speaking skills is considered as an exclusion criterion in this type of surveys, they were not included in the pilot study. The expected number of mental health cases in the pilot study was extremely low (N=2), considering a prevalence of any mental illness in the Spanish general population of 5.25%,19 so that the diagnostic algorithms were not run. The electronic information system recorded all information that was inputted to the computer with the corresponding times in a way that calculated the administration time of all and every section followed by the use of algorithms for the response consistency checks, originally developed using the statistics package SAS (Statistical Analysis System).

This study, as part of the PEGASUS-Murcia project, was approved by a local medical ethics advisory committee from Virgen de la Arrixaca Hospital.

 

Results

As part of the cultural and linguistic adaptation process of the Latin American version of the CIDI for its use in Spain, adaptations and changes were made to a total of 372 questions (approximately 7.4% of the total) with a mean of nine per section (standard deviation of 11.57), range from zero (Psychosis and Respondent Contacts sections) to 68 (34%) (Chronic Conditions section) (Table 2).

The majority of changes made were minor linguistic adaptations related to grammatical terms or vocabulary unique to Spain (semantic of idiomatic equivalences) (Table 3). Others needed a modification to capture experiential or conceptual equivalences more appropriate in Spain. For example, the expert panel considered that the psychological consequences of being beaten up by a spouse or romantic partner is not a matter of the intensity of the beat (badly beaten in PT14, Table 3), but they are related to the experience itself. Consistently, the adjective "muy fuerte" was eliminated looking for an experiential equivalence in Spain.

Other changes, including healthcare personnel designation, units of measurement and currency, names of Spanish institutions, organizations and psychotropic medication, as well as some other healthcare resources, also needed to be adapted for use in Spain (Table 4).

Most of the 32 participants of the pilot study were males (66%), married or cohabiting (64.5%), with a mean age of 39 years (SD: 13.6), and a mean duration of formal education of 14 years (SD: 3.3). The median time to complete the entire interview was 2h and 10min with an interquartile range of between 1h 25min and almost 3h.

The correct functioning of the electronic adapted version (CAPI) was verified, specifically focusing on the complex skip out patterns of questions arising from the combination of answers previously given. Finally, after performing all the documentation necessary to reflect the changes made (Fig. 1), the adaptation of the LA versión of CIDI for Spain received official approval by the Editorial Committee of WMH-CIDI.

 

Discussion

The CAPI format of the most current Latin American (v 20.0) Spanish version of the WHO-CIDI has been adapted following a rigorous and meticulous cross-cultural adaptation process and has been successfully pilot tested. It is over ten years since the last WHO-CIDI CAPI version was used in Spain and there have been many changes made during this time to improve the diagnostic interview and, therefore, to make it more relevant to present-day mental health availability and organization of services. However, this continuing process of up-dating the instrument has only been applied to the LA version which, because of cultural and linguistic factors, makes it unsuitable for use in Spain in its present form.

Although the questionnaire had already been translated into many languages, the last version specifically adapted for Spain was in the context of the ESEMeD project. During this time, the WHO-CIDI had gone through various iterations of improvement but the only currently available updated version was the LA CIDI (v. 20.0). We, therefore, used the most updated Spanish version of the CIDI available but only following the cultural and linguistic adaptation process described above.

The comprehensiveness and complexity of the instrument made the adaptation process particularly challenging, especially because of the interactive design of the diagnostic interview in the form of elaborate skip out patterns, complex randomization routines, question fills and edit checking during the course of the interview. This process results in the generation of questions which are directly linked to the answers previously provided by the interviewee. This, therefore, requires a very careful review of the CAPI version of the CIDI and a rigorous process of evaluation in the form of a pilot study.

The number of participants in the pilot study, included in the range previously suggested,17 was sufficient to activate and test all the survey sections to confirm their correct functioning and to allow an estimate of the administration time of the survey to be made. This administration time of the interview in our experience (2h and 10min approximately) was similar to that previously described in international studies.4 This time represents the median time for an interview when all the sections are answered. The administration time, however, can vary greatly depending on the number of diagnostic sections activated according to the pattern of positive responses answered by the interviewee in the initial screening section. In our case, the time ranged from a minimum of 54min to a maximum of 5h. The interactive design of the diagnostic interview allows the administration time of the interview to be shortened considerably for those interviewees who did not endorse symptoms of mental disorders in their lives and therefore respond negatively to many questions, but it can be very lengthy for those who respond affirmatively to a large number of questions in the screening interview. Moreover, the design also gives great flexibility to researchers to select the sections or modules to be activated depending on the study research questions. For example, certain research projects may wish to focus only on specific sections of the interview, depending on the topic under investigation, such as major depressive disorders. The CAPI format ensures maximum efficiency in terms of reducing the length of the interview as well as optimizing data management following completion of the interview.

The conventional cross-cultural adaptation process should be considered within a continuum, from one situation where no adaptation is needed as it is intended to be used in the same language and culture in which it was developed to the opposite pole in which the application of the questionnaire is to be used in a different culture, language and country.17, 18 The situation outlined here falls somewhat in the middle (another country with the same language) so that no translation but only a cultural adaptation is needed. It is beyond the scope of this paper to completely assess all the psychometric characteristics of the CIDI (v. 3.0) for its use in Spain. As mentioned earlier, the process described here should be considered as part of the ongoing improvement process of continuous updating, refinement, validation and clinical calibration of the questionnaire led by the Editorial Committee of the WHO-CIDI.13-16,20

In summary, the CAPI format of the most current Latin American Spanish version of the CIDI has been adapted for use in Spain and its correct functioning has been successfully pilot tested. This version has been successfully tested and received official approval, so that it can now be widely employed for further mental health epidemiological studies in Spain.

 

 

Author's contributions

M.J. Tormo, J. Alonso, S. Aguilar-Gaxiola, C. Navarro and F. Navarro-Mateu conceived the design and supervised the whole process of the study. I. Morán-Sánchez, F. Navarro-Mateu, M.L. Pujalte and A. Garriga were, simultaneously, accredited as trainers for future interviewers. I. Morán-Sánchez, M.L. Pujalte, A. Garriga, J. Alonso, M.J. Tormo, S. Aguilar-Gaxiola and F. Navarro-Mateu participated in the adaptation process. All authors read, edited and approved the final manuscript.

 

Funding

This work has been financed by the Murcian Health Service, the Cajamurcia Foundation and the Foundation for Healthcare Training and Research (FFIS) of the Murcia Region.

 

Conflict of interest

None.

 

Acknowledgements

We thank Carlos Giribert Muñoz, Deputy Sub-Director of Mental Health and Psychiatric Services, Murcia Health Service, for his support in developing the PEGASUS-Murcia project; Guadalupe Ruiz Merino and David Martínez, from the Foundation for Healthcare Training and Research (Fundación para la Formación e Investigación Sanitarias, FFIS) of the Murcia Region, for their collaboration in the adaptation process; Javier Júdez, Salvador Martínez and Gemma Villagut for their collaboration in the PEGASUS-Murcia project; Corina Benjet and Jerónimo Blanco for their support as expert trainers during the WHO-CIDI training; and Mike Tobin for his helpful discussions and contribution during the English translation of the document.

 

References

1. Eaton W, Merikangas K. Psychiatric epidemiology: progress and prospects in the year 2000. Epidemiol Rev. 2000; 29-34.         

2. Borges G, Medina-Mora ME, López-Moreno S. El papel de la epidemiología en la investigación de los trastornos mentales. Salud Publica Mex. 2004; 46:451-63.         

3. Regier D, Myers J, Kramer M, et al. The NIMH Epidemiologic Catchment Area program: historical context, mayor objectives and study population characterístics. Arch Gen Psychiatry. 1984; 41:934-41.         

4. Kessler RC, Ustun TB. The World Mental Health (WMH) survey initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). Int J Methods Psychiatr Res. 2004; 13:93-121.         

5. Kessler RC. The World Health Organization International Consortium in Psychiatric Epidemiology (ICPE): initial work and future directions ¿ the NAPE Lecture 1998. Nordic Association for Psychiatric Epidemiology. Acta Psychiatr Scand. 1999; 99:2-9.         

6. Alarcón R, Aguilar-Gaxiola S. Mental health policy developments in Latin America. Bull World Health Organ. 2000; 78:483-90.         

7. Medina-Mora ME, Borges G, Benjet C, et al. Estudio de los trastornos mentales en México: resultados de la Encuesta Mundial de Salud Mental. En: Rodríguez J., Kohn R., Aguilar-Gaxiola S., editors. Epidemiología de la salud mental en Latinoamérica y el Caribe. Washington, DC: PAHO (Organización Panamericana de la Salud); 2009. 79-89.         

8. Medina-Mora M, Borges-Guimaraes G, Lara C, et al. Prevalencia de sucesos violentos y de trastorno por estrés postraumático en la población mexicana. Salud Publica Mex. 2005; 47:8-22.         

9. Posada-Villa J, Aguilar-Gaxiola S, Debb-Sossa N. La patología psiquiátrica en Colombia: resultados del Estudio Nacional de Salud Mental. Colombia 2003. En: Rodríguez J., Kohn R., Aguilar-Gaxiola S., editors. Epidemiología de la salud mental en Latinoamérica y el Caribe. Washington, DC: PAHO (Organización Panamericana de la Salud); 2009. 64-78.         

10. Aguilar-Gaxiola SA, Debb-Sossa N. La investigación en epidemiología psiquiátrica y la Encuesta Mundial de Salud Mental de la Organización Mundial de la Salud en América Latina y el Caribe. En: Rodríguez J., Kohn R., Aguilar-Gaxiola S.A., editors. Epidemiología de la salud mental en Latinoamérica y el Caribe. Washington, DC: PAHO (Organización Panamericana de la Salud); 2009. 35-53.         

11. Alonso J, Ferrer M, Romera B, et al. The European Study of the Epidemiology of Mental Disorders (ESEMeD/MHEDEA 2000) project: rationale and methods. Int J Methods Psychiatr Res. 2002; 11:55-67.         

12. Alonso J, Angermeyer MC, Bernert S, et al. Sampling and methods of the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatr Scand Suppl. 2004; 109(Suppl. 420):8-20.         

13. Ochoa S, Haro JM, Torres JV, et al. What is the relative importance of self reported psychotic symptoms in epidemiological studies? Results from the ESEMeD - Catalonia Study. Schizophr Res. 2008; 102:261-9.         

14. Harkness J, Pennell B, Villar A, et al. Translation procedures and translation assessment in the World Mental Health Survey Initiative. En: Kessler R.C., Bedirhan üstün T., editors. The WHO World Mental Health Surveys: global perspectives on the epidemiology of mental disorders. New York: Cambridge University Press, World Health Organization; 2008. 91-113.         

15. Kessler RC, Akiskal HS, Angst J, et al. Validity of the assessment of bipolar spectrum disorders in the WHO CIDI 3.0. J Affect Disord. 2006; 96:259-69.         

16. Haro JM, Arbabzadeh-Bouchez S, Bugha T, et al. Concordance of the Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) with standardized clinical assessments in the WHO World Mental Health Surveys. Int J Methods Psychiatr Res. 2006; 15:167-80.         

17. Beaton DE, Bombardier C, Guillemin F, et al. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000; 25:3186-91.         

18. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993; 46:1417-32.         

19. Haro JM, Palacín C, Vilagut G, et al. Prevalence of mental disorders and associated factors: results from the ESEMeD-Spain study. Med Clin (Barc). 2006; 126:445-51.         

20. Kessler RC, Abelson J, Demler O, et al. Clinical calibration of DSM-IV diagnoses in the World Mental Health (WMH) version of the World Health Organization (WHO) Composite International Diagnostic Interview (WMHCIDI). Int J Methods Psychiatr Res. 2004; 13:122-39.         

 

 

Correspondence:
E-mail address: fernando.navarro@carm.es
(F. Navarro-Mateu)

Received 3 April 2012
Accepted 18 June 2012

Ediciones Doyma, S.L. Barcelona - Barcelona - Spain
E-mail: gs@elsevier.com