Abstract

INTRODUCTION

Over the last decade, as a consequence of technological innovations, the demand for qualified researchers and the spread of the culture of assessment, evaluate the quality of educational processes at all levels of teaching, notably master’s and doctorate courses, and their relationship with the professional world has come to form part of the agenda in education institutions.

Studies in countries which are highly socially and economically developed are concerned with the quality of postgraduate courses ¹¹11 Morrison E, Rudd E, Zumeta W, Nerad M. What Matters for Excellence in PhD Programs? Latent constructs of doctoral program quality used by early career social scientists. J High Educ. 2011; 82 (5): 535 - 63. DOI: 10.1353/jhe.2011.0029
https://doi.org/10.1353/jhe.2011.0029... and trends in the career paths chosen by researchers. ²2 Brass LF, Akabas, MH, Burnley LD, Engman DM, Wiley CA, Andersen OS. Are MD–PhD Programs Meeting Their Goals? An analysis of career choices made by graduates of 24 MD–PhD programs. Acad Med. 2010; 85 (4): 692 – 701. DOI: 10.1097/ACM.0b013e3181d3ca17
https://doi.org/10.1097/ACM.0b013e3181d3... ^,55 Gemme B, Gingras, Y. Academic careers for graduate students: a strong attractor in a changed environment. High Educ. 2012; 63 (6): 667 - 83. DOI: 10.1007/s10734-011-9466-3 ^,99 Kemp MW, Newnham JP, Chapman E. The biomedical doctorate in the contemporary university: education or training and why it matters. High Educ. 2012; 63 (5): 631 - 44. DOI: 10.1007/s10734-011-9464-5
https://doi.org/10.1007/s10734-011-9464-... In Brazil, there are no systematic studies following postgraduate educational processes, whether discussing successful experiences to construct strategies for scientific development, or to support and strengthen postgraduate education. However, continuous development in new professional competencies is part of the agenda in postgraduate educational institutions. ¹⁴14 Velloso J, organizador. A Pós-Graduação no Brasil: Formação e trabalho de mestres e doutores no país. 2. ed. Brasília (DF): Fundação Coordenação de Aperfeiçoamento de Pessoal de Nível Superior; 2005.

At the end of 2010, on its 60 ^th anniversary, the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Capes – Coordination for the Improvement of Higher Education Personnel) launched the 2011-2020 National Postgraduate Plan, ^aa Ministério da Educação. Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Plano Nacional de Pós-Graduação – PNPG 2011-2020 /Coordenação de Pessoal de Nível Superior. Brasília (DF): CAPES; 2010. Available from: http://www.capes.gov.br/sobre-a-capes/plano-nacional-de-pos-graduacao/pnpg-2011-2020. containing “new directives, strategies and goals for continuity and progress in proposals for postgraduate and research policy in Brazil”. For the first time, this plan became part of the Ministry of Education’s National Education Plan. This meant better coordination and complementarity between the different levels of education. Of the six directives aimed at evaluating the national postgraduate system, no reference is made to following up alumni, something which could form part of initiative by educational institutions. This procedure allows possible efforts in forming the career path of ex-students to be analyzed, provides support in adjusting educational processes and may help curriculum reforms which aim to transform the professional world.

At the beginning of 2013, there were 3,613 postgraduate programs accredited by Capes, in nine areas of knowledge. Of these, 1,772 are master’s or doctorate programs. According to a study conducted by the Center for the Study of Strategic Management ^bb Centro de Gestão e Estudos Estratégicos. Doutores 2010: estudos da demografia da base técnico-científica brasileira. Brasília (DF); 2010. on the education of those with doctorate titles awarded in Brazil between 1998 and 2008 and their employability as of 2008, postgraduate education in Brazil increased and matured with a high standard of quality. The diversity of knowledge areas meant it was able to increase its competitiveness among the emerging countries.

The Fundação Oswaldo Cruz (Fiocruz – Oswaldo Cruz Foundation) belongs to the Ministry of Health and is a scientific and technological institution dedicated to research, teaching and developing health technology. It has 18 master’s and doctorate programs accredited by Capes in ten evaluation areas, with around 1,200 students enrolled. From an academic and political point of view, this institution occupies a prominent position in professional formation and in formulating directives for scientific and technological development in the health sector. Various ex-students occupy positions in public administration, in lecturing and in producing knowledge. However, the institution does not systematically follow up its alumni’s career paths. ³3 Conde MVF, Araujo-Jorge TC. Modelos e concepções de inovação: a transição de paradigmas, a reforma da C&T brasileira e as concepções de gestores de uma instituição pública de pesquisa em saúde. Cienc Saude Coletiva. 2003; 8 (3): 727 - 41. DOI: 10.1590/S1413-81232003000300007
https://doi.org/10.1590/S1413-8123200300... ^,88 Hortale VA, Leal MC, Moreira COF, Aguiar AC. Características e limites do mestrado profissional na área da Saúde: estudo com egressos da Fundação Oswaldo Cruz. Cienc Saude Coletiva. 2010; 15 (4): 2051 - 8. DOI: 10.1590/S1413-81232010000400019
https://doi.org/10.1590/S1413-8123201000... ^,1212 Pereira Neto AF. O perfil dos egressos da pós-graduação stricto sensu da ENSP: hipótese, tendências e proposta para uma avaliação institucional. In: Trindade N, organizador. Uma escola para a saúde. Rio de Janeiro: Editora FIOCRUZ; 2004. p. 219 - 45.

Fiocruz is establishing regular evaluation mechanisms to assess its educational processes and conducted an exploratory study, the object of this article. Thus, the aim of this study was to analyze career paths and professional satisfaction and evaluations of doctorate courses by alumni.

METHODS

The subjects of the study were 827 alumni who did doctorate courses in Public Health, Biological and Health Sciences between 1984 (four years after the first doctorate courses began at the institution) and 2007. Alumni were contacted by e-mail. The Lattes ^cc Conselho Nacional de Desenvolvimento Científico e Tecnológico. Plataforma Lattes. Available from: http://lattes.cnpq.br curriculum was used to locate the alumni and contact was made by telephone when e-mail was not available through the Fiocruz Electronic Academic Management System (SIGA). Those who did not respond to the e-mail, or when the e-mail was not delivered, were contacted by telephone.

When drawing up the instruments to collect and analyze the data, the following considerations were used: a) differences between cross-temporal cohorts who may have been affected by restructuring curricular structure and contents, or alterations in the Capes evaluation system; b) differences between alumni from bioscience and health areas, i.e., different paths in education and different work processes; c) peculiarities in the different areas in which the institution offers doctorate courses. An electronic questionnaire to be completed online was developed and then underwent a pilot test to verify intelligibility, relevance and reliability, as well as to control possible bias in filling it out. This procedure was chosen as it did not require much of respondents’ time. ⁴4 Evans JR, Mathur A. The value of online surveys. Internet Res. 2005; 15 (2): 195 - 219. DOI: 10.1108/10662240510590360 The questionnaire was available online between August and December 2008.

The questionnaire was composed of five blocks: personal data, professional activity, professional satisfaction, evaluation of the course and follow up program.

Personal data. Record of each alumni (address, contact telephone, e-mail address, sex, date of birth, marital status, academic formation, program followed, year entered and year received title). The undergraduate programs were categorized based on Ministry of Education standards, as: Biological and Health sciences, Physical and Earth Sciences, Human and Social Sciences, Applied Social Sciences, Engineering and Technology. Personal data were included after examining SIGA, in operation since 2004, and completed with data from years before 2004. The responses formed a preliminary database which, to facilitate analysis, underwent readjustments which included the sets of respondents and their responses or lack thereof. Cross-temporal cohorts were defined based on distribution of the year the students received their title in the universe of the study, presenting frequencies of students close to each other to maintain the same interval of years. Three cohorts were constructed: those who received their doctorate between 1984 and 1999, between 2000 and 2003 and 2004 to 2007, and by teaching department in which they completed their doctorate. We were able to maintain the same coverage of years for the two latter cohorts, with frequency of alumni of 277 and 316, respectively. To have a similar frequency (234) in the first cohort, it was necessary to consider a greater interval (1984 to 1998). We sought to identify differences in response patterns, bearing in mind possible changes in the course over the years. The analysis considered possible difference and similarities between the cohorts of alumni.

Professional activity. Closed questions on: professional activity before the doctorate (research teaching, technological development, health care, management, consulting, other); nature and type of institution in which principal professional activity is conducted; type of activity developed; post and function; year entered institution; type of contract; relationship between professional activity and course studied; change of position or function after obtaining the doctorate; and mean monthly income.

Professional satisfaction. Perceptions of professional satisfaction after obtaining the doctorate, as well as closed questions on: remuneration, prestige, work relations, social relevance of work, opportunity to learn new things and to exercise creativity, opportunities for professional development, workload and autonomy. The responses were mutually exclusive and measured using a scale that went from “extremely dissatisfied” to “extremely satisfied”. An index, entitled “degree of satisfaction”, was created: “satisfied” and “extremely satisfied” were grouped together as “satisfied”; “extremely dissatisfied” and “dissatisfied” were grouped together as “dissatisfied”; another group was formed for the “moderately satisfied”. The proportion of satisfaction was estimated using the equation: number of individuals associated with the “satisfied” grade/total number of individuals who marked one of the options.

Evaluation of the course. Closed questions on: motivation to undertake the doctorate course at the Fiocruz; product(s) of the thesis; level of impact of the course on professional life; level of impact of the course on specific aspects (“low” to “high”); satisfaction with specific aspects of the course (“excellent” to ”very poor”). Two sections allowed various responses regarding the motives for doing the doctorate at Fiocruz and products generated by the thesis.

The analyses were conducted by grouping responses of alumni from the three cohorts. Considering that the return of the questionnaire was proportionally different between the different cohorts, the sample was weighted regarding the response rate (32.3%) of the most recent, 2004-2007, cohort (102 respondents). This cohort was attributed the value of 1, that of 1984 to 1999 was given a weight of 2.7 (going from 28 to 76 respondents) and that of 2000 to 2003 weighting of 2.1 (going from 43 to 89 respondents). The sample of respondents was weighted to guarantee representativeness of all three groups in the overall analyses, i.e., those which included all participants. The original number of respondents was maintained, without weighting, for descriptions within the cohorts.

Of the 827 alumni, 20.9% responded to the questionnaire, which corresponds to the expected response rate for internet surveys. ⁴4 Evans JR, Mathur A. The value of online surveys. Internet Res. 2005; 15 (2): 195 - 219. DOI: 10.1108/10662240510590360 As the number of respondents was higher among alumni from 2000 onwards, especially 2004-2007, it is supposed that poor adherence to the study on the part of alumni from the 1984 to 1999 period was due to difficulties locating them, failure to update e-mail addresses and moving to other states or countries.

The project was approved by the Fiocruz Research Ethics Committee, record 450/08. Agreeing to participate required: accessing the link given in the e-mail or message, entering the first screen and reading the informed consent form, confirming and updating data, if necessary, and accessing the other screens of the questionnaire.

RESULTS

The respondent group did not differ significantly from the universe of the study regarding age, sex, nationality, graduation, type of institution and type of contract before the doctorate ( Table 1 ). The youngest responded less, proportionally, and Brazilian were more helpful than foreigners. The percentage of women was slightly higher than men, although this was slightly lower in the last cohort. There was a predominance of alumni aged < 40, with a slight percentage decrease in more recent years, i.e., stability in participation of those aged 40-49 and increased share of those aged > 50 years old.

Alumni of Biological and Health Sciences predominated in all cohorts, both in the universe and in the respondents. More than 93.0% were Brazilian for both universe and respondents.

Information on type of institution and employment contract before the doctorate was only available for respondents of the study. They were most commonly connected with public institutions and this increased over time. The lack of any type of link with an institution also increased (3.6% in the first cohort and 22.5% in the last). Irrespective of the cohort, the Unified Legal System ^dd Unified Legal System - Regime Jurídico Único – is the set of rules governing labor relations of public civil servants direct, independent and public foundation management, defining their rights, responsibilities and duties (Law 5, 247, 26 July 1991. was that which presented the highest percentage and mean income varied between 5.8 and 16.6 minimum wages. The highest mean monthly income was found in higher age groups.

The highest levels of satisfaction were found in attributes “social relevance of work”, “opportunity to learn new things and exercise creativity” and “opportunities for professional development” and the lowest for “remuneration” ( Table 2 ). This result was repeated in all three cohorts, but with a trend for the proportion to decrease. The cohorts with more alumni in older age groups had the highest levels of satisfaction in the sections mentioned above. Despite this trend, calculating confidence intervals (95%CI) for the proportions of these attributes showed no significant differences. “Interest in the lines of research offered” was most common in the second and third cohorts, regarding their motivation for doing a doctorate at Fiocruz. In the first cohort, the highest percentage was for “traditions of the institution”. In all cohorts, “Excellence of the course” was the second most commonly reported item ( Table 3 ).

Of those who declared that their thesis generated products, more than one product per respondent was reported ( Table 4 ). It was noted that there was increase in the number of articles published as a product of thesis in the latter two cohorts, as well as a relative decrease in the number of books and chapters of books. There was a high percentage of alumni who evaluated the impact of the doctorate on their professional life as “high”. No significant differences were observed between cohorts with regards these percentages.

Responses evaluating attributes related to the course were grouped as: (a) teaching body and pedagogical practice, (b) infrastructure and (c) academic processes ( Table 5 ). This was dichotomized into excellent (70.0% or more classified this aspect as “excellent” or “good”) and very bad (fewer than 30.0% classified this aspect as “excellent” or “good”). The aspects which were mainly classes as “excellent” or “good” were for the set of disciplines, content, teaching body and thesis guidance, which may confirm the high motivation of alumni to qualify the institution for the “excellence of the course”. The evaluation was negative for “guidance in producing scientific articles”. Ratings of “excellent” or “good” were repeated for aspects of “infrastructure” for facilities, classes and library. There was a trend to give lower ratings to ‘academic processes’, the “selective process” was highlighted as “excellent” and “very good”; the worst rating went to the “strategy for evaluating lecturers and disciplines”.

DISCUSSION

In Brazil, there have been few studies with alumni of postgraduate courses with the type of coverage of this article. One of the few studies on this topic, ¹⁰10 Moreira LM, Velho L. Trajetória de egressos da pós-graduação do Instituto de Pesquisas Espaciais: uma ferramenta para avaliação. Aval Rev Aval Educ Super. 2012; 17 (1): 257 - 88. DOI: 10.1590/S1414-40772012000100013
https://doi.org/10.1590/S1414-4077201200... showed that the majority who sought to do a postgraduate course were interested in research, were satisfied with their job and assessed their education positively. Around 40.0% had studied abroad. Another study of alumni covered nine areas of knowledge (administration, agronomy, biochemistry, clinical medicine, civil engineering, electrical engineering, physics, chemistry and sociology), ⁵5 Gemme B, Gingras, Y. Academic careers for graduate students: a strong attractor in a changed environment. High Educ. 2012; 63 (6): 667 - 83. DOI: 10.1007/s10734-011-9466-3 with similar results to this study.

Despite its exploratory nature, the results of this study indicate that the objectives were met, in other words, information was obtained on the alumni’s professional activity, their perception of job satisfaction and their evaluation of the course. A study conducted by the Management Center for Strategic Studies showed that women with a doctorate ceased to be the minority from 2004 onwards, although in another study, ¹⁰10 Moreira LM, Velho L. Trajetória de egressos da pós-graduação do Instituto de Pesquisas Espaciais: uma ferramenta para avaliação. Aval Rev Aval Educ Super. 2012; 17 (1): 257 - 88. DOI: 10.1590/S1414-40772012000100013
https://doi.org/10.1590/S1414-4077201200... with alumni of a Brazilian science and technology research institution, male alumni predominated; and this raises the hypothesis that gender difference is marked in areas related to physical sciences and in careers in science and technology, although this trend is decreasing.

A study in the same institution with master’s alumni ⁸8 Hortale VA, Leal MC, Moreira COF, Aguiar AC. Características e limites do mestrado profissional na área da Saúde: estudo com egressos da Fundação Oswaldo Cruz. Cienc Saude Coletiva. 2010; 15 (4): 2051 - 8. DOI: 10.1590/S1413-81232010000400019
https://doi.org/10.1590/S1413-8123201000... found that more than 80.0% were aged > 40 and the association of this variable with longer time spent in the institution explains, among other factors, the need for professional improvement in the face of technological innovations. A study in the area of Public Health ⁶6 Gomes MHA, Goldenberg P. Retrato quase sem retoques dos egressos dos programas de pós-graduação em Saúde Coletiva, 1998-2007. Cienc Saude Coletiva. 2010; 15 (4): 1989 - 2005. DOI: 10.1590/S1413-81232010000400014
https://doi.org/10.1590/S1413-8123201000... identified that more than 60.0% of alumni were aged between 39 and 49 when they defended their thesis.

The mean age of alumni in the area of Biological sciences was lower than that in other areas, which may characterize the acceleration of specializing in research in areas where there are initiative aimed at undergraduate science students. As a consequence, there has been a rejuvenation in this clientele. A similar situation was identified in England, based on analysis of statistics published in 2007 by the Higher Education Statistics Agency Limited, an official agency for collecting, analyzing and disseminating information on higher education in 2005. ^ee Higher Education Statistics Agency. Cheltenham; [s.d.]. Available from: http://www.hesa.ac.uk At English universities, female students accounted for 52.8% of total first year students on master’s and doctorate courses; 55.6% of women and 49.0% of men were aged between 21 and 24 at the start of the course. This situation can be explained due to the shorter course time agreed by the new European Credit System, in which students on biomedicine courses (except medicine) graduate in three or four years; and in research education starting directly after graduation. ⁷7 Hortale VA, Mora JG. Tendências das reformas da educação superior na Europa no contexto do processo de Bolonha. Educ Soc. 2004; 25 (88): 937 - 60. DOI: 10.1590/S0101-73302004000300014
https://doi.org/10.1590/S0101-7330200400...

The result regarding remuneration was repeated in all three cohorts, with small variations in the value of the index and constant dissatisfaction with salary levels. This may suggest that there have been no substantial changes in alumni’s work over the last 20 years. Despite their dissatisfaction with remuneration, alumni were satisfied with the social relevance of their work and with new opportunities to learn and to exercise creativity.

The motivation for entering the institution changed over time. The first cohort identified the tradition of the institution as their principal motive, whereas the latter two highlighted the “excellence of the course” and “interest in the lines of research”. This change may be related to the continued division in scientific work, in which the specificity of the line of research is essential, as well as growing competition for financing between scientific institutions, which throws excellence into relief. These results, in addition to confirming the relevance of tradition in choosing institutions, may suggest a growing specialization with scientific fields, with focus on lines of research and on competition between institutions. ¹1 Bourdieu, P. Para uma sociologia da ciência. Lisboa: Edições 70; 2008.

The predominance of professional activity associated with research, teaching and technological development among the alumni may be specific to Fiocruz, with its teaching, research and technological development departments. This is not common in other higher education institutions in the areas of health and S&T institutions. ¹⁰10 Moreira LM, Velho L. Trajetória de egressos da pós-graduação do Instituto de Pesquisas Espaciais: uma ferramenta para avaliação. Aval Rev Aval Educ Super. 2012; 17 (1): 257 - 88. DOI: 10.1590/S1414-40772012000100013
https://doi.org/10.1590/S1414-4077201200...

The results of this study are in agreement with the findings regarding the predominance of the public nature of alumni employment. In one of them, on doctorates in the S&T area, ¹⁰10 Moreira LM, Velho L. Trajetória de egressos da pós-graduação do Instituto de Pesquisas Espaciais: uma ferramenta para avaliação. Aval Rev Aval Educ Super. 2012; 17 (1): 257 - 88. DOI: 10.1590/S1414-40772012000100013
https://doi.org/10.1590/S1414-4077201200... more than 80.0% of alumni were working in the public sector. Another study, conducted at the end of the 1980s, covering Master’s and Doctorates in various areas of knowledge, showed the more than 70.0% worked in public higher education institutions. ¹³13 Spagnolo F, Gunther H. Vinte anos de pós-graduação: o que fazem nossos mestres e Doutores? Uma visão geral. Cienc Cultura. 1986; 38 (10): 1643 - 62.

One of the limitations of this study was a loss of respondents, equivalent to around 80.0% of eligible subjects, although there were no significant differences between the two group. However, it is known that online surveys have poor response rates, but are characterized as an approach that is increasingly used due to its low cost and speed and its broad reach. There is no guarantee that the representativeness of such studies is worse than that of face-to-face studies. Thus, the authors ⁴4 Evans JR, Mathur A. The value of online surveys. Internet Res. 2005; 15 (2): 195 - 219. DOI: 10.1108/10662240510590360 recommend that comparative studies on the advantages and disadvantages are conducted and to see whether, in fact, they differ in representativeness.

Differences were observed between the cohorts of alumni as a possible consequence of changes in the courses, of different career paths in education, and different work processes specific to the areas of biological and health sciences. The possible differences and similarities between the various courses may be related to peculiarities of the work processes in the areas in which the institution offers doctorate courses: public health, biological and health sciences. It may also reflect current scientific development in the country, which increasingly places Brazil on the international stage as an important actor in global scientific production.

The results of this study enabled students to evaluate their education on Fiocruz doctorate courses, signaling weaknesses and strengths, and allowed us to gain wider knowledge of instances of academic management on educational processes, establishing a base line for accompanying the career paths of alumni. Moreover, it contributes to improving monitoring processes for alumni of Brazilian postgraduate programs.

ACKNOWLEDGEMENTS

Thanks to Adriana Aguiar, Juliana Nascimento and Mauricio Luz, who participated in designing and executing the study; to Fernando Speich who drew up the online tool and to Arthur Schilithz who helped to review the statistical results.

References

Publication Dates

History