The development of a scale to measure concepts of schizophrenia: experience among Brazilian psychiatrists*
Desenvolvimento de escala para medir conceitos de esquizofrenia: experiência entre psiquiatras brasileiros
Darci N. Santos, Robert Blizard and Anthony H. Mann
Instituto de Saúde Coletiva da Universidade Federal da Bahia. Salvador, BA - Brasil (D.N.S.), Section of Epidemiology and General Practices of the Institute of Psychiatry. London, UK (R.B., A.H.M.)
|Introduction||Among psychiatric disorders schizophrenia is often said to be the condition with the most disputed definition.The Bleulerian and Schneiderian approaches have given rise to diagnostic formulations that have varied with time and place. Controversies over the concept of schizophrenia were examined within European/North American settings in the early 1970s but little has since been reported on the views of psychiatrists in developing countries. In Brazil both concepts are referred to in the literature. A scale was developed to measure adherence to Bleulerian and Schneiderian concepts among psychiatrists working in S. Paulo.|
|Methodology||A self-reported questionnaire comprising seventeen visual analogue-scale statements related to Bleulerian and Schneiderian definitions of Shizophrenia, plus sociodemographic and training characteristics, was distributed to a non-randomised sample of 150 psychiatrists. The two sub-scales were assessed by psychometric methods for internal consistency, sub-scale structure and test-retest reliability. Items selected according to internal consistency were examined by a two-factor model exploratory factor analysis. Intraclass correlation coefficients described the stability of the scale.|
|Results||Replies were received from 117 psychiatrists (mean age 36 (SD 7.9)), 74% of whom were made and 26% female. The Schneiderian scale showed better overall internal consistency than the Bleulerian scale. Intra-class correlation coefficients for test-retest comparisons were between 0.5 and 0.7 for Schneiderian items and 0.2 and 0.7 for Bleulerian items. There was no negative association between Bleulerian and Schneiderian scale scores, suggesting that respondents may hold both concepts. Place of training was significantly associated with the respondent's opinion; disagreement with a Bleulerian standpoint predominated for those trained at the University of S. Paulo.|
|Conclusions||The less satisfactory reliability for the Bleulerian sub-scale limits confidence in the whole scale but on the other hand this questionnaire contributes to the understanding of the controversy over Bleulerian and Schneiderian models for conceptualisation of schizophrenia, the former requiring more inference and therefore being prone to unreliability.|
|Schizophrenia, diagnosis. Concept formation. Psychiatry, manpower.|
|Introdução||Foi desenvolvida uma escala para medir aderência ao conceito Bleuleriano e Schneideriano de esquizofrenia entre psiquiatras trabalhando em São Paulo, analisando relações entre variáveis sociodemográficas e de formação sobre o escore obtido.|
|Métodos||Questionário contendo escala visual analógica com dezessete enunciados sobre conceitos Schneideriano e Bleuleriano de esquizofrenia, foi distribuído para 150 psiquiatras. As sub-escalas Bleuleriana e Schneideriana foram avaliadas por metódos psicométricos de consistência interna, estrutura das subescalas e confiabilidade test- reteste.|
|Resultados||Completaram o questionário 117 psiquiatras. A subescala Schneideriana demonstrou melhor consistência interna e melhores coeficientes de correlação intraclasse. Não houve associação negativa entre os escores das subescalas. Discordância com o conceito Bleuleriano predominou entre profissionais treinados na USP.|
|Conclusões||A baixa confiabilidade da sub-escala Bleuleriana limita a confiabilidade do instrumento como um todo, embora contribua para a discussão dos modelos em questão. Argumenta-se que o modelo Bleuleriano, por exigir maior inferência, torna-se propenso a baixa confiabilidade.|
|Esquizofrenia, diagnóstico. Formação de conceito. Psiquiatria, recursos humanos.|
Among psychiatric disorders schizophrenia is often said to be the condition whose definition is most disputed7. Diverse theoretical viewpoints as to the nature of this condition are available to psychiatrists, and adherence to one or another will affect clinical practice and, specifically, diagnosis. Variations in diagnostic rates may thus be explained by understanding the concepts that are held, concerning the conditions.
Bleuler2 is generally regarded as having widened the original Kraepelian concept of schizophrenia. The symptoms he believed to be essential to diagnose the disorder - looseness of association, blunting of affect, autism and ambivalence - give wide scope for differing clinical interpretation3. On the other hand, Schneider's phenomenological definition of schizophrenia used symptoms which can be more reliably elicited - hallucinations, delusions and deficits of ego boundary9. Bleuler2 believed that the intrapsychic process of associative splitting was central to this group of psychotic disorders. He explained the existence of delusions and hallucinations - accessory symptoms - as a product of the complexes. Schneider9 did not subscribe to this theoretical formulation, but postulated delusions and hallucinations as important markers for diagnosis on the part of clinicians.
These two relatively distinct approaches to schizophrenia have given rise to diagnostic formulations that have varied with time and place. European psychiatry embraced the Schneiderian concept; Bleuler's influence was more apparent in the United States3,6. The controversies over the concept of schizophrenia were examined within European/North American settings in the early 1970s, showing a broader concept in the United States at that stage than in the UK, in keeping with these different influences4.
Little has since been reported on the views of psychiatrists in developing countries. In Brazil, Bleulerian and Schneiderian views are both commonly held. Shirakawa10 and Bastos1, for example, express a Bleulerian viewpoint. Shirakawa10 suggests that clinicians may diagnose this disorder according to features such as autism, ambivalence, withdrawal, delusions and non-systematised hallucinations. In Bastos' view, rapport and abnormal expression by the patient are features for diagnosis; schizophrenia may present with a non-specific clinical picture which becomes clear later in its course1. However, Schneider's first rank symptoms have also been suggested as diagnostic criteria11. Sougey reported a 65% rate for these symptoms amongst seventy inpatients diagnosed as schizophrenic according to ICD9.
Seven hundred and seventy-two medical doctors in the state of S. Paulo have specialised in psychiatry by attending one of the recognised training centres. The orientation of most centres is biological, although the psychodynamic approach is also taught5.
The measurement of psychiatrists' concepts of schizophrenia has not been carried out systematically by questionnaire before. The current study attempted to develop a scale to measure adherence to Bleulerian and Schneiderian concepts among psychiatrists in Brazil, aiming at an assessment of their influence on the diagnosis of schizophrenia. Brazil is useful for this exercise since both concepts are likely to be widely held. The development and refinement of this scale using data from Brazilian respondents is described in the present paper.
SUBJECT AND METHOD
Development of the Bleuler Schneider Concepts Questionnaire (BSCQ)
The questionnaire was designed for self-reporting**. In constructing the questionnaire the main purpose was to detect the conceptual model of the respondent in relation to diagnosis. A large number of items concerning features of schizophrenia were drawn from psychiatry textbooks. To ensure face validity, the final selection among these items was made by a panel of three British schizophrenia researchers. Seventeen items, nine representing the Bleulerian and eight the Schneiderian school of thought, were chosen. Each statement was followed by a 10 cm visual analogue scale (VAS), anchored at one end by `strongly agree' and at the other end by `strongly disagree'. The introduction to the questionnaire contained guidance for respondents on how to use the VAS.
Surveying the Psychiatrists
One hundred and fifty copies of the seventeen-item scale were distributed by the main investigator, who visited psychiatrists at their places of work in S. Paulo. These comprised five outpatient clinics, two emergency psychiatric services, three mental hospitals in the public sector, and three teaching hospitals. Participation was based on the availability of psychiatrists on the day of the visit. Respondents were also asked to complete a questionnaire covering their sociodemographic characteristics and the professional training they had received. Twenty-one psychiatrists agreed to answer the questionnaire for a second time one month later, so that the correlation between scores on the two occasions could be compared to measure the test-retest reliability of the instrument.
The BSCQ VAS were measured in millimetres. Statistical analysis was carried out with the Statistical Package for the Social Sciences and involved the following operations:
A.Simple descriptive statistics were calculated for each demographic, training and attitudinal item. Mean scores and their 95% confidence interval were calculated for the BSCQ items and are shown in Table 1.
B. The responses from the psychiatrists to the eight Schneiderian items and the nine Bleulerian were further refined. The following statistical procedures were applied.
A skewness test, achieved by dividing skewness by the standard error of skew for each item, was applied to eliminate those with great departure from symmetry. Items with a ratio equal to or larger than two were eliminated.
Cronbach Alpha Coefficients were calculated for the Bleulerian and Schneiderian scales to check that each item was contributing consistently to a unitary scale.
The items selected according to internal consistency were then submitted to an exploratory factor analysis on the basis of a two-factor model, the factors being extracted by the method of principal components. This procedure was carried out to identify common factors that would help classify Bleulerian and Schneiderian variables based on statistical criteria.
The stability of the scale in terms of respondent's consistency across time was described by the intraclass correlation coefficients based upon one-way analysis of variance.
C. The most stable items were then summed to give a composite Bleuler and Schneider score for each psychiatrist (low values meant agreement and high values disagreement). The Bleuler and Schneider scale scores were plotted against one another. The difference between the Bleuler and Schneider scale scores produced a single variable to distinguish the psychiatrists. A high positive score would indicate a weak Bleulerian affiliation and a low score a stronger Bleulerian affiliation. Scores around zero would indicate that the respondents scored at the same level on both concepts. The Student t test for independent groups was carried out to examine the association between psychiatrists' conceptual variables and gender, year graduated, training additional to rotation and psychiatric college of the respondents. Age was defined as years at last birthday and stratified into two groups. Year of graduation from medical school was categorised as pre- or post-1980. Experience of Rotation through a number of psychiatric posts was the criterion for classification of a respondent as a trained psychiatrist. The place of training was first classified as inside or outside S. Paulo state [three respondents trained outside S. Paulo state were excluded]. Then training was classified as being either at one of eight colleges in S. Paulo or at the University of S. Paulo (USP). Each respondent was also screened as having additional training: academic or psychotherapeutic.
Table 1 - Mean scores (m) and standard deviation (Sd) with 95% CI, for Brazilian psychiatrists on the BSCQ items. Higher values indicating greater disagreement with statement.
|Bleulerian (B) and Schneiderian (S) items||m||Sd||95%CI||n|
|1(B). Autism, ambivalence, affective blunting and thought disorder are sufficient to diagnose schizophrenia (Sz).*||35||30||2940||113|
|2(B). Impoverishment of affect and disturbances in personal contact/rapport are fundamental to characterising Sz.**||45||30||3951||113|
|3 (B). Ambivalence and depersonalisation are essential features for Sz diagnosis.**||61||31||5466||113|
|4 (B). The split of several psychic functions is one of the most important characteristics in Sz.*||35||28||2940||113|
|5 (B). Ambivalence and autism constitute the basic symptoms in Sz.**||44||30||3849||113|
|6 (B). Looseness of association and inappropriate affect are typical features of Sz.**||52||29||4556||113|
|7 (B). Loss of capacity for modulation of the affects is indicative of Sz.||59||30||5264||113|
|8 (B). Persistent affective indifference and affective rigidity would indicate Sz.||56||28||5060||114|
|9 (B). Poor rapport, autism and incomprehensible behaviour can lead to diagnose Sz before unequivocal psychotic symptoms were present.*||41||31||3547||113|
|10 (S). Schneiders first rank symptoms are key symptoms of Sz.*||74||25||6979||113|
|11 (S). Having excluded an organic cause from a first acute episode, diagnosis can be made on florid symptoms alone.||60||35||5366||113|
|12 (S). Diagnostic criteria of Sz can only be based on specific types of hallucinations and delusions.*||82||24||7786||113|
|13 (S). Thought insertion, thought withdrawal and thought broadcasting are basic phenomena for the diagnosis of Sz. **||49||31||4254||113|
|14 (S). Auditory hallucinations constituted by voices discussing the subject in the third person is pathognomonic of Sz.**||58||34||5164||113|
|15 (S). The sensation of feelings impulses or acts being experienced or carried out under external control is pathognomonic of Sz.**||53||34||4659||113|
|16 (S). Psychotic symptoms other than Schneiders first rank are not indicative of Sz.*||67||30||6172||113|
|17 (S). If first rank symptoms are present in a psychotic condition in the absence of organic pathology, it is Sz. **||45||33||3851||113|
* Eliminated items by skewness test . ** Selected items for the final scales
A total of 117 psychiatrists (78%) completed the BSCQ. Eighty-six (74%) men and 31 (26%) women responded. Their mean age was 36 years (standard deviation, SD 7.9). Sixty-six doctors (56%) of the sample had less than ten years of experience since qualification. A total of ninety-six (82%) were trained in a rotation, attending teaching hospitals inside S. Paulo state. The majority - fifty-three (55 %) - were trained at USP, and forty-three (45%) at one of the other colleges. Additional training, such as in research or psychotherapy, was carried out by forty-four respondents (46%). Information regarding the thirty-three doctors who did not respond to the questi-onnaire was limited to their current place of work.
The mean scores and a 95% confidence interval (CI) of all respondents for each Bleulerian and Schneiderian VAS item was calculated (Table 1). None showed a clear bimodal distribution, thus making it impossible to identify two different groups of psychiatrists. The mean for the nine Bleulerian items ranged from 35 to 61. The large standard de-viations (28 31) suggest a large variation among the observations. Across the Schneiderian items mean values varied from 45 to 82, and standard deviation from 24 to 35.
Refining the Questionnaire
Items 10, 12 and 16 of the Schneider scale and items 1, 4, and 9 of the Bleuler scale were eliminated on account of Skewness test results.
When the Cronbach Alpha coefficient was calculated for the remaining five Schneiderian and six Bleulerian items, an Alpha value of .62 was found for the Bleulerian subscale (Table 2). No item-total correlation was negative but the highest correlation was .43. With the elimination of both item 8 and item 7, Cronbach Alpha improved to .64. Cronbach's Alpha value for the five Schneiderian items was .61 (Table 2). By eliminating item number 11 - the only one with a negative correlation - the Alpha value increa-sed to .73. Both scales were thus reduced to four items each.
Table 2 - Item-total correlation and Alpha (a) values for the first calculations of Bleulerian and Schneiderian scales.
|Bleulerian scale a= .62||Schneiderian scale a= .61|
|Item||Item-total Correlation||a If item deleted Correlation||Item||Item-total||a If item deleted|
Examination of these final four-item Bleulerian and Schneiderian scales by the two-factor model su-cceeded in identifying two common factors with a clear pattern to explain the variables. Factor 1 had a higher correlation with Schneiderian items, and factor 2 with Bleulerian items. No item achieved high loa-dings for both factors (Table 3). A plot of the total variance associated with each factor showed a clear break between the slope of factors 1 and 2 and the other factors.
Table 3 - Factor loadings for the eight items, after varimax rotation according to Bleulerian and Schneiderian classification.
|Item||Factor 1||Factor 2||Classification|
As an assessment of the stability of the scale, the intraclass coefficients were calculated. The four Schneiderian items lay between .5 and .7, but only one Bleulerian item attained a satisfactory consistency (Table 4).
Table 4 - Intraclass correlation coefficient (ICC) for test-retest reliability by 21 psychiatrists on the final Bleulerian (B) and Schneiderian (S) items together with composite scores.
|2 (B)||Impoverishment & disturbances in personal contact/ rapport||.22|
|3 (B)||Ambivalence and depersonalisation as essential features in Sz||.34|
|5 (B)||Ambivalence and autism are the basic symptoms in Sz||.24|
|6 (B)||Looseness of association and inappropriate affect, typical features of Sz||.70|
|13 (S)||Thought insertion, thought withdrawal and thought broadcasting||.68|
|14 (S)||Auditory hallucinations by voices in the third person||.72|
|15 (S)||Feelings impulses or acts experienced under external control||.69|
|17 (S)||Symptoms of the first rank without organic pathology||.54|
|Bleulerian scale||Composite score from the Bleulerian items||.37|
|Schneiderian scale||Composite score from the Schneiderian items||.77|
|Single conceptual variable||Difference between both composite scores||.66|
Associations with Scale Scores
The mean value for the composite score on the four-item Bleulerian and Schneiderian scales were respectively: (201, 95% CI=183<>218) and (207, 95% CI=186<>228). The plot of these two scores for each psychiatrist shows a scattered distribution with no discernible association between the two measures. The difference between the Bleulerian and Schneiderian composite scores had a mean of (-6, 95% CI=-33<>21). There was no association of the difference score with age, gender, year graduated, psychotherapeutic and academic training undertaken by the respondents. Only place of training was significantly associated with this difference score, more disagreement with a Bleulerian standpoint pre-dominating for those trained at the USP (Table 5).
Table 5 - Mean scores (m) of the Bleulerian and Schneiderian four-item final scales by characteristics of the doctors with 95% CI for mean difference. N=96.
|Aged £ 35||59||207||(-1655)||.28|
|Bleuler||Graduated before 1980:||32||184||(-6110)||.16|
|Not USP trained||41||174|
|Aged £ 35||58||211||(-2659)||.44|
|Schneider||Graduated before 1980:||33||192||(-6423)||.36|
|Not USP trained||40||220|
|Aged £ 35||58||-3||(-4964)||.78|
|Bleuler/Schneider||Graduated before 1980:||32||-13||(-6847)||72|
USP - University of S. Paulo
The psychiatrists in this study did not hold a con-cept of schizophrenia that was exclusively Bleulerian or Schneiderian in type; however, USP trained respondents were less inclined to a Bleulerian view. Much lower test-retest reliability and internal consistency was found for the scale measuring the Bleulerian concept.
Discussion of Methods
There are methodological limitations to consider. These arise from uncertainty about accuracy of atti-tude measures, selection bias of the items reflecting a Schneiderian view, poor reliability of Bleulerian items, non-randomisation and over-use of the sample.
Problems of accuracy are involved in the construction and evaluation of any measurement tool. To the best of our knowledge this report is the first to assess Brazilian psychiatrists' attitudes towards Bleulerian and Schneiderian definitions of schizophrenia. It was expected that there should be a degree of reciprocity between doctors' agreements with Bleuler/Schneider standpoints. This was not the case, however, since the plot of the scores showed a scattered distribution with no negative association between the two scales. It could be argued that the statements were, therefore, not good differentiators between Bleulerian and Schneiderian viewpoints, even though the initial item selection was made on the advice of three researchers expert in schizophrenia. These advisors could have been biased as they worked within the British tradition, aligned with the Schneiderian point of view. Nevertheless the two sets of conceptual statements did represent precisely the literature on these schools of thought, their construct validity supported by a two-dimensional exploratory factor analysis model.
An important point to be made concerns the different psychometric performance of the two sets of items. The distinction between the contribution of items to overall internal consistency was clearer for the Schneiderian than the Bleulerian scale. Schneiderian items correlated more highly with each other than Bleulerian items. The alpha values were, however, good enough to imply that each scale was measuring a unitary dimension, and the principal component analysis demonstrated two large factors accounting for 53% of the variance. Each factor had very large positive loadings on different sets of items, creating a clear distinction between Bleulerian and Schneiderian statements. Different performance for internal consistency measures on both scales may, therefore, reflect the ingredients of each scale, the Bleuler scale being less clear-cut.
When the items were scored for the second time, less satisfactory repeatability was found amongst the Bleulerian items. The intraclass correlation coefficients suggested that more intra subject variability was found for these items. The poor internal consistency and repeatability of the items measuring the Bleulerian concept of schizophrenia tends to confirm its vagueness, and perhaps explains its loss of significance in present systems of classification8. However, test reliability of the total eight-item scale was shown to be satisfactory.
Sampling concerns must also be considered. The possible bias involving the surveying process in this study should be borne in mind, as representativeness cannot be claimed. Despite a 78% response rate, non-responding psychiatrists might have differed systematically as regards their Bleulerian/Schneiderian viewpoint. On the other hand, taking into account participation of teaching hospital psychiatrists and those working in a diversity of clinical settings, the sample chosen probably gave a reasonable indication of the range of local psychiatrists' views.
Discussion of Findings' Implications
Despite low reliability for the Bleulerian sub-scale presenting a problem for the complete usefulness of this scale, a good reliability coefficient was found for the single conceptual variable consisting of the difference of scores between the two sub-scales. The association between being trained at the USP expressing higher disagreement with a Bleulerian conceptualisation is a consistent finding since this college has a traditional academic orientation. It is a World Health Organization collaborating center for training and research in mental health, which runs courses on the Portuguese version of the Present State Examination on a regular basis.
The exercise has been partially successful, producing a four-item scale that points to a Schneiderian viewpoint. As the Bleulerian scale is unsatisfactory, further consideration of the items themselves and their wording is needed - checking with those who favour this concept. If two scales of equal reliability could be established, then a study in a new and random sample of psychiatrists is necessary to confirm the factor structure. Subsequently, the ability of the scale to predict diagnostic behaviour by comparison with a research diagnosis should be verified. This in turn could also enable us to predict psychiatrists' behaviour in response to patients with psychotic symptoms suggesting schizophrenia.
To the psychiatrists who completed the questionnaire. Thanks are also due to Dr J. van Os, Dr G. Lewis, Dr M. Prince, Dr G. Busatto and Mr N. Hunter for their contributions.
1. BASTOS, O. Distúrbios esquizofrênicos J. Bras. Psiquiatr., 37: 71-5, 1988.
2. BLEULER, E. Dementia Praecox or the group of schizo-phrenias. New York, International Universities Press, 1950.
3. COOPER, J.E. Concepts of schizophrenia in the United States of America and in Great Britain; a summary of some studies by the U.S-U.K. Diagnostic Project. In: Lader, M.H., ed. Studies of schizophrenia. London, Headley Brothers, 1972. p. 1924.
4. COOPER, J.E. et al. Psychiatric diagnosis in New York and London. A comparative study of mental hospital admissions Maudsley Monogr., 20:47-54, 1972.
5. IACOPONI, E. et al. Brazil: a giant wakes up to progress and inequality. In: Appleby, L. & Araya, R., ed. Mental health services in the global village. London, Gaskell, 1991.
6. KENDELL, R.E. Schizophrenia. In: Kendell, R.E. & Zealley, A.K., ed. Companion to psychiatric studies. Edinburgh, Churchill-Livingstone, 1988. p. 310-34.
7. SARTORIUS, N. et al. Towards an international definition of schizophrenia: a report from the International Pilot Study of Schizophrenia. In: Lader, M.H., ed. Studies of schizophrenia. London, Headley Brothers, 1972. p. 25-8.
8. SASS, H. The classification of schizophrenia in the different diagnostic systems. In: Hafner, H.; Gattaz, F.W.; Janzarik, W., ed. Berlin Spring-Verlag, 1987. p. 19-28.
9. SCHNEIDER K. Clinical psychopathology. New York, Grune & Straton, 1950.
10. SHIRAKAWA, I. Esquizofrenia: histórico e conceito. J. Bras. Psiquiatr., 38: 154-6, 1989.
11. SOUGEY, E.B. Freqüência dos sintomas de primeira ordem de Kurt Schneider numa população de esquizofrênicos do Nordeste brasileiro. Rev. ABP APAL, 9: 151-6, 1987.
* Work carried out at: Section of Epidemiology and General Practice, Institute of Psychiatry, London. Study funded by "Conselho Nacional de Desenvolvimento Científico e Tecnológico/CNPq" (Process nº 203310-870). Derived from a PhD thesis "The diagnosis of schizophrenia in S. Paulo, Brazil: the influence of patients culture and clinicians' concepts", submitted to and approved by the University of London in April 1996.
** Available on request.
Correspondence to: Darci N. Santos - Rua Padre Feijó, 29 - 4º andar - Canela 40110-170 Salvador, Ba - Brasil. E-mail: email@example.com
Submited on 16.6.1997. Approved on 27.1.1998.