Abstract

We aim to describe the construction and validation of the logical model and the matrix of criteria for assessing care to people with mental disorders in conflict with the law. This is a methodological research, carried out from February to December 2019, following three procedures: 1) theoretical - composed of an evaluability study performed from documentary research and interviews with key informants; 2) empirical - construction of the collection instrument and selection of experts for the validation process of the proposed evaluation instrument; and 3) analytical - performing two Delphi steps. The evaluability study resulted in the elaboration and agreement of the logical model; the analysis and comparison between the reality of the policy and the logical model; and the elaboration of the matrix of criteria. The criteria matrix content adequacy was assessed by 16 experts in the Delphi 1 step and 12 experts in the Delphi 2 step, whose content was validated with a Content Validity Coefficient of 0.93. The logical model and the matrix of criteria proposed in this study are expected to direct health professionals, researchers, workers, and other social actors to assess this clientele’s care.

Key words:
Evaluation of health programs and projects; Evaluation of research programs and tools; Validation study; Mental disorders; Inmates

Introduction

In Brazil, the rights to dignity, autonomy, and social inclusion of people with mental disorders and the gradual deinstitutionalization of mental health users, along with the prohibition on prolonged hospitalization in asylum or asylum-like institutions were established under Law N° 10,216/2001 - the landmark of the Psychiatric Reform¹1 Amarante P, Nunes MO. A reforma psiquiátrica no SUS e a luta por uma sociedade sem manicômios. Cien Saude Colet 2018; 23(6):2067-2074..

Thus, the hospitalization of people with mental disorders started to be indicated only when the treatment outside the hospital proved to be ineffective. Three options are available: voluntary hospitalization, with the patient’s consent; involuntary, without consent and at the request of another person; and compulsory, determined by Justice²2 Brasil. Lei nº 10.216, de 6 de abril de 2001. Dispõe sobre a proteção e os direitos das pessoas portadoras de transtornos mentais e redireciona o modelo assistencial em saúde mental. Diário Oficial da União 2001; 30 abr..

Offenders with mental disorders are included in the compulsory hospitalization modality. In these cases, the Security Measures established by articles 96 to 99 of the Brazilian Criminal Code (CP) are applied to those considered unimputable or semi-imputable, who are unable to understand the illegality of their acts, and have an indication of hospitalization in Custody and Psychiatric Treatment Hospital (HCTP), or are subject to outpatient treatment³3 Brasil. Decreto-Lei nº 2.848, de 7 de dezembro de 1940 alterado pela Lei nº 9.777 em 26/12/98. Código Penal. Diário Oficial da União 1940; 31 dez..

However, a mismatch is observed between the current National Mental Health Policy, published from Law N° 10,216/2001, and the application of Security Measures, since legal issues centered on the ability to understand and self-determination in implementing the illicit act, combined with the specific and exclusive assessment of the psychiatrist, culminate sometimes in life imprisonment of the “crazy offender” in HCTPs³3 Brasil. Decreto-Lei nº 2.848, de 7 de dezembro de 1940 alterado pela Lei nº 9.777 em 26/12/98. Código Penal. Diário Oficial da União 1940; 31 dez.^,44 Cunha CC, Boarini ML. A medicina com o voto de minerva: o louco infrator. Psicol Soc 2016; 28:442-452..

The last survey carried out by the National Penitentiary Department in 2011 identified 26 Custody and Psychiatric Treatment Establishments (ECTP) in Brazil, namely, 23 HCTPs and three Psychiatric Treatment Wards (ATPs)⁵5 Diniz D. A custódia e o tratamento psiquiátrico no Brasil: Censo 2011. Brasília: Letras Livres, Editora Universidade de Brasília; 2013.. A survey conducted by the Geopenitentiary System of the National Council of Justice (CNJ) in 2014 identified 35 asylum-like spaces for the confinement of people with mental disorders in conflict with the law in Brazil⁶6 Geopresídios. Sistema Geopresídios do Conselho Nacional de Justiça (CNJ) [Internet]. [acessado 2020 mar 20]. Disponível em: https://www.cnj.jus.br/inspecao_penal/mapa.php.
https://www.cnj.jus.br/inspecao_penal/ma... . It is worth considering that such establishments remain connected to the security systems, and, despite being called “hospitals”, they have historically been governed according to the criminal execution principles since Law N° 7,210, of 1984⁷7 Oliveira AS, Dias FMV. Andando na contramão: o destino dos indivíduos com transtorno mental que cometem crimes no Brasil. Physis 2018; 28:e280305..

Such spaces had the following characteristics: the absence of a Singular Therapeutic Project (PTS); containment model determined by criminal law to the detriment of health policies; low participation of the health and social assistance networks; inadequate, insufficient, or nonexistent treatments; reinforced stigma, social prejudice, and eternalization of institutionalizations of patients; almost always irreversible loss of family and social ties; and improper consumption of public resources⁸8 Brasil. Ministério da Saúde (MS). Serviço de Avaliação e Acompanhamento de Medidas Terapêuticas Aplicáveis à Pessoa com Transtorno Mental em Conflito com a Lei. Brasília: MS; 2014..

Attentive to such demands, the Ministries of Justice and Health have implemented actions aimed at improving mental health assistance offered to people in conflict with the law, such as Resolution N° 113, of the National Council of Justice, which, in April 2010, included the Psychiatric Reform Law in the rules governing the application of the Security Measure, together with the Criminal Execution Law⁹9 Brasil. Conselho Nacional de Justiça. Resolução nº 113, de 20 de abril de 2010. Dispõe sobre o procedimento relativo à execução de pena privativa de liberdade e de medida de segurança, e dá outras providências. Diário da Justiça Eletrônico 2010; 26 abr..

Again, in 2010, the National Council for Criminal and Penitentiary Policy, in Resolution N° 4, highlighted the need to observe the principles established by Law N° 10,216/2001 in the implementation of the Security Measure. It proposed important guidelines, such as the intersectoral approach, continuous psychosocial monitoring, individualizing the imposed measure, concerning the psychological, social, and biological individual singularities, the social inclusion, among others¹⁰10 Brasil. Conselho Nacional de Política Criminal e Penitenciária. Resolução nº 4, de 30 de julho de 2010. Dispõe sobre as Diretrizes Nacionais de Atenção aos Pacientes Judiciários e Execução da Medida de Segurança. Diário Oficial da União 2010; 2 ago..

More recently, in 2014, through Ordinance N° 94, in line with the National Policy for Comprehensive Health Care for People Deprived of Liberty (PNAISP), the Ministry of Health established the service of evaluation and monitoring of therapeutic measures applicable to people with mental disorders in conflict with the law within the Unified Health System (SUS)¹¹11 Brasil. Portaria nº 94 de 15 de janeiro de 2014. Dispõe sobre a avaliação e acompanhamento de medidas terapêuticas aplicáveis à pessoa com transtorno mental em conflito com a Lei, vinculado à Política Nacional de Atenção Integral à Saúde das Pessoas Privadas de Liberdade no Sistema Prisional. Diário Oficial da União 2014, 15 jan..

This study is justified by the scarce literature, especially in the health sciences, on studies that evaluate the care to people with mental disorders in conflict with the law in the Brazilian context, the limited investments in evaluative research on health programs and policies associated with the difficulty of assessing a complex intervention, with a multidimensional character, involving services, systems, and multiple activities, and the lack of an instrument guiding the assessment of mental health care to people in conflict with the law continuously and systematically, and producing changes in the production of care for this group.

From this perspective, we aim to describe the process of constructing and validating the logical model and the matrix of criteria for assessing care to people with mental disorders in conflict with the law.

Methods

This is a methodological research, with a mixed approach, developed from February to December 2019, based on the methodological framework adapted from the three-step Psychometry of Pasquali¹²12 Pasquali L. Instrumentação psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010., as follows: 1) theoretical procedures, to identify the underlying contents of the logical model and the evaluation criteria matrix; 2) empirical procedures, when the content validation of the criteria matrix with experts in the field was outlined; and 3) analytical procedures, when the validation was analyzed with the Delphi technique to confirm or refute the validation of the proposed criteria matrix.

As for the theoretical procedures, a qualitative evaluability study that precedes the evaluation step itself was carried out to build the logical model and evaluation criteria matrix. It allows identifying the extent a program/policy is in a position to be subjected to an evaluation¹³13 Mendes MFM, Cazarin G, Bezerra LCA, Dubeux LS. Avaliabilidade ou pré-avaliação de um programa. In: Samico A, Felisberto E, Figueiró AC, Frias PG, colaboradores. Avaliação em Saúde: bases conceituais e operacionais. Rio de Janeiro: MedBook; 2010. p. 57-64..

It is a four-step cyclical and dynamic process, as follows: I) clarifications about the objectives and goals of the program/policy; II) development and agreement of the logical model with the interested parties; III) analysis and comparison between the reality of the program/policy and the logical model; IV) recommendations for carrying out the program/policy evaluation¹³13 Mendes MFM, Cazarin G, Bezerra LCA, Dubeux LS. Avaliabilidade ou pré-avaliação de um programa. In: Samico A, Felisberto E, Figueiró AC, Frias PG, colaboradores. Avaliação em Saúde: bases conceituais e operacionais. Rio de Janeiro: MedBook; 2010. p. 57-64..

Initially, the following documents were read in order to list relevant data and establish appropriations about PNAISP with regard to mental health care for people in conflict with the law: Interministerial Ordinance N° 1, of 2014, which establishes the PNAISP within the SUS¹⁴14 Brasil. Ministério da Saúde (MS). Secretaria de Atenção à Saúde. Departamento de Ações Programáticas Estratégicas. Coordenação de Saúde no Sistema Prisional. Política Nacional de Atenção Integral à Saúde das Pessoas Privadas de Liberdade no Sistema Prisional. Brasília: MS; 2014.; Ordinance N° 94/GM/MS, of 2014, which establishes the service of evaluation and monitoring of therapeutic measures applicable to people with mental disorders in conflict with the law, within the SUS¹¹11 Brasil. Portaria nº 94 de 15 de janeiro de 2014. Dispõe sobre a avaliação e acompanhamento de medidas terapêuticas aplicáveis à pessoa com transtorno mental em conflito com a Lei, vinculado à Política Nacional de Atenção Integral à Saúde das Pessoas Privadas de Liberdade no Sistema Prisional. Diário Oficial da União 2014, 15 jan.; Law N° 10,216, of 2001, which provides for the protection and rights of people with mental disorders and redirects the care model in mental health²2 Brasil. Lei nº 10.216, de 6 de abril de 2001. Dispõe sobre a proteção e os direitos das pessoas portadoras de transtornos mentais e redireciona o modelo assistencial em saúde mental. Diário Oficial da União 2001; 30 abr.; Ordinance N° 95, of January 14, 2014, which provides for the financing of the service of evaluation and monitoring of therapeutic measures applicable to the judicial patient, within the Unified Health System (SUS)¹⁵15 Brasil. Portaria nº 95, de 14 de janeiro de 2014. Dispõe sobre o financiamento do serviço de avaliação e acompanhamento às medidas terapêuticas aplicáveis ao paciente judiciário, no âmbito do Sistema Único de Saúde (SUS). Diário Oficial da União; 2014.; and Ordinance N° 142, of February 28, 2014, which establishes rules for the registration of the Teams for the Assessment and Monitoring of Therapeutic Measures Applicable to People with Mental Disorders in Conflict with the Law (EAP)¹⁶16 Brasil. Portaria nº 142, de 28 de fevereiro de 2014. Estabelece normas para o cadastramento das equipes de Avaliação e Acompanhamento das Medidas Terapêuticas Aplicáveis à Pessoa com Transtorno Mental em Conflito a Lei (EAP). Diário Oficial da União; 2014..

Then, the texts were read once more, and the relevant information for the description of the PNAISP was highlighted in the context of mental health care for people in conflict with the law and the contribution to the construction of the logical model. Thus, it was possible to identify PNAISP’s objectives, resources, activities, products, results, and impact. As a result, the logical model was built to systematize the functioning of the PNAISP concerning mental health care for people in conflict with the law.

The logical model was presented to the key informants - five actors who were directly involved with the implementation of mental health care for people in conflict with the law, within the State Health Secretariat (SESAP) and the State Penitentiary Administration Secretariat (SEAP) of the State of Rio Grande do Norte - interviewed by the responsible researcher, in their work environment, according to previous scheduling. At the time, they identified the proposed model’s adequacy to describe the policy and proposed adjustments.

Noteworthy is that, in the State of Rio Grande do Norte, locus of this study, care to people with mental disorders in conflict with the law occurs, primarily, at the Custody and Psychiatric Treatment Hospital (HCTP/RN). According to data provided by SEAP, it has a population of 45 inmates who occupy all the vacancies available at the institution. Also, the institution is equipped with the following health team: psychiatrist (1), nurses (2), nursing technicians (16), psychologist (1), and social worker (1).

The interviews adopted a semi-structured roadmap, as follows: Were the elements of PNAISP presented? Are there any other plausible ways to achieve the expected results? Have all relevant context factors been identified, and their potential influences described? If not, what other aspects can be added? What are the difficulties or facilities to operationalize the proposed objective?

They were recorded in audio, transcribed per the participants’ consent and, subsequently, an exhaustive reading-analysis of the transcriptions was carried out to extract information for readjustments of the proposed logical model. A consensus meeting was held after the suggested adjustments were made, where the logical model was presented to the key informants and validated through the Nominal Group Technique (TNG)¹⁷17 Pope C, Mays N. Pesquisa Qualitativa na Atenção à Saúde. Porto Alegre: Artmed; 2009.. In light of the validated logical model, a matrix of criteria was constructed to evaluate care to people with mental disorders in conflict with the law.

Subsequently, empirical and analytical quantitative procedures were used to validate the content of the criteria matrix. Experts selected through the analysis of curricula submitted to the Lattes Platform participated in this validation process, according to the following search strategy: Search mode - subject (title or keyword of the production) - “Mental health”; “Prison Health”; at the bases - doctors and other researchers; academic background/degree - Master.

Sixty-six experts were selected and, subsequently, their curricula analyzed according to the adaptation of Fehring’s criteria¹⁸18 Fehring RJ. The Fehring model. In: Carrol-Johnson RM, Paquete M. Classification of nursing diagnoses: proceeding of the tenth conference. Philadelphia: Lippincott Company; 1994. p. 55-62., with a minimum score of five points being established to select experts in the area of the construct, identifying 48 experts with the established score (Chart 1), which was followed by the search for the e-mails of the selected experts through their resumes, on the websites of their institutions, or in published papers. The e-mail address of four experts was not found, and these professionals were excluded.

Six to twenty experts are recommended to compose the content validation process¹²12 Pasquali L. Instrumentação psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.. However, considering the possible losses due to non-responses, an invitation e-mail was sent with the research’s presentation and its objectives, and the link that directed to the collection instrument for the 44 selected experts previously.

The collection instrument was built using the electronic tool Google Forms, consisting of four sections: 1) characterization of experts; 2) guidance to experts on how to complete the form; 3) logical model and criteria matrix; and 4) 20 multiple-choice questions (items) according to the Adequate, Partially Adequate or Inadequate options, with an open space for “comments or suggestions for inadequacies” about each item in the matrix mentioned above.

The multiple-choice questions referred to the items addressed in the criteria matrix, organized according to the dimensions of analysis: structure (1-8), process (9-14), and results (15-20). The experts only accessed the other sections of the form after signing the ICT.

The analytical procedures occurred through two Delphi steps. In the Delphi 1 step, 16 experts evaluated the matrix of criteria. In the Delphi 2 step, 12 completed the assessment instrument. The data were analyzed using simple descriptive statistics, using absolute and relative frequencies. The item with more than 70% agreement between the experts (assessed as Adequate) and a Content Validity Coefficient (CVC) >0.8¹²12 Pasquali L. Instrumentação psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010. was considered valid.

The ethical precepts established by Resolution N° 466/2012 of the National Health Council were followed, so that the study proposal was assessed and approved by the Research Ethics Committee. Participants signed the Informed Consent Term (ICT), and their anonymity and voluntary nature were preserved.

Results

I - Construction of the Logical Model and the Evaluation Criteria Matrix

The logical model of care to people with mental disorders in conflict with the law was elaborated (Figure 1) from the consulted documents and interviews with key informants. It aims to identify the components, resources, activities, and results expected with the implementation of the program (product and final result), and the causal chain of premises that articulate such elements.

Two components (political-managerial and tactical-operational) and three subcomponents were defined, as proposed by the experts consulted.

The discrepancies between the proposed logical model and the study’s loci’s reality were pointed out by the key informants and are shown in Chart 2.

Based on the logical model and the comparison between what is legally established and the reality, the components, subcomponents, dimensions of analysis, the indicators, and the different investigation techniques that resulted in an evaluation criteria matrix were described. Noteworthy is that the analysis dimension was organized from the triad proposed by Donabedian¹⁹19 Donabedian A. Basic approaches to assessment: structure, process and outcome. In: Donabedian A. Explorations in quality assessment and monitoring. Michigan: Health Administration Press; 1980. p. 77-125.: structure, process, and results.

II - Validation of the Criteria Matrix

Twelve experts participated in the final sample of the research, with a predominance of women (10; 83.3%); with a mean age of 42.6±8.9 years; graduates in psychology (7; 58.3%) and with a doctorate (7; 58.3%).

Table 1 shows the result of evaluating the items in the criteria matrix, in Delphi steps 1 and 2. Eleven items were considered valid in their content in the first evaluation step and had CVC=0.89 (Table 1).

Changes were made to items not validated during the Delphi 1 step, according to the experts’ suggestions, which were in item 1- To add community participation in the working committee; item 2- To subdivide into two indicators: elaboration and implementation of deinstitutionalization strategies; item 4- Details of the purpose of realizing the mental transfer; items 5, 8, 12, 14, 18 and 20- To add a field diary and interview with users as collection techniques to verify the established indicators.

Then, the matrix was submitted to a new evaluation step (Delphi 2). All items were considered valid in their content from this evaluation round, with experts’ agreement higher than 70% and CVC=0.93 (Table 1). The matrix validated by experts is shown in Chart 3.

Discussion

The complexity, plurality, and intersectoriality of the mental health field denote the need to implement assessment processes in this field, in the light of theoretical and methodological rigor under current legislation¹1 Amarante P, Nunes MO. A reforma psiquiátrica no SUS e a luta por uma sociedade sem manicômios. Cien Saude Colet 2018; 23(6):2067-2074.^,2020 Bessa MS, Araújo Filho JD, Azevedo DM, Salvetti MG, Torres GV. Avaliação de Resultados da Assistência em Saúde Mental por Usuários. Rev Bras Cien Saude 2019; 23:89-96..

In this context, the study of evaluability emerges as a fundamental step, as it provides a favorable environment for evaluation, builds understandings among those involved about the nature and objectives of the program/policy, seeks agreement on the interest in carrying out the evaluation, and potential study users, increasing the likelihood of using the evaluation results¹²12 Pasquali L. Instrumentação psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010..

We identified that the policy’s objectives and goals concerning the context studied are poorly defined. However, the development of the logical model clarified issues regarding PNAISP’s direction regarding care to people with mental disorders in conflict with the law, emphasizing deinstitutionalization based on the following actions: implementing the Singular Therapeutic Project (PTS); favoring the articulation between SUS services and the Unified Social Assistance Service (SUAS); and contributing to the progressive disinternation of people under security measures in penal or hospital institutions¹³13 Mendes MFM, Cazarin G, Bezerra LCA, Dubeux LS. Avaliabilidade ou pré-avaliação de um programa. In: Samico A, Felisberto E, Figueiró AC, Frias PG, colaboradores. Avaliação em Saúde: bases conceituais e operacionais. Rio de Janeiro: MedBook; 2010. p. 57-64..

Notwithstanding, enacting legal norms is an insufficient condition for realizing that their practical consequences must be materialized in systematic and integrated actions¹²12 Pasquali L. Instrumentação psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010..

In this context, comparing the logical model and the evaluated policy’s reality allows appreciating essential aspects not outlined in the logical model and already subsidize the subsequent evaluation process¹²12 Pasquali L. Instrumentação psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.. Regarding the structure, the key informants pointed out the difficulty of operationalizing the logical model related to the non-detailing of official documents, a finding similar to the study by Silva et al.²¹21 Silva RN, Guarda FRB, Hallal PC, Martelli PJL. Avaliabilidade do Programa Academia da Saúde no Município do Recife, Pernambuco, Brasil. Cad Saude Publica 2017; 33:e00159415.. On the normative production in the right to health of people with mental disorders in conflict with the law, a study by Borges and Moura²²22 Borges AAB, Moura LM. Análise da produção normativa no direito à saúde dos inimputáveis - doentes mentais infratores (2011-2014). Cad Ibero-Amer Dir Sanit 2015; 4:83-102. points out the need for rectification in the legislation on the subject that prioritizes the link with the Justice sector the country.

The key informants pointed out the structural deficiency in providing the recommended care, which can be explained by the history of negligence experienced by the “crazy offender”²³23 Soares Filho MM, Bueno PMMG. Demografia, vulnerabilidades e direito à saúde da população prisional brasileira. Cien Saude Colet 2016; 21(7):1999-2010. and increasing hospitalizations due to the Safety Measure of users of alcohol and other drugs²⁴24 Lhacer PMV. Transinstitucionalização: Caminhos e Descaminhos na Dinâmica de Internações e Desinternações de Pessoas com Transtorno Mental em Conflito com a Lei no Estado de São Paulo [tese]. São Paulo: Universidade de São Paulo; 2019..

Besides the structural deficiency, restructuring the care to people with mental disorders in conflict with the law collides with the struggle of implementing intersectoriality, both among the health team professionals, and these professionals and legal practitioners²⁵25 Oliveira TTSS, Abrici EP, Santos MA. Estrutura e funcionamento de uma equipe de saúde mental de Trieste na perspectiva de seus integrantes: um estudo qualitativo. Psicol Pesq 2018; 12(2):24-35..

The medical hegemony-based statements, to the detriment of the expanded clinic, and based on actions’ punitive character, to the detriment of resocialization, hinder everyone’s intersectoriality in conflict with the law, regardless of their mental health status²³23 Soares Filho MM, Bueno PMMG. Demografia, vulnerabilidades e direito à saúde da população prisional brasileira. Cien Saude Colet 2016; 21(7):1999-2010.. In turn, such discourses are maintained, among other reasons, by the insufficient continuing and permanent education projects focusing on psychosocial care in the services²⁶26 Ferreira TPS, Sampaio J, Souza ACN, Oliveira DL, Gomes LB. Produção do cuidado em Saúde Mental: desafios para além dos muros institucionais. Interface (Botucatu) 2017; 21(61):373-384., which contributed to the disarticulation between the devices of the Psychosocial Care Network (RAPS) and the courts of law, and the lack of shared accountability by the PTS of subjects under SM²⁷27 Cortez PA, Souza MVR, Oliveira LFA. Princípios de uma política alternativa aos manicômios judiciais. Saude Soc 2018; 27(4):1206-1217..

The construction of the matrix of evaluation criteria elucidated the absence of goals defined in the consulted legal documents, which denotes that aspects addressed in the PNAISP are not adequately explained regarding care to people in conflict with the law. However, the matrix presented in this study can favor systematic monitoring by the actors involved with such a clientele¹²12 Pasquali L. Instrumentação psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010..

Also, the validation of the content of the evaluation criteria matrix is a fundamental step to verify the relevance of the items underpinning the material proposed to the construct they represent¹⁸18 Fehring RJ. The Fehring model. In: Carrol-Johnson RM, Paquete M. Classification of nursing diagnoses: proceeding of the tenth conference. Philadelphia: Lippincott Company; 1994. p. 55-62..

Delphi is the most appropriate instrument validation technique because it seeks the consensus of professionals with significant expertise in knowledge on screen and obtains quality answers and opinions for a given question addressed to these professionals²⁸28 Scarparo AF, Laus AM, Azevedo ALCS, Freitas MRI, Gabriel CS, Chaves LDP. Reflexões sobre a técnica delphi em pesquisa na enfermagem. Rev Rene 2012; 13(1):242-251.. Concerning suggestions from experts in the field, we underscore the importance of including users in the evaluation process since, as research by Lanbecker et al.²⁹29 Langbecker A, Castellanos MEP, Neves RF, Catalan-Matamoros D. Journal coverage on issues of interest to Brazilian Collective Health: a literature review. Interface (Botucatu) 2019; 23:e1800095. points out, people with mental disorders’ voice is sometimes invisible in the Brazilian research scenario. Noteworthy is that the validation of health assessment tools must be systematic and continuous, given the health field’s dynamics.

Final considerations

The institutionalization of evaluation in the daily life of services is a valuable tool to support processes of change in the evaluated scenarios organization, insofar as they provide those involved or interested, directly or indirectly, with conditions to decide how to address and solve everyday problems.

From this perspective, the elaboration of the logical model and its confrontation with the reality experienced by the key informants allowed the identification of gaps regarding the structure, process, and results of the implementation of care to people with mental disorders in conflict with the law. Also, the elaboration of the criteria matrix and subsequent validation of its content by experts in the field can favor the proposed evaluation.

An important limitation of the study is the reduced number of critical informants carrying out the evaluability study.

Finally, the logical model and the criteria matrix constructed in this study can be studied and revised at any time, as new guidelines and implementation strategies are innovated or as other analytical or evaluative perspectives direct to the PNAISP. We recommend establishing achievable goals, and that the criteria matrix proposed in this study to guide the evaluation of care to people with mental disorders in conflict with the law.

References

Publication Dates

History