Abstracts

Introduction

Reliable information on causes of death can provide useful epidemiological evidence to support decision-making and inform public policies ¹1. Dias RISC, Barreto JOM, Vanni T, Candido AMSC, Moraes LH, Gomes MAR. Estratégias para estimular o uso de evidências científicas na tomada de decisão. Cad Saúde Colet (Rio J.) 2015; 23:316-22.. In Brazil, such data can help address the wide disparities in mortality among states and sociodemographic groups ²2. Ministério da Saúde. Painel de monitoramento da mortalidade por causas básicas inespecíficas ou incompletas (garbage codes). http://svs.aids.gov.br/dantps/centrais-de-conteudos/paineis-de-monitoramento/mortalidade/codigos-garbage/ (accessed on 02/Dec/2019).
http://svs.aids.gov.br/dantps/centrais-d... ^,33. Marinho MF, França EB, Teixeira RA, Ishitani LH, Cunha CC, Santos MR, et al. Data for health: impact on improving the quality of cause-of-death information in Brazil. Rev Bras Epidemiol 2019; 22 Suppl 3:E190005.supl.3.. A major public health concern in Brazil are external causes (injuries), which comprise a higher percentage of deaths (12%) compared with other countries ⁴4. GBD 2017 Causes of Death Collaborators. Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018; 392:1736-88..

The main source of cause of death data in Brazil is the Mortality Information System (SIM), established in 1975. Brazil recorded more than 1.31 million deaths in 2017, accounting for over 96% of all deaths; of these deaths, 36.5% were garbage codes ²2. Ministério da Saúde. Painel de monitoramento da mortalidade por causas básicas inespecíficas ou incompletas (garbage codes). http://svs.aids.gov.br/dantps/centrais-de-conteudos/paineis-de-monitoramento/mortalidade/codigos-garbage/ (accessed on 02/Dec/2019).
http://svs.aids.gov.br/dantps/centrais-d... ^,33. Marinho MF, França EB, Teixeira RA, Ishitani LH, Cunha CC, Santos MR, et al. Data for health: impact on improving the quality of cause-of-death information in Brazil. Rev Bras Epidemiol 2019; 22 Suppl 3:E190005.supl.3.^,55. Ministério da Saúde. Indicadores de cobertura que utilizam a metodologia do Busca Ativa. http://svs.aids.gov.br/dantps/acesso-a-informacao/acoes-e-programas/busca-ativa/indicadores-de-saude/cobertura/ (accessed on 02/Dec/2019).
http://svs.aids.gov.br/dantps/acesso-a-i... . Garbage codes are poor-quality and uninformative for public health policy causes of death, for example “undetermined intent”. Garbage codes are a classic indicator of the quality of health information systems ⁶6. Rao C, Lopez AD, Yang G, Begg S, Ma J. Evaluating national cause-of-death statistics: principles and application to the case of China. Bull World Health Organ 2005; 83:618-25.^,77. Cendales R, Pardo C. Quality of death certification in Colombia. Colomb Med 2018; 49:121-7.^,88. Mikkelsen L, Richards N, Lopez AD. Redefining 'garbage codes' for public health policy: report on the expert group meeting, 27-28 February 2017. Melbourne: University of Melbourne; 2018., and have been used as an indicator of the level of comprehensiveness and specificity of information on death certificates ⁹9. Lu TH, Walker S, Anderson RN, McKenzie K, Bjorkenstam C, Hou WH. Proportion of injury deaths with unspecified external cause codes: a comparison of Australia, Sweden, Taiwan and the US. Inj Prev 2007; 13:276-81.. Often, records do not specify a valid cause of death, requiring in-field collection of supplementary information ¹⁰10. Soares Filho AM, Cortez-Escalante JJ, França E. Review of deaths correction methods and quality dimensions of the underlying cause for accidents and violence in Brazil. Ciênc Saúde Colet 2016; 21:3803-18.. Such supplementary information is difficult to obtain or is inexistent, but algorithms exist to redistribute garbage codes to other specific cause of death ¹¹11. Naghavi M, Makela S, Foreman K, O'Brien J, Pourmalek F, Lozano R. Algorithms for enhancing public health utility of national causes-of-death data. Popul Health Metr 2010; 8:9.. Brazil has important differences in coverage in the capture of deaths and quality of cause of death data among regions, observing less favorable situations in the poorest regions, such as North and Northeast ¹²12. Cunha CC, Teixeira R, França E. Assessment of the investigation of ill-defined causes of death in Brazil in 2010. Epidemiol Serv Saúde 2017; 26:19-30.^,1313. Frias PG, Szwarcwald CL, Lira PIC. Avaliação dos sistemas de informações sobre nascidos vivos e óbitos no Brasil na década de 2000. Cad Saúde Pública 2014; 30:2068-280.. However, improvement in coverage of death reporting and quality of cause of death over the years has reduced these differences ¹³13. Frias PG, Szwarcwald CL, Lira PIC. Avaliação dos sistemas de informações sobre nascidos vivos e óbitos no Brasil na década de 2000. Cad Saúde Pública 2014; 30:2068-280.^,1414. Szwarcwald CL, Frias PG, Souza Júnior PRS, Almeida WS, Morais Neto OL. Correction of vital statistics based on a proactive search of deaths and live births: evidence from a study of the North and Northeast regions of Brazil. Popul Health Metr 2014; 12:16.^,1515. Teixeira RA, Naghavi M, Guimarães MDC, Ishitani LH, França EB. Quality of cause-of-death data in Brazil: garbage codes among registered deaths in 2000 and 2015. Rev Bras Epidemiol 2019; 22 Suppl 3:E190002.supl.3..

In 2017, injuries were the cause of 158,658 deaths in Brazil. Over one-quarter of the original cause for these deaths was a garbage code ¹⁶16. Soares Filho AM, Vasconcelos CH, Nóbrega AA, Pinto IV, Merchan-Hamann E, Ishitani LH, et al. Improvement of the unspecified external causes classification based on the investigation of death in Brazil in 2017. Rev Bras Epidemiol 2019; 22 Suppl 3:E190011.supl.3.. In recent decades, Brazil has been applying efforts to improve the quality of data in SIM, including investigation of garbage codes ¹⁷17. Campos D, França E, Loschi RH, Souza MFM. Uso da autópsia verbal na investigação de óbitos com causa mal definida em Minas Gerais, Brasil. Cad Saúde Pública 2010; 26:1221-33.^,1818. França EB, Cunha CC, Vasconcelos AMN, Escalante JJC, Abreu DX, Lima RB, et al. Investigation of ill-defined causes of death: assessment of a program's performance in a state from the Northeastern region of Brazil. Rev Bras Epidemiol 2014; 17:119-34.^,1919. Bierrenbach AL, Alencar GP, Martinez C, Souza MFM, Policena GM, França EB. Redistribution of heart failure deaths using two methods: linkage of hospital records with death certificate data and multiple causes of death data. Cad Saúde Pública 2019; 35:e00135617.^,2020. Ishitani LH, Teixeira RA, Abreu DMX, Paixão L, França EB. Quality of mortality statistics' information: garbage codes as causes of death in Belo Horizonte, 2011-2013. Rev Bras Epidemiol 2017; 20 Suppl 1:34-45.^,2121. Lima RB, Frederes A, Marinho MF, Cunha CC, Adair T, França EB. Investigation of garbage code deaths to improve the quality of cause-of-death in Brazil: results from a pilot study. Rev Bras Epidemiol 2019; 22 Suppl 3:E190004.supl.3.. As a result of investigation by municipal health departments, garbage codes from injury deaths have been halved to 13% ¹⁶16. Soares Filho AM, Vasconcelos CH, Nóbrega AA, Pinto IV, Merchan-Hamann E, Ishitani LH, et al. Improvement of the unspecified external causes classification based on the investigation of death in Brazil in 2017. Rev Bras Epidemiol 2019; 22 Suppl 3:E190011.supl.3.. Notably, 81% of injury garbage codes were issued by forensic institutes, indicating inadequacies in death certificate issues that can be understood by coders and, therefore, be correctly coded; this was found to be particularly true in small- and medium-sized municipalities ⁴4. GBD 2017 Causes of Death Collaborators. Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018; 392:1736-88.^,1010. Soares Filho AM, Cortez-Escalante JJ, França E. Review of deaths correction methods and quality dimensions of the underlying cause for accidents and violence in Brazil. Ciênc Saúde Colet 2016; 21:3803-18.^,2222. Messias KLM, Bispo Júnior JP, Pegado MFQ, Oliveira LC, Peixoto TG, Sales MAC, et al. The quality of certification of deaths due to external causes in the city of Fortaleza in the State of Ceará, Brazil. Ciênc Saúde Colet 2016; 21:1255-67..

In Brazil, there has been a long-standing process to investigate garbage codes, specifically on ill-defined causes and unspecified external causes. These investigation procedures were better structured nationally around the mid-2000s by a standardized procedure and form ¹²12. Cunha CC, Teixeira R, França E. Assessment of the investigation of ill-defined causes of death in Brazil in 2010. Epidemiol Serv Saúde 2017; 26:19-30.^,1515. Teixeira RA, Naghavi M, Guimarães MDC, Ishitani LH, França EB. Quality of cause-of-death data in Brazil: garbage codes among registered deaths in 2000 and 2015. Rev Bras Epidemiol 2019; 22 Suppl 3:E190002.supl.3.^,1717. Campos D, França E, Loschi RH, Souza MFM. Uso da autópsia verbal na investigação de óbitos com causa mal definida em Minas Gerais, Brasil. Cad Saúde Pública 2010; 26:1221-33.^,1818. França EB, Cunha CC, Vasconcelos AMN, Escalante JJC, Abreu DX, Lima RB, et al. Investigation of ill-defined causes of death: assessment of a program's performance in a state from the Northeastern region of Brazil. Rev Bras Epidemiol 2014; 17:119-34.. Deaths by injury investigation comprises collecting information about the circumstances of the event at forensic institutes and hospitals, in addition to collecting information from other sources, such as police stations, toxicology units, and the public emergency transport service. The investigation is conducted according to the exact type of accident or violence that produced (are the cause for) the injuries leading to death ¹⁰10. Soares Filho AM, Cortez-Escalante JJ, França E. Review of deaths correction methods and quality dimensions of the underlying cause for accidents and violence in Brazil. Ciênc Saúde Colet 2016; 21:3803-18..

In 2017, Brazil, with support from the Data for Health Initiative, implemented actions to improve the diagnosis of cause of death in cooperation with death surveillance teams in 60 municipalities ⁵5. Ministério da Saúde. Indicadores de cobertura que utilizam a metodologia do Busca Ativa. http://svs.aids.gov.br/dantps/acesso-a-informacao/acoes-e-programas/busca-ativa/indicadores-de-saude/cobertura/ (accessed on 02/Dec/2019).
http://svs.aids.gov.br/dantps/acesso-a-i... ^,2121. Lima RB, Frederes A, Marinho MF, Cunha CC, Adair T, França EB. Investigation of garbage code deaths to improve the quality of cause-of-death in Brazil: results from a pilot study. Rev Bras Epidemiol 2019; 22 Suppl 3:E190004.supl.3.. The standard form - used by the mortality surveillance program to investigate causes of garbage codes deaths in hospitals ²³23. Ministério da Saúde. Causas mal definidas. http://svs.aids.gov.br/dantps/cgiae/vigilancia-do-obito/causas-mal-definidas/ (accessed on 02/Dec/2019).
http://svs.aids.gov.br/dantps/cgiae/vigi... - was proposed and tested in 2017 to collect information from medical records in hospitals to assign the underlying-cause of death (Supplementary Material 1: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl1-0972-22_8224.pdf) ²¹21. Lima RB, Frederes A, Marinho MF, Cunha CC, Adair T, França EB. Investigation of garbage code deaths to improve the quality of cause-of-death in Brazil: results from a pilot study. Rev Bras Epidemiol 2019; 22 Suppl 3:E190004.supl.3.. However, this form presents an insufficient number of questions about the circumstances of injury deaths to accurately assign the underlying cause of death. Moreover, it lacks questions that could allow to determine the aggressor’s intent and the means used (e.g., firearm homicide or self-inflicted).

One of the actions developed was to investigate external garbage codes from different sources of information, including forensic institutes and hospitals, using a standard investigation form (investigation of deaths from external causes - IDEC) ¹⁶16. Soares Filho AM, Vasconcelos CH, Nóbrega AA, Pinto IV, Merchan-Hamann E, Ishitani LH, et al. Improvement of the unspecified external causes classification based on the investigation of death in Brazil in 2017. Rev Bras Epidemiol 2019; 22 Suppl 3:E190011.supl.3.. Previously, external-cause garbage codes have been investigated with the same form as every other garbage codes. The IDEC form, developed by the mortality surveillance team of the Brazilian Ministry of Health, with the support of the Graduate Program in Public Health of the University of Brasília and the Federal University of Minas Gerais, was devised to be prospectively used across the country for external-cause garbage codes investigation (Supplementary Material 2: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl2-0972-22_5497.pdf). This form differs from the previous one since it introduced questions and variables that allow for the collection of detailed data about the circumstance of death from external cause (Supplementary Material 1: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl1-0972-22_8224.pdf; Supplementary Material 2: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl2-0972-22_5497.pdf).

The use of a specific form could improve the quality of external cause of death data in Brazil. This study aimed to analyze the performance and suitability of the new IDEC form to improve the quality of external cause of death data in Brazil. Therefore, we intend to verify whether this new form, designed to recapture data on the circumstance of the external cause of death, provides sufficient information for the reclassification of garbage codes into valid cause of death codes. Moreover, if a form with specific questions for this type of cause reclassifies more garbage codes into valid codes than the standard procedure.

Methods

An observational-analytical study of investigations on garbage-coded deaths due to injuries was performed using the newly developed IDEC form.

The IDEC form was tested in six Brazilian state capitals - Fortaleza (Ceará), Recife (Pernambuco), Goiânia (Goiás), Rio de Janeiro, Belo Horizonte (Minas Gerais), and Florianópolis (Santa Catarina) - selected among the 60 cities of the Data for Health Initiative covering different regions of the country. The garbage codes for injuries were defined according to the GBD 2015 study ⁸8. Mikkelsen L, Richards N, Lopez AD. Redefining 'garbage codes' for public health policy: report on the expert group meeting, 27-28 February 2017. Melbourne: University of Melbourne; 2018.^,1111. Naghavi M, Makela S, Foreman K, O'Brien J, Pourmalek F, Lozano R. Algorithms for enhancing public health utility of national causes-of-death data. Popul Health Metr 2010; 8:9.^,2424. GBD 2015 Mortality and Causes of Death Collaborators. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet 2016; 388:1459-544.. The detailed list of garbage codes type is presented in the Supplementary Material 3 (http://cadernos.ensp.fiocruz.br/static//arquivo/suppl3-0972-22_6700.pdf).

The six capitals reported 17,514 deaths from external causes, with 44% (n = 7,731) classified as garbage code. As part of the garbage codes investigation, 85% (n = 6,606) were investigated: 6,382 using the current standard procedure and 224 (212 external causes and 12 cases suspected to be violent) with the IDEC form. These 224 cases correspond to 20% of the 1,125 garbage codes that were not investigated by current standard procedure. A total of 60 of the 224 deaths were discarded for not reporting an underlying cause on the death certificate in SIM. However, 164 deaths were investigated using the new IDEC form. Of these deaths, 133 were exclusively due to external causes with garbage codes. That is, since the field investigator did not inform the type of garbage codes before the investigation, it was impossible to compare and reclassify these causes before and after the investigation. However, it is important to note that the investigation allowed classifying 83% (n = 50) of these investigated deaths in a valid code. These deaths were discarded for it was impossible to make the planned comparisons. The matched random sample of deaths that used the standard procedure made up a third group of 992 cases (Supplementary Material 4: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl4-0972-22_1248.pdf; Supplementary Material 5: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl5-0972-22_3246.pdf). The 133 deaths from external causes with garbage codes were considered as a reference for sample calculation since the standard procedure for investigating deaths does not provide defined causes (valid codes) for the investigation. The sample size with the current standard procedure was defined as the largest possible to obtain the matching with the proportional distribution by cause, region, sex, and age in the 133 deaths investigated with the IDEC form. Matched sample = 16%, 992 of 6,196 (6,382-186) since the ignored ages were excluded in six Brazilian state capitals (Supplementary Material 4: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl4-0972-22_1248.pdf; Supplementary Material 5: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl5-0972-22_3246.pdf); this was calculated by group of external causes with garbage codes (two groups), sex, age, and region. The matched random sample was, therefore, stratified by causes (undetermined intent; all other garbage codes), sex (male, female), age group (0-24, 25-44, 45-54, 55-64, 65-74, 75 or more), and region (Northeast, Southeast, South/Central-West) to provide a distribution similar to that found in the 133 deaths investigated with the IDEC form. The South and Central-West regions were grouped because they presented similar results in the investigation with the IDEC form.

Field testing of the new form was carried out in the second half of 2018, with death records from external causes notified with garbage codes in the SIM in 2017 and 2018. The cities had teams, comprised of health service professionals with experience in mortality surveillance, within the municipal health departments to investigate deaths. Using the IDEC form, each team retrieved data at notifying units, such as forensic institutes and hospitals, and were usually coordinated by physicians or nurses with experience in improving the diagnosis of cause of death in the Data for Health Initiative. After the investigation, the underlying cause of death was coded in each city and was reviewed by a senior coder at national level, with extensive experience in external causes. The investigation using the current standard procedure and the IDEC form was carried out by the same team at the same period of time, after training in the field protocol; fieldwork supervision was carried out during the same period.

The reclassification of an original underlying cause of death by garbage codes to a better-qualified underlying-cause after investigation was conducted according to França et al. ²⁵25. França E, Teixeira R, Ishitani L, Duncan BB, Cortez-Escalante JJ, Morais Neto OL, et al. Ill-defined causes of death in Brazil: a redistribution method based on the investigation of such causes. Rev Saúde Pública 2014; 48:671-81.. The results before and after investigation and between the IDEC form and the current standard procedure were compared defining two comparative groups obtained from SIM 2017: “total cases” and a “matched random sample”.

The primary comparison was conducted between the IDEC form and the matched sample. Results from the total cases are shown in Supplementary Material 6 (http://cadernos.ensp.fiocruz.br/static//arquivo/suppl6-0972-22_6369.pdf). These data help the comparative and critical analyses with the main results of the article. In addition, it allows greater access to different data produced in the study. To characterize the garbage codes, the following variables were analyzed: age groups (0-24, 15-24, 25-44, 45-54, 55-64, 65-74, 75 or more), sex (male, female), the original underlying cause of death before the investigation (undetermined intent: Y10-Y34, all other garbage codes, detailed in Supplementary Material 3: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl3-0972-22_6700.pdf), and region (Northeast, Southeast, South/Central-West). Also, the sufficiency of the collected data was verified by identifying necessary and unnecessary variables presenting a synthesis of the feedback offered by field researchers after the investigation using the IDEC form. Researchers’ comments recorded in a field diary were organized according to strengths, difficulties or aspects to be improved, and suggestions. This feedback from field investigators supported the reformulation of the new form (IDEC), as one of the final products of this work (Supplementary Material 7: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl7-0972-22_2894.pdf). Thus, this article shows the performance of the IDEC form to improve the recording of the external cause of death and the possible improvements on this form after the field test in the capitals of Brazil.

As previously described, the six capitals were part of the 60 cities of the Data for Health Initiative that investigated garbage codes, applying the standard form and investigation protocol. The same teams from this Initiative tested the new form with the deaths that were not investigated during that project. For this reason, we did not consider the proportion of investigated deaths by capital using the new form to calculate the sample.

Statistical inference was estimated for the change from garbage codes to valid codes before and after the investigation, measured as a proportion and using 95% confidence intervals (95%CI) with binomial distribution. The hypothesis of no difference (H0) of the proportions was refuted when the confidence intervals did not overlap, assuming the alternative hypothesis (H1) that the proportions were significantly different in the comparisons. Furthermore, the ratio of the proportion of change using cases with the IDEC form as the reference (numerator) was calculated. Changes in the three groups were compared for total garbage codes, undetermined intent, and all other garbage codes. The interval estimation is given by the following equation:

where: n is the sample size; p is the proportion; and z (standardized value) is equal to 1.96 for 95% confidence.

Overall, 6,546 garbage codes were investigated using three analysis groups: (1) current standard procedure (n = 6,382); (2) IDEC form (n = 164), of which 152 were injuries; and (3) matched random sample of cases from the standard procedure group (n = 992).

This study was approved by the Research Ethics Committee of the Federal University of Minas Gerais (CAEE 75555317.0.0000.5149). Non-nominal secondary data for the current standard procedure was used, according to Resolution n. 510/2016²⁶26. Conselho Nacional de Saúde. Resolução nº 510, de 7 de abril de 2016. Diário Oficial da União 2016; 24 may., which provides for research standards.

Results

In this section, we describe our results: firstly, we show data on the performance of the new form/IDEC (Tables 1, 2, 3 and 4) and summarize the field researchers’ feedback on its suitability to recapture data (Box 1), which led to a final reformulated version of the tested IDEC form (Supplementary Material 7: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl7-0972-22_2894.pdf).

Table 1 shows the characteristics of deaths the new form investigated and the current standard procedure with matched samples. In both groups, the investigated deaths occurred more often in older men living in the Brazilian Southeast for undetermined causes. As designed, the IDEC form and matched sampling showed similar characteristics. The proportion of deaths in the group aged 65 years or older composed 40.6% of the cases the IDEC form investigated and 41% the standard procedure did. Among the evaluated injury garbage codes, the most common cause of death was “undetermined intent”, at a frequency of 54.1% in the IDEC form and 54.6% in the current standard procedure. Investigated causes across regions showed slight differences in the Southeast (74.4% in the IDEC and 71.9% in the standard procedure) and South/Central-West (7.5% in the IDEC and 10.2% in the standard procedure). The IDEC form also assessed deaths from natural causes considered suspect or likely to be injuries (7.3%) and valid injury codes (11%) to confirm the cause of death (Table 3; Supplementary Material 6: http://cadernos.ensp.fiocruz.br/static//arquivo/suppl6-0972-22_6369.pdf).

Table 2 shows the results of classifying garbage codes of external causes into valid codes. The IDEC form consisted of 133 cases due to this delimitation in its data. Garbage codes evaluation with the IDEC form reduced injury garbage codes by -92.5% (95%CI: -97.0; -88.0), whereas the current standard procedure only reduced garbage codes by -60.5% (95%CI: -63.5; -57.4) (Table 2), a 1.53 times greater reduction. This rate was lower for deaths of undetermined intent (i.e., 1.15) but higher (2.50) for all other injury garbage codes.

Table 3 shows the reclassification of deaths after the IDEC form investigation. We consider all investigated causes: garbage codes for injuries and natural cause and valid injury codes (11%) to confirm causes of death in 164 cases. From undetermined injuries, 7% remained garbage codes, 56% became falls; 13%, self-harm; and 8%, interpersonal violence. In total, 7% of unspecified unintentional injuries remained as garbage codes; 33% became pedestrian road injuries; 30%, motorcyclist injuries; and 19%, falls. As expected, the IDEC reclassified almost all unspecified road injuries to pedestrian, cyclist, motorcyclist, or motor vehicle ones. It also gave specific causes to previously unspecified transport injuries, interpersonal violence, and unintentional injuries. The form recategorized 30% of the causes it investigated into falls; 33%, as specific road injuries; and 15%, as specified interpersonal violence.

Table 4 shows how the current standard procedure reclassified deaths initially categorized as injury garbage codes after investigating its matched sample . Of the most common causes of undetermined injuries, 20.3% remained garbage codes. The percentage rises for most less common causes: 70.3% of unspecified transport injuries, 53.2% of unspecified unintentional injuries, 83.5% of unspecified interpersonal violence, and 100% of other garbage codes injuries. The standard procedure reclassified 23.8% of cases with specific causes into falls; 9.5%, as interpersonal violence; and 16.2% as road injuries (much lower than the 32% via IDEC form). IDEC attributed 94% of the evaluated garbage codes to valid causes, whereas the standard procedure, only 60.5%.

Box 1 summarizes the feedback field researchers offered after using the IDEC form. They provided feedback after testing it on information collected in hospitals and forensic institutes. Supplementary Material 2 (http://cadernos.ensp.fiocruz.br/static//arquivo/suppl2-0972-22_5497.pdf) and Supplementary Material 7 (http://cadernos.ensp.fiocruz.br/static//arquivo/suppl7-0972-22_2894.pdf) show the IDEC form before and after the modifications we implemented based on testing and feedback. The advantages researchers mentioned included the standardization of the instrument to investigate deaths due to external causes and its improved potential for retrieving true cause of death. However, they found that the longer IDEC form takes 30 minutes until completion, on average, a clear disadvantage.

Based on the feedback from field researchers, several modifications were made to the form to make it more intuitive, simple, objective, and clear (Box 1). One was standardizing the terminology for the variables to be consistent with other forms, such as the death certificate and violence notification form. We also removed three redundant items/questions. The sequence is important since we designed the form for use in different settings. Therefore, we grouped questions in a more relevant and logical manner for the several involved institutions: policy data, followed by that from hospitals and forensic institutes. Finally, we included additional items, including complementary information on violence and accidents to facilitate specifying victims, means, other parties in transport accidents, etc.

We found that the investigated causes failed to always define circumstances of deaths due to insufficient information after data collection from relevant sources, for example, the absence of data from police investigations or the non-registration of the circumstances of death in hospital records. All 11 garbage codes deaths which evaded classification into valid causes lacked details from hospital records and/or in police reports.

Discussion

As far as we know, this is the first Brazilian study comparing the effectiveness of a new form to investigate garbage codes for external causes. The recapture of information on the circumstances of deaths from external causes with the new IDEC form greatly reduced garbage codes than the current standard procedure; only 7.5% of IDEC form deaths remained as garbage codes, compared to 34% in the matched sample. IDEC reclassified deaths from undetermined intent into valid codes twice as effectively than in other external garbage codes, convincingly reclassifying garbage codes into specific categories such as falls, road injuries, and interpersonal violence.

The characteristics of the matched sample under the current standard procedure usually resembled the 133 cases investigated via IDEC, only slightly differing in regional distribution. Its characteristics agreed with previous studies and showed a higher frequency of death in men, both younger and older, and a higher frequency of deaths from injuries occurring in hospitals than other deaths ¹⁶16. Soares Filho AM, Vasconcelos CH, Nóbrega AA, Pinto IV, Merchan-Hamann E, Ishitani LH, et al. Improvement of the unspecified external causes classification based on the investigation of death in Brazil in 2017. Rev Bras Epidemiol 2019; 22 Suppl 3:E190011.supl.3.^,2020. Ishitani LH, Teixeira RA, Abreu DMX, Paixão L, França EB. Quality of mortality statistics' information: garbage codes as causes of death in Belo Horizonte, 2011-2013. Rev Bras Epidemiol 2017; 20 Suppl 1:34-45.^,2727. Lopes AS, Passos VMA, Souza MFM, Cascão AM. Improvement of data quality on the underlying cause of death from external causes using health, public security and press sector database linkage in the State of Rio de Janeiro, Brazil, 2014. Epidemiol Serv Saúde 2018; 27:e2018058..

IDEC reduced the number of garbage codes by more than 90%. Results may vary due to localities, information sources, and garbage codes types. Regional differences in police investigation and hospital service availability and forensic institute service quality may affect investigations. Certain studies reduce garbage codes for external causes from 39% to 83%, typically using data from forensic institutes as their central source ²⁸28. Matos SG, Proietti FA, Barata RC. Reliability of cause of death due to violence from information systems in Belo Horizonte, Southern Brazil. Rev Saúde Pública 2007; 41:76-84.^,2929. Drumond Jr. M, Lira MM, Freitas M, Nitrini TM, Shibao K. Avaliação da qualidade das informações de mortalidade por acidentes não especificados e eventos com intenção indeterminada. Rev Saúde Pública 1999; 33:273-80.^,3030. Jorge MHPM, Gotlieb SLD, Laurenti R. O sistema de informações sobre mortalidade: problemas e propostas para o seu enfrentamento. II - mortes por causas externas. Rev Bras Epidemiol 2002; 5:212-23.. Previous research has shown better results for unspecified accidents ²⁸28. Matos SG, Proietti FA, Barata RC. Reliability of cause of death due to violence from information systems in Belo Horizonte, Southern Brazil. Rev Saúde Pública 2007; 41:76-84.^,2929. Drumond Jr. M, Lira MM, Freitas M, Nitrini TM, Shibao K. Avaliação da qualidade das informações de mortalidade por acidentes não especificados e eventos com intenção indeterminada. Rev Saúde Pública 1999; 33:273-80. and undetermined intent ³⁰30. Jorge MHPM, Gotlieb SLD, Laurenti R. O sistema de informações sobre mortalidade: problemas e propostas para o seu enfrentamento. II - mortes por causas externas. Rev Bras Epidemiol 2002; 5:212-23.. A multisource study has recently reduced garbage codes with undetermined intent by 84% and reclassified 11% of undetermined natural causes to external causes, pointing to a greater contribution to police, press, and forensic institute data ¹⁶16. Soares Filho AM, Vasconcelos CH, Nóbrega AA, Pinto IV, Merchan-Hamann E, Ishitani LH, et al. Improvement of the unspecified external causes classification based on the investigation of death in Brazil in 2017. Rev Bras Epidemiol 2019; 22 Suppl 3:E190011.supl.3.^,2727. Lopes AS, Passos VMA, Souza MFM, Cascão AM. Improvement of data quality on the underlying cause of death from external causes using health, public security and press sector database linkage in the State of Rio de Janeiro, Brazil, 2014. Epidemiol Serv Saúde 2018; 27:e2018058.. Interestingly, research managed to categorize 67% of undetermined intent deaths by relying on newspaper reports alone ³¹31. Villela LC, Rezende EM, Drumond EF, Ishitani LH, Carvalho GM. Use of the printed press for qualification of external causes of death. Rev Saúde Pública 2012; 46:730-6..

Our reclassification of external causes with garbage codes obtained findings similar to previous results based on national data, including the transition of deaths between groups of external and natural causes - as did we - and the reclassification of deaths from accidents to other valid codes, which, in this study, migrated to accidents on highways ¹⁰10. Soares Filho AM, Cortez-Escalante JJ, França E. Review of deaths correction methods and quality dimensions of the underlying cause for accidents and violence in Brazil. Ciênc Saúde Colet 2016; 21:3803-18..

We reclassified most deaths of undetermined intent into falls in both comparison groups, which may have suffered the partial influence of age and gender profile of the investigated garbage codes. The greater proportional weight of females and older adults in the IDEC form and sample group, compared to the total evaluated deaths across municipalities, contributed to the form effectively reclassifying garbage codes. Previous studies have shown increased reclassification of undetermined intent into accidents - especially falls ²⁸28. Matos SG, Proietti FA, Barata RC. Reliability of cause of death due to violence from information systems in Belo Horizonte, Southern Brazil. Rev Saúde Pública 2007; 41:76-84.^,2929. Drumond Jr. M, Lira MM, Freitas M, Nitrini TM, Shibao K. Avaliação da qualidade das informações de mortalidade por acidentes não especificados e eventos com intenção indeterminada. Rev Saúde Pública 1999; 33:273-80. -, whereas more recent studies have shown a greater reclassification of undetermined intent into homicides ¹⁶16. Soares Filho AM, Vasconcelos CH, Nóbrega AA, Pinto IV, Merchan-Hamann E, Ishitani LH, et al. Improvement of the unspecified external causes classification based on the investigation of death in Brazil in 2017. Rev Bras Epidemiol 2019; 22 Suppl 3:E190011.supl.3.^,2727. Lopes AS, Passos VMA, Souza MFM, Cascão AM. Improvement of data quality on the underlying cause of death from external causes using health, public security and press sector database linkage in the State of Rio de Janeiro, Brazil, 2014. Epidemiol Serv Saúde 2018; 27:e2018058.^,3030. Jorge MHPM, Gotlieb SLD, Laurenti R. O sistema de informações sobre mortalidade: problemas e propostas para o seu enfrentamento. II - mortes por causas externas. Rev Bras Epidemiol 2002; 5:212-23.^,3131. Villela LC, Rezende EM, Drumond EF, Ishitani LH, Carvalho GM. Use of the printed press for qualification of external causes of death. Rev Saúde Pública 2012; 46:730-6.. Studies have indicated that using multiple sources of information improves garbage codes reclassification results ²⁷27. Lopes AS, Passos VMA, Souza MFM, Cascão AM. Improvement of data quality on the underlying cause of death from external causes using health, public security and press sector database linkage in the State of Rio de Janeiro, Brazil, 2014. Epidemiol Serv Saúde 2018; 27:e2018058.^,3030. Jorge MHPM, Gotlieb SLD, Laurenti R. O sistema de informações sobre mortalidade: problemas e propostas para o seu enfrentamento. II - mortes por causas externas. Rev Bras Epidemiol 2002; 5:212-23., although this may be insufficient to assign a specific cause of death ²⁰20. Ishitani LH, Teixeira RA, Abreu DMX, Paixão L, França EB. Quality of mortality statistics' information: garbage codes as causes of death in Belo Horizonte, 2011-2013. Rev Bras Epidemiol 2017; 20 Suppl 1:34-45.. Thus, we observed that certain sources contribute more to the identification of a particular cause of death category, such as the police investigating homicides or newspaper reports on recent traffic accidents, etc. ¹⁰10. Soares Filho AM, Cortez-Escalante JJ, França E. Review of deaths correction methods and quality dimensions of the underlying cause for accidents and violence in Brazil. Ciênc Saúde Colet 2016; 21:3803-18.^,2828. Matos SG, Proietti FA, Barata RC. Reliability of cause of death due to violence from information systems in Belo Horizonte, Southern Brazil. Rev Saúde Pública 2007; 41:76-84.^,3131. Villela LC, Rezende EM, Drumond EF, Ishitani LH, Carvalho GM. Use of the printed press for qualification of external causes of death. Rev Saúde Pública 2012; 46:730-6..

After more than 40 years of operation, the SIM shows difficulties in the current scenario of modernization and decentralization in a relatively large country such as Brazil ³²32. Figueirôa BQ, Frias PG, Vanderlei LCM, Vidal SA, Carvalho PI, Pereira CCB, et al. Evaluation of the implantation of the Mortality Information System in Pernambuco state, Brazil, in 2012. Epidemiol Serv Saúde 2019; 28:e2018384.. Challenges may be greater in areas with poorer access to public services, especially small and medium-sized municipalities in the countryside or in rural areas ¹⁰10. Soares Filho AM, Cortez-Escalante JJ, França E. Review of deaths correction methods and quality dimensions of the underlying cause for accidents and violence in Brazil. Ciênc Saúde Colet 2016; 21:3803-18.^,3333. Almeida WDS, Szwarcwald CL. Adequacy of mortality data and correction of reported deaths from the proactive search of deaths. Ciênc Saúde Colet 2017; 22:3193-203.. These challenges worsen due to poor updating of death records for external causes, especially due to poor agreement on causes of death between forensic institutes and the Health Department ²²22. Messias KLM, Bispo Júnior JP, Pegado MFQ, Oliveira LC, Peixoto TG, Sales MAC, et al. The quality of certification of deaths due to external causes in the city of Fortaleza in the State of Ceará, Brazil. Ciênc Saúde Colet 2016; 21:1255-67.^,3434. Simões EMS, Reichenheim ME. Confiabilidade das informações de causa básica nas declarações de óbito por causas externas em menores de 18 anos no Município de Duque de Caxias, Rio de Janeiro, Brasil. Cad Saúde Pública 2001; 17:521-31.. Suboptimal death certificates may partly stem from forensic physicians’ inclination to disregard records related to hospitalization. A recent study found that the quality of causes may show movements and discontinuities over time ³⁵35. Cerqueira D. Mortes violentas não esclarecidas e impunidade no Rio de Janeiro. Economia Aplicada 2012; 16:201-35.. The literature in other countries found certain similarities related to some types of garbage codes. For example, more than two-thirds of the deceased classified as having suffered from exposure to an unspecified factor (code X59 from the 10th revision of the International Classification of Diseases - ICD-10) were over the age of 65 years, and more than half of them had femur fractures ⁹9. Lu TH, Walker S, Anderson RN, McKenzie K, Bjorkenstam C, Hou WH. Proportion of injury deaths with unspecified external cause codes: a comparison of Australia, Sweden, Taiwan and the US. Inj Prev 2007; 13:276-81..

The IDEC form usually collected enough data to improve the quality of external cause of death data in hospitals and forensic institutes. However, after the investigations, we had to rearrange the logical sequence of its questions to make the form more intuitive and useful for several services. Causes that remained as garbage code due to absent information on circumstances of death usually resulted from unavailable police investigations. Greater reclassification largely stemmed from poisoning (especially by cocaine) and unspecified vehicle accidents, in which reports attributed the site of the violent act or accident to private residences or public roads without any witness. A study observed that events occurring in homes are more likely to be classified with some type of garbage code ²⁰20. Ishitani LH, Teixeira RA, Abreu DMX, Paixão L, França EB. Quality of mortality statistics' information: garbage codes as causes of death in Belo Horizonte, 2011-2013. Rev Bras Epidemiol 2017; 20 Suppl 1:34-45.. The difficulty of correctly diagnosing external causes often depends on additional information supporting coroners’ work, such as police investigations, since the lack of this information at the time of death registration may cause misclassification ³⁶36. Gotsens M, Marí-Dell'Olmo M, Rodríguez-Sanz M, Martos D, Espelt A, Pérez G, et al. Validation of the underlying cause of death in medicolegal deaths. Rev Esp Salud Pública 2011; 85:163-74..

Such questions reinforce the hypothesis that the difficulty in properly diagnosing external causes extends beyond the contextual and structural issues of service and medical training previous studies have reported, noting, as key issues, the non-use of instructional materials, certifiers attributing them low value, and the impossibility of describing chains of events ²²22. Messias KLM, Bispo Júnior JP, Pegado MFQ, Oliveira LC, Peixoto TG, Sales MAC, et al. The quality of certification of deaths due to external causes in the city of Fortaleza in the State of Ceará, Brazil. Ciênc Saúde Colet 2016; 21:1255-67.^,3737. Ministério da Saúde. Portaria nº 116, de 11 de fevereiro de 2009. Regulamenta a coleta de dados, fluxo e periodicidade de envio das informações sobre óbitos e nascidos vivos para os Sistemas de Informações em Saúde sob gestão da Secretaria de Vigilância em Saúde. Diário Oficial da União 2009; 12 feb.^,3838. Mendonça FM, Drumond E, Cardoso AMP. Problemas no preenchimento da Declaração de Óbito: estudo exploratório. Rev Bras Estud Popul 2010; 27:285-95.^,3939. Silva JA, Yamaki VN, Oliveira JP, Teixeira RK, Santos FA, Hosoume VS. Commitment in the completion of the medical death certification. Evaluation in Belem, Para, Brazil in 2010. Rev Assoc Med Bras 2013; 59:335-40.. Studies suggest that the conflicting needs and working styles of the legal structure/police and health epidemiology sectors contribute to the challenges faced in death investigations ¹⁶16. Soares Filho AM, Vasconcelos CH, Nóbrega AA, Pinto IV, Merchan-Hamann E, Ishitani LH, et al. Improvement of the unspecified external causes classification based on the investigation of death in Brazil in 2017. Rev Bras Epidemiol 2019; 22 Suppl 3:E190011.supl.3.^,2727. Lopes AS, Passos VMA, Souza MFM, Cascão AM. Improvement of data quality on the underlying cause of death from external causes using health, public security and press sector database linkage in the State of Rio de Janeiro, Brazil, 2014. Epidemiol Serv Saúde 2018; 27:e2018058.. This dual role not only affects the Brazilian medicolegal death investigation system but also influences the United States, in which death investigations also carry significant societal importance for its criminal justice and public health. The autonomy of federated entities can also play a role in creating multiple realities and highly varied state and local death investigation systems ⁴⁰40. Hanzlick R. Overview of the medicolegal death investigation system in the United States. In: Institute of Medicine, editor. Medicolegal death investigation system: workshop summary. Washington DC: National Academies Press; 2003. p. 7-11..

Despite their common goal of protecting and guaranteeing rights ⁴¹41. Jackson D, Wenz K, Muniz M, Abouzahr C, Schmider A, Bratschi MW, et al. Civil registration and vital statistics in health systems. Bull World Health Organ 2018; 96:861-3., institutions operate with different priorities and working styles. For instance, public health prioritizes victims and associated risk factors, requiring a shorter time for prompt interventions ⁴²42. Sevalho G. Tempos históricos, tempos físicos, tempos epidemiológicos: prováveis contribuições de Fernand Braudel e Ilya Prigogine ao pensamento epidemiológico. Cad Saúde Pública 1997; 13:7-20.^,4343. Rodrigues-Junior AL. Epidemiological intelligence as a model of organization in health. Ciênc Saúde Colet 2012; 17:797-805.^,4444. Almeida-Filho N. Modelos de determinação social das doenças crônicas não-transmissíveis. Ciênc Saúde Colet 2004; 9:865-84.^,4545. Almeida-Filho N, Coutinho D. Causalidade, contingência, complexidade: o futuro do conceito de risco. Physis (Rio J.) 2007; 17:95-137.. On the other hand, the legal/police sector, part of the public security and justice system, has a normative focus on the victim-perpetrator relationship, thus operating at a slower pace and timeframe, especially in cases of violent deaths with criminal implications ⁴⁶46. Rodrigues CV, Silva MT, Truzzi OMS. Perícia criminal: uma abordagem de serviços. Gestão & Produção 2010; 17:843-57..

Experiments have shown promising results in cause of death qualification, such as the use of an online death certification system to better record causes of death, especially couple with a training program ⁴⁷47. Miki J, Rampatige R, Richards N, Adair T, Cortez-Escalante J, Vargas-Herrera J. Saving lives through certifying deaths: assessing the impact of two interventions to improve cause of death data in Peru. BMC Public Health 2018; 18:1329.. To address errors in the cause of death on death certificates, research has suggested multiple cause of death, which can provide strong clues about the valid cause ¹⁹19. Bierrenbach AL, Alencar GP, Martinez C, Souza MFM, Policena GM, França EB. Redistribution of heart failure deaths using two methods: linkage of hospital records with death certificate data and multiple causes of death data. Cad Saúde Pública 2019; 35:e00135617.^,4848. Foreman KJ, Naghavi M, Ezzati M. Improving the usefulness of US mortality data: new methods for reclassification of underlying cause of death. Popul Health Metr 2016; 14:14.. Other countries have delayed filing cause of death in death certificates for up to six days after death to incorporate test results and police investigations. This entails issuing a prior death certificate and delaying categorizing the circumstances of death until a full certificate can be issued following the conclusion of outstanding investigations ²⁷27. Lopes AS, Passos VMA, Souza MFM, Cascão AM. Improvement of data quality on the underlying cause of death from external causes using health, public security and press sector database linkage in the State of Rio de Janeiro, Brazil, 2014. Epidemiol Serv Saúde 2018; 27:e2018058..

This study has some limitations, especially due to its low number of cases, its geographical locations, and the variety of codes it investigated, which may have affected its results. Although testing was performed only in capitals, the selection of deaths to review allowed us to investigate some cases from the countryside of the states, which have distinctive epidemiological patterns.

Conclusions

Our new form for investigating deaths from external causes (IDEC form) more efficiently reduced garbage codes than the current procedure in the studied Brazilian locations, performing much better for unspecified garbage codes. It appropriately improved the quality of data on causes of death, although it still requires further adjustments to make it more intuitive and useful for collecting data from different sources. We suggest that wider tests of this new form to assess how it reclassifies several types of garbage codes from external causes in different areas of Brazil. Research should also apply the IDEC form to untested sources of information, such as police stations, plans which lie in the near future. The persistence of garbage codes in reports of causes of death require the development of the best practices for searching and recapturing information via standardized procedures and validated instruments to improve the quality of external cause of death data, and produce useful statistics and evidence to formulate policies in public health in Brazil.

Acknowledgments

We would like to pay special thanks to the participating investigators from the death surveillance teams in the Brazilian municipalities that contributed to data collection. We also wish to thank Sara Hudson for editing this manuscript. Financing: Bloomberg Philanthropies Data for Health Initiative, Vital Strategies.

References

Publication Dates

History