ORIGINAL ARTICLES

 

Effectiveness of a quality control program in mammography for the Brazilian National Health System

 

Efectividad de programa de control de calidad en mamografía para el Sistema Nacional de Salud de Brasil

 

 

Rosangela da Silveira CorrêaI; Ruffo Freitas-JuniorII; João Emílio PeixotoIII; Danielle Cristina Netto RodriguesII; Maria Eugênia Fonseca LemosI; Cíntia Melazo DiasIV; Rubemar de Souza FerreiraV; Rosemar Macedo Souza RahaIII

IRede Goiana de Pesquisa em Mastologia. Centro Regional de Ciências Nucleares do Centro-Oeste. Comissão Nacional de Energia Nuclear. Abadia de Goiás, GO, Brasil
IIRede Goiana de Pesquisa em Mastologia. Programa de Mastologia. Universidade Federal de Goiás. Goiânia, GO, Brasil
IIIRede Goiana de Pesquisa em Mastologia. Instituto Nacional de Câncer. Rio de Janeiro, RJ, Brasil

IVRede Goiana de Pesquisa em Mastologia. Diretoria de Radioproteção e Segurança. Comissão Nacional de Energia Nuclear. Brasília, DF, Brasil
VDiretoria de Radioproteção e Segurança. Comissão Nacional de Energia Nuclear. Rio de Janeiro, RJ, Brasil

Correspondence

 

 


ABSTRACT

OBJECTIVE: To assess the effectiveness of a quality control program in mammography services of the Brazilian National Health System (SUS).
METHODS: A prospective study using temporal analysis of a health surveillance action was conducted. A total of 35 service providers that had mammography equipment in operation and regularly performed exams between 2007 and 2009 in the state of Goiás, Central-Western Brazil, participated in this study. Services were assessed during three site visits by performance testing of mammography equipment, film processors, and other materials, and image quality and entrance surface dose in a phantom were also assessed. Each service was scored according to the percentage of tests that conformed to standards.
RESULTS: The mean percentage for compliance among the participating service providers were 64.1% (± 13.3%) in the first visit, 68.4% (± 15.9%) in the second, and 77.1% (± 13.3%) in the third (p < 0.001). The main improvements resulted from adjustments to the breast compression force, the automatic exposure control system, and the alignment of the compression paddle. The doses measured were within the conformity range in 80% of the services assessed.
CONCLUSIONS: The implementation of this program in the mammography services was effective at improving the operational parameters of the mammography machines, although 40% of the services did not reach the acceptable level of 70%. This result indicates the need to continue this health surveillance action.

Descriptors: Mammography, standards. Effectiveness. Evaluation of the Efficacy-Effectiveness of Interventions. Quality Assurance, Health Care. Brazilian Public Health System. Breast Neoplasms, diagnosis.


RESUMEN

OBJETIVO: Evaluar la efectividad de un programa de control de calidad de imagen en los servicios de mamografía de la red del Sistema Único de Salud.
MÉTODOS: Estudio prospectivo con análisis temporal de tipo "antes" y "después" de una acción de vigilancia en salud. Participaron del estudio 35 servicios que tenían mamógrafos operativos y que realizaban exámenes regularmente en el estado de Goiás, Brasil, entre 2007 y 2009. Se evaluaron los servicios, por pruebas de desempeño de mamógrafos , procesadoras y demás materiales en tres visitas técnicas, la calidad de la imagen y la dosis de entrada en el simulador radiográfico de mama. Cada servicio recibió una puntuación correspondiente al porcentaje de las pruebas en conformidad con los patrones.
RESULTADOS: Los porcentajes promedio de conformidad de los servicios fueron de 64,1% (+/-13,3%) en la primera visita, 68,4% (+/-15,9%) en la segunda y 77,1% (+/-13,3%) en la tercera (p < 0,001). Las principales mejoras fueron decurrentes de los ajustes de la fuerza de compresión de la mama, del control automático de exposición y del alineamiento de la bandeja de compresión. Las dosis medidas estaban dentro del intervalo de conformidad en 80% de los servicios evaluados.
CONCLUSIONES: La implantación del programa en los servicios fue efectiva para la mejora de los parámetros de operación del mamógrafo, a pesar de que 40% de los servicios no hayan alcanzado el nivel aceptable de 70%. Este resultado indica la necesidad de darle continuidad a la vigilancia en salud.

Descriptores: Mamografía, normas. Efectividad. Evaluación de Eficacia- Efectividad de Intervenciones. Garantía de la Calidad de Atención de Salud. Sistema Único de Salud. Neoplasias de la Mama, diagnostico.


 

INTRODUCTION

The main objective of mammography as a screening method for breast cancer is to reduce the mortality rate through the increase of cases detected at early stages of the disease.5 Randomized trials show statistically significant reduction in mortality rates for women undergoing mammography screening.9,14,16,17 However, screening effectiveness is directly related to the quality and performance of equipment, materials and procedures employed.8 As a result, reference documents were drawn up for the implementation of quality control programs in mammography.6,a,b

The Brazilian College of Radiology created in 1992 the Quality Certification Program in Mammography on a voluntary basis, in order to initiate an action plan for quality control in mammography in Brazil.10 Radiological protection guidelines in medical and dental radiodiagnosis were established by the Brazilian Ministry of Health, in 1998.c

The National Cancer Institute (INCA) recommended in 2004 the creation of quality control guidelines to the Brazilian National Health System (SUS), as part of the criteria for accreditation and monitoring of mammography services.d This recommendation was aimed at implementing quality control programs in the accredited network. Thus, the services became responsible for conducting periodic performance tests in mammography units, film processors and other materials, as well as verifying the image quality and the radiation dose applied to patients.

Screening programs for breast cancer are aimed at improving public health. Quality control actions for achieving satisfactory imaging by exposing patients to acceptable radiation doses constitute a major component of such programs. Thus, the objective of this study was to evaluate the effectiveness of the quality control program in mammography for continuous monitoring of services that integrate the SUS network.

 

METHODS

A prospective temporal analysis of a health surveillance action was carried out. The unity of the research was the mammography service, and data collection was performed by site visits in three periods: 2007, 2008 and 2009. Service providers that had equipment with conventional processing system (screen/film) and performed mammograms through the SUS from July 2007 to March 2009, in the state of Goiás, Central-Western Brazil, were included in this research. Data collection was divided into two stages: service provider registration and performance assessment of mammography units, film processors and other materials, as well as evaluation of image quality and radiation doses applied.

Of the 45 mammography service providers caring for SUS patients in the state of Goiás between 2007 and 2009, 35 participated in this study. The following service providers were excluded: two were banned from performing mammography on the SUS, four were closed (during the research period) for not having the technical conditions required, two were not involved in all stages of the research, and two were excluded at the end because they replaced their conventional image processing for a digital system.

An evaluation report was sent to each service provider after the visits, containing the measured and the acceptance value (or value range) for each parameter. Upon delivery of the report, the service provider received a deadline from the health surveillance organ of the State of Goiás for the completion of nonconformities.

Identification of services was performed using data from the National Registry of Health Care Services (CNES/DATASUS/MS).e Background information on the equipment and materials used in mammography was collected. Participating services were coded by the acronym GO (state of Goiás), followed by a three-figure numerical sequence starting at the code GO001, to preserve the mammography services identity.

Mammography quality was established according to the degree of compliance shown in performance tests applied to the equipment and materials used. The evaluation of the performance parameters for equipment and materials, image quality and radiation dose was carried out according to the technical regulation by MS/SVS,c the European Guidelines for Quality Assurance in Breast Cancer Screening and Diagnosis15 and the Protocol on Quality Assurance in Mammography of the International Atomic Energy Agency (IAEA).ª Such documents provided the measurement processes used in the evaluations of performance parameters and their acceptance limits.

Radiation dose and image quality were assessed through a mammographic phantom3 (Figure 1A). It simulates a 5.3 cm compressed breast made of 50% fat and 50% fibroglandular tissue. It consists of three acrylic sheets (10 mm x 120 mm x 160 mm) and one acrylic plate (20 mm x 120 mm x 160 mm), which contains a wax insert (5 mm x 70 mm x 140 mm) and a five-step scale that produces areas of different optical densities, used for the assessment of image contrast (Figure 1B). The wax insert contains four metal grids for evaluating the spatial resolution of the image, five groups of Al2O3 microspheres simulating microcalcifications, eight polyester disks simulating low contrast areas, six nylon strands simulating fibrous tissues and five spherical nylon caps simulating tumor masses.

 

 

The images were generated under the same conditions in each mammography unit, with the phantom positioned on the breast support platform, aligned with the cassete on the edge of the chest wall and the sensor for automatic exposure control (AEC) activated and positioned under the phantom's main body. The strain selected for the exposure was held constant at 28 kV at all mammography services. After exposure, the film was developed at the service's processor, in normal use conditions (Figure 1B).

The image quality assessment considered the possibility of visualizing the following groups of structures: four metal gratings (spatial resolution), four microcalcifications (high contrast details), seven disks (low contrast threshold), four fibers (linear low-contrast details) and four spherical caps (tumor masses). The contrast index and the background optical density were also measured in the phantom image, the presence of artifacts and image uniformity being observed. Image reading was carried out in a dimly lit room by at least two reviewers, using masks to cover the unused clear area of the negatoscope.

The performance of the devices and accessories that directly and indirectly influenced image quality was tested by collimation system, AEC's performance, compression force, alignment of thecompression paddle, cassete integrity and processing system.

The radiation dose at the entrance surface of the phantom was determined by measuring the air-kerma, established by MS/SVS,c with a solid state dosimeter (model Multi-O-Meter L 535, Unfors, Billdal, Sweden) calibrated for mammography. The measurements were performed with the same radiographic techniques selected for image processing of the phantom. The compliance range of 7 to 13 mGy was adopted, considering the reference value of 10 mGy (± 30% for this study), established by the SVS/MS.c

One point was awarded for compliance and zero for non-compliance of each parameter, at each assessment. Thus, considering 16 parameters, the total score of the service varied from zero to 16. The percentage of compliance for each service and their average percentage (2007, 2008 and 2009) were calculated. The t-test for comparison of means for paired data samples was used to verify the statistical differences between the mean compliance percentages between the services at each year. The McNemar's test was applied to compare the parameters between two years (2007 and 2008, 2007 and 2009, and 2008 and 2009). The significance level of 0.05 was used in the statistical tests.

This study was approved by the Dr. Henrique Santillo Ethics in Research Committee at the State Department of Health of Goiás (Protocol 0007.1.177.000-5).

 

RESULTS

About 20% of mammography units were owned by public institutions, 11% by charities and 69% by private health services. Mammography units from eight different manufacturers were identified: 80% were imported and 20% were Brazilian units. Among the film processors, 69% were imported, 20% were made in Brazil and 11% were made by other national and foreign manufacturers. A total of 69% of the processors were used exclusively for mammograms.

The analyses for 2007-2008 and 2007-2009 revealed statistically significant differences between the percentages of compliance for compression force (p = 0.039 and p = 0.002), AEC (p = 0.012 and p = 0.004) and alignment of the breast support platform ( p = 0.004 and p = 0.002), while the integrity of the cassete (p = 0.035) showed a statistically significant difference in the 2007-2009 period. An increase in absolute numbers of services showing compliance in the alignment of the x-ray field with the film and in the processing of x-ray films (Table 1), even without statistically significant differences between the percentages.

Regarding the assessment of the quality parameters of the phantom's image recorded on film and the radiation dose used, the two parameters that showed statistically significant differences from 2007 to 2009 were the absence of image artifacts (p = 0.021) and the image uniformity (p = 0.035) (Table 2).

Although no statistically significant differences were observed regarding the optical density of the image and the dose, the data showed an increase in the number of services that were in conformity with these parameters. In relation to the spatial resolution and the visualization of structures that mimic tumor masses and fibers, services showed compliance in the assessment for 2007, a result that was also seen in 2008 and 2009.

The other parameters of image quality (visualization of microcalcifications and contrast index) showed differences in the order of ± 5% between the percentages, whereas the difference was ± 14% for the low contrast disks. In such cases, no numerical increase of services in accordance with the standards was observed.

About 23% of services presented percentage of compliance equal or higher than 70% in 2007, which is considered acceptable, decreasing to 60% in 2009 (Figure 2). A mammography service (3%) achieved a desirable level of compliance in 2007, above 90%, but was rated three (9%) in 2008 and six (17%) in 2009. The average compliance of services in the first visit (2007) was 64.1% (± 13.3%), whereas in the second (2008) and third (2009) were 68.4% (± 15.9%) and 77.5% (± 13.3%), respectively. The difference between the mean percentage of compliance of the services was statistically significant between the first and third visits (p < 0.001) and between the second and third visits (p = 0.004).

Approximately 20% of evaluated services in 2009 were not in compliance with the established range for the dose used, which was from 7 to 13 mGy (Figure 3).

 

 

DISCUSSION

The evaluation of the quality actions and health services is fundamental to the control of health care offered to the population2. Equipment emitting ionizing radiation can operate with a high degree of quality, but it is necessary to follow the rules and procedures of radiological protection and quality control.ª The implementation of a quality control program in mammography services, which are part of the SUS network in Goiás, was more effective with the results found for 2007 and 2009, i.e., with two interventions. By continuing the program, it is possible to establish a better quality control, reducing the risks linked to mammography exams, even though 20% of services have shown desirable results in the last assessment of above 90% compliance, considering the evaluated items.

The performance parameters for the equipment and materials that showed improvement resulting from the quality control action in the services were related to adjustments in breast compression force, AEC system, alignment of the breast support platform and integrity of the cassete. However, some mammography units were left unadjusted in relation to the breast compression force (22.9%), AEC system (31.4%) and alignment of the compression paddle and integrity of the cassete (14.3%). In a study carried out in Minas Gerais13, the percentage of mammography units unadjusted for the compression force was 23.9%, whereas 37.3% were unadjusted for the AEC system. The results obtained in both studies coincide and point to a situation in which it is not possible to make adjustments in these performance parameters for some mammography units. It was not possible to establish, during this research, whether this hypothesis was associated with the technology of the equipment or duration of use.

The only performance parameter that showed no improvement during the study period was the alignment of the x-ray field with the image recording system composed by the cassete and the film (p = 0.092). However, there was a progressive increase in the percentage of compliance for this parameter, result that shows the need for continuity of this type of intervention in the coming years.

Studies indicate the development of radiographic films as the process that most affects image quality in mammography.3,11,12 The solution of non-compliance cases for film processing is not simple, involving from the change of equipment to the adoption of standardized processes for the preparation of certified solutions. The result obtained in this study showed that the percentage of compliance of film processing remained almost unchanged, and around 40% during the three years of research, which is similar to that found in the study carried out in Minas Gerais13 (38.8%). About 31% of the film processors were not specific for mammography, which may have contributed to the relatively low percentage of compliance in film processing. The materials used, the temperature of the employed solutions and the processing time were not evaluated in this study.

The image quality parameters that showed improvement resulting from the quality control program between 2007 and 2009 were related to uniformity and reduced number of image artifacts. Those that did not show a statistically significant difference between the mean percentage of compliance services between the first and third visits can be divided into two groups. In the first group are included the mean optical density, spatial resolution, microcalcifications, fibers and masses, with percentages of compliance above 70% (minimum acceptable percentage for a set of services). In the second group are the low contrast disks and contrast index, with percentages of compliance below 70%. These groups require separate analysis. The parameters of the first group reached the minimum acceptable levels. The situation is not considered critical and requires a finer adjustment in the image production chain, in a small number of services.

The situation of the parameters in the second group is considered critical, because no improvement was observed between assessments. Their mean percentages of compliance (43% and 69%) are considered unacceptable. These parameters will require more intense effort for performance tuning of equipment and materials. The visualization of low contrast disks and the contrast index are directly associated with the performance of the automatic film processor.

On one hand, the analysis of radiation doses on the entrance surface of the phantom shows no improvement during the study (p = 0.210), but a progressive increase in the percentage of compliance of this parameter was observed. Corrective measures related to equipment and materials can improve the image quality parameters of the phantom, with a positive impact on the adequacy of the doses to a range of acceptable values.1

The dose of radiation to which the patient is exposed should be kept as low as possible without compromising the quality of the image.ª The legislationc established 10 mGy as the reference value for applications near the skin. In this study, upon acceptance of variation of ± 30%, 80% of services showed values of 7 to 13 mGy, averaging 8.94 mGy and comparable to the results of the Minas Gerais research.13

A study conducted in the Republic of Macedonia showed that 50% of mammography units lacked basic quality criteria for the screening of breast cancer, in 2008-2009.7 In an opportunistic screening performed by the SUS in 20084, in the state of Goiás, 62.9% services had quality standards of not acceptable compliance (< 70%), whereas 28.6% were considered acceptable (70% < 90%) and 8.6% were rated as desirable (> 90%).

The quality of services in relation to equipment and accessories was evaluated. However, it is necessary to conduct research focusing on mammography professionals, as well as image quality, for the early detection of breast cancer and the carcinogenic risk within the SUS and the supplementary health system.

Interventions in the Quality Control Program in Mammography, based on the methodology applied in this study, were effective for improving the screening quality and monitoring the services that compose the SUS in Goiás. Although the percentage of mammography services classified as unacceptable in relation to the technical criteria evaluated has decreased (from 77.1% in 2007 to 40% in 2009), doctors continued to have mammograms of inferior quality and were more prone to misdiagnosis. It is necessary to continue quality control activities, including services that are not linked to the SUS.

 

ACKNOWLEDGEMENTS

To the Superintendency of Health Surveillance of Goiás, the Department of Health Surveillance of Goiânia and the National Commission of Nuclear Energy, which contributed to this research.

 

REFERENCES

1. Avramova-Cholakova S, Vassileva J. A survey of the state of mammography practice in Bulgaria. Radiat Prot Dosimetry. 2011;147(1-2):14-6. DOI:10.1093/rpd/ncr320        

2. Azevedo AC. Avaliação de desempenho de serviços de saúde. Rev Saude Publica. 1991;25(1):64-71. DOI:10.1590/S0034-89101991000100013        

3. Corrêa RS, Peixoto JE, Silver LD, Dias CM, Nogueira MS, Hwang SF, et al. Impacto de um programa de avaliação da qualidade da imagem nos serviços de mamografia do Distrito Federal. Radiol Bras. 2008;41(2):109-14. DOI:10.1590/S0100-39842008000200010.         

4. Corrêa RS, Freitas-Júnior R, Peixoto JE, Rodrigues DCN, Lemos MEF, Marins LAP, et al. Estimativas da cobertura mamográfica no estado de Goiás, Brasil. Cad Saude Publica. 2011;27(9):1757-67. DOI:10.1590/S0102-311X2011000900009        

5. Feig SA. Screening mammography: a successful public health initiative. Rev Panam Salud Publica. 2006;20(2-3):125-33. DOI:10.1590/S1020-49892006000800009        

6. Food and Drug Administration (US). The Mammography Quality Standards Act (MQSA) interim final rules. Silver Spring; 1993.         

7. Gershan V, Antevska-Grujoska S. Performance of mammography equipment in the Macedonian breast screening campaign 2008/2009. Radiat Prot Dosimetry. 2011;147(1-2):187-91. DOI:10.1093/rpd/ncr290        

8. Hendrick RE, Klabunde C, Grivegnee A, Pou G, Ballard-Barbash R. Technical quality control practices in mammography screening programs in 22 countries. Int J Qual Health Care. 2002;14(3):219-26.         

9. Hendrick RE, Helvie MA. United States Preventive Services Task Force screening mammography recommendations: science ignored. AJR Am J Roentgenol. 2011;196(2):W112-6. DOI:10.2214/AJR.10.5609        

10. Koch HA, Peixoto JE, Neves ALE. Análise da infra-estrutura para a mamografia no Brasil. Radiol Bras. 2000;33(1):23-30.         

11. Magalhães LAG, Azevedo ACP, Carvalho ACP. A importância do controle de qualidade de processadoras automáticas. Radiol Bras. 2002;35(6):357-63. DOI:10.1590/S0100-39842002000600009        

12. Milano F, Maggi E, Roselli del Turco M. Evaluation of the effect of a quality control programme in mammography on technical and exposure parameters. Radiat Prot Dosimetry. 2000;90(1-2):263-6.         

13. Oliveira M, Nogueira MS, Guedes E, Andrade MC, Peixoto JE, Joana GS, et al. Average glandular dose and phantom image quality in mammography. Nucl Instrum Methods Phys Res A. 2007;580(1):574-7. DOI:10.1016/j.nima.2007.05.228.         

14. Parkin DM, Whelan SL, Ferlay J, Teppo L, Thomas DB, editors. Cancer incidence in five continents. Lyon: IARC; 2002. (IARC Scientific Publication, 155).         

15. Perry N, Broeders M, Wolf C, Törnberg S, Holland R., von Karsa L, editors. European guidelines for quality assurance in breast cancer screening and diagnosis. 4. ed. Luxembourg: Office for Official Publications of the European Communities; 2006.         

16. Shapiro S, Venet W, Strax P, Venet L. Periodic screening for breast cancer: the Health Insurance Plan Project and its sequelae, 1963-1986. Baltimore: Johns Hopkins University Press; 1988.         

17. Tabár L, Vitak B, Chen HH, Duffy SW, Yen MF, Chiang CF, et al. The Swedish Two-County Trial twenty years later. Updated mortality results and new insights from long-term follow-up. Radiol Clin North Am. 2000;38(4):625-51. DOI:10.1016/S0033-8389(05)70191-3        

 

 

Correspondence:
Rosangela da Silveira Corrêa
Comissão Nacional de Energia Nuclear
Centro Regional de Ciências Nucleares do Centro-Oeste
BR-060 km 174,5, Zona Rural, Parque Estadual
Telma Ortegal

Received: 10/26/2011
Approved: 4/17/2012

 

 

a OIEA. Organismo Internacional de Energía Atómica. Control de calidad en mamografía. Protocolo elaborado en el marco de dos proyectos regionales ARCAL/OIEA. Viena; 2006. (IAEA-TECDOC-1517). [cited 2011 Sept 12] Available from: http://www.pub.iaea.org/MTCD/publications/PDF/te_1517s_web.pdf
b Wolf CJM, Perry NM, editors. European guidelines for quality assurance in mammography screening. Luxembourg: European Commission, Europe Against Cancer Programme; 1993.
c Ministério da Saúde (BR), Agência Nacional de Vigilância Sanitária. Portaria/MS/SVS nº 453, de 1º de junho de 1998. Aprova o Regulamento Técnico que estabelece as diretrizes básicas de proteção radiológica em radiodiagnóstico médico e odontológico, dispõe sobre o uso dos raios-x diagnósticos em todo o território nacional e dá outras providências. Diario Oficial Uniao. 2 jun 1998. [cited 2011 Sept 18]. Available from: http://www.anvisa.gov.br/legis/portarias/453_98.htm
d Ministério da Saúde (BR). Instituto Nacional de Câncer (INCA). Controle do câncer de mama: documento de consenso. Rio de Janeiro; 2004. [cited 2011 Sept 12]. Available from: http://www1.inca.gov.br/publicacoes/Consensointegra.pdf
e Ministério da Saúde (BR). Cadastro Nacional de Estabelecimentos de Saúde - CNES. Brasília, DF; 2007. [cited 2011 Sept 12]. Available from: http://cnes.datasus.gov.br

Faculdade de Saúde Pública da Universidade de São Paulo São Paulo - SP - Brazil
E-mail: revsp@org.usp.br