ABSTRACT

OBJECTIVE

To describe the methodological aspects of the Piauí home healthcare survey (ISAD-PI) and assess the relation between sampling plan, precision, and design effects, assuming that population health surveys are relevant instruments for health monitoring.

METHODS

ISAD-PI was a population-based cross-sectional study that analyzed the living conditions and health status of the population residing in urban areas in the municipalities of Teresina and Picos, in Piauí. Sampling was carried out by conglomerates in two stages: Primary Sampling Units and households. To calculate the sample size, we considered the stratification of the population in both cities, according to the age of the individuals. We evaluated the “non-response” rate (NRR) and estimated the proportions according to sex and age, as well as the prevalence of social determinants of health in order to assess the compliance of the sampling plan. Analyses related to the precision according to the coefficient of proportion variation of the standard error (Cv-pˆ) and the design effect (deff). Cv-pˆ less than 20% and deff less than 1.5 were considered adequate. The total NRR of households was 38.2% in Teresina and 38.3% in Picos. We carried out twenty-four proportion estimates in relation to age and sex and 48 prevalence of social and health determinants estimates, totaling 72 estimates. Among them, 71 had Cv-pˆ less than 20% and 61 had deff less than or equal to 1.5.

CONCLUSION

Data generated from the ISAD-PI may contribute to the assessment of health and morbidity conditions in the population. Furthermore, methodological aspects employed in this research may serve as a basis for studies carried out in other cities in Brazil.

Health Surveys, methods; Data Collection, methods; Cluster Sampling; Stratified Sampling

INTRODUCTION

Population healthcare surveys are instruments of great importance for monitoring the health situation of the population, providing data that support the planning of action strategies, investments, and implementation of new health policies, as well as allowing the evaluation of health policies already existing¹1. Szwarcwald CL, Damacena GN. Complex Sampling Design in Population Surveys: Planning and effects on statistical data analysis. Rev Bras Epidemiol. 2008;11(SUPPL. 1):38-45. doi:10.1590/s1415-790x2008000500004
https://doi.org/10.1590/s1415-790x200800... ,²2. Szwarcwald CL, Malta DC, Pereira CA, et al. Pesquisa nacional de saúde no Brasil: Concepção e metodologia de aplicação. Cienc e Saude Coletiva. 2014;19(2):333-342. doi:10.1590/1413-81232014192.14072012
https://doi.org/10.1590/1413-81232014192... .

Epidemiological surveys cover a wide universe of individuals and, given the impossibility to consider the participation of the whole population in this research, we worked with representative samples. In this context, the sampling plan represents the set of techniques used to calculate the sample size and sample selection³3. Martins AMEB de L, Santos-Neto PE dos, Souza LH, et al. Plano amostral e ponderação pelo efeito de desenho de um levantamento epidemiológico de saúde bucal. UNIMONTES CIENTÍFICA. 2012;14(1):15-29..

Publications with greater detail on the sampling plans used in epidemiological research in the health area have intensified and might serve as a basis for new experiences. Besides, it could provide tools for the design of other studies⁴4. Alves MCGP, Escuder MML, Goldbaum M, Barros MB de A, Fisberg RM, Cesar CLG. Sampling plan in health surveys, city of São Paulo, Brazil, 2015. Rev Saude Publica. 2018;52. doi:10.11606/S1518-8787.2018052000471
https://doi.org/10.11606/S1518-8787.2018... .

The cluster sampling plan with stratification has been used in health surveys with national coverage, such as the Pesquisa Nacional de Saúde (PNS - National Health Survey)⁶6. Souza-Júnior PRB de, Freitas MPS de, Antonaci G de A, Szwarcwald CL. Desenho da amostra da Pesquisa Nacional de Saúde 2013. Epidemiol e Serviços Saúde. 2015;24(2):207-216. doi:10.5123/s1679-49742015000200003
https://doi.org/10.5123/s1679-4974201500... and the Pesquisa Nacional de Saúde Bucal⁵5. Da Silva NN, Roncalli AG. Sampling plan, weighting process and design effects of the Brazilian oral health survey. Rev Saude Publica. 2014;47(SUPPL.3):3-11. doi:10.1590/S0034-8910.2013047004362
https://doi.org/10.1590/S0034-8910.20130... (National Oral Health Survey), and with municipal coverage, such as the Inquérito de Saúde de São Paulo (ISA -CAPITAL - São Paulo Health Survey)⁴4. Alves MCGP, Escuder MML, Goldbaum M, Barros MB de A, Fisberg RM, Cesar CLG. Sampling plan in health surveys, city of São Paulo, Brazil, 2015. Rev Saude Publica. 2018;52. doi:10.11606/S1518-8787.2018052000471
https://doi.org/10.11606/S1518-8787.2018... . In these studies, the coefficient of variation (Cv) and the design effect (deff) have been used to assess the sampling plan⁴4. Alves MCGP, Escuder MML, Goldbaum M, Barros MB de A, Fisberg RM, Cesar CLG. Sampling plan in health surveys, city of São Paulo, Brazil, 2015. Rev Saude Publica. 2018;52. doi:10.11606/S1518-8787.2018052000471
https://doi.org/10.11606/S1518-8787.2018... , stipulated from estimates of the prevalence of health determinants such as self-assessment of health, use of health services, and diagnosis of chronic diseases.

We considered the “Inquérito de Saúde Domiciliar no Piauí - ISAD-PI” (“Home Health Survey in Piauí - ISAD-PI”) to analyze determinants and health conditions of the population residing in urban areas in the municipalities of Teresina and Picos in Piauí. Thus this study aim to describe the methodological aspects of ISAD-PI as a population health survey and assess the compliance of the sampling plan in relation to precision and design effects.

METHODS

Description of the ISAD-PI, with an emphasis on the study population, sampling, and collection procedures, in addition to the presentation of the results of the application of the sampling plan.

Study Characterization and Research Subjects

The ISAD-PI was a population-based, cross-sectional study that intended to analyze determinants and health conditions of the population residing in urban areas of Teresina and Picos, in Piauí. For the study, all individuals residing in private households were eligible, except individuals with disabilities that hampered research.

Piauí is a state in the Northeast of the country located between 2º 44’ 49” and 10º 55’ 05” south latitude and between 40º 22’ 12” and 45º 59’ 42” west longitude. This Brazilian state limits with Ceará, Pernambuco, Bahia, Tocantins, and Maranhão. The state of Piauí has an area of 251,616,823km² and has 224 municipalities⁸8. Instituto Brasileiro de Geografia e Estatística - IBGE. IBGE | Cidades@ | Piauí | Panorama. Accessed March 24, 2021. https://cidades.ibge.gov.br/brasil/pi/panorama
https://cidades.ibge.gov.br/brasil/pi/pa... . The choice of the two municipalities included in the research took into account the four demographic mesoregions of Piauí: Northern, Center-North region, Southeast and Southwest regions, with Teresina being the state capital and the municipality with the highest population density in the Center-north region and Picos being the third-largest city in the state (located 308km from the capital Teresina), with the highest population density in southeastern Piauí. In addition, these municipalities have campuses of the Universidade Federal do Piauí (Federal University of Piauí), the institution responsible for data collection, making logistics feasible.

Sample Size

To calculate the sample size, the size of the population of Teresina (767,557 inhabitants) and the population of Picos (58,321 inhabitants)⁹9. Instituto Brasileiro de Geografia e Estatística - IBGE. Censo Demográfico 2010: Características Gerais Da População e Dos Domicílios, Resultados Do Universo.; 2010. https://censo2010.ibge.gov.br/resultados.html
https://censo2010.ibge.gov.br/resultados... were considered, as well as the stratification of the population of both cities, according to the age of the individuals to both sexes: children under 2 years old; children aged 3 to 4 years; children from 5 to 9 years old; adolescents aged 10 to 14 years; adolescents aged 15 to 19 years; adults aged 20 to 59 years, and older adults over 60 years (Table 1 - Block 1).

The municipality of Teresina had 210,093 private households in 2010 and that Picos had 16,944⁹9. Instituto Brasileiro de Geografia e Estatística - IBGE. Censo Demográfico 2010: Características Gerais Da População e Dos Domicílios, Resultados Do Universo.; 2010. https://censo2010.ibge.gov.br/resultados.html
https://censo2010.ibge.gov.br/resultados... . Therefore, we calculated the average number of individuals in each age group per household (Table 1 - Block 2).

The distribution of sample means can be approximated by a normal distribution if n > 30 and the population has any distribution¹⁰10. Larson R, Farber B, Patarra C traducão técnica. Estatística Aplicada. Prentice Hall; 2004.; so in order to ensure that a minimum of 30 individuals of each age group, for both sexes participated in the sample, we estimated the number of households needed for each age group (Table 1 - Block 3). Thus, the largest sample size of households relates to the female age group of 3-4 years, both in Teresina (n₀ = 578 households) and in Picos (n₀ = 620 households). The expected number of individuals for each age group and sex was obtained, presented in Table 1 - Block 4.

Considering the age ranges (Tabela 1 – Block 4), studies were carried out by simulating the 95% confidence interval (95%CI) and the coefficient of variation of the standard error of the proportion – Cv-pˆ for estimates of the proportion (pˆ ), ranging from 10% to 70%, according to age groups, sex, and respective sample sizes (values for estimates of 50% can be seen in Table 1- Block 5).

Taking into account that losses may occur during data collection due to various reasons, such as the absence of the resident in the selected household, refusal of the resident to answer the questionnaire, errors in the answers, or even closed household, the size of the final sample for this study was adjusted using n = n₀/0,90, assuming a response rate of 90%, resulting in n ≅ 642 households in Teresina and n ≅ 688households in Picos.

Sampling Plan

The study’s sampling plan was carried out by a cluster sampling process, in two stages: Primary Sampling Units (PSU) and households, based on census data from the Brazilian Institute of Geography and Statistics (IBGE) in 2010⁹9. Instituto Brasileiro de Geografia e Estatística - IBGE. Censo Demográfico 2010: Características Gerais Da População e Dos Domicílios, Resultados Do Universo.; 2010. https://censo2010.ibge.gov.br/resultados.html
https://censo2010.ibge.gov.br/resultados... .

The PSU are area units set apart to the sampling plans. The census sector, composed of approximately 300 families and approximately 1,000 inhabitants, is the smallest available geographic unit for which there is data on residents with similar socioeconomic characteristics.

In the first stage, we intended to improve sampling efficiency and generate similarly sized PSU (in relation to the number of households). So when necessary the census tracts of each city were divided or grouped in such a way that the coefficient of variation for their size did not exceed 10%. Thus, the generated PSU could be constituted by a single census tract, a fraction of a census tract, or a grouping of census tracts¹¹11. Portal de mapas do IBGE. Accessed March 24, 2021. https://portaldemapas.ibge.gov.br/portal.php#homepage
https://portaldemapas.ibge.gov.br/portal... .

Then we ordered the PSU according to their code, so all urban areas of the municipalities included in the research were represented in the sample. Thus, a systematic sample was taken from this ordered list of PSU in each city, with probability proportional to size. To facilitate the estimation of the parameters of interest, we defined that 30 PSU in Teresina and 24 PSU in Picos would be selected with equiprobability.

The second stage involved the systematic sampling of households within each UPA selected in the first stage. The fix sampling fraction in the second stage caused the number of selected households to be higher (or lower) than planned if the census sector had grown (or decreased) since the 2010 Census. Thus the second-stage sampling fraction can be rewritten by: b(Mi′/MiMi, whereby M_i’ is the number of households in the PSU “i” obtained in the household listing activity carried out in the field.

The global sampling fraction used in this study was: f=aMi∑Mi×bMi where: f = global sampling ration; a = total number of PSU to be selected in the first stage; M_i = number of households in PSU “i”; b = number of households to be drawn in each selected UPA.

Household Non-Response Rate

Cases in which the team made initial contact with the household were classified as “non-response” due to refusal of the residents (NR-Refusal) and, after clarification on the research procedures, the residents refused to participate in the study. The cases in which the household remained closed after three attempts were classified as “non-response” due to the absence of residents (NR-Absence) and the total number of households with impediment (NR-Total) corresponds to the sum of the two values.

“Non-Response” Rates (NRR) were calculated as follows: NRR – Total = x/X; NRR – Absence = xi/X and ; NRR – Absence = xz/X where: x = total number of households with “non-response”; xi = number of households with “non-response” due to refusal by residents; xz = number of households with “non-response” due to the absence of residents; and X = number of households in the sample.

Data Collection Logistics

Data were collected between September 2018 and February 2020. During this period, with the help of IBGE’s digital grids¹¹11. Portal de mapas do IBGE. Accessed March 24, 2021. https://portaldemapas.ibge.gov.br/portal.php#homepage
https://portaldemapas.ibge.gov.br/portal... , the streets of the PSU were always covered in a clockwise direction, with the supervisor’s right arm facing the houses to count the households. When selected, a multi-professional trained team visited a household.

After clarification on ethical procedures and data collection, residents of the households were invited to participate in the research and, in case of acceptance and by signing the Informed Consent Form and the Free and Informed Assent (for minors). Data collection was started immediately or scheduled according to the availability of residents.

If any selected household was unavailable on the first visit, the researchers returned to the household three times, on different days and times, including one day on the weekend or on a holiday. After the attempts, if they remained closed, these households were excluded. In the case of closed households, the team used an informative pamphlet about the research, containing clarifications, a telephone number, and an invitation to participate.

To give visibility to the Survey and with a view to clarifying the population in general about the existence of the research, the study was disseminated in various media such as radio, social networks, newspapers broadcast on open TV, and written newspapers. Furthermore, information leaflets were distributed at the research sites.

The collection in the households was carried out in two stages. The first stage took place by the application of structured questionnaires by trained interviewers with mobile devices (cellphones and tablets) and the Epicollect 5® (Imperial College London, 2018), available at https://five.epicollect.net/. The questionnaires used in the survey were based on questionnaires previously used in population-based surveys developed in the country: Inquérito de Saúde no município de São Paulo (Health Survey in the city of São Paulo), in 2015¹²12. ISA-Capital-SP. Questionários ISA Capital - 2015 | Secretaria Municipal da Saúde | Prefeitura da Cidade de São Paulo. Published 2020. Accessed December 20, 2020. https://www.prefeitura.sp.gov.br/cidade/secretarias/saude/epidemiologia_e_informacao/isacapitalsp/index.php?p=216392
https://www.prefeitura.sp.gov.br/cidade/... , and Pesquisa Nacional de Saúde (National Health Survey), in 2013¹³13. PNS - Pesquisa Nacional de Saúde - Proposição do Questionário da PNS. Accessed March 24, 2021. https://www.pns.icict.fiocruz.br/index.php?pag=proposicao
https://www.pns.icict.fiocruz.br/index.p... .

Teams collected sociodemographic, economic, access to health and sanitation services, current and past health status, violence and safety, self-reported morbidities, medication use, lifestyle, eating habits, and physical activity data. Moreover, at this stage, anthropometric data were also collected (weight, height, waist circumference, arm circumference, calf circumference, and skin folds) and blood pressure was measured. In order to reduce errors, all anthropometrists and technicians responsible for measuring blood pressure were trained and standardized according to the same methodology, and all measurements were collected in duplicate. Specifically for anthropometric measurements, training was carried out by the team from the Laboratory of Nutritional Assessment of Populations (LANPOP), from the Faculdade de Saúde Pública of the Universidade de São Paulo (Faculty of Public Health/ University of São Paulo), a partner in carrying out the ISAD-PI.

Questions related to the household, including access to health and sanitation services, family income, and goods were addressed to the head of the family, identified by the residents themselves. In the absence of the head of household or his refusal to answer the questions, another capable family member answered the questions.

Due to logistical reasons, only in the municipality of Teresina we carried out a second collection stage, following the same sampling plan, so 50% of the households drawn in each sector were systematically selected, forming a sub-sample. For this, in addition to the data collected in the first stage, adolescents (10 to 19 years old), adults (20 to 59 years old), and older adults (60 years old or more) residing in households included in the sub-sample, households were invited to participate in data collection on food consumption, by the application of 24-hour food recall (Sample-R24hs) and blood collection (Blood-sample) for subsequent biochemical analysis (glycemia and lipid profile).

Blood collection was performed at home by trained nurses, on days scheduled according to the availability of residents. Guidance for participants was provided in writing at the first home visit and reinforced by phone call the day before the collection date. They followed a standardized script, including 12-hour fasting for food and non-alcoholic beverages, 72-hour fasting for alcoholic beverages, and no physical activity or physical effort on the day scheduled for collection.

The R24hs was applied by trained nutritionists, using the multiple-pass method interview technique, which consists of an interview guided in five stages with the objective of reducing underreporting of food consumption¹⁴14. Conway JM, Ingwersen LA, Vinyard BT, Moshfegh AJ. Effectiveness of the US Department of Agriculture 5-step multiple-pass method in assessing food intake in obese and nonobese women. Am J Clin Nutr. 2003;77(5):1171-1178. doi:10.1093/ajcn/77.5.1171
https://doi.org/10.1093/ajcn/77.5.1171... . Furthermore, after an interval of 2 months, face-to-face reapplication of the 24-hour recall was performed in 40% of the sample that responded to the first recall.

Evaluated Variables

In this study, to assess the compliance of the sampling plan in relation to precision and design effects, variables related to sociodemographic aspects, self-assessment in health, use of health services, and health assessment were used, usually studied in surveys of health⁴4. Alves MCGP, Escuder MML, Goldbaum M, Barros MB de A, Fisberg RM, Cesar CLG. Sampling plan in health surveys, city of São Paulo, Brazil, 2015. Rev Saude Publica. 2018;52. doi:10.11606/S1518-8787.2018052000471
https://doi.org/10.11606/S1518-8787.2018... .

The variables were presented to the participants as follows: 1 - gender (What is your gender? male | female); 2 - age (How old are you?); 3 - skin color (What is your skin color? white | black | yellow | brown | indigenous | another | do not know); 4 - health self-assessment (In general, how do you rate your health? very good | good | regular | too bad | bad | do not know); 5 - use of family health services (Have you ever used the services offered by the Programa Saúde da Família/Estratégia Saúde da Família (PSF/ESF - Family Health Program/Family Health Strategy)? yes | no | do not know); 6 - health assessment (When was the last time you had your blood pressure measured? less than 6 months ago | between 6 months and less than 1 year | between 1 year and less than 2 years | between 2 years and less than 3 years | 3 years or more | never | do not know).

Coefficient of Variation (Cv) and Design Effect (deff)

The parameters estimated in this study were the proportions according to sex and age, as well as the prevalence of people who declared themselves black or brown, reported very good or good self-rated health, had already used the family health program, and had their blood pressure measured in the last 6 months.

Estimates of proportion and prevalence were analyzed for accuracy using the coefficient of variation (Cv). Estimates with Cv less than 20% were considered accurate enough. In addition, we also evaluated the design effect measures (deff), used as efficiency measures of complex sampling designs¹⁵15. Kalton G. Chapter VI Estimating components of design effects for use in sample design Thanh Lê. In: Household Sample Surveys in Developing and Transition Countries. UNITED NATIONS PUBLICATION: Department of Economic and Social Affairs Statistics Division; 2005.. Values less than 1.5 were considered adequate. The frequency of estimates smaller than two was also verified, which is a value frequently adopted in sampling plans in health surveys⁴4. Alves MCGP, Escuder MML, Goldbaum M, Barros MB de A, Fisberg RM, Cesar CLG. Sampling plan in health surveys, city of São Paulo, Brazil, 2015. Rev Saude Publica. 2018;52. doi:10.11606/S1518-8787.2018052000471
https://doi.org/10.11606/S1518-8787.2018... ,⁷7. Boing AC, Peres KG, Boing AF, Hallal PC, Silva NN, Peres MA. Inquérito de saúde EpiFloripa: Aspectos metodológicos e operacionais dos bastidores. Rev Bras Epidemiol. 2014;17(1):147-162. doi:10.1590/1415-790X201400010012ENG
https://doi.org/10.1590/1415-790X2014000... ,⁵5. Da Silva NN, Roncalli AG. Sampling plan, weighting process and design effects of the Brazilian oral health survey. Rev Saude Publica. 2014;47(SUPPL.3):3-11. doi:10.1590/S0034-8910.2013047004362
https://doi.org/10.1590/S0034-8910.20130... .

For the variables that had missing values, it was decided to perform the imputation by the Predictive Mean Matching method, since the percentage of imputed data did not exceed 20%. This procedure kept the original equiprobabilistic design of the sample. All analyzes were carried out in the survey module of the Stata program version 14, which considers the sampling design in estimating the results.

RESULTS

30 PSU were drawn in Teresina and 24 in Picos¹⁶16. Silva DMC. Qualidade da dieta medida pela ESQUADA e sua associação com fatores sociodemográficos e parâmetros antropométricos de adultos residentes nas cidades de Teresina e Picos, no Piauí. Published online 2020. (Figure). In total, 1,285 people were interviewed in Teresina, corresponding to 42.8 (16.4) individuals per PSU, and 1013 people in Picos, which correspond to 42.2 (18.1) individuals per PSU. The survey ended with the final total sample of 497 households in Teresina and 441 in Picos (Table 2). The sub-samples Sample-R24h and Sample-blood comprised, respectively, 617 and 421 people in Teresina.

The numbers of households drawn in Teresina and Picos (804 and 715, respectively; Table 2) were higher than those considered necessary for conducting the interviews, provided for in the sampling stage (642 and 688, respectively). Despite this, the number of households interviewed was lower than planned, considering the average total “non-response” rate of 38.2% in Teresina and 38.3% in Picos, both higher than expected, of 10%.

Of the total number of households in which there was “non-response” in Teresina, 21.64% occurred due to residents’ refusal to participate in the survey and 16.54% occurred due to exclusion given the absence of residents after three attempts. In Picos, impediments due to refusal and absence of the resident in three attempts accounted for 12.45% and 25.87%, respectively.

We carried out twenty-four estimates of the proportion in relation to age and sex (Table 3) and 48 estimates of the prevalence of social and health indicators (Table 4), totaling 72 estimates. Except for the estimated proportion of male adolescents in the blood sample (Cv-pˆ = 27,6), the other estimates showed Cv-pˆ less than 20%.

The effect of the proportion design in relation to sex and age (Table 3) was less than 1.5 for 20 of the 24 estimates. The proportion estimates that presented deff greater than 1.5 were the proportion of elderly females in Teresina (deff = 1.9) and in Picos (deff = 2.1), as well as the proportion of male adolescents in Teresina (deff = 2.4) and proportion of male adolescents in the blood sample.

Regarding the prevalence estimates of social and health indicators (Table 4), the design effect was less than 1.5 in 87.5% of the estimates (42 of the 48 estimates) and less than 2 in 95.8% of the estimates (46 out of 48 estimates).

DISCUSSION

The ISAD-PI stands out for being a household population study that addresses health determinants and conditions in two cities in Piauí and encompasses various health components. It is expected to obtain more specific and detailed health data and indicators, meeting the needs at the municipal and regional level, and contributing with relevant information for national surveys.

Brazil is a large country, with great socioeconomic diversity⁹9. Instituto Brasileiro de Geografia e Estatística - IBGE. Censo Demográfico 2010: Características Gerais Da População e Dos Domicílios, Resultados Do Universo.; 2010. https://censo2010.ibge.gov.br/resultados.html
https://censo2010.ibge.gov.br/resultados... , so it is essential to carry out municipal surveys such as the ISAD-PI. Piauí has an HDI (Human Development Index) of 0.646 and is one of the Brazilian states with the lowest index, only higher than those of Maranhão (0.639) and Alagoas (0.631)⁸8. Instituto Brasileiro de Geografia e Estatística - IBGE. IBGE | Cidades@ | Piauí | Panorama. Accessed March 24, 2021. https://cidades.ibge.gov.br/brasil/pi/panorama
https://cidades.ibge.gov.br/brasil/pi/pa... . Thus, cities in Piauí have a different reality from many cities in Brazil. Furthermore, the decision to include in the study the capital, Teresina-PI (IDH: 0.751) and a city in the interior of the state, Picos-PI (IDH: 0.698), favors the assessment of different realities within the state.

Regarding data collection procedures, the ISAD-PI took 18 months to complete, which can be considered a disadvantage in relation to the research costs. We emphasize the collection of detailed information on health and lifestyle, as well as the diversity of anthropometric measurements performed on all household members, at the expense of time and cost reduction. Anyway, this allowed for a deepening of the health information generated.

The number of households drawn was greater than that conceived in the sampling stage, mainly in the municipality of Teresina, a fact related to the increase in the number of households in the census sectors of Teresina and Picos since the 2010 census. The largest number of sampled households is the result of the application of constant fractions in the household drawing stage; thus, the equiprobability of the sample was maintained, which was provided by the drawing with probability proportional to size. However, the control over its final size was harmed.

Residents’ participation was lower than expected, despite the use of strategies such as dissemination of the research in the media, use of informative pamphlets, and the team returning to their homes more than once. Many refusals occurred because residents feared to open their homes or provide information to participate in the study. The “non-response” rate verified in this study can be used as a parameter for future research in the sample planning stage.

It is noteworthy that, although the number of households and, therefore, of participants, was lower than expected, the number of individuals in the final sample was considered appropriate for studies in public health, allowing adequate precision, in general with Cv-pˆ less than 20%. When stratification is used properly in the sampling plan, precision gains are obtained in the average estimates¹⁷17. Cochran WG. Sampling Techniques. 3rd ed.; 1977.. The decision to use stratification by sex and age group in the sampling stage of this study was satisfactory.

Cluster sampling designs, such as the one used in this study, present a risk of inaccuracy in estimated parameters. The deff measures the relationship between the estimators calculated according to the proposed sampling plan and a simple casual sample. This is a statistic commonly used to assess this effect¹⁸18. Vierron E, Giraudeau B. Design effect in multicenter studies: Gain or loss of power? BMC Med Res Methodol. 2009;9(1):1-9. doi:10.1186/1471-2288-9-39
https://doi.org/10.1186/1471-2288-9-39... ,¹⁹19. Lynn P, Haeder S, Gabler S. Design effects for multiple design samples. In: Survey Methodology. Vol 32. ; 2006:115-120.. In this study, deff values lower than 2 suggest that the difference between the values obtained according to the sample design used and a simple casual sample are not expressively different, indicating that the sample design was successful.

The ISAD-PI sample generated estimates close to those predicted, considering that most estimates presented Cv below 20% and that, in more than 90% of them, the deff was less than 1.5. Other epidemiological studies in the health area have proposed this value as an acceptable limit³3. Martins AMEB de L, Santos-Neto PE dos, Souza LH, et al. Plano amostral e ponderação pelo efeito de desenho de um levantamento epidemiológico de saúde bucal. UNIMONTES CIENTÍFICA. 2012;14(1):15-29.,⁴4. Alves MCGP, Escuder MML, Goldbaum M, Barros MB de A, Fisberg RM, Cesar CLG. Sampling plan in health surveys, city of São Paulo, Brazil, 2015. Rev Saude Publica. 2018;52. doi:10.11606/S1518-8787.2018052000471
https://doi.org/10.11606/S1518-8787.2018... ,⁷7. Boing AC, Peres KG, Boing AF, Hallal PC, Silva NN, Peres MA. Inquérito de saúde EpiFloripa: Aspectos metodológicos e operacionais dos bastidores. Rev Bras Epidemiol. 2014;17(1):147-162. doi:10.1590/1415-790X201400010012ENG
https://doi.org/10.1590/1415-790X2014000... . Furthermore, the accuracy verified in the study shows that the choice to maintain the self-weighting of the sample was correct, considering that the draw was equiprobabilistic.

The precision and effect of the design, examined in the evaluation of the estimates in this study, indicate that the data generated from the ISAD-PI may contribute to the assessment of health and morbidity conditions in the population, as well as to the assessment and implementation of health services and actions in the evaluated municipalities. Furthermore, methodological aspects employed in this research may serve as a basis for studies carried out in other cities in Brazil.

However, it is important to be aware of the use of results related to rare events, which must be interpreted with caution, in particular when performed with small samples. The few estimates with deff greater than 1.5 and Cv greater than 20% occurred mainly among adolescents and older adults, whose sample size was smaller than the adult stratum.

FINAL CONSIDERATIONS

Representative health surveys are important for the assessment of health conditions in Brazilian municipalities, especially in cities in the northeast region. This region of Brazil lacks epidemiological studies with robust sampling methods that guarantee the representativeness of data. Moreover, it is important to highlight that their lifestyle and eating habits have particularities in relation to those practiced by the inhabitants of the South and Southeast regions, where most of the health surveys are carried out.

This survey was designed using a robust sampling technique, ensuring the representativeness of the data. Finally, household surveys present numerous challenges to researchers. For further development, subsidies are necessary and important to improve sampling designs and to discuss strategies of improvement.

REFERENCES

Publication Dates

History