ABSTRACT

Objective.

To design and analyze the evidence of content validity, internal structure, and reliability of a questionnaire of preventive practices for hantavirus in an endemic community in the Panamanian context.

Material and methods.

Quantitative study of instrumental design. This research was conducted in four phases: Literature review, content validity through expert judgment with the individual aggregate method and the calculation of the V Aiken, pilot test and psychometric validation, through exploratory factor analysis (EFA) and reliability analysis of instrument scores with ordinal alpha.

Results.

Content validity was evidenced and V Aiken values higher than 0.70 were reported in the lower limit of 95% CI. In the internal structure we identified that the 8 items underlie a single factor that explains 60.70% of the total variance of the test and with factor loadings greater than 0.40; during the reliability analysis, we obtained an ordinal alpha value of 0.84, which is considered good.

Conclusions.

The Hantavirus preventive practical questionnaire is a brief instrument that shows acceptable psychometric properties to measure the activities or behaviors that people carry out to prevent hantavirus.

Keywords:
Preventive Medicine; Hantavirus; Surveys and Questionnaires; Validation Study

INTRODUCTION

Hantavirus is responsible for two syndromes in humans, hemorrhagic fever with renal syndrome (HFRS), mostly found in Eurasia, and hantavirus pulmonary syndrome, more frequent in the Americas ¹1. Clement J, Maes P, Lagrou K, Rants M, Lameire N. A unifying hypothesis and a single name for a complex globally emerging infection: hantavirus disease. Eur J Clin Microbiol Infect Dis. 2012 ; 31 (1): 1-5. doi: 10.1007/s10096-011-1456-y.
https://doi.org/10.1007/s10096-011-1456-... ^,22. Jonsson CB, Figueiredo LT, Vapalahti O. A global perspective on hantavirus ecology, epidemiology, and disease. Clin Microbiol Rev. 2010; 23(2): 412-441. doi: 10.1128/CMR.00062-09.
https://doi.org/10.1128/CMR.00062-09... . The first outbreak of hantavirus in the Americas was identified in 1993 in the United States in the health departments of New Mexico, Arizona, Colorado, and Utah ³3. Center for Disease Control and prevention. Estados Unidos. Outbreak of Acute Illness- Southwestern United States. MMWR Morb Mortal Wkly Rep [Internet]. 1993. [citado el 20 de julio de 2021]; 42(22):421-4 Disponible en: https://stacks.cdc.gov/view/cdc/26824.
https://stacks.cdc.gov/view/cdc/26824... . Subsequently, cases have been identified in 13 countries in the Americas, including Canada, the United States, Argentina, Bolivia, Brazil, Chile, Ecuador, French Guyana, Paraguay, Peru, Uruguay, Panama, and Costa Rica ⁴4. Organización Panamericana de la Salud [Internet]. Estados Unidos de América: OPS; 2017. [citado el 15 de julio del 2021]. Disponible en: https://www3.paho.org/hq/index.php?option=com_content&view=article&id=14911:hantavirus&Itemid=40721&lang=es.
https://www3.paho.org/hq/index.php?optio... .

Hantavirus pulmonary syndrome is an emerging zoonotic disease with a global impact on public health. According to data from the Pan American Health Organization (PAHO), 300 cases are reported each year in the Americas and mortality rates can reach up to 60% ⁴4. Organización Panamericana de la Salud [Internet]. Estados Unidos de América: OPS; 2017. [citado el 15 de julio del 2021]. Disponible en: https://www3.paho.org/hq/index.php?option=com_content&view=article&id=14911:hantavirus&Itemid=40721&lang=es.
https://www3.paho.org/hq/index.php?optio... .

Transmission of hantavirus to humans occurs through contact with infected rodents. This virus is excreted in the feces, urine and saliva of asymptomatic infected rodents and is transmitted to humans through inhalation of these aerosols ²2. Jonsson CB, Figueiredo LT, Vapalahti O. A global perspective on hantavirus ecology, epidemiology, and disease. Clin Microbiol Rev. 2010; 23(2): 412-441. doi: 10.1128/CMR.00062-09.
https://doi.org/10.1128/CMR.00062-09... ^,55. Yates T, Mills JN, Parmenter CH, Ksiazek T, Parmenter RR, Vande CR, et al. The Ecology and Evolutionary History of an Emergent Disease: Hantavirus Pulmonary Syndrome. Bioscience. 2002; 52 (11): 989-998. doi: 10.1641/0006-3568(2002)052[0989:TEAEHO]2.0.CO;2.
https://doi.org/10.1641/0006-3568(2002)0... . Human exposure to the presence of the infected vector increases with activities in rural areas, forests and agricultural areas, and when the vector is in the household or in the surroundings, becoming risk factors for the development of the hantavirus pulmonary syndrome ⁶6. Watson D, Sargianou M, Papa A, Chra P, Starakis I, Panos G. Epidemiology of Hantavirus infections in humans: a comprehensive, global overview. Crit Rev Microbiol. 2014; 40 (3): 261-272. doi: 10.3109/1040841X.2013.783555.
https://doi.org/10.3109/1040841X.2013.78... .

Preventive practices are the activities or behaviors that people carry out to protect, promote or maintain their health ⁷7. Harris DM, Guten S. Health-protective behavior: An exploratory study. J Health Soc Behav. 1979; 20(1): 17-29. doi: 10.2307/2136475.
https://doi.org/10.2307/2136475... and include measures to prevent the onset of the disease and reduce risk factors ⁸8. Organización Mundial de la Salud [Internet]. Promoción de la Salud Glosario. OMS: Ginebra; 1998. [citado el 15 de agosto del 2021]. Disponible en: http://apps.who.int/iris/bitstream/handle/10665/67246/WHO_HPR_HEP_98.1_spa.pdf.
http://apps.who.int/iris/bitstream/handl... . Measuring the practices carried out by people to prevent hantavirus disease is a valuable input that allows us to know how effective past interventions have been; it also serves as evidence to reformulate or restructure future intervention programs and strategies.

During the literature review, we did not identify studies on the design or validation of instruments that measure hantavirus prevention practices and report evidence of psychometric validity. In this sense, this study aims to design and analyze the evidence of content validity, internal structure and reliability of a hantavirus prevention practices questionnaire in an endemic community in the Panamanian context, in order to have a valid and reliable instrument that contributes to provide evidence for the development of prevention programs.

MATERIALS AND METHODS

Design of the instrument

An observational study was carried out during ten months, in four specific phases: design of the instrument based on literature review and construct clarity, content validity by expert judgment, pilot test and psychometric validation.

Literature review and initial development of the instrument

A literature review was conducted in Medline (Pubmed), SciELO and LILACS. The MESH descriptors we used were: hantavirus OR hantavirus pulmonary syndrome; (prevention) OR (preventive measures) AND Americas. The following search strategy was designed for Pubmed: (((hantavirus [Title]) OR (hantavirus pulmonary syndrome [Title])) AND ((prevention) OR (preventive measures [Title])))) AND (Americas), which retrieved 174 documents. We searched for articles with questionnaires measuring hantavirus prevention practices by reviewing the titles and abstracts. We identified three studies ⁹9. Suzuki K, Mutinelli LE. Knowledge and practices about hantavirus pulmonary syndrome in a cluster of Japanese communities in Argentina. Rev Panam Salud Publica. 2009; 25(2):128-33. doi: 10.1590/s1020-49892009000200005.
https://doi.org/10.1590/s1020-4989200900...

10. Harris C, Armien B. Sociocultural determinants of adoption of preventive practices for hantavirus: A knowledge, attitudes, and practices survey in Tonosí, Panama. PLoS Negl Trop Dis. 2020;14 (2):1-17. doi: 10.1371/journal.pntd.0008111.
https://doi.org/10.1371/journal.pntd.000... ^-1111. Valdivieso F, Gonzalez C, Najera M, Olea A, Cuiza A, Aguilera X, et al. Knowledge, attitudes, and practices regarding hantavirus disease and acceptance of a vaccine trial in rural communities of southern Chile. Hum Vaccin Immunother. 2017; 13 (4): 808-815. doi: 10.1080/21645515.2016.1250989.
https://doi.org/10.1080/21645515.2016.12... .

The search in LILACS was based on the following health descriptors (DeCS): hantavirus and prevention, with the following search strategy: TI (hantavirus) AND (prevention), which retrieved seven documents that include guidelines and recommendations on hantavirus and its prevention. Another search was carried out in LILACS with the following strategy: TI (hantavirus) AND (practices) and one study was identified in Argentina ⁹9. Suzuki K, Mutinelli LE. Knowledge and practices about hantavirus pulmonary syndrome in a cluster of Japanese communities in Argentina. Rev Panam Salud Publica. 2009; 25(2):128-33. doi: 10.1590/s1020-49892009000200005.
https://doi.org/10.1590/s1020-4989200900... .

The search strategy in SciELO: “hantavirus” AND “practices”, retrieved a study on hantavirus prevention practices along with other zoonoses ¹²12. Alvear Almendras M, Troncoso Muñoz C, Lastarria Cuevas F, Aliaga Russel F, Concha Rosales JP, Henríquez Alvear L, et al. Conocimientos y prácticas asociadas a transmisión de Triquinelosis, Hanta y Equinococosis quística. Cienc enferm. 2018; 24(18): 1-16. doi: 10.4067/s0717-95532018000100218.
https://doi.org/10.4067/s0717-9553201800... . Another study on the effectiveness of public health interventions through behaviors was conducted in New Mexico, Chile and Panama ¹³13. McConnell M. Hantavirus Public Health Outreach Effectiveness in Three Populations: An Overview of Northwestern New Mexico, Los Santos Panama, and Region IX Chile. J Viruses. 2014: 6 (3): 986-1003. doi: 10.3390/v6030986.
https://doi.org/10.3390/v6030986... .

The items were designed and based on the scientific evidence on the mechanisms of hantavirus transmission ²2. Jonsson CB, Figueiredo LT, Vapalahti O. A global perspective on hantavirus ecology, epidemiology, and disease. Clin Microbiol Rev. 2010; 23(2): 412-441. doi: 10.1128/CMR.00062-09.
https://doi.org/10.1128/CMR.00062-09... ^,55. Yates T, Mills JN, Parmenter CH, Ksiazek T, Parmenter RR, Vande CR, et al. The Ecology and Evolutionary History of an Emergent Disease: Hantavirus Pulmonary Syndrome. Bioscience. 2002; 52 (11): 989-998. doi: 10.1641/0006-3568(2002)052[0989:TEAEHO]2.0.CO;2.
https://doi.org/10.1641/0006-3568(2002)0... that support prevention measures and the recommendations of international public health organizations such as PAHO and the Center for Disease Control (CDC) ¹⁴14. Organización Panamericana de la Salud. Hantavirus en las Américas: guía para el diagnóstico, el tratamiento, la prevención y control. [Internet]. Estados Unidos de América: Cuaderno Técnico No. 47; 1999. [citado el 20 enero 2022]. Disponible en: https://iris.paho.org/bitstream/handle/10665.2/31081/9275330476-spa.pdf.
https://iris.paho.org/bitstream/handle/1... ^,1515. Centers for Disease Control and Prevention. Hantavirus pulmonary syndrome-United States: updated recommendations for risk reduction. MMWR Morb Mortal Wkly Rep. [Internet.] 2002 [citado el 15 de julio del 2021]; 51(No. RR-9): 5-6. Disponible en https://www.cdc.gov/mmwr/PDF/rr/rr5109.pdf.
https://www.cdc.gov/mmwr/PDF/rr/rr5109.p... ; in addition, we reviewed the items elaborated in studies that evaluated hantavirus preventive practices ⁹9. Suzuki K, Mutinelli LE. Knowledge and practices about hantavirus pulmonary syndrome in a cluster of Japanese communities in Argentina. Rev Panam Salud Publica. 2009; 25(2):128-33. doi: 10.1590/s1020-49892009000200005.
https://doi.org/10.1590/s1020-4989200900...

10. Harris C, Armien B. Sociocultural determinants of adoption of preventive practices for hantavirus: A knowledge, attitudes, and practices survey in Tonosí, Panama. PLoS Negl Trop Dis. 2020;14 (2):1-17. doi: 10.1371/journal.pntd.0008111.
https://doi.org/10.1371/journal.pntd.000...

11. Valdivieso F, Gonzalez C, Najera M, Olea A, Cuiza A, Aguilera X, et al. Knowledge, attitudes, and practices regarding hantavirus disease and acceptance of a vaccine trial in rural communities of southern Chile. Hum Vaccin Immunother. 2017; 13 (4): 808-815. doi: 10.1080/21645515.2016.1250989.
https://doi.org/10.1080/21645515.2016.12...

12. Alvear Almendras M, Troncoso Muñoz C, Lastarria Cuevas F, Aliaga Russel F, Concha Rosales JP, Henríquez Alvear L, et al. Conocimientos y prácticas asociadas a transmisión de Triquinelosis, Hanta y Equinococosis quística. Cienc enferm. 2018; 24(18): 1-16. doi: 10.4067/s0717-95532018000100218.
https://doi.org/10.4067/s0717-9553201800... ^-1313. McConnell M. Hantavirus Public Health Outreach Effectiveness in Three Populations: An Overview of Northwestern New Mexico, Los Santos Panama, and Region IX Chile. J Viruses. 2014: 6 (3): 986-1003. doi: 10.3390/v6030986.
https://doi.org/10.3390/v6030986... .

The identified questionnaires had different validation levels, such as content validity by expert judges, and had been developed by epidemiologists with experience in hantavirus and other tropical diseases, as well as PhD students in Global Health and Microbiology. Another element we considered during the development of the questionnaire was the evidence that the presence of rodent populations is associated with an increased risk of hantavirus pulmonary syndrome ⁵5. Yates T, Mills JN, Parmenter CH, Ksiazek T, Parmenter RR, Vande CR, et al. The Ecology and Evolutionary History of an Emergent Disease: Hantavirus Pulmonary Syndrome. Bioscience. 2002; 52 (11): 989-998. doi: 10.1641/0006-3568(2002)052[0989:TEAEHO]2.0.CO;2.
https://doi.org/10.1641/0006-3568(2002)0... .

Based on this review, we constructed the first preliminary list of 30 questions or items on hantavirus preventive practices and seven sociodemographic and clinical questions, which were submitted to review and discussion by the researchers for a consensus of 20 items on practices and seven sociodemographic and clinical questions (age, sex, monthly family income, educational level, occupation, personal history of hantavirus, history of hantavirus in close relatives, such as parents, children and siblings). The items on practices had polytomous responses (1 to 5) to determine the frequency of the activity (always-never).

Content validity by expert judgment

Content validity was assessed by means of expert judgment, who are people with vast knowledge of the topic or phenomenon under study, and we used the method of individual aggregates ¹⁶16. Corral Y. Validez y confiabilidad de los instrumentos de la investigación para la recolección de datos. Revista Ciencias de la Educación. [Internet]. 2009 [citado 20 de agosto de 2021]; 19 (33): 228-247. Disponible en: http://servicio.bc.uc.edu.ve/educacion/revista/n33/art12.pdf.
http://servicio.bc.uc.edu.ve/educacion/r... . A panel of five experts was selected, two of whom were medical epidemiologists with a master’s degree in public health, two nurses with a master’s degree in public health and a doctorate in nursing, and a specialist in health education. Judges had more than 15 years of professional experience; four of the five judges had experience in hantavirus and the other had experience as an expert judge in other public health instruments. The expert judges were provided with the printed and electronic format of the content evaluation template that rates clarity, coherence and relevance, on a scale of one to four ¹⁷17. Escobar Pérez J, Jiménez Cuervo A. Validez de contenido y juicio de expertos: una aproximación a su utilización. Avances en medición. 2008;6(1): 27-36. as well as the the hantavirus preventive practices questionnaire with 20 items. The qualitative assessment of the judges and their quantitative agreement was reviewed through Aiken’s V and its confidence intervals ¹⁸18. Merino Soto C, Segovia JL. Intervalos de confianza asimétricos para el índice la validez de contenido: Un programa Visual Basic para la V de Aiken. An Psicol. 2009; 25(1):169-71..

Pilot test

The purpose of the pilot test was to evaluate the instrument in a population with similar characteristics to the study population, in order to obtain qualitative assessments such as identification of semantic errors, wording and comprehension. Quantitative assessments were included when examining the metric properties of the instrument in its preliminary version ¹⁹19. Muñiz J, Fonseca-Pedrero E. Diez pasos para la construcción de un test. Psicothema. 2009;31(1):7-16. doi: 10.7334/psicothema2018.291.
https://doi.org/10.7334/psicothema2018.2... . Based on methodological recommendations ¹⁹19. Muñiz J, Fonseca-Pedrero E. Diez pasos para la construcción de un test. Psicothema. 2009;31(1):7-16. doi: 10.7334/psicothema2018.291.
https://doi.org/10.7334/psicothema2018.2... , at the end of the pilot test, the new version of the instrument was presented and reviewed by expert judges for it to be submitted for psychometric validation.

Psychometric validation

The psychometric validation of the construct was carried out using exploratory factor analysis (EFA), whose main purpose is to explore the structure of the factors that underlie a data set and explain most of the variance of the data set ²⁰20. Pérez ER, Medrano L. Análisis Factorial Exploratorio: Bases Conceptuales y Metodológicas. Rev Argent Cienc Comport. 2010;2(1):58-66.. The study area for the psychometric validation was the village of El Cacao (second with the highest number of reported cases) in the district of Tonosí, province of Los Santos-Panamá, which has a hantavirus incidence of 681 cases per 100,000 inhabitants ²¹21. Ministerio de Salud. Informe del Departamento de Epidemiología de la Región de salud de Los Santos. Panamá: MINSA; 2015. Manuscrito no publicado.. This town has 315 dwellings; we identified one person over 18 years of age for each dwelling for the application of the questionnaire, preferably the person in charge of the household. We proposed a minimum sample of 200 persons, based on the minimum number of observations necessary for the factor analysis, even in ideal situations of high communalities and well-determined factors ²²22. Ferrando PJ, Anguiano-Carrasco C. El análisis factorial como técnica de investigación en psicología. Pap Psicol. 2010;31(1):18-33.. The participants were selected non-probabilistically by convenience sampling.

The EFA was carried out in three stages. The first stage consisted of preliminary analyses which included reliability analysis and the elimination of items with a corrected item-total correlation lower than 0.30 ²³23. Méndez Martínez C, Rondón Sepúlveda MA. Introducción al análisis factorial exploratorio. Rev Colomb Psiquiat. 2012; 41(1):197-207.; the descriptive analysis of the items (mean, standard deviation, skewness and kurtosis) and the analysis of the feasibility of the EFA, through Bartlett’s statistical test of sphericity, the Kaiser-Mayer-Olkin (KMO) sample adequacy measure and sample adequacy values ²³23. Méndez Martínez C, Rondón Sepúlveda MA. Introducción al análisis factorial exploratorio. Rev Colomb Psiquiat. 2012; 41(1):197-207.. The second stage included the use of the polychoric correlation matrix, which is a suitable option for the EFA when the items are on an ordinal scale ²⁴24. Freiberg Hoffmann A, Stover JB, De la iglesia G, Fernández Liporace M. Correlaciones policóricas y tetracóricas en estudios factoriales exploratorios y confirmatorios. Cienc Psicol. 2013; 7(2):151-64., and it is also recommended when the items are asymmetric with high kurtosis ²⁵25. Muthén B, Kaplan D. Comparación de algunas metodologías para el análisis factorial de variables Likert no normales. Br J Math Stat Psychol. 1985;38(2):171-89., as was the case for results. The unweighted least squares method was used for factor estimation, and for the selection of the number of factors to retain, we used the optimal implementation of parallel analysis as well as an oblique rotation (Promin). The unweighted least squares method is highly recommended when working with categorical variables and on the basis of a polychoric correlation matrix ²⁶26. Ledesma RD, Ferrando PJ, Tosi JD. Uso del Análisis Factorial Exploratorio en RIDEP. Recomendaciones para Autores y Revisores. Revista Iberoamericana de Diagnóstico y Evaluación - e Avaliação Psicológica. 2019; 3(52):173-180. doi: 10.21865/RIDEP52.3.13.
https://doi.org/10.21865/RIDEP52.3.13... ; parallel analysis selects common factors that have eigenvalues greater than those that would be found by chance and is the most appropriate method for evaluating the underlying common factors in variables that are rated on an ordinal scale ²⁷27. Timmerman ME, Lorenzo-Seva U. Evaluación de la dimensionalidad de elementos politómicos ordenados con análisis paralelo. Psychol Methods. 2011; 16(2):209-220. doi: 10.1037/a0023353.
https://doi.org/10.1037/a0023353... . The Promin oblique rotation method provides good results and is simpler to use ²⁸28. Lorenzo-Seva U. Promin: A Method for Oblique Factor Rotation. Multivariate Behav Res. 2010; 34(3):347-65. doi: 10.1207/S15327906MBR3403_3.
https://doi.org/10.1207/S15327906MBR3403... . During the third stage, we determined the factor model on the basis of the explained variance, and items with factor loadings equal to or greater than 0.40 were retained ²⁹29. Nunnally J, Bernstein I. Psychometric theory. New York: McGraw-Hill; 1994..

For the descriptive analysis and the EFA, we used the freely available FACTOR v11 program designed by Lorenzo-Seva and Ferrando of the University of Tarragona-Spain.

To analyze reliability with the internal consistency of the scores, we used the ordinal alpha which is based on the Excel matrix designed by Domínguez-Lara that uses factor loadings, and is recommended for calculating reliability based on Likert response items ³⁰30. Domínguez-Lara S. Propuesta para el cálculo del alfa ordinal y theta de armor. Rev Investig Psicol. 2012;15(1):213-7..

Possible interviewer bias was addressed with training for the interviewers and the researcher, which included practical sessions on the application of the questionnaire.

Ethical Aspects

The study was approved by the research bioethics committee of the Hospital Regional Anita Moreno, Los Santos province, Panama, with the number Proy-38 and with an approval date of February 2020.

RESULTS

Content validation

During the qualitative evaluation, three judges made suggestions for improving the phrasing of seven items; two judges recommended omitting the measurements in centimeters and meters from two items: “30 m around the dwelling and 2 cm holes”, since respondents might have difficulty assessing the measurements objectively. After careful review of the judges’ recommendations, the researchers integrated the received suggestions to improve the clarity and phrasing of the items and accepted the recommendation to eliminate the measurements in centimeters and meters.

Table 1 shows the results of the consensus by the expert judges based on Aiken’s V. We found values higher than 0.70 in the lower limit, with a 95% confidence interval, a margin of error of 5% and a mean that ranged from 3.80 to 4.00 on a scale from 1 to 4. Regarding the clarity criterion, six items showed a lower limit of 0.62 (items 3, 4, 15, 16, 18 and 19), and item 12 showed a lower limit of 0.55 in the relevance and coherence criteria. Phrasing was adjusted based on the qualitative recommendations of the judges and in the items with Aiken’s V between 0.62 and 0.55.

Pilot test

The pilot test was applied at the Tonosí Rural Hospital in 32 residents of hantavirus endemic areas in May 2021. The instrument was applied face-to-face by two health professionals who were trained in the application of the instrument, and by the main researcher. Three questions were added to evaluate the comprehension and clarity of the items, as well as the time required to complete the form, and the option of additional suggestions or comments was left. Participants considered the items clear and understandable, the approximate duration was 10-12 min, and some phrasing suggestions were obtained.

Based on the pilot test we considered the following adjustments: the observations regarding the understanding of each item by the participants and the corrected total item correlation; a value greater than or equal to 0.30 on the total scale was evaluated as the cut-off point; two items that presented low correlations and a certain coincidence with other questions were eliminated; this resulted in a new version with 18 items.

Psychometric validation

The questionnaire was applied to 213 participants, which represents 67.6% (213/315) of the universe in the study area. Regarding the characteristics of the population (n = 213), 67.8% were women, the age ranged from 18 to 93 years, with a mean of 46 years and a standard deviation of 18.70; 67.8% had an income of less than 300.00 dollars per month; 18.7% had low schooling in (no studies or incomplete primary education). The instrument was applied by the researchers or by a trained collaborator in the participant’s household and the duration ranged between 10-12 min.

First, we carried out a descriptive analysis of the items and response options. Given that only 58.6% (125/213) answered items 13 to 18, which inquired about hantavirus preventive practices related to planting, storing and harvesting food, these were eliminated due to the low response rate, since the community members stated that they were farming for family consumption and did not store the food harvest. We proceeded to work with the remaining 12 items, of which four were eliminated with total corrected item correlation lower than 0.30, prior to an analysis and contrast of the importance of the item in the literature review.

Table 2 shows the descriptive statistics of the adjusted eight-item hantavirus preventive practices instrument; items 2 and 3 had skewness values higher than 3 as absolute value and high kurtosis as well. The percentages of the response options of the items mostly showed high scores, especially item 8, which did not register low scores.

Table 3 presents the polychoric correlation matrix, which shows low correlations between item 11 and items 3 and 4; the rest of the items have correlations close to 0.30 or higher than 0.40.

We analyzed sample adequacy indices; the KMO value was 0.7565 with a 95% CI of 0.709-0.820, Bartlett’s sphericity test was 833.5 (df = 28; p <0.001) and all items showed simple sample adequacy greater than 0.50, these scores evidence the feasibility of the EFA.

The unweighted least squares method and the parallel analysis performed in the FACTOR program suggest that the eight items underlie a single factor, which explains 60.70% of the total variance of the test and the factor loadings range from 0.496 to 0.854 as described in Figure 1. The results of the factor loadings are acceptable based on the criteria of retaining items with factor loadings equal to or greater than 0.40.

Reliability analysis

Reliability was analyzed by means of the ordinal alpha internal consistency test, using the factor loadings of the polychoric correlation matrix, this resulted in a score of 0.84, a value considered good. It should be noted that the ordinal alpha value is a measure of internal consistency that refers to the scores obtained with the instrument in the population and not a metric of the instrument itself.

DISCUSSION

This study was conducted with the aim of designing and validating a hantavirus preventive practices questionnaire, in an endemic context, which included content validity through expert judges, pilot test, construct validity through exploratory factor analysis and reliability measured with ordinal alpha.

We did not identify many instruments that measure hantavirus preventive practices in our context ⁹9. Suzuki K, Mutinelli LE. Knowledge and practices about hantavirus pulmonary syndrome in a cluster of Japanese communities in Argentina. Rev Panam Salud Publica. 2009; 25(2):128-33. doi: 10.1590/s1020-49892009000200005.
https://doi.org/10.1590/s1020-4989200900...

10. Harris C, Armien B. Sociocultural determinants of adoption of preventive practices for hantavirus: A knowledge, attitudes, and practices survey in Tonosí, Panama. PLoS Negl Trop Dis. 2020;14 (2):1-17. doi: 10.1371/journal.pntd.0008111.
https://doi.org/10.1371/journal.pntd.000...

11. Valdivieso F, Gonzalez C, Najera M, Olea A, Cuiza A, Aguilera X, et al. Knowledge, attitudes, and practices regarding hantavirus disease and acceptance of a vaccine trial in rural communities of southern Chile. Hum Vaccin Immunother. 2017; 13 (4): 808-815. doi: 10.1080/21645515.2016.1250989.
https://doi.org/10.1080/21645515.2016.12...

12. Alvear Almendras M, Troncoso Muñoz C, Lastarria Cuevas F, Aliaga Russel F, Concha Rosales JP, Henríquez Alvear L, et al. Conocimientos y prácticas asociadas a transmisión de Triquinelosis, Hanta y Equinococosis quística. Cienc enferm. 2018; 24(18): 1-16. doi: 10.4067/s0717-95532018000100218.
https://doi.org/10.4067/s0717-9553201800... ^-1313. McConnell M. Hantavirus Public Health Outreach Effectiveness in Three Populations: An Overview of Northwestern New Mexico, Los Santos Panama, and Region IX Chile. J Viruses. 2014: 6 (3): 986-1003. doi: 10.3390/v6030986.
https://doi.org/10.3390/v6030986... . One of the studies ⁹9. Suzuki K, Mutinelli LE. Knowledge and practices about hantavirus pulmonary syndrome in a cluster of Japanese communities in Argentina. Rev Panam Salud Publica. 2009; 25(2):128-33. doi: 10.1590/s1020-49892009000200005.
https://doi.org/10.1590/s1020-4989200900... we identified explains the use of literature review and hantavirus prevention material developed by health institutions for questionnaire design and another one¹²12. Alvear Almendras M, Troncoso Muñoz C, Lastarria Cuevas F, Aliaga Russel F, Concha Rosales JP, Henríquez Alvear L, et al. Conocimientos y prácticas asociadas a transmisión de Triquinelosis, Hanta y Equinococosis quística. Cienc enferm. 2018; 24(18): 1-16. doi: 10.4067/s0717-95532018000100218.
https://doi.org/10.4067/s0717-9553201800... reports the use of focus groups for questionnaire design and validation by an expert. None of the studies presented evidence of psychometric validation.

The hantavirus preventive practices questionnaire applied in an endemic community showed content validity, Aiken’s V values higher than 0.70 and a margin of error of 5%. The exploratory factor analysis showed that the eight items underlie a single factor that explains 60.70% of the variance. Reliability measured through the ordinal alpha based on the factor loadings of the polychoric correlation matrix was adequate (0.84).

The designed and validated instrument (supplementary material) is a contribution to the measurement of hantavirus preventive practices as it could be applied at the baseline for the development of health education programs for hantavirus prevention; furthermore, it could contribute to assess change in the practices or behavior in pre- and post-intervention focused studies. This instrument was designed around the main prevention strategy currently available, which includes household hygiene practices to prevent rodent entry into the home and the safe cleaning of droppings ¹⁵15. Centers for Disease Control and Prevention. Hantavirus pulmonary syndrome-United States: updated recommendations for risk reduction. MMWR Morb Mortal Wkly Rep. [Internet.] 2002 [citado el 15 de julio del 2021]; 51(No. RR-9): 5-6. Disponible en https://www.cdc.gov/mmwr/PDF/rr/rr5109.pdf.
https://www.cdc.gov/mmwr/PDF/rr/rr5109.p... ^,1616. Corral Y. Validez y confiabilidad de los instrumentos de la investigación para la recolección de datos. Revista Ciencias de la Educación. [Internet]. 2009 [citado 20 de agosto de 2021]; 19 (33): 228-247. Disponible en: http://servicio.bc.uc.edu.ve/educacion/revista/n33/art12.pdf.
http://servicio.bc.uc.edu.ve/educacion/r... , as well as evidence on the relationship between the presence of rodents and increased risk of hantavirus cases ⁵5. Yates T, Mills JN, Parmenter CH, Ksiazek T, Parmenter RR, Vande CR, et al. The Ecology and Evolutionary History of an Emergent Disease: Hantavirus Pulmonary Syndrome. Bioscience. 2002; 52 (11): 989-998. doi: 10.1641/0006-3568(2002)052[0989:TEAEHO]2.0.CO;2.
https://doi.org/10.1641/0006-3568(2002)0... . The general design of this instrument allows its application in other Latin American countries where hantavirus is endemic; however, it is necessary to consider the following limitation: in this questionnaire it was not possible to measure the items related to the sowing, harvesting and storage of grains in the fields near the house, which represent a risk for human contact with the vector and its droppings.

Another limitation of our study is the low response rate obtained for the questions on hantavirus preventive practices, related to sowing, storage and harvesting of agricultural products, which prevented these items from being used in the EFA, these topics could allow a more complete reading of hantavirus preventive practices. Other limitations of the study include the selection of participants by convenience sampling does not allow generalization of the results; the stability of the instrument over time was not verified, so it would be necessary in future studies to explore test-retest reliability. Finally, given that the questionnaire measures preventive practices by self-report, responses could be biased by learning and self-defense, since the participant tends to answer based on acquired knowledge and expected responses. Consequently, in future research the questionnaire could be complemented with qualitative assessments or other data collection techniques such as observation and the use of checklists.

In conclusion, the hantavirus preventive practices questionnaire is an eight-item unidimensional instrument, that showed evidence of content validity, structure and reliability to measure the practices and/or activities or behaviors carried out by people in an endemic community to prevent hantavirus.

References

Supplementary Material:

Publication Dates

History