Abstracts

INTRODUCTION

Brazil has adopted the Declaration of Commitment of the United Nations, which aimed at slowing the HIV/AIDS epidemic by 2015. HIV/AIDS knowledge is one of the indicators proposed by the United Nations General Assembly Special Session for monitoring AIDS among vulnerable subgroups including, sex workers, injection drug users and men who have sex with men (MSM). This indicator requires that adequate HIV/AIDS knowledge is an essential prerequisite for the adoption of behaviors that reduce the risk of infection.^aa United Nations General Assembly Special Session on HIV/AIDS. Monitoring the Declaration of Commitment on HIV/AIDS: Guidelines on Constructions of Core Indicators: 2008 reporting. Geneva; 2008. Global estimates among low and middle income countries indicate that 56.0% of MSM did not have correct knowledge about HIV/AIDS, 70.0% had never been tested for HIV and 46.0% did not use condoms the last time they practiced anal sex.²2 . Adam PCG, Wit JBF, Toskin I, Mathers BM, Nashkhoev M, Zoblotska I, et al. Estimating levels of HIV testing, HIV prevention coverage, HIV knowledge, and condom use among men who have sex with (MSM) in low-income and middle-income countries. J Acquir Immune Defic Syndr. 2009;52(Suppl 2):143-51. DOI:10.1097/QAI.0b013e3181baf111
https://doi.org/10.1097/QAI.0b013e3181ba...

In Brazil, the AIDS epidemic is concentrated in population subgroups with a markedly higher risk of acquiring HIV infection among MSM.⁴4 . Beyrer C, Baral SD, van Griensven F, Goodreau SM, Chariyalertsak S, Wirtz AL, et al. Global epidemiology of HIV infection in men who have sex with men. Lancet. 2012;380(9839):367-77. DOI:10.1016/S0140-6736(12)60821-6
https://doi.org/10.1016/S0140-6736(12)60... ^{, 6}6 . Gondim RC, Kerr LRFS, Werneck GI, Macena RHM, Pontes MK, Kendall C. Risky sexual practices among men who have sex with men in Northeast Brazil: results from four sequential surveys. Cad Saude Publica. 2009;25(6):1390-8. DOI:10.1590/S0102-311X2009000600021
https://doi.org/10.1590/S0102-311X200900... Recent data from a national survey found a worrisome HIV prevalence rate of 14.2% among this population.¹⁰10 . Kerr LRFS, Mota RS, Kendall C, Pinho AA, Melo MB, Guimarães MDC, et al. HIV among MSM in a large middle-income country. AIDS. 2013;27(3):427-35. DOI:10.1097/QAD.0b013e32835ad504
https://doi.org/10.1097/QAD.0b013e32835a... The promotion of safer sex has been the main policy strategy for HIV prevention and access to information is a key element in reducing vulnerability to HIV/AIDS by providing an opportunity to change individual attitudes and increase safe practices.^bb Ministério da Saúde. Secretaria de Vigilância em Saúde. Departamento de DST, Aids e Hepatites Virais. Resumo analítico dos dados do Boletim Epidemiológico de 2011. Brasília (DF); 2011.

Despite its importance, there is no standard instrument used to assess HIV/AIDS knowledge across different populations and many studies vary in their choice of the number and formulation of questions used.¹⁸18 . Vian T, Semrau K, Hamer DH, Loan LTT, Sabin LL. HIV/AIDS-related knowledge and behaviors among most-at-risk populations in Vietnam. Open AIDS J. 2012;6:259-65. DOI:10.2174/1874613601206010259
https://doi.org/10.2174/1874613601206010... ^{, 19}19 . Zhang H, Liao M, Nie X, Pan R, Wang C, Ruan S, et al. Predictors of consistent condom use based on the information-motivation-behavioral skills IMB) model among female sex workers in Jinan, China. BMC Public Health. 2011;11:113. DOI:10.1186/1471-2458-11-113
https://doi.org/10.1186/1471-2458-11-113... Moreover, the knowledge score has been expressed as the sum of the correct responses to each item, based on Classical Test Theory (CTT), and an arbitrary cut-off point is established in order to classify good or adequate knowledge.⁹9 . Hong SY, Thompson D, Wanke C, Omosa G, Jordan MR, Tang AM, et al. Knowledge of HIV transmission and associated factors among HIV-positive and HIV-negative patients in rural Kenya. J AIDS Clinic Res. 2012;3(7):1-6. ^{, 11}11 . Liu S, Wang K, Yao S, Guo X, Liu Y, Wang B. Knowledge and risk behaviors related to HIV/AIDS and their association with information resource among men who have sex with men in Heilongjiang province, China. BMC Public Health. 2010;10:250. DOI:10.1186/1471-2458-10-250
https://doi.org/10.1186/1471-2458-10-250... Thus, the total score is dependent on the set of items that compose the measuring instrument, which makes it difficult to compare results between different studies.^cc Pasquali L. Teoria de resposta ao item: teoria, procedimentos e aplicações. Brasília (DF): Laboratório de pesquisa em avaliação e medida da UnB; 2007.

Recent studies assessed HIV/AIDS knowledge using the Item Response Theory (IRT).¹1 . AarØ LE, Breivik K, Klepp KI, Kaaya S, Onya HE, Wubs A, et al. An HIV/AIDS knowledge scale for adolescents: item response theory analyses based on data from a study in South Africa and Tanzania. Health Educ Res. 2011;26(2):212-24. DOI:10.1093/her/cyq086
https://doi.org/10.1093/her/cyq086... ^{, 13}13 . Melo APS, César CC, Acurcio FA, Campos LN, Ceccato MGB, Wainberg ML, et al. Individual and treatment setting predictors of HIV/AIDS knowledge among psychiatric patients and their implications in a national multisite study in Brazil. Community Ment Healthy J. 2010;46(5):505-16. DOI:10.1007/s10597-010-9303-7 ^{, 15}15 . Okubo T, Ohsawa S, Nakagawa M. Scaling of AIDS knowledge test items for japanese junior high school students. School Health. 2006;2:27-32. IRT is considered the modern theory of psychometry, focuses on each item of the measuring instrument and assumes that the performance of a given test can be explained by individual characteristics, not directly observable, named latent traits.³3 . Araújo EAC, Andrade DF, Bortolotti SLV. Teoria da resposta ao item. Rev Esc Enferm. 2009;43(Esp):1000-8. DOI:10.1590/S0080-62342009000500003
https://doi.org/10.1590/S0080-6234200900... ^{, 14}14 . Pasquali L, Primi R. Fundamentos da teoria da resposta ao item - TRI. Aval Psicol. 2003;2(2):99-110. Although IRT does not contradict classical methods, it is based on the assumption that the estimate of the latent trait is independent of sample items, which allows the equalization of scores on evaluations when using different instruments applied to the same population.¹⁴14 . Pasquali L, Primi R. Fundamentos da teoria da resposta ao item - TRI. Aval Psicol. 2003;2(2):99-110. This is especially important when assessment of HIV/AIDS knowledge is used to monitor effectiveness of public health policies over time among vulnerable populations. More precise and accurate analysis of knowledge may allow proper planning of new prevention intervention strategies.

The objective of this study was to evaluate the level of HIV/AIDS knowledge among men who have sex with men from Brazil using the Item Response Theory.

METHODS

This analysis is part of a cross-sectional study of MSM carried out in 10 Brazilian cities in 2008-2009. The main objectives of the national study were to estimate the prevalence of HIV and syphilis and to assess knowledge, attitudes and sexual practices of MSM.¹⁰10 . Kerr LRFS, Mota RS, Kendall C, Pinho AA, Melo MB, Guimarães MDC, et al. HIV among MSM in a large middle-income country. AIDS. 2013;27(3):427-35. DOI:10.1097/QAD.0b013e32835ad504
https://doi.org/10.1097/QAD.0b013e32835a...

Participants should be residents of the following cities: Manaus, Recife, Salvador, Campo Grande, Brasília, Curitiba, Itajaí, Santos, Rio de Janeiro and Belo Horizonte. These were a priori chosen by the Department of STD, AIDS and Viral Hepatitis of the Ministry of Health (STD/AIDS/MH). Eligibility criteria included adult MSM (18 years old or over), who reported at least one sexual contact with another man in the 12 months preceding the interview.

The sample size was previously calculated as 250 to 350 participants by city (α = 0.05, power = 0.90, estimated prevalence = 13.6%) ¹⁰10 . Kerr LRFS, Mota RS, Kendall C, Pinho AA, Melo MB, Guimarães MDC, et al. HIV among MSM in a large middle-income country. AIDS. 2013;27(3):427-35. DOI:10.1097/QAD.0b013e32835ad504
https://doi.org/10.1097/QAD.0b013e32835a... to provide independent estimates for each city and it was obtained using the Respondent Driven Sampling technique.¹²12 . Magnani R, Sabin K, Saidel T, Heckathorn D. Review of sampling hard-to-reach and hidden populations for HIV surveillance. AIDS. 2005;19(Suppl2):67-72. DOI:10.1097/01.aids.0000172879.20628.e1
https://doi.org/10.1097/01.aids.00001728... This technique is a chain link sampling method used to address hard to reach populations and their social networks, since the lack of a sampling base does not allow the application of traditional probabilistic method. The recruitment is carried out by participants themselves using a dual incentive system, and begins with a convenience sample of members of the target population, named seeds. In this study, these were selected during preliminary formative research, when individuals of different ages and socioeconomic classes were included. In each city, participants received three unique coupons, non-falsifiable, to distribute to their peers. Individuals who came to the study site with a valid coupon and who met the inclusion criteria were considered the first “wave” of the study. Each participant also received three coupons to invite new acquaintances, repeating this process thereafter until the desired sample size was reached in each city.

Data were collected in face-to-face interviews, composed of questions regarding sociodemographic data, behavior, social context, health care and HIV/AIDS knowledge. Participants were also invited for HIV and syphilis testing.

HIV/AIDS knowledge was assessed using 10 statements to which participants should indicate whether each one was true, false or “did not know”. The statements were chosen from previously used instrument by the STD/AIDS/MH at face value. For this analysis, correct responses were categorized as 1 and those which were considered incorrect or to which respondents replied “did not know” were categorized as 0.

Descriptive analysis of the sample was carried out and HIV/AIDS knowledge was assessed by IRT using the two-parameter logistic model, difficulty and discrimination. Because our main interest was to assess the overall result and the quality of the instrument using the methodology of IRT, we conducted the analysis considering the 10 cities simultaneously, since the parameter estimates do not depend on the recruitment sampling method.⁸8 . Hambleton RK, Jones RW. Comparison of classical test theory and item response theory and their applications to test development. Educ Meas Issues Pract. 1993;12(3):38-47. DOI:10.1111/j.1745-3992.1993.tb00543.x
https://doi.org/10.1111/j.1745-3992.1993... This model makes the assumption of unidimensionality, i.e., that a given test should measure one single latent trait, which indicates a dominant skill responsible for the performance of a set of items of the test. In this study, HIV/AIDS knowledge was the dominant latent trait measured by the 10 items.

The logistic model represents the probability that the participants correctly responded to a given item as a function of their level of HIV/AIDS knowledge and the difficulty and discrimination parameters of the item. The responses to the different items are independent (local independence). It is described as a non-linear logistic function and expressed by the item characteristic curve (ICC) defined by the parameters of the item. The probability of a correct answer varies from 0 to 1 and the knowledge scale assumes a normal distribution pattern (-∞ to +∞) with mean = 0 and standard deviation = 1, but in practice -3 to +3 is used, corresponding to 99.97% of all individuals in a population. It is assumed that every individual has a specific level of knowledge, score theta, which places him on the scale. The discrimination parameter of each item (a _i) is expressed by the slope of the ICC at the inflection point when the probability of a correct response is 0.5. In general, the metric for this parameter is 0 to 3, where higher values produce steeper curves and indicate items with high discrimination power.¹⁴14 . Pasquali L, Primi R. Fundamentos da teoria da resposta ao item - TRI. Aval Psicol. 2003;2(2):99-110. Baker’s scale was used to interpret this parameter.^dd Baker FB. The basics of item response theory. College Park: ERIC Clearinghouse on Assessment and Evaluation; 2001. The difficulty parameter of each item (b _i) corresponds to the point on the scale of knowledge where the probability of correct response is 0.5. Typically, the values are between -3 to +3 and higher values indicate the most difficult items. For a better understanding of our results, the parameters and the knowledge scores were transformed so that the knowledge scores were presented on a scale of 0 to 10.¹⁴14 . Pasquali L, Primi R. Fundamentos da teoria da resposta ao item - TRI. Aval Psicol. 2003;2(2):99-110.

The item parameters were estimated by marginal maximum likelihood, proposed by Bock & Aitkin,⁵5 . Bock RD, Aitkin M. Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika. 1981;46(4):443-59. DOI:10.1007/BF02293801
https://doi.org/10.1007/BF02293801... and the knowledge score (theta) was estimated by the expected a posteriori method based on Bayesian statistical principles. BILOG-MG software for Windows 3.0.2 was used for these analyses and the convergence criterion used was 0.0001.¹⁸18 . Vian T, Semrau K, Hamer DH, Loan LTT, Sabin LL. HIV/AIDS-related knowledge and behaviors among most-at-risk populations in Vietnam. Open AIDS J. 2012;6:259-65. DOI:10.2174/1874613601206010259
https://doi.org/10.2174/1874613601206010...

Full-information factor analysis was carried out to test the unidimensionality of the knowledge scale, i.e., the items must share only one underlying variable if they are to be combined into a scale. Full-information factor analysis takes into account all the empirical data and it is based on the tetrachoric correlation matrix using TESTFACT software, version 4.0.^ee Scientific software international. IRT from SSI: BILOG-MG, MULTILOG, PARSCALE, TESTFACT. Lincolnwood: Mathilda du Toit; 2003. The marginal maximum likelihood was used to estimate the probabilities of all possible response patterns that occurred in the sample according to the different levels of knowledge.

The differential item functioning (DIF) was assessed by the likelihood ratio test for age and years of schooling, using the IRTLRDIF software, version 2.0b.^ff Thissen D. IRTLRDIF V.2.0b: Software for the computation of the statistics involved in item response theory likelihood-ratio tests for differential item functioning. Wilmington: University of North Carolina at Chapel Hill; 2001. When individuals with the same level of knowledge in different groups do not have the same probability of correctly answering a given item, this is taken as an indicator of DIF. Differences in parameters were tested by chi-squared statistic and the significance level considered was 0.05. The characteristic curves of the items which presented with DIF were analyzed and differentiated between uniform DIF (parallel ICC) and non-uniform (crossover ICC).^gg Pasquali L. Teoria de resposta ao item: teoria, procedimentos e aplicações. Brasília (DF): Laboratório de pesquisa em avaliação e medida da UnB; 2007.

This study was approved by the National Research Ethical Committee (CONEP 14,494) and all participants signed the informed consent form.

RESULTS

On average, there were 15 (range 8-20) waves of recruitment in each city, resulting in 3,859 participants, with 3,746 (97.1%) responding to the ten items on HIV/AIDS knowledge. Most of the participants was more than 25 years old (52.1%), had more than eight years of schooling (69.7%), were single or separated (83.4%) and non-white (72.4%). Only 19.0% was living alone, and 28.8% were classified as economic class AB (higher).

Overall, the proportion of correct answers varied from 34.5% to 98.5%, with the lowest proportions shown for items 1 and 2 (35.5% and 34.5%, respectively). Some beliefs still exist in this population regarding the transmission of the virus by insect bites, by using public restrooms, and by sharing utensils during meals (Table).

The crude mean and median total score of correct items were 7.5 (SD = 1.5) and 8.0, respectively, with 43.2% of the sample falling below the average. On the other hand, the mean and median overall HIV/AIDS knowledge score using IRT were 5.0 (SD = 0.9) and 5.3, respectively, with 40.7% of the sample with knowledge levels below the average.

The parameters for each item, estimated by IRT, can also be seen in the Table, in descending order of the parameter of difficulty. Items 1 and 2 stood out as the most difficult items, with the larger values of difficulty parameter (b = 14) exceeding the scale (0 to 10). This points to potential problems in these items, as indicated by the low percentage of correct responses for these items. The eight remaining items showed low degree of difficulty, with values below the average of the scale, ranging from 1.0 to 4.0. The average difficulty of the set of items, excluding items 1 and 2, was 2.48 (SD = 1.0). The discrimination parameters ranged from 0.04 to 1.01. Item 5 was considered the best item, with the highest discrimination parameter (a₅ = 1.01), capable of differentiating individual HIV/AIDS knowledge. According to Baker’s classification, five items (3, 4, 5, 9 and 10) showed moderate discrimination, one item showed low discrimination (8), and four items (1, 2, 6 and 7) had very low discrimination (values lower than 0.34). The overall average of all items was 0.56 (SD = 0.38), and it can be considered of low discriminatory value.

One item of each type of discrimination is shown in Figure 1, represented on the left by the ICC and on the right by the curve of the item information. As observed, the ICC of item 5 is the steepest curve, gently sloping to the right of the knowledge scale. This indicates that a slight increase in the level of knowledge is capable of significantly increasing the probability of a correct response to this item. Because item 5 had the highest degree of discrimination, it is capable of distinguishing individual knowledge at much closer levels, as compared to the remaining items. On the other hand, ICC for item 1 is almost a straight line parallel to the scale of knowledge, indicating that an increase in the theta values does not significantly change the probability of correctly answering the item, i.e., low discriminatory power of this item. The item information curve shows how much the item contributes to the measure of knowledge, i.e., it indicates precisely which levels of theta were better discriminated. Usually the item brings best information about a few theta levels than others, and its representation resembles a normal curve type. The information curve of item 5 brought more information for measuring the levels of knowledge around value 3.0. Outside this amplitude, the item starts producing incorrect information on the level of knowledge, since the standard error curve is inversely proportional to the information curve. On the other hand, the information curve of item 1 showed that this item hardly contributed with any information for measuring HIV/AIDS knowledge.

Figure 2 presents a graphical representation of the total information curve, i.e., the sum of all information functions, for all the ten items. Overall, the curve indicates that the 10 items provided better differentiation among individuals who are below the midpoint on the knowledge scale. For individuals with levels above the average, the items have little discrimination, producing most of the information error, as seen by the standard error curve (dotted line). In addition, there was no measurable knowledge score above six on the scale.

A macroscopic view of the item analysis in our sample is shown in Figure 3, which simultaneously provides the total information curve, the curve of HIV/AIDS knowledge scores (IRT), and the total observed scores (CTT). In summary, the estimated latent knowledge among MSM was limited by the parameters of the items, i.e., it more accurately measured individuals with lower knowledge but little differentiation was obtained among those with median or high knowledge levels.

Regarding the existence of the unidimensionality, Full-information factor analysis indicated four factors with the following variance partition: 31.0%, 10.0%, 5.2% and 3.8%. The first component is predominant in relation to the other factors, which confirms that the set of analyzed items presents a unidimensional structure, explained by a variance of 31.0%.

The DIF by age and schooling was identified in six items (1, 2, 3, 5, 6 and 7) whose ICC are shown in Figure 4. Items 3 and 5 presented uniform DIF in the two variables, producing parallel curves that differ between the two groups only in the difficulty parameter. This indicates that individuals who are younger than 25 years old and those with more than eight years of schooling have a greater probability of correctly responding to these items compared to those 25 years old or more and with eight or fewer years of education, respectively. On the other hand, crossover DIF has been found for items 2 and 6 with respect to age, and for items 1 and 7 with respect to schooling. This indicates that the ICC of these items differ with respect to both parameters difficulty and discrimination.

DISCUSSION

Currently, there is no validated instrument capable of measuring HIV/AIDS knowledge across different populations in Brazil. This study applied IRT for the analysis of HIV/AIDS knowledge among MSM, as it offers important advantages, particularly by the individual analysis of the items and the reliability of the measure, supplementing information provided by the CTT. In addition, IRT psychometrics offers a suitable approach to studying an instrument’s ability to detect change.¹⁷17 . Reise SP, Haviland MG. Item response theory and the measurement of clinical change. J Pers Assess. 2005;84(3):228-38. DOI:10.1207/s15327752jpa8403_02
https://doi.org/10.1207/s15327752jpa8403... In particular, IRT offers both the potential for new ways of interpreting individual change and improving scale properties in order to better ascertain the measurement scores.

Initially, both analyses (CTT and IRT) showed that a large proportion (43.2% and 40.7%, respectively) of participants did not reach the average level of HIV/AIDS knowledge, and this is of public health concern. It also indicates that myths about HIV transmission are still present in this population, also reported in other studies.¹¹11 . Liu S, Wang K, Yao S, Guo X, Liu Y, Wang B. Knowledge and risk behaviors related to HIV/AIDS and their association with information resource among men who have sex with men in Heilongjiang province, China. BMC Public Health. 2010;10:250. DOI:10.1186/1471-2458-10-250
https://doi.org/10.1186/1471-2458-10-250...

On the other hand, the IRT analysis provided more useful information with regard to the knowledge score as well as the individual analysis of the items, including the characteristic curves, the item information curves, the identification of items with problems, their distribution on a scale, and how much information each item brought to the measurement of knowledge.

We should note that the most problematic items were those related to AIDS treatment (items 1 and 2). Both require knowledge on two distinct issues, risk or prevention and treatment, and therefore, presented higher degree of difficulty, low discrimination power and also the lowest percentage of correct answers. Most likely, the respondents did not completely distinguish or understood their contents, casting doubt on where the lack of knowledge predominated and also indicating an excessive difficulty for a correct response. On the other hand, item 6, which is also related to the risk of HIV positive mothers infecting their babies and AIDS treatment, did not seem to be totally unknown by the respondents.

The absence of difficult items in this study contributed to the inaccuracy of the measurement of knowledge among those with median level and above, as accurately shown by the total information curve. A recent study that examined the psychometric properties of an HIV/AIDS knowledge scale among adolescents reported that in order to improve the precision of the instrument, new items should be added, particularly those more difficult to answer which provide information about higher trait values. Moreover, in order to improve the overall performance of the knowledge scale, this should include a greater number of items, with higher discriminatory power and different degrees of difficulty, which can provide information along the whole scale.¹1 . AarØ LE, Breivik K, Klepp KI, Kaaya S, Onya HE, Wubs A, et al. An HIV/AIDS knowledge scale for adolescents: item response theory analyses based on data from a study in South Africa and Tanzania. Health Educ Res. 2011;26(2):212-24. DOI:10.1093/her/cyq086
https://doi.org/10.1093/her/cyq086...

The analysis of the DIF identified items that tend to benefit one group more than others. Items 3 and 5 were shown to be more favorable to MSM under age 25 and those with higher schooling, showing higher chances of correct answers of these items. The domain of items 3 and 5 with uniform DIF refers to the indirect transmission of HIV (using public restrooms and the sharing of meals). Studies show that the analysis of patterns of items that display DIF is a useful tool to identify and better understand the differences between ethnic and racial groups.⁷7 . Hagman BT, Kuerbis AN, Morgenstern J, Bux DA, Parsons JT, Heidinger BE. An item response theory (IRT) analysis of the short inventory of problems-alcohol and drugs (SIP-AD) among non-treatment seeking men-who-have-sex-with-men: evidence for a shortened 10-item SIP-AD. Addict Behav. 2009;34(11):948-54. DOI:10.1016/j.addbeh.2009.06.004
https://doi.org/10.1016/j.addbeh.2009.06... ^{, 16}16 . Rao D, Pryor JB, Gaddist BW, Mayer R. Stigma, secrecy and discrimination: ethnic/racial differences in the concerns of people living with HIV/Aids. AIDS Behav. 2008;12(2):265-71. DOI:10.1007/s10461-007-9268-x
https://doi.org/10.1007/s10461-007-9268-... The analysis of the DIF items may contribute to the development of educational strategies in the approach of the domain of items in which DIF was detected. However, it becomes more complex when trying to understand crossover DIF, as in the case of items 1, 2, 6 and 7. As these items also showed low discrimination power, further analysis is warranted for a better understanding of the DIF effects. We suggest they should be reviewed with regard to content, language and format, since they contain words (e.g., small, less, reduced) that may have caused ambiguity, bringing confusion, indecision and insecurity for respondents.

Although there are substantial problems in the structure of some items, the results of the unidimensional analysis led us to admit the existence of a dominant trait or factor (i.e., HIV knowledge) responsible for the performance of the set of items and that the instrument used was able to measure the levels of latent knowledge. Ideally, one should pursue a higher percentage of total variance accounted for by the first principle component, indicating that the set of items is more associated with the dominant factor, which is the latent trait measured.^hh Deng N, Wells C, Hambleton R. A confirmatory factor analytic study examining the dimensionality of educational achievement tests. In: Paper 31. NERA Conference Proceedings. Connecticut; 2008. Available from: http://digitalcommons.uconn.edu/nera_2008/31 We emphasize the need to review items 1, 2, 6 and 7 in order to better compose the scale with large loading values in the first factor. In addition, in order to promote unidimensionality, it is recommended to use constructs that are in the same direction, i.e., a set of items strictly negative or positive.ⁱi Andrade DF, Tavares HR, Valle RC. Teoria da resposta ao item: conceitos e aplicações. In: 4º SINAPE. São Paulo: Associação Brasileira de Estatística; 2000.

In conclusion, the IRT model was shown to be adequate to measure the level of HIV/AIDS knowledge among MSM and brought important information that can contribute to improving the properties of the items in order to build a knowledge scale suitable for this population. The high proportion (40.7%) of participants with a knowledge score below the average is of concern, considering that the evaluated items are basic and well publicized information about the modes of HIV transmission, particularly among MSM populations. Furthermore, the results revealed some weaknesses of the measuring instrument, and improvement in the quality of the instrument is essential to better ascertain the levels of knowledge of HIV/AIDS.

The results of IRT analyses should be considered before carrying out other evaluations or interventions in this population. It is essential to review the items with lower discrimination, to incorporate new and more difficult items, and to add other relevant topics. Calibration of items and checking differential item functioning should be assessed in preliminary pilot studies. Comparisons between scores of different samples are possible with IRT methodology because item parameters are invariant to the various groups, and both parameters and latent trait are measured in the same metric scale.^bb Ministério da Saúde. Secretaria de Vigilância em Saúde. Departamento de DST, Aids e Hepatites Virais. Resumo analítico dos dados do Boletim Epidemiológico de 2011. Brasília (DF); 2011. This way, monitoring the level of knowledge of this MSM population, or others, over time could be measured in different samples, allowing to accurately detect the progress made by the population, as well as assisting in the development of prevention programs and of new interventions.

REFERENCES

Publication Dates

History