Abstract
Objective:
To explore the combined use of quantitative and qualitative methods with a longitudinal perspective in the field of obesity diet and physical activity.
Method:
A systematic scoping review following PRISMA guidelines. The databases searched were Web of Science, PubMed, and ASSIA.
Results:
1592 records were returned from the searches. In total, nine studies met the inclusion criteria and were included in the review. Authors of included studies mixed quantitative and qualitative methods to obtain a deeper understanding of their study subjects, but few documents use longitudinal data. Authors value the combination of methods and try to integrate the results in their conclusions.
Conclusions:
Total integration is rarely achieved in the analysis. The origin of this divergence can be found in the lack of theoretical guidance in these articles, but also in the difficulty of working in multidisciplinary teams in the field of obesity.
Keywords:
Longitudinal studies; Obesity; Physical activity; Methods Evaluations studies
Resumen
Objetivo:
Explorar el uso combinado de métodos cuantitativos y cualitativos con una perspectiva longitudinal en el campo de la obesidad y la actividad física.
Método:
Se ha realizado una revisión sistemática de las bases de datos Web of Science, PubMed y ASSIA siguiendo las pautas de PRISMA.
Resultados:
Solo nueve estudios fueron seleccionados de los 1592 que cumplieron los criterios de inclusión. Los autores combinan métodos cuantitativos y cualitativos, y afirman hacerlo para obtener una comprensión más profunda de sus sujetos de estudio, pero pocos utilizan datos longitudinales. Se valora la combinación de métodos y se intenta integrar los resultados en las conclusiones.
Conclusiones:
La integración total de métodos cuantitativos, cualitativos y longitudinales es excepcional y rara vez se logra en el análisis de los resultados. El origen de esta divergencia se puede encontrar en la falta de orientación teórica de estos artículos, pero también en la dificultad de trabajar en equipos multidisciplinarios en el campo de la obesidad.
Palabras clave:
Estudios longitudinales; Obesidad; Actividad física; Análisis cuantitativo; Análisis cualitativo
Introduction
The alarming increase in the prevalence of obesity worldwide has led to substantial academic and policy interest and action.11. Long B, Robertson A. Obesity and inequities. Guidance for addressing inequities in overweight and obesity. Geneva: WHO; 2014.
2. Devaux M, Sassi F. Social inequalities in obesity and overweight in 11 OECD countries. Eur J Public Health. 2013;23:464-9.
3. FAO. Second International Conference on Nutrition. ICN2. 2014.-44. World Health Organization. Data and statistics. The challenge of obesity. Geneva: WHO; 2016. Obesity is a complex phenomenon with many determinants in both the social and biological realms that are likely to act independently, in series, and synergistically in both predictable and unpredictable ways.11. Long B, Robertson A. Obesity and inequities. Guidance for addressing inequities in overweight and obesity. Geneva: WHO; 2014.,55. Wilkinson R, Marmot M. Social determinants of health. The solid facts. 2nd ed. International Center for Health and Society. Geneva: WHO; 2003.
6. Darmon N, Drewnowski A. Does social class predict diet quality? Am J. Clin Nutr. 2008;87:1107-17.
7. Rutter H. Where next for obesity? Lancet. 2011;378:746-7.-88. Vandenbroek P, Goossens J, Marshall C. Tackling obesities: future choices - Building the Obesity. System Map. UK Government's Foresight Programme. 2017. The importance of both biological and social factors in the etiology of obesity has led to many calls for inter, multi and even transdisciplinary working between those with training in the social and natural sciences, and beyond, in order to achieve a comprehensive understanding of both the ‘problem', and potential solutions.88. Vandenbroek P, Goossens J, Marshall C. Tackling obesities: future choices - Building the Obesity. System Map. UK Government's Foresight Programme. 2017.
9. Burtland B, Jebb S, Kopelman P, et al. Foresight Tackling Obesities: Future Choices Project. Implications for research. UK Government's Foresight Programme. 2007.
10. EASO. Social sciences and humanities contribution to tackle the obesity epidemic challenges and potentials in obesity research towards Horizon 2020. European Association for the Study of Obesity; 2012.-1111. Plano Clark VL. The adoption and practice of mixed methods: US trends in federally funded health-related research. Qualitative Inquiry. 2010;16:428-40. In addition to different disciplines working together, the combined use of qualitative and quantitative methods and the integration of these different methodological approaches has been widely suggested.1212. Johnson RB, Onwuegbuzie AJ, Turner LA. Toward a definition of mixed methods research. Journal of Mixed Methods Research. 2007;2:112-33.
13. Creswell JW, Klassen AC, Plano Clark VL, et al. Best practices for mixed methods research in the health sciences. Bethesda (Maryland): National Institutes of Health;. 2013:541-5.-1414. Gómez MCS. La dicotomía cualitativo-cuantitativo: posibilidades de integración y diseños mixtos. Campo Abierto. Revista de Educación. 2015:11-30. This is known as ‘mixed methods' research. Mixed methods research has been widespread in the field of nursing and medicine since the 1990s.1313. Creswell JW, Klassen AC, Plano Clark VL, et al. Best practices for mixed methods research in the health sciences. Bethesda (Maryland): National Institutes of Health;. 2013:541-5.
14. Gómez MCS. La dicotomía cualitativo-cuantitativo: posibilidades de integración y diseños mixtos. Campo Abierto. Revista de Educación. 2015:11-30.
15. Rosemfield PL. The potential of transdisciplinary research for sustaining and extending linkages between the health and social sciences. Soc Sci Med. 1992;35:1343-57.
16. Cerdà JM, Rodríguez MP, García MH, et al. Técnicas cualitativas para la investigación en salud pública y gestión de servicios de salud: algo más que otro tipo de técnicas. Gac Sanit. 1999;13:312-9.-1717. Östlund U, Kidd L, Wengström Y, et al. Combining qualitative and quantitative research within mixed method research designs: a methodological review. Int J Nurs Stud. 2011;48:369-83. A key benefit of mixed methods research is the potential to integrate findings from different methodological approaches.1818. Creswell JW. Mapping the developing landscape of mixed methods research. SAGE Handbook of mixed methods in social and behavioral research. 2010;2:45-68. The use of mixed methods has been repeatedly proposed as an effective approach to frame and solve complex problems like obesity.77. Rutter H. Where next for obesity? Lancet. 2011;378:746-7.,1919. Holm L, Sandoe P, Nielsen MEJ, et al. Social sciences and humanities contribution to tackle the obesity epidemic challenge and potentials in obesity research towards Horizon 2020. EASO European Association for the Study of Obesity. 2012. Both approaches are necessary to the study of a multicausal phenomenon such as obesity.
We are aware of a number of previous systematic reviews that have focused on mixed methods designs in the health field1717. Östlund U, Kidd L, Wengström Y, et al. Combining qualitative and quantitative research within mixed method research designs: a methodological review. Int J Nurs Stud. 2011;48:369-83. and which have combined primary quantitative and qualitative studies on obesity-specific topics.2020. Campbell F, Johnson M, Messina J, et al. Behavioural interventions for weight management in pregnancy: a systematic review of quantitative and qualitative data. BMC Public Health. 2011;11:491.
21. Robertson C, Archibald D, Avenell A, et al. Systematic reviews of and integrated report on the quantitative, qualitative and economic evidence base for the management of obesity in men. Health Tech Assess (Winchester, England). 2014;18(35.).-2222. Everson-Hock ES, Johnson M, Jones R, et al. Community-based dietary and physical activity interventions in low socioeconomic groups in the UK: a mixed methods systematic review. Prev Med. 2013;56:265-72. However, we are not aware of any previous systematic reviews of longitudinal, mixed methods studies specifically related to obesity. Given the public health importance of obesity, and the potential value of both longitudinal and mixed methods approaches to developing a full understanding of obesity, we conducted a systematic scoping review of longitudinal, mixed methods studies in the field of obesity and its primary behavioural determinants -diet and physical activity. Our primary aim was to understand how longitudinal mixed methods have been used in this field, rather than the findings of these studies. Scoping reviews allow literature to be mapped in this way without a focus on findings.
In most previous reviews of mixed methods, authors have considered cross-sectional quantitative and qualitative methods but we don't have information about the mixed-use of qualitative and quantitative longitudinal data. From a quantitative point of view, a longitudinal perspective allows for better estimation of causal inference and the exclusion of the possibility of causality associated with cross-sectional data. From a qualitative point of view, a longitudinal perspective allows a greater understanding about the impact of previous experiences on present actions.
Methods
Inclusion criteria
We searched for primary research papers that simultaneously reported longitudinal data collected using both quantitative and qualitative methods in the fields of diet, physical activity and obesity. Following Morse and Niehaus we defined longitudinal data as that which “is gathered from the same subjects repeatedly over a period of time”.2323. Morse JM, Niehaus L. Principles and procedures of mixed methods design. In: Denzin NK, Lincoln YS, editors. The Sage Handbook of qualitative research. Sage: Thousand Oaks; 2011. We defined qualitative methods as those which used written or spoken discourse as the data.2424. Regoniel P. Quantitative methods: meaning and characteristics. University of Southern California;. 2015. We defined quantitative methods as those which use numbers as the basis for making generalizations about a phenomenon.2525. Olson CM, Bove CF, Miller EO. Growing up poor: long-term implications for eating patterns and body weight. Appetite. 2007;49:198-207.
In order to capture work on “obesity” in its widest sense, we included studies that focused on diet and physical activity as both social and biological concepts directly linked to obesity. We excluded studies focusing on hospitalized populations, populations with chronic illnesses, and diseases or treatments which affect patients' diets (e.g. chemotherapy or anorexia). However, we included papers related to community-dwelling (not hospitalized) individuals with type 2 diabetes. We also excluded studies of populations with unusual relationships to food and physical activity, including those in residential care, and professional sportspeople. However, we included studies which included healthy pregnant women or focused on breastfeeding. We did not impose any restrictions based on year or language of publication.
Search strategy
We searched for papers meeting the inclusion criteria in three databases covering both social and natural health sciences: Web of Science, with access to multidisciplinary databases (https://clarivate.com/products/web-of-science/databases/); PubMed, with citations for biomedical literature from MEDLINE (US National Library of Medicine), life sciences journals and on line books; and Applied Social Sciences Index and Abstracts (ASSIA).
The search was conducted in August-September 2017. The search terms were: qualitative AND (longitudinal OR cohort OR prospective OR retrospective OR epidemiology) AND (food OR eat OR diet OR Obese OR obesity OR BMI OR overweight OR adiposity OR “Physical activity” OR sport OR exercise OR sedentary).
In Web of Science we used the Core Collection, filtered for peer review and articles and included abstracts, titles and keywords. In PubMed, we filtered by “Human” studies (not animal), free full text and peer review and only open access documents. And in ASSIA we filtered by peer review.
Screening
Firstly, we remove duplicates and then screening titles and abstracts. Full texts for remaining records were then retrieved and screened following inclusion criteria.
Data extraction
The included studies were organized in four categories using a data extraction template. Firstly, we extracted general information about the study topic, objectives, and study participants. Secondly, methodological aspects were captured including how authors' described mixed methods, details of sampling, sample recruitment, and data collection. Finally, analytical and integration methods and study limitations identified by authors were recorded. Data were tabulated for analysis and were narratively synthesized (reporting results according to PRISMA).
Results
After removal of duplicates, 1592 records were returned from the searches. In total, nine studies met the inclusion criteria and were included in the review. The flow of studies through the review and the reasons for exclusions are detailed in Figure 1.
Thematic areas
The main focus of included papers, their objectives and study populations are described in Table 1. Seven out of nine papers were focused on diet, whilst two referred to physical activity. Within the nine papers focused on diet, one11. Long B, Robertson A. Obesity and inequities. Guidance for addressing inequities in overweight and obesity. Geneva: WHO; 2014. focused in particular on food insecurity.
Given our restriction to longitudinal data, it is not surprising that all included papers studied change over time. However, both observational and interventional approaches were included with two papers exploring the effect of interventions on eating habits2727. Huberty JL, Ehlers D, Coleman J, et al. Women bound to be active: differences in long-term physical activity between completers and noncompleters of a book club intervention. J Phys Activ Health. 2013;10:368-78. and physical activity.2828. Duong DV, Lee AH, Binns CW. Determinants of breast-feeding within the first 6 months' post-partum in rural Vietnam. J Paediatr Child Health. 2005;41:338-43. The remaining studies focused on change over time in the absence of a researcher-led intervention, but sometimes in relation to a change in life circumstances, such as the arrival of a new child.2626. Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.,2929. Duram LA, Williams LL. Growing a student organic garden within the context of university sustainability initiatives. International Journal of Sustainability in Higher Education. 2015;16:3-15.
30. Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62.
31. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69.
32. Whitford HM, Donnan PT, Symon AG, et al. Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project. JAMIA. 2012;19:744-9.-3333. Carruth BR, Skinner JD. Revisiting the picky eater phenomenon: neophobic behaviors of young children. J Am Coll Nutr. 2000;19:771-80. Two studies tested technologies that aimed to improve eating habits. Morrison et al.3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69., studied a mobile application implementation of a weight control program; and Whitford et al., used text messages to influence newborn feeding patterns. Three included studies focused on university students.3030. Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62.
31. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69.-3232. Whitford HM, Donnan PT, Symon AG, et al. Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project. JAMIA. 2012;19:744-9. The remaining six articles studied mothers with children,2929. Duram LA, Williams LL. Growing a student organic garden within the context of university sustainability initiatives. International Journal of Sustainability in Higher Education. 2015;16:3-15.,3333. Carruth BR, Skinner JD. Revisiting the picky eater phenomenon: neophobic behaviors of young children. J Am Coll Nutr. 2000;19:771-80.,3434. Stange KC, Crabtree BF, Miller WL. Publishing multimethod research. Ann Fam Med. 2006;4:292-4. women in general2828. Duong DV, Lee AH, Binns CW. Determinants of breast-feeding within the first 6 months' post-partum in rural Vietnam. J Paediatr Child Health. 2005;41:338-43. and families.2626. Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.,2727. Huberty JL, Ehlers D, Coleman J, et al. Women bound to be active: differences in long-term physical activity between completers and noncompleters of a book club intervention. J Phys Activ Health. 2013;10:368-78.
The use of methods
Six out of nine papers explicitly referred to the value of mixed methods methodologies and identified this as a particular strength of their work (Table 2). The majority of authors referred specifically to the advantages of qualitative approaches and proposed that their qualitative results provided more information and deeper knowledge than their quantitative ones.2626. Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.,2828. Duong DV, Lee AH, Binns CW. Determinants of breast-feeding within the first 6 months' post-partum in rural Vietnam. J Paediatr Child Health. 2005;41:338-43.,3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69.
32. Whitford HM, Donnan PT, Symon AG, et al. Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project. JAMIA. 2012;19:744-9.-3333. Carruth BR, Skinner JD. Revisiting the picky eater phenomenon: neophobic behaviors of young children. J Am Coll Nutr. 2000;19:771-80. In addition, three articles mentioned the advantages of the longitudinal perspective to developing evolving understanding over time.3030. Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62.,3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69.
32. Whitford HM, Donnan PT, Symon AG, et al. Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project. JAMIA. 2012;19:744-9.
33. Carruth BR, Skinner JD. Revisiting the picky eater phenomenon: neophobic behaviors of young children. J Am Coll Nutr. 2000;19:771-80.
34. Stange KC, Crabtree BF, Miller WL. Publishing multimethod research. Ann Fam Med. 2006;4:292-4.-3535. Smith KE, Bambra C, Joyce KE, et al. Partners in health? A systematic review of the impact of organizational partnerships on public health outcomes in England between 1997 and 2008. J Public Health. 2009;31:210-21.
Many authors also identified limitations of qualitative techniques. In particular, the limits imposed on generalizability of small sample sizes.2626. Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.
27. Huberty JL, Ehlers D, Coleman J, et al. Women bound to be active: differences in long-term physical activity between completers and noncompleters of a book club intervention. J Phys Activ Health. 2013;10:368-78.-2828. Duong DV, Lee AH, Binns CW. Determinants of breast-feeding within the first 6 months' post-partum in rural Vietnam. J Paediatr Child Health. 2005;41:338-43.,3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69.,3434. Stange KC, Crabtree BF, Miller WL. Publishing multimethod research. Ann Fam Med. 2006;4:292-4. The samples used in most included studies were small and unrepresentative in probabilistic terms, but clear sampling strategies were provided. Purposive sampling was used in four studies.2626. Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.,3030. Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62.,3232. Whitford HM, Donnan PT, Symon AG, et al. Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project. JAMIA. 2012;19:744-9.,3434. Stange KC, Crabtree BF, Miller WL. Publishing multimethod research. Ann Fam Med. 2006;4:292-4.
Two of the studies used convenience samples of participants in intervention programs who agreed to take part in an additional qualitative component.2828. Duong DV, Lee AH, Binns CW. Determinants of breast-feeding within the first 6 months' post-partum in rural Vietnam. J Paediatr Child Health. 2005;41:338-43.,3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69. However, in the case of Morrison et al.3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69., recruitment ceased when saturation was achieved. As well as small sample sizes limiting generalisability, Morrison et al.3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69., also identify the limitation imposed by using student volunteers on generalisability.
In other cases, participants were randomly selected from those taking part in a controlled trial. This is the case of the 57 parents of the study by Gardner et al.2727. Huberty JL, Ehlers D, Coleman J, et al. Women bound to be active: differences in long-term physical activity between completers and noncompleters of a book club intervention. J Phys Activ Health. 2013;10:368-78.. Whilst this may also be the case in Whitford et al.3333. Carruth BR, Skinner JD. Revisiting the picky eater phenomenon: neophobic behaviors of young children. J Am Coll Nutr. 2000;19:771-80. details of selection beyond being part of the main study are sparse. Only one of the studies had a sample size sufficient to be statistically representative of the population.2929. Duram LA, Williams LL. Growing a student organic garden within the context of university sustainability initiatives. International Journal of Sustainability in Higher Education. 2015;16:3-15.
Following the mixed methods typology of Johnson et al.1212. Johnson RB, Onwuegbuzie AJ, Turner LA. Toward a definition of mixed methods research. Journal of Mixed Methods Research. 2007;2:112-33. five of the nine included articles used a dominant quantitative model, one a dominant qualitative model, and three gave both methods the same weight. Qualitative data was obtained from in-depth interviews or from open survey questions. In five cases both open and closed survey questions were used.2626. Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.,2929. Duram LA, Williams LL. Growing a student organic garden within the context of university sustainability initiatives. International Journal of Sustainability in Higher Education. 2015;16:3-15.,3232. Whitford HM, Donnan PT, Symon AG, et al. Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project. JAMIA. 2012;19:744-9.
33. Carruth BR, Skinner JD. Revisiting the picky eater phenomenon: neophobic behaviors of young children. J Am Coll Nutr. 2000;19:771-80.-3434. Stange KC, Crabtree BF, Miller WL. Publishing multimethod research. Ann Fam Med. 2006;4:292-4. In three cases, in-depth interviews accompanying a survey.2727. Huberty JL, Ehlers D, Coleman J, et al. Women bound to be active: differences in long-term physical activity between completers and noncompleters of a book club intervention. J Phys Activ Health. 2013;10:368-78.,2828. Duong DV, Lee AH, Binns CW. Determinants of breast-feeding within the first 6 months' post-partum in rural Vietnam. J Paediatr Child Health. 2005;41:338-43.,3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69.,3333. Carruth BR, Skinner JD. Revisiting the picky eater phenomenon: neophobic behaviors of young children. J Am Coll Nutr. 2000;19:771-80.
One article used focus groups in addition to open survey questions to generate qualitative data, but the same participants did not take part in both methods.2929. Duram LA, Williams LL. Growing a student organic garden within the context of university sustainability initiatives. International Journal of Sustainability in Higher Education. 2015;16:3-15. One paper presented a case study.3030. Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62. Only one article used different samples for their quantitative and qualitative components complementing their quantitative data with qualitative interview data.3030. Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62. The remainder used the same participants in both the quantitative and qualitative components, with both open and closed survey questions asked of the same subjects. Whilst this offers more information about the same subjects, the authors themselves point out that the depth of the results is reduced.
All included articles provided separated descriptions of their approach to both qualitative and quantitative analysis. All of them included verbatim quotations to illustrate qualitative results.
Quantitative descriptive analyses were used in all cases, with standard statistical procedures used in a variety of ways.
Most authors referred to coding and thematic analysis in qualitative approaches. Some explained how consensus was achieved when arriving at the final coding scheme,2626. Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.,2828. Duong DV, Lee AH, Binns CW. Determinants of breast-feeding within the first 6 months' post-partum in rural Vietnam. J Paediatr Child Health. 2005;41:338-43..
Quality assessment
According to the objective of the review and the potential of mixed methods research to integrate findings from different methodological approaches1818. Creswell JW. Mapping the developing landscape of mixed methods research. SAGE Handbook of mixed methods in social and behavioral research. 2010;2:45-68. we assessed the quality of papers. We did this by exploring the degree of results integration explained and the authors assessment of mixed and longitudinal methods used. The articles show a very variable degree of joint analysis and integration of results. Most included articles presented qualitative and quantitative results separately in different sections and in different tables; only Gardner et al.2727. Huberty JL, Ehlers D, Coleman J, et al. Women bound to be active: differences in long-term physical activity between completers and noncompleters of a book club intervention. J Phys Activ Health. 2013;10:368-78. presented tables combining qualitative and quantitative data. A clear example of integration is joint report of the quantitative and qualitative results in the discussion section of article. This occurred in all included articles, although with differing intensities given the differing dominance of quantitative and qualitative approaches.
Authors (Table 3) justified the use of mixed methods as the most appropriate way to achieve their objectives. In seven of the nine articles, the authors proposed that the use of mixed methods improved their work by providing deeper knowledge of study subjects and more comprehensive explanations of quantitative results. They argue, as previously,2121. Robertson C, Archibald D, Avenell A, et al. Systematic reviews of and integrated report on the quantitative, qualitative and economic evidence base for the management of obesity in men. Health Tech Assess (Winchester, England). 2014;18(35.). that mixed methods create stronger results than achievable via a single method. Two articles included specific reference to the advantage of a longitudinal perspective.3030. Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62.,3434. Stange KC, Crabtree BF, Miller WL. Publishing multimethod research. Ann Fam Med. 2006;4:292-4. They argue that this allows knowledge of how study subjects evolve over time and thereby helps identify potential intervention points that could not be known otherwise.
Whilst all authors present and analyse qualitative and quantitative results together in their discussion sections, none of them refers specifically to the type of methodological integration conducted.1818. Creswell JW. Mapping the developing landscape of mixed methods research. SAGE Handbook of mixed methods in social and behavioral research. 2010;2:45-68. However, as confirmed in other reviews1717. Östlund U, Kidd L, Wengström Y, et al. Combining qualitative and quantitative research within mixed method research designs: a methodological review. Int J Nurs Stud. 2011;48:369-83. conclusions were integrated. No authors mentioned the theoretical orientation adopted in their work, although some mentioned the use of an inductive approach to analysis2727. Huberty JL, Ehlers D, Coleman J, et al. Women bound to be active: differences in long-term physical activity between completers and noncompleters of a book club intervention. J Phys Activ Health. 2013;10:368-78.,3131. Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69. or that a specific procedure has been carried out to generate hypotheses (e.g. an iterative process).2626. Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.
Based on the objective of this systematic review, we consider that the quality of the selected articles can be determined by the degree of integration of the research methods used (quantitative, qualitative and longitudinal). Thus, we can affirm that all have achieved a joint discussion of the results, and some integrated conclusions regarding the combined use of qualitative and qualitative methods were presented. However, only two papers3030. Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62.,3434. Stange KC, Crabtree BF, Miller WL. Publishing multimethod research. Ann Fam Med. 2006;4:292-4. extend this discussion to the use of a longitudinal perspective.
Discussion
This work had the objective to explore the combined use of quantitative and qualitative methods with a longitudinal perspective as applied to the study of obesity, diet and physical activity. After review only nine studies were identified that met our criteria. This shows a limited interest (or difficulty) in combining these methodologies. The first observation we experienced was terminological confusion. When screening papers, we found a number of studies that claimed to use qualitative methods, but did not specifically use discursive data. For example, some authors considered attitude items using Likert-type scales as a qualitative methodology. Similarly, we found a number of examples where “longitudinal” was used to refer to repeated cross-sectional designs, rather than data collected from the same participants at different points in time.
The included articles confirm an interest in using mixed methods in order to provide more comprehensive understanding of obesity, diet and physical activity. These methods were used in a longitudinal context particularly to explore intervention effectiveness or behaviour change across life transitions. However, all included articles were published since 2000 suggesting that longitudinal mixed-method approaches are relatively new. Many authors identified that including qualitative components substantially improved the understanding gained from their work. Clearly there is substantial interest in addressing some of the limitations of quantitative methods with the additional use of qualitative methods. But the small number of included studies suggest that we have to search for more explanation for why scientists don't use mixed longitudinal methods.
A key methodological challenge of mixed methods identified by study authors is the limitation on generalisability imposed by small sample sizes. However, this may reflect a mistaken attempt to quantify qualitative results.3636. O'Cathain A, Murphy E, Nicholl J. Multidisciplinary, interdisciplinary, or dysfunctional? Team working in mixed-methods research. Qual Health Res. 2008;18:1574-85. Although some authors solved this problem with targeted recruitment of study subjects, it remains a challenge to collect statistically representative and therefore generalizable data in a mixed methods context. Others used surveys with open and closed questions, in order to include larger sample sizes, but the authors themselves identify that whilst this leads to deeper understanding than quantitative methods alone, it does not achieve the depth of information achieved with more traditional forms of qualitative data.
In most included papers, no reference was made to the type of qualitative analysis performed. Whilst procedures are mentioned (thematic grouping and coding) the inductive or deductive process leading to final interpretation of results is not explained. Qualitative analytical approaches were generally poorly described. In contrast, detailed explanations and justifications for quantitative analysis procedures were consistently provided. These results could show the distance between quantitative and qualitative paradigms and the dominance of the first over the second.
Our data has a limitation: the searches were conducted in 2017 and we have not updated them. However, we would like to point out that we have consulted the three most widely used databases for the study of obesity by both the health sciences and the social sciences. Also we did not impose any restrictions based on year or language.
In conclusion, our finding shows limited use of mixed longitudinal methodologies in the field of obesity, but where these are used, authors use them to gain deeper understanding of the 'problem' of obesity. There appears to be openness within the health sciences towards the use of mixed methods. In the field of public health, in particular, the use of combined qualitative and quantitative methods is valued.
Given the great transformation of eating habits and physical activity in recent decades and the increasing consideration of obesity as an epidemic, its inclusion as a public health topic is an opportunity for adopting longitudinal qualitative perspectives alongside traditional quantitative epidemiological studies.
At the beginning of the XXI century, a much greater connection between epidemiology and the social sciences was anticipated. Obesity is clearly socially patterned and inherently a social topic incorporating issues of key relevance to the social sciences: poverty, consumption, sports and eating habits, and sustainability. The mixed longitudinal approach is one way to achieve this type of collaboration and a new road to multidisciplinarity. One way to address the current paucity of collaboration would be to ask both health and social scientists why they do not currently collaborate and what could be done to support them to do so further.
A limitation of this review is that it could not be updated. However, we would like to point out that we have consulted the three most widely used databases for the study of obesity by both the health sciences and the social sciences. Also, we did not impose any restrictions based on the year and language.
References
- 1Long B, Robertson A. Obesity and inequities. Guidance for addressing inequities in overweight and obesity. Geneva: WHO; 2014.
- 2Devaux M, Sassi F. Social inequalities in obesity and overweight in 11 OECD countries. Eur J Public Health. 2013;23:464-9.
- 3FAO. Second International Conference on Nutrition. ICN2. 2014.
- 4World Health Organization. Data and statistics. The challenge of obesity. Geneva: WHO; 2016.
- 5Wilkinson R, Marmot M. Social determinants of health. The solid facts. 2nd ed. International Center for Health and Society. Geneva: WHO; 2003.
- 6Darmon N, Drewnowski A. Does social class predict diet quality? Am J. Clin Nutr. 2008;87:1107-17.
- 7Rutter H. Where next for obesity? Lancet. 2011;378:746-7.
- 8Vandenbroek P, Goossens J, Marshall C. Tackling obesities: future choices - Building the Obesity. System Map. UK Government's Foresight Programme. 2017.
- 9Burtland B, Jebb S, Kopelman P, et al. Foresight Tackling Obesities: Future Choices Project. Implications for research. UK Government's Foresight Programme. 2007.
- 10EASO. Social sciences and humanities contribution to tackle the obesity epidemic challenges and potentials in obesity research towards Horizon 2020. European Association for the Study of Obesity; 2012.
- 11Plano Clark VL. The adoption and practice of mixed methods: US trends in federally funded health-related research. Qualitative Inquiry. 2010;16:428-40.
- 12Johnson RB, Onwuegbuzie AJ, Turner LA. Toward a definition of mixed methods research. Journal of Mixed Methods Research. 2007;2:112-33.
- 13Creswell JW, Klassen AC, Plano Clark VL, et al. Best practices for mixed methods research in the health sciences. Bethesda (Maryland): National Institutes of Health;. 2013:541-5.
- 14Gómez MCS. La dicotomía cualitativo-cuantitativo: posibilidades de integración y diseños mixtos. Campo Abierto. Revista de Educación. 2015:11-30.
- 15Rosemfield PL. The potential of transdisciplinary research for sustaining and extending linkages between the health and social sciences. Soc Sci Med. 1992;35:1343-57.
- 16Cerdà JM, Rodríguez MP, García MH, et al. Técnicas cualitativas para la investigación en salud pública y gestión de servicios de salud: algo más que otro tipo de técnicas. Gac Sanit. 1999;13:312-9.
- 17Östlund U, Kidd L, Wengström Y, et al. Combining qualitative and quantitative research within mixed method research designs: a methodological review. Int J Nurs Stud. 2011;48:369-83.
- 18Creswell JW. Mapping the developing landscape of mixed methods research. SAGE Handbook of mixed methods in social and behavioral research. 2010;2:45-68.
- 19Holm L, Sandoe P, Nielsen MEJ, et al. Social sciences and humanities contribution to tackle the obesity epidemic challenge and potentials in obesity research towards Horizon 2020. EASO European Association for the Study of Obesity. 2012.
- 20Campbell F, Johnson M, Messina J, et al. Behavioural interventions for weight management in pregnancy: a systematic review of quantitative and qualitative data. BMC Public Health. 2011;11:491.
- 21Robertson C, Archibald D, Avenell A, et al. Systematic reviews of and integrated report on the quantitative, qualitative and economic evidence base for the management of obesity in men. Health Tech Assess (Winchester, England). 2014;18(35.).
- 22Everson-Hock ES, Johnson M, Jones R, et al. Community-based dietary and physical activity interventions in low socioeconomic groups in the UK: a mixed methods systematic review. Prev Med. 2013;56:265-72.
- 23Morse JM, Niehaus L. Principles and procedures of mixed methods design. In: Denzin NK, Lincoln YS, editors. The Sage Handbook of qualitative research. Sage: Thousand Oaks; 2011.
- 24Regoniel P. Quantitative methods: meaning and characteristics. University of Southern California;. 2015.
- 25Olson CM, Bove CF, Miller EO. Growing up poor: long-term implications for eating patterns and body weight. Appetite. 2007;49:198-207.
- 26Gardner B, Sheals K, Wardle J, et al. Putting habit into practice, and practice into habit: a process evaluation and exploration of the acceptability of a habit-based dietary behaviour change intervention. Int J Behav Nutr Phys Act. 2014;11:135.
- 27Huberty JL, Ehlers D, Coleman J, et al. Women bound to be active: differences in long-term physical activity between completers and noncompleters of a book club intervention. J Phys Activ Health. 2013;10:368-78.
- 28Duong DV, Lee AH, Binns CW. Determinants of breast-feeding within the first 6 months' post-partum in rural Vietnam. J Paediatr Child Health. 2005;41:338-43.
- 29Duram LA, Williams LL. Growing a student organic garden within the context of university sustainability initiatives. International Journal of Sustainability in Higher Education. 2015;16:3-15.
- 30Morrison LG, Hargood C, Lin SX, et al. Understanding usage of a hybrid website and smartphone App for weight management: a mixed-methods study. J Med Internet Res. 2014;16:43-62.
- 31Moy B, Renshaw I, Davids K. Variations in acculturation and Australian physical education teacher education students' receptiveness to an alternative pedagogical approach to games teaching. Phys Educ Sport Pedagogy. 2014;19:349-69.
- 32Whitford HM, Donnan PT, Symon AG, et al. Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project. JAMIA. 2012;19:744-9.
- 33Carruth BR, Skinner JD. Revisiting the picky eater phenomenon: neophobic behaviors of young children. J Am Coll Nutr. 2000;19:771-80.
- 34Stange KC, Crabtree BF, Miller WL. Publishing multimethod research. Ann Fam Med. 2006;4:292-4.
- 35Smith KE, Bambra C, Joyce KE, et al. Partners in health? A systematic review of the impact of organizational partnerships on public health outcomes in England between 1997 and 2008. J Public Health. 2009;31:210-21.
- 36O'Cathain A, Murphy E, Nicholl J. Multidisciplinary, interdisciplinary, or dysfunctional? Team working in mixed-methods research. Qual Health Res. 2008;18:1574-85.
Funding
This work was supported by the Ministerio de Educación, Cultura y Deportes, Gobierno de España, Programa Salvador de Madariaga (Grant Ref. PRX17/00121). Jean Adams is funded by the Centre for Diet and Activity Research (CEDAR), a UKCRC Public Health Research Centre of Excellence which is funded by the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the National Institute for Health Research, and the Wellcome Trust (ref: MR/K023187/1). The funders had no role in the study design, in the collection, analysis and interpretation of data or in the writing of the report and the decision to submit for publication.
Publication Dates
- Publication in this collection
15 Apr 2022 - Date of issue
Nov-Dec 2021