Skip to main content
Open AccessOriginal Article

Use of Item Response Models in Assessing the Health Literacy Facet Understanding Health Information for Early Childhood Allergy Prevention and Prevention of COVID-19 Infections by Pregnant Women and Mothers of Infants

Published Online:https://doi.org/10.1026/0012-1924/a000298

Abstract. Appropriate parental health literacy (HL) is essential to preventively maintain and promote child health. Understanding health information is assumed to be fundamental in HL models. We developed N = 67 items (multiple-choice format) based on information materials on early childhood allergy prevention (ECAP) and prevention of COVID-19 infections to assess the parental HL facet Understand. N = 343 pregnant women and mothers of infants completed the items in an online assessment. Using exploratory factor analysis for ordinal data (RML estimation) and item response models (1-pl and 2-pl model), we proved the psychometric homogeneity of the item pool. 57 items assess the latent dimension Understand according to the assumptions of the 1-pl model (weighted MNSQ < 1.2; separation reliability = .855). Person parameters of the latent trait Understand correlate specifically with subjective socioeconomic status (r = .27), school graduation (r = .46), allergy status (r = .11), and already infected with COVID-19 (r = .12). The calibrated item pool provides a psychometrically sound, construct-valid assessment of the HL facet Understand Health Information in the areas of ECAP and prevention of COVID-19 infections.


Anwendung von Item-Response-Modellen bei der Erfassung der Gesundheitskompetenzfacette Verstehen von Gesundheitsinformationen zur frühkindlichen Allergieprävention und der Prävention von COVID-19-Infektionen bei Schwangeren und Müttern von Kleinkindern

Zusammenfassung. Hinreichende elterliche Gesundheitskompetenz (GK) ist wesentlich, um die Gesundheit des Kindes erhalten und präventiv fördern zu können. Dem angemessenen Verstehen von Gesundheitsinformationen kommt in GK-Modellen eine grundlegende Funktion zu. Für die beiden Anwendungsgebiete frühkindliche Allergieprävention (FKAP) und Prävention von COVID-19 Infektionen wurden N = 67 Testitems auf Basis von Informationsmaterialien entwickelt. N = 343 Schwangere und Mütter von Kleinkindern bearbeiteten die Items in einer Online-Testung. 57 Testitems erfassen die latente Dimension Verstehen gemäß des 1-pl Item Response Modells (Weighted MNSQ < 1,2; Separations-Reliabilität = .874). Die Personenparameter der latent trait Verstehen von Gesundheitsinformationen korrelieren u. a. mit dem subjektiven sozioökonomischen Status (r = .27), dem Schulabschluss (r = .46), dem Allergiestatus (r = .11) und bereits erfolgter COVID-19-Infektion (r = .12) der Frauen. Die kalibrierte Itemgruppe erlaubt eine psychometrisch fundierte, konstruktvalide Erfassung der GK-Facette Verstehen von Gesundheitsinformation in den Anwendungsgebieten FKAP und Prävention von COVID-19-Infektionen.

Literatur

  • Adams, R. J, Wu, M. L, Cloney, D., & Wilson, M. R. (2020). ACER ConQuest: Generalised item response modelling software [Computer software], Version 5. Australian Council for Educational Research. First citation in articleGoogle Scholar

  • Andrulis, D.P., & Brach, C. (2007). Integrating literacy, culture, and language to improve healthcare quality for diverse populations. American Journal of Health Behavior, 31(Suppl 1), 122 – 133. https://doi.org/10.5555/ajhb.2007.31.supp.S122 First citation in articleCrossrefGoogle Scholar

  • Borges, K., Sibbald, C., Hussain-Shamsy, N., Vasilevska-Ristovska, J., Banh, T., Patel, V. et al. (2017). Parental Health Literacy and Outcomes of Childhood Nephrotic Syndrome. Pediatrics, 139 (3), e20161961. https://doi.org/10.1542/peds.2016-1961 First citation in articleCrossrefGoogle Scholar

  • Bundesinstitut für Bevölkerungsforschung. (2021). Bund-Länder Demografieportal: Schulabschluss der Bevölkerung nach Alter und Geschlecht, 2020 [Federal-State Demography Portal: Graduation of the population by age and gender]. Retrieved from www.demografie-portal.de/DE/Fakten/schulabschluss.html First citation in articleGoogle Scholar

  • Burnham, K. B., & Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach. Springer. First citation in articleGoogle Scholar

  • Cella, D., Chang, C. H., & Heinemann, A. W. (2002). Item response theory (IRT): Applications in quality of life measurement, analysis and interpretation. In M. MesbahB. F. ColeM. T. Lee (Eds.), Statistical methods for quality of life studies (pp. 169 – 185). Springer. https://doi.org/10.1007/978-1-4757-3625-0_14 First citation in articleGoogle Scholar

  • Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., Cook, K., Devellis, R., DeWalt, D., Fries, J. F., Gershon, R., Hahn, E. A., Lai, J., Pilkonis, P., Revivki, D., Rose, M., Weinfurt, K., & Hays, R., PROMIS Cooperative Group (2010). Initial item banks and first wave testing of the patient-reported outcomes measurement information system (PROMIS) network: 2005 – 2008. Journal of Clinical Epidemiology, 63, 1179 – 1194. https://doi.org/10.1016/j.jclinepi.2010.04.011 First citation in articleCrossrefGoogle Scholar

  • Cluver, L., Lachman, J. M., Sherr, L., Wessels, I., Krug, E., Rakotomalala, S., Blight, S., Hillis, S., Bachman, G., Green, O., Butchart, A., Tomlinson, M., Ward, C. L., Doubt, J., & McDonald, K. (2020). Parenting in a time of COVID-19. The Lancet, 395, 10,231), e64 https://doi.org/10.1016/S0140-6736(20)30736-4 First citation in articleGoogle Scholar

  • DeWalt, D. A., & Hink, A. (2009). Health literacy and child health outcomes: A systematic review of the literature. Pediatrics, 124 (3), 265 – 274. https://doi.org/10.1542/peds.2009-1162B First citation in articleCrossrefGoogle Scholar

  • Dillman, D. A., Smyth, J. D., & Christian, L. M. (2015). Internet, phone, mail, and mixed-mode surveys: The tailored design method (4th ed.). Wiley. First citation in articleGoogle Scholar

  • Dresch, C., Schulz, A. A., & Wirtz, M. A. (2021). Modellierung und Messung elterlicher Gesundheitskompetenz im Bereich frühkindlicher Allergieprävention [Modeling and measuring parental health literacy in early childhood allergy prevention]. In K. RathmannK. DadaczynskiO. OkanM. Messer (Eds.), Gesundheitskompetenz (pp. 1 – 11). Springer. https://doi.org/10.1007/978-3-662-62800-3_139-1 First citation in articleGoogle Scholar

  • Eid, M., & Schmidt, K. (2014). Testtheorie und Testkonstruktion [Test theory and test construction]. Hogrefe. First citation in articleGoogle Scholar

  • Frey, A., Taskinen, P., Schütte, K., Prenzel, M., Artelt, C., Baumert, J., Blum, W., Hammann, M., Klieme, E., & Pekrun, R. (2006). PISA 2006 Skalenhandbuch [PISA 2006 scale manual]. Waxmann. First citation in articleGoogle Scholar

  • Harville, D. A. (1977). Maximum likelihood approaches to variance component estimation and to related problems. Journal of the American Statistical Association, 72 (358), 320 – 338. https://doi.org/10.2307/2286796 First citation in articleCrossrefGoogle Scholar

  • Haun, J. N., Valerio, M. A., McCormack, L. A., Sørensen, K., & Paasche-Orlow, M. K. (2014). Health literacy measurement: An inventory and descriptive summary of 51 instruments. Journal of Health Communication, 19 (2), 302 – 333. https://doi.org/10.1080/10810730.2014.936571 First citation in articleCrossrefGoogle Scholar

  • Hoebel, J., Müters, S., Kuntz, B., Lange, C., & Lampert, T. (2015). Messung des subjektiven sozialen Status in der Gesundheitsforschung mit einer deutschen Version der MacArthur Scale [Measuring subjective social status in health research with a German version of the MacArthur Scale]. Bundesgesundheitsblatt – Gesundheitsforschung – Gesundheitsschutz, 58, 749 – 757. https://doi.org/10.1007/s00103-015-2166-x First citation in articleCrossrefGoogle Scholar

  • Klieme, E., Hartig, J., & Rauch, D. (2008). The concept of competence in educational contexts. In J. HartigE. KliemeD. Leutner (Eds.), Assessment of competencies in educational contexts: State of the art and future prospects (pp. 3 – 22). Hogrefe. First citation in articleGoogle Scholar

  • Kolen, M. J., & Brennan, R. L. (2014). Test equating, scaling, and linking: Methods and practices. Statistics for social and behavioral sciences (3rd ed.). Springer. First citation in articleCrossrefGoogle Scholar

  • Kumar, D., Sanders, L., Perrin, E. M., Lokker, N., Patterson, B., Gunn, V., Finkle, J., Franco, V., Choi, L., & Rothman, R. L. (2010). Parental understanding of infant health information: Health literacy, numeracy, and the Parental Health Literacy Activities Test (PHLAT). Academic Pediatrics, 10 (5), 309 – 316. https://doi.org/10.1016/j.acap.2010.06.007 First citation in articleCrossrefGoogle Scholar

  • Mackert, M., Champlin, S., Su, Z., & Guadagno, M. (2015). The many health literacies: Advancing research or fragmentation? Health Communication, 30(12), 11611165. https://doi.org/10.1080/10410236.2015.1037422 First citation in articleGoogle Scholar

  • Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741 – 749. https://doi.org/10.1037/0003-066X.50.9.741 First citation in articleCrossrefGoogle Scholar

  • Nitsch, R., Fredebohm, A., Bruder, R., Kelava, A., Nacarella, D., Leuders, T., & Wirtz, M. A. (2014). Students’ competencies in working with functions in secondary mathematics education: Empirical examination of a competence structure model. International Journal of Science and Mathematics Education, 13 (3), 657 – 682. https://doi.org/10.1007/s10763-013-9496-7 First citation in articleCrossrefGoogle Scholar

  • Nutbeam, D. (2000). Health literacy as a public health goal: A challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int, 5, 3, 259 – 267. https://doi.org/10.1093/heapro/15.3.259 First citation in articleCrossrefGoogle Scholar

  • Parker, R. M., Baker, D. W., Williams, M. V., & Nurss, J. R. (1995). The test of functional health literacy in adults. Journal of General Internal Medicine, 10, 537 – 541. https://doi.org/10.1007/BF02640361 First citation in articleCrossrefGoogle Scholar

  • Pohontsch, N., & Meyer, T. (2015). Das kognitive Interview: Ein Instrument zur Entwicklung und Validierung von Erhebungsinstrumenten [Cognitive interviewing: A tool to develop and validate questionnaires]. Die Rehabilitation, 54 (1), 53 – 59. https://doi.org/10.1055/s-0034-1394443 First citation in articleCrossrefGoogle Scholar

  • Rost, J., & Langeheine, R. (Eds.). (1997). Applications of latent trait and latent class models in the social sciences. Waxmann. First citation in articleGoogle Scholar

  • Rupp, A. A., Templin, J., & Henson, R. A. (2010). Diagnostic measurement: Theory, methods, and applications. Guilford. First citation in articleGoogle Scholar

  • Schmuckle, S. C., & Egloff, B. (2011). Indirekte Verfahren zur Erfassung von Persönlichkeit (“Objektive Persönlichkeitstests”) [indirect procedures for the assessment of personality („objective personality tests“)]. In L. F. Hornkeet al. (Eds.), Enzyklopädie der Psychologie: Bd. 4: Themenbereich B, Serie 2, Psychologische Diagnostik (pp. 73 – 120). Hogrefe. First citation in articleGoogle Scholar

  • Sijtsma, K., & van der Ark, L. A. (2021). Advances in nonparametric item response theory for scale construction in quality-of-life research. Quality of Life Research, 31, 1 – 9. https://doi.org/10.1007/s11136-021-03022-w First citation in articleCrossrefGoogle Scholar

  • Soellner, R., Huber, S., Lenartz, N., & Rudinger, G. (2010). Facetten der Gesundheitskompetenz: Eine Expertenbefragung. Projekt Gesundheitskompetenz [Facets of health literacy: An expert survey. Health literacy project]. In E. KliemeD. LeutnerM. Kenk (Eds.), Kompetenzmodellierung: Eine aktuelle Zwischenbilanz des DFG-Schwerpunktprogramms (pp. 104 – 144). Beltz. First citation in articleGoogle Scholar

  • Soellner, R., & Rudinger, G. (2018). Gesundheitskompeten [Health literacy]. In C.-W. KohlmannC. SalewskiM.A. Wirtz (Eds.), Psychologie in der Gesundheitsförderung [Psychology in health promotion] (pp. 59 – 72). Hogrefe. First citation in articleGoogle Scholar

  • Sørensen, K., van den Broucke, S., Fullam, J., Doyle, G., Pelikan, J. M., Slonska, Z., & Brand, H., & (HLS-EU). Consortium Health Literacy Project European (2012). Health literacy and public health: A systematic review and integration of definitions and models. BMC Public Health, 12 (1), 80 https://doi.org/10.1186/1471-2458-12-80 First citation in articleCrossrefGoogle Scholar

  • Sørensen, K., van den Broucke, S., Pelikan, J. M., Fullam, J., Doyle, G., Slonska, Z., Kondilis, B., Stoffels, V., Osborne, R. H., Brand, H., & Consortium, HLS-EU (2013). Measuring health literacy in populations: Illuminating the design and development process of the European Health Literacy Survey Questionaire (HLS-EU-Q). BMC Public Health, 13 (1), 948 https://doi.org/10.1186/1471-2458-13-948 First citation in articleCrossrefGoogle Scholar

  • Van der Linden, W. J. (Ed.). (2021). Handbook of item response theory. Chapman & Hall. First citation in articleGoogle Scholar

  • Weinert, F. E. (2001). Concept of competence: A conceptual clarification. In D. RychenL. H. Salganik (Eds.), Defining and selecting key competencies (pp. 45 – 65). Hogrefe & Huber Publishers. First citation in articleGoogle Scholar

  • Wilson, M. (2005). Constructing measures. An item response modeling approach. Erlbaum. First citation in articleGoogle Scholar

  • Wirtz, M., & Böcker, M. (2007). Das Rasch-Modell – Eigenschaften und Nutzen für die diagnostische Praxis [The Rasch Model – Properties and benefits for diagnostic practice]. Die Rehabilitation, 46 (4), 238 – 245. https://doi.org/10.1002/pon.3092 First citation in articleCrossrefGoogle Scholar

  • Wirtz, M. A., & Farin, E. (2018). Generische und indikationsspezifische Messeigenschaften des IRES-24-Patientenfragebogen Ein Vergleich der Skalenstruktur bei orthopädischen und neurologischen Rehabilitationspatientinnen und -patienten mittels Differential Item Functioning [Generic and indication-specific measurement properties of the IRES-24 patient questionnaire. A comparison of the scale structure in orthopedic and neurological rehabilitation patients using Differential Item Functioning]. Diagnostica, 64 (2), 74 – 83. https://doi.org/10.1026/0012-1924/a000193 First citation in articleLinkGoogle Scholar

  • Wirtz, M. A., Dresch, C. J., & Schulz, A. A. (2021). Structural modelling and assessment of health literacy in allergy prevention of new parents by means of item-response-theory. PsychArchives. https://doi.org/10.23668/psycharchives.4551 First citation in articleGoogle Scholar

  • Wirtz, M., Farin, E., Bengel, J., Jäckel, W., Hämmerer, D., & Gerdes, K. (2005). IRES-24 Patientenfragebogen – Entwicklung der Kurzform eines Assessmentinstrumentes in der Rehabilitation mittels der Mixed-Rasch-Analyse [IRES-24 patient questionnaire – development of the short form of an assessment instrument in rehabilitation using mixed Rasch analysis]. Diagnostica, 51 (2), 75 – 87. https://doi.org/10.1026/0012-1924.51.2.75 First citation in articleLinkGoogle Scholar