Measuring cancer caregiver health literacy: Validation of the Health Literacy of Caregivers Scale–Cancer (HLCS-C) in an Australian population
Corresponding Author
Eva Yuen PhD
School of Psychology, Deakin University, Burwood, VIC, Australia
College of Public Health, Temple University, Philadelphia, PA, USA
Correspondence
Eva Yuen, College of Public Health, Temple University, Philadelphia, PA, USA.
Email: [email protected]
Search for more papers by this authorTess Knight PhD
School of Psychology, Deakin University, Burwood, VIC, Australia
Search for more papers by this authorSarity Dodson DPsych
Public Health Innovation, Deakin University, Fred Hollows Foundation, Carlton, VIC, Australia
Search for more papers by this authorJacqueline Chirgwin MBBS, FRACP
Department of Medical Oncology, Eastern Health, Melbourne, VIC, Australia
Search for more papers by this authorLucy Busija PhD
Deakin Biostatistics Unit, Deakin University, Burwood, VIC, Australia
Institute of Health and Ageing, Australian Catholic University, Melbourne, VIC, Australia
Search for more papers by this authorLina A. Ricciardelli PhD
School of Psychology, Deakin University, Burwood, VIC, Australia
Search for more papers by this authorSusan Burney PhD
School of Psychological Sciences, Monash University, Clayton, VIC, Australia
Cabrini Monash Psycho-Oncology, Cabrini Health, Malvern, VIC, Australia
Search for more papers by this authorPhillip Parente MBBS
Department of Medical Oncology, Eastern Health, Melbourne, VIC, Australia
Search for more papers by this authorPatricia M. Livingston PhD
Faculty of Health, Deakin University, Burwood, VIC, Australia
Search for more papers by this authorCorresponding Author
Eva Yuen PhD
School of Psychology, Deakin University, Burwood, VIC, Australia
College of Public Health, Temple University, Philadelphia, PA, USA
Correspondence
Eva Yuen, College of Public Health, Temple University, Philadelphia, PA, USA.
Email: [email protected]
Search for more papers by this authorTess Knight PhD
School of Psychology, Deakin University, Burwood, VIC, Australia
Search for more papers by this authorSarity Dodson DPsych
Public Health Innovation, Deakin University, Fred Hollows Foundation, Carlton, VIC, Australia
Search for more papers by this authorJacqueline Chirgwin MBBS, FRACP
Department of Medical Oncology, Eastern Health, Melbourne, VIC, Australia
Search for more papers by this authorLucy Busija PhD
Deakin Biostatistics Unit, Deakin University, Burwood, VIC, Australia
Institute of Health and Ageing, Australian Catholic University, Melbourne, VIC, Australia
Search for more papers by this authorLina A. Ricciardelli PhD
School of Psychology, Deakin University, Burwood, VIC, Australia
Search for more papers by this authorSusan Burney PhD
School of Psychological Sciences, Monash University, Clayton, VIC, Australia
Cabrini Monash Psycho-Oncology, Cabrini Health, Malvern, VIC, Australia
Search for more papers by this authorPhillip Parente MBBS
Department of Medical Oncology, Eastern Health, Melbourne, VIC, Australia
Search for more papers by this authorPatricia M. Livingston PhD
Faculty of Health, Deakin University, Burwood, VIC, Australia
Search for more papers by this authorAbstract
Caregivers have been largely neglected in health literacy measurement. We assess the construct validity, and internal consistency of the Health Literacy of Caregivers Scale–Cancer (HLCS-C), and present a revised, psychometrically robust scale. Using data from 297 cancer caregivers (12.4% response rate) recruited from Melbourne, Australia between January–July 2014, confirmatory factor analysis (CFA) was conducted to evaluate the HLCS-C's proposed factor structure. Items were evaluated for: item difficulty, unidimensionality and overall item fit within their domain. Item-threshold-ordering was examined though one-parameter Item Response Theory models. Internal consistency was assessed using Raykov's reliability coefficient. CFA results identified 42 poorly performing/redundant items which were subsequently removed. A 10-factor model was fitted to 46 acceptable items with no correlated residuals or factor cross-loadings accepted. Adequate fit was revealed (χ2 WLSMV = 1463.807[df = 944], p < .001, RMSEA = 0.043, CFI = 0.980, TLI = 0.978, WRMR = 1.00). Ten domains were identified: Proactivity and determination to seek information; Adequate information about cancer and cancer management; Supported by healthcare providers (HCP) to understand information; Social support; Cancer-related communication with the care recipient (CR); Understanding CR needs and preferences; Self-care; Understanding the healthcare system; Capacity to process health information; and Active engagement with HCP. Internal consistency was adequate across domains (0.78–0.92). The revised HLCS-C demonstrated good structural, convergent, and discriminant validity, and high internal consistency. The scale may be useful for the development and evaluation of caregiver interventions.
Supporting Information
Filename | Description |
---|---|
hsc12524-sup-0001-TableS1.docxWord document, 89.2 KB |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- Armstrong, J. S. (1967). Derivation of theory by means of factor analysis or tom swift and his electric factor analysis machine. The American Statistician, 21(5), 17–21. https://doi.org/10.1080/00031305.1967.10479849
- Australian Bureau of Statistics. (2016). Disability, ageing and carers, Australia: Summary of findings, 2015. Canberra, ACT: Australian Bureau of Statistics.
- Baker, D. W., Wolf, M. S., Feinglass, J., Thompson, J. A., Gazmararian, J. A., & Huang, J. (2007). Health literacy and mortality among elderly persons. Archives of Internal Medicine, 167(14), 1503. https://doi.org/10.1001/archinte.167.14.1503
- Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling: A Multidisciplinary Journal, 13(2), 186–203. https://doi.org/10.1207/s15328007sem1302_2
- Bentler, P. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246. https://doi.org/10.1037/0033-2909.107.2.238
- Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606. https://doi.org/10.1037/0033-2909.88.3.588
- Berkman, N., Sheridan, S., Donahue, K., Halpern, D., Viera, A., Crotty, K., … Viswanathan, M. (2011). Health literacy interventions and outcomes: an updated systematic review. Evidence Report/Technology Assessment No. 199. (Prepared by RTI International–University of North Carolina Evidence-based Practice Center under contract No. 290-2007-10056-I. AHRQ Pub. Rockville, MD.
- Bevan, J., & Pecchioni, L. (2008). Understanding the impact of family caregiver cancer literacy on patient health outcomes. Patient Education and Counseling, 71(3), 356–364.
- Bostock, S., & Steptoe, A. (2012). Association between low functional health literacy and mortality in older adults: Longitudinal cohort study. British Medical Journal, 344, 1–10.
- Brown, T. (2014). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
- Browne, M., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. Bollen, & J. Long (Eds.), Testing structural equation models (pp. 136–162). Thousand Oaks, CA: Sage Publications.
- Buchbinder, R., Batterham, R., Elsworth, G., Dionne, C., Irvin, E., & Osborne, R. (2011). A validity-driven approach to the understanding of the personal and societal burden of low back pain: Development of a conceptual and measurement model. Arthritis, 13(5), 1–13.
- Byrne, B. (2013). Structural equation modeling with Mplus: Basic concepts, applications, and programming. New York, NY: Routledge.
10.4324/9780203807644 Google Scholar
- Campbell, D., & Fiske, D. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.
- Campbell, H., Sanson-Fisher, R., & Taylor-Brown, J. (2009). The cancer support person's unmet needs survey. Cancer, 115(14), 3351–3359.
- Comrey, A., & Lee, H. (2013). A first course in factor analysis ( 2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates Inc..
10.4324/9781315827506 Google Scholar
- Davis, T., Crouch, M., Long, S., & Jackson, R. (1991). Rapid assessment of literacy levels of adult primary care patients. Family, 23(6), 514–522.
- Davis, T., Long, S., Jackson, R., Mayeaux, E., George, R., Murphy, P., & Crouch, M. (1993). Rapid estimate of adult literacy in medicine: A shortened screening instrument. Family Medicine, 25(6), 391–395.
- DeVellis, R. F. (2012). Scale Development: Theory and Applications, 3rd ed. Thousand Oaks, CA: SAGE Publications, Inc.
- Dolce, M. (2011). The internet as a source of health information: Experiences of cancer survivors and caregivers with healthcare providers. Oncology Nursing Forum, 38(3), 353–359.
- Dumenci, L., Matsuyama, R., Riddle, D. L., Cartwright, L. A., Perera, R. A., Chung, H., & Siminoff, L. A. (2014). Measurement of cancer health literacy and identification of patients with limited cancer health literacy. Journal of Health Communication, 19(Suppl 2), 205–224. https://doi.org/10.1080/10810730.2014.943377
- Eggly, S., Penner, L., Greene, M., & Harper, F. (2006). Information seeking during “bad news” oncology interactions: Question asking by patients and their companions. Social Science & Medicine, 63(11), 2974–2985.
- Federman, A. D., Wolf, M. S., Sofianou, A., Martynenko, M., O'Connor, R., Halm, E. A., … Wisnivesky, J. P. (2014). Self-management behaviors in older adults with asthma: Associations with health literacy. Journal of the American Geriatrics Society, 62(5), 872–879. https://doi.org/10.1111/jgs.12797
- Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate data analysis. Upper Saddle River, NJ: Pearson, Prentice Hall.
- Haun, J. N., Valerio, M. A., McCormack, L. A., Sorensen, K., & Paasche-Orlow, M. K. (2014). Health literacy measurement: An inventory and descriptive summary of 51 instruments. Journal of Health Communication, 19(Suppl 2), 302–333. https://doi.org/10.1080/10810730.2014.936571
- IBM Corp. (2012). SPSS statistics for windows. Armonk, NY: IBM.
- Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44(3), 486–507. https://doi.org/10.1177/0049124114543236
- Kline, R. (2015). Principles and practice of structural equation modeling ( 4th ed.). New York, NY: Guilford Press.
- Krishnasamy, M., Wilkie, E., & Haviland, J. (2001). Lung cancer health care needs assessment: Patients’ and informal carers’ responses to a national mail questionnaire survey. Palliative Medicine, 15(3), 213–227.
- Laidsaar-Powell, R., Butow, P., Bu, S., & Charles, C. (2013). Physician–patient–companion communication and decision-making: A systematic review of triadic medical consultations. Patient Education and Counseling, 91(1), 3–13.
- Levin, J. B., Peterson, P. N., Dolansky, M. A., & Boxer, R. S. (2014). Health literacy and heart failure management in patient-caregiver dyads. Journal of Cardiac Failure, 20(10), 755–761. https://doi.org/10.1016/j.cardfail.2014.07.009
- Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103(3), 391–410. https://doi.org/10.1037/0033-2909.103.3.391
- Muthen, B. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49(1), 115–132. https://doi.org/10.1007/BF02294210
- Muthén, L., & Muthén, B. (1998). Mplus user's guide: The comprehensive modeling program for applied researchers. Los Angeles, CA: Muthén & Muthén.
- Muthén, L., & Muthén, B. (2014). Mplus (Version 7.4). Los Angeles, CA: Muthén & Muthén.
- Osborne, R., Batterham, R., Elsworth, G., Hawkins, M., & Buchbinder, R. (2013). The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health, 13, 1–17.
- Pallant, J. F., & Tennant, A. (2007). An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology, 46(1), 1–18. https://doi.org/10.1348/014466506X96931
- Parker, R., Baker, D., & Williams, M. (1995). The test of functional health literacy in adults. Journal of General Internal, 10(10), 537–541.
- Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21(2), 173–184.
- Raykov, T. (1998). Coefficient alpha and composite reliability with interrelated nonhomogeneous items. Applied Psychological Measurement, 22(4), 375–385. https://doi.org/10.1177/014662169802200407
- Raykov, T. (2012). Scale construction and development using structural equation modeling. Handbook of structural equation modeling. New York, NY: Guilford Press.
- Rosland, A.-M., Heisler, M., Choi, H.-J., Silveira, M. J., & Piette, J. D. (2010). Family influences on self-management among functionally independent adults with diabetes or heart failure: Do family members hinder as much as they help? Chronic Illness, 6(1), 22–33. https://doi.org/10.1177/1742395309354608
- Rosland, A.-M., Piette, J. D., Choi, H., & Heisler, M. (2011). Family and friend participation in primary care visits of patients with diabetes or heart failure. Medical Care, 49(1), 37–45. https://doi.org/10.1097/MLR.0b013e3181f37d28
- Saris, W. E., Satorra, A., & van der Veld, W. M. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling: A Multidisciplinary Journal, 16(4), 561–582. https://doi.org/10.1080/10705510903203433
- Sherwood, P., & Given, B. (2013). Caregiver knowledge and skills. In K. Bellizzi, & M. Gosney (Eds.), Cancer and aging handbook: Research and practice (pp. 445–458). Hoboken, NJ: John Wiley & Sons Ltd.
10.1002/9781118312513.ch28 Google Scholar
- Siminoff, L., Zyzanski, S., & Rose, J. (2008). The Cancer Communication Assessment Tool for Patients and Families (CCAT-PF): A new measure. Psycho-Oncology, 17(12), 1216–1224.
- Sørensen, K., Van den Broucke, S., Fullam, J., Doyle, G., Pelikan, J., Slonska, Z., & Brand, H. (2012). Health literacy and public health: A systematic review and integration of definitions and models. BMC Public Health, 12(1), 1–13. https://doi.org/10.1186/1471-2458-12-80
- Sørensen, K., Van den Broucke, S., Pelikan, J., Fullam, J., Doyle, G., Slonska, Z., … Brand, H. (2013). Measuring health literacy in populations: Illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLS-EU-Q). BMC Public Health, 13(948), 1–10.
- Streiner, D., Norman, G., & Cairney, J. (2015). Health measurement scales: A practical guide to their development and use. Oxford, UK: Oxford University Press.
10.1093/med/9780199685219.001.0001 Google Scholar
- Tabachnick, B., & Fidell, L. (2012). Using multivariate statistics. Boston, MA: Pearson/Allyn & Bacon.
- Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., & de Vet, H. C. W. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(1), 34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012
- Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington, DC: American Psychological Association.
10.1037/10694-000 Google Scholar
- Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10. https://doi.org/10.1007/BF02291170
- Weiss, B. D., Mays, M. Z., Martz, W., Castro, K. M., DeWalt, D. A., Pignone, M. P., & Hale, F. A. (2005). Quick assessment of literacy in primary care: The Newest Vital Sign. Annals of Family Medicine, 3(6), 514–522. https://doi.org/10.1370/afm.405
- Williams, A., & Bakitas, M. (2012). Cancer family caregivers: A new direction for interventions. Journal of Palliative Medicine, 15(7), 775–783.
- Wolff, J., & Roter, D. (2011). Family presence in routine medical visits: A meta-analytical review. Social Science & Medicine, 72(6), 823–831.
- Yuen, E. Y. N., Dodson, S., Batterham, R., Knight, T., Chirgwin, J., & Livingston, P. (2016). Development of a conceptual model of cancer caregiver health literacy. European Journal of Cancer Care, 25(2), 294–306. https://doi.org/10.1111/ecc.12284
- Yuen, E. Y. N., Knight, T., Dodson, S., Ricciardelli, L., Burney, S., & Livingston, P. M. (2014). Development of the Health Literacy of Caregivers Scale – Cancer (HLCS-C): Item generation and content validity testing. BMC Family Practice, 15, 202. https://doi.org/10.1186/s12875-014-0202-9
- Zhang, N., Terry, A., & McHorney, C. A. (2014). Impact of health literacy on medication adherence: A systematic review and meta-analysis. The Annals of Pharmacotherapy, 48(6), 741–751. https://doi.org/10.1177/1060028014526562
- Zhang, A. Y., Zyzanski, S., & Siminoff, L. (2010). Differential patient–caregiver opinions of treatment and care for advanced lung cancer patients. Social Science & Medicine, 70(8), 1155–1158. https://doi.org/10.1016/j.socscimed.2009.12.023