Research Report
A Multilevel Analysis of the Effects of the Practice Environment Scale of the Nursing Work Index on Nurse Outcomes
Allison S. Gabriel,
Rebecca J. Erickson,
Christina M. Moran,
James M. Diefendorff,
Gail E. Bromley,
Corresponding Author
Allison S. Gabriel
Department of Management, Virginia Commonwealth University, 301 West Main Street, PO Box 844000 Richmond, Virginia, 23284-4000
Assistant Professor of Management.Correspondence to Allison S.Search for more papers by this authorRebecca J. Erickson
Department of Sociology, The University of Akron, Akron, Ohio
Professor of Sociology.Search for more papers by this authorChristina M. Moran
PRADCO, Chagrin Falls, Ohio
Management Consultant.Search for more papers by this authorJames M. Diefendorff
Department of Psychology, The University of Akron, Akron, Ohio
Associate Professor of Psychology.Search for more papers by this authorGail E. Bromley
College of Nursing, Kent State University, Kent, Ohio
Associate Dean for Academics.Search for more papers by this authorAllison S. Gabriel,
Rebecca J. Erickson,
Christina M. Moran,
James M. Diefendorff,
Gail E. Bromley,
Corresponding Author
Allison S. Gabriel
Department of Management, Virginia Commonwealth University, 301 West Main Street, PO Box 844000 Richmond, Virginia, 23284-4000
Assistant Professor of Management.Correspondence to Allison S.Search for more papers by this authorRebecca J. Erickson
Department of Sociology, The University of Akron, Akron, Ohio
Professor of Sociology.Search for more papers by this authorChristina M. Moran
PRADCO, Chagrin Falls, Ohio
Management Consultant.Search for more papers by this authorJames M. Diefendorff
Department of Psychology, The University of Akron, Akron, Ohio
Associate Professor of Psychology.Search for more papers by this authorGail E. Bromley
College of Nursing, Kent State University, Kent, Ohio
Associate Dean for Academics.Search for more papers by this authorThe research reported here is an analysis of data from a larger study, “Identity and Emotional Management Control in Health Care Settings,” funded by the National Science Foundation (SES-1024271). A previous version of this article was presented at the 72nd annual meeting of the Academy of Management.
Abstract
Few researchers have examined how the components of the Practice Environment Scale of the Nursing Work Index (PES-NWI) relate to nurses' well-being at multiple organizational levels. The objective of the study was to perform a multilevel assessment of the relationships of the PES-NWI subscales with three nurse outcomes: job satisfaction, emotional exhaustion, and turnover intentions. Additionally, we tested the multilevel factor structure of the PES-NWI. In a sample of 699 full-time registered nurses in 79 units and 9 branches of a hospital system, relationships of the NWI with nurse outcomes were fairly consistent across levels of analysis. However, subscales contributed differently to the three outcomes, demonstrating the complexity of environmental influences on nurses' work experience. © 2013 Wiley Periodicals, Inc. Res Nurs Health 36: 567–581, 2013
References
- Aiken, L., Clarke, S., Sloane, D., Sochalski, J., Busse, R., Clarke, H., … Shamian, J. (2001). Nurses' reports on hospital care in five countries. Health Affairs, 20, 43–53. doi:10.1377/hlthaff.20.3.43
- Aiken, L. H., Clarke, S. P., Sloane, D. M., Sochalski, J., & Silber, J. H. (2002). Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA: The Journal of the American Medical Association, 288, 1987–1993. doi: 10.1001/jama.288.16.1987
- Aiken, L., & Patrician, P. (2000). Measuring organizational traits of hospitals: The revised nursing work index. Nursing Research, 49, 146–153.
- Aiken, M., & Hage, J. (1968). Organizational interdependence and intra-organizational structure. American Sociological Review, 33, 912–930. doi:10.2307/2092683
- Anderson, J., & Gerbing, D. (1998). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103, 411–423. doi:10.1037/0033-2909.103.3.411
-
Bakker, A. B., &
Demerouti, E. (2007).
The job demands-resources model: State of the art.
Journal of Managerial Psychology,
22, 309–328. doi:10.1108/02683940710733115
doi:10.1108/02683940710733115 Google Scholar
- Bandalos, D. L. (2002). The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling, 9, 78–102. doi:10.1207/S15328007SEM0901_5
- Bentler, P. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. doi:10.1037/0033-2909.107.2.238
- Bentler, P., & Bonett, D. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606. doi:10.1037/0033-2909.88.3.588
- Bliese, P. D. (2002). Multilevel random coefficient modeling in organizational research. In F. Drasgow & N. Schmitt (Eds.), Measuring and analyzing behavior in organizations (pp. 401–445). San Francisco, CA: Jossey-Bass.
- Bliese, P., Chan, D., & Ployhart, R. (2007). Multilevel methods: Future directions in measurement, longitudinal analyses, and nonnormal outcomes. Organizational Research Methods, 10, 551–563. doi:10.1177/1094428107301102
- Budge, C., Carryer, J., & Wood, S. (2003). Health correlates of autonomy, control, and professional relationships in the nursing work environment. Journal of Advanced Nursing, 42, 260–268. doi:10.1046/j.1365-2648.2003.02615.x
- Buerhaus, P., Auerbach, D., & Staiger, D. (2009). The recent surge in nurse employment: Causes and implications. Health Affairs, 28, 657–668. doi:10.1377/hlthaff.28.4.w657
- Buerhaus, P., Staiger, D., & Auerbach, D. (2009). The future of the nursing workforce in the United States: Data, trends and implications. Sudbury, MA: Jones & Bartlett Publishers.
- Brewer, C., Kovner, C., Green, W., & Cheng, Y. (2009). Predictors of RNs intent to work and work decisions: 1 year later in a U.S. national sample. International Journal of Nursing Studies, 46, 940–956. doi:10.1016/j.ijnurstu.2008.02.003
- Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.
- Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234–246. doi:10.1037/0021-9010.83.2.234
- Chen, G., Bliese, P., & Mathieu, J. (2005). Conceptual framework and statistical procedures for delineating and testing multilevel theories of homology. Organizational Research Methods, 8, 375–409. doi:10.1177/1094428105280056
- Chen, G., Webber, S., Bliese, P., Mathieu, J., Payne, S., Born, D., & Zaccaro, S. (2002). Simultaneous examination of the antecedents and consequences of efficacy beliefs at multiple levels of analysis. Human Performance, 15, 381–409. doi:10.1207/S15327043HUP1504_05
- Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. doi:10.1207/S15328007SEM0902_5
- Chiang, H. Y., & Lin, S. Y. (2009). Psychometric testing of the Chinese version of nursing practice environment scale. Journal of Clinical Nursing, 18, 919–929. doi:10.1111/j.1365-2702.2008.02433.x
- Cho, S. H., Mark, B. A., Yun, S. C., & June, K. J. (2011). Differences in intensive care unit work environments among and within hospitals using subscales and a composite measure of the Revised Nursing Work Index. Journal of Advanced Nursing, 67, 2637–2648. doi:10.1111/j.1365-2648.2011.05713.x
- Choi, J., Bakken, S., Larson, E., Du, Y., & Stone, P. (2004). Perceived nursing work environment of critical care nurses. Nursing Research, 53, 370–378.
- Clark, P. A., Leddy, K., Drain, M., & Kaldenberg, D. (2007). State nursing shortages and patient satisfaction: More RNs-better patient experiences. Journal of Nursing Care Quality, 22, 119–127. doi: 10.1097/01.NCQ.0000263100.29181.e3
- Cohen, S., & Willis, T. (1985). Stress, social support, and the buffering hypothesis. Psychological Bulletin, 98, 310–357. doi:10.1037/0033-2909.98.2.310
- Cronbach, L., & Meehl, P. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. doi:10.1037/h0040957
- Cropanzano, R., James, K., & Konovsky, M. (1993). Dispositional affectivity as a predictor of work attitudes and job performance. Journal of Organizational Behavior, 14, 595–606. doi:10.1002/job.4030140609
- Cummings, G. G., Hayduk, L., & Estabrooks, C. A. (2006). Is the nursing work index measuring up? Moving beyond estimating reliability to testing validity. Nursing Research, 55, 82–93.
- Dalal, R., & Hulin, C. (2008). Motivation for what? A multivariate dynamic perspective of the criterion. In R. Kanfer, G. Chen, & R. Pritchard (Eds.), Work motivation: Past, present, and future (pp. 63–100). New York, NY: Routledge.
- De Gieter, S., Hofmans, J., & Pepermans, R. (2011). Revisiting the impact of job satisfaction and organizational commitment on nurse turnover intention: An individual differences analysis. International Journal of Nursing Studies, 48, 1562–1569. doi:10.1016/j.ijnurstu.2011.06.007
- Dyer, N., Hanges, P., & Hall, R. (2005). Applying multilevel confirmatory factor analysis techniques to the study of leadership. The Leadership Quarterly, 16, 149–167. doi:10.1016/j.leaqua.2004.09.009
- Enders, C., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121–138. doi:10.1037/1082-989X.12.2.121
- Erickson, R., & Ritter, C. (2001). Emotional labor, burnout, and inauthenticity: Does gender matter? Social Psychology Quarterly, 64, 146–163. doi:10.2307/3090130
- Estabrooks, C. A., Midodzi, W. K., Cummings, G. G., & Wallin, L. (2007). Predicting research use in nursing organizations: A multilevel analysis. Nursing Research, 56, S7–S23.
- Foley, B., Kee, C., Minick, P., Harvey, S., & Jennings, B. (2002). Characteristics of nurses and hospital work environments that foster satisfaction and clinical expertise. Journal of Nursing Administration, 31, 274–282.
- Friese, C. R., Lake, E. T., Aiken, L. H., Silber, J. H., & Sochalski, J. (2008). Hospital nurse practice environments and outcomes for surgical oncology patients. Health Services Research, 43, 1145–1163. doi:10.1111/j.1475-6773.2007.00825.x
- Gabriel, A., Diefendorff, J., & Erickson, R. (2011). The relations of daily task accomplishment satisfaction with changes in affect: A multilevel study in nurses. Journal of Applied Psychology, 96, 1095–1104. doi:10.1037/a0023937
- Gajewski, B. J., Boyle, D. K., Miller, P. A., Oberhelman, F., & Dunton, N. (2010). A multilevel confirmatory factor analysis of the Practice Environment Scale. Nursing Research, 59, 147–153.
- Gibson, C. (2001). Me and us: Differential relationships among goal setting, training, efficacy, and effectiveness at the individual and team level. Journal of Organizational Behavior, 22, 789–808. doi:10.1002/job.114
- Glick, W. (1985). Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Academy of Management Review, 10, 601–616. doi:10.5465/AMR.1985.4279045
- Hall, R., Snell, A., & Foust, M. S. (1999). Item parceling strategies in SEM: Investigating the subtle effects of unmodeled secondary constructs. Organizational Research Methods, 2, 233–256. doi:10.1177/109442819923002
- Hanrahan, N. P. (2007). Measuring inpatient psychiatric environments: Psychometric properties of the Practice Environment Scale-Nursing Work Index (PES-NWI). The International Journal of Psychiatric Nursing Research, 12, 1521–1528.
- Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternative. Structural Equation Modeling, 6, 1–55. doi:10.1080/10705519909540118
- Institute of Medicine. (2003). Health professions education: A bridge to quality. Retrieved from http://www.iom.edu/Reports/2003/Health-Professions-Education-A-Bridge-to-Quality.aspx
- Jackson, D. L., Gillaspy, J. A., Jr., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14, 6–23. doi:10.1037/a0014694
- James, L. (1982). Aggregation bias in estimates of perceptual agreement. Journal of Applied Psychology, 67, 219–229. doi:10.1037/0021-9010.67.2.219
- Kalisch, B. J., Lee, H., & Rochman, M. (2010). Nursing staff teamwork and job satisfaction. Journal of Nursing Management, 18, 938–947. doi:10.1111/j.1365-2834.2010.01153.x
- Kline, R. (2005). Principles and practice of structural equation modeling. New York: Guilford.
- Klein, K., Dansereau, F., & Hall, R. (1994). Levels issues in theory development, data collection, and analysis. Academy of Management Review, 19, 195–229. doi:10.5465/AMR.1994.9410210745
- Kish, L. (1965). Survey sampling. New York, NY: Wiley.
- Kovner, C., Brewer, C., Fairchild, S., Poornima, S., Kim, H., & Jadjukic, A. (2007). A better understanding of newly licensed RNs and their employment patterns is crucial to reducing turnover rates. American Journal of Nursing, 107, 58–70.
- Kozlowski, S., & Klein, K. (2000). A levels approach to theory and research in organizations. In K. Klein & S. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 3–90). San Francisco, CA: Jossey-Bass.
- Kutney-Lee, A., Lake, E., & Aiken, L. (2009). Development of the Hospital Nurse Surveillance Capacity Profile. Research in Nursing & Health, 32, 217–228. doi:10.1002/nur.20316
- Lake, E. (2002). Development of the Practice Environment Scale of the Nursing Work Index. Research in Nursing & Health, 25, 176–188. doi:10.1002/nur.10032
- Lake, E. (2007). The Nursing Practice Environment: Measurement and evidence. Medical Care Research and Review, 64, 104S–122S. doi:10.1177/1077558707299253
- Lake, E., & Friese, C. (2006). Variations in nursing practice environments: Relation to staffing and hospital characteristics. Nursing Research, 55, 1–9.
- Larson, J. (2009). The recession's effect on jobs for new nurses. Retrieved from http://www.nursezone.com/nursing-news-events/more-news/The-Recession%E2%80%99sEffect-on-Jobs-for-New-Nurses_28968.aspx
- Leiter, M. P., & Laschinger, H. K. S. (2006). Relationships of work and practice environment to professional burnout: Testing a causal model. Nursing Research, 55, 137–146.
- Liou, S. R., & Cheng, C. Y. (2009). Using the practice environment scale of the nursing work index on Asian nurses. Nursing Research, 58, 218–225.
- Lindell, M., & Brandt, C. (1999). Assessing interrater agreement on the job relevance of a test: A comparison of the CVI, T, rwg(j), and r*wg(j) indexes. Journal of Applied Psychology, 84, 640–647. doi:10.1037/0021-9010.84.4.640
- Lucero, R., Lake, E., & Aiken, L. (2010). Nursing care quality and adverse events in US hospitals. Journal of Clinical Nursing, 19, 2185–2195. doi:10.1111/j.1365-2702.2010.03250.x
- Maas, C. J. M., & Hox, J. J. (2004). The influence of violations and assumptions on multilevel parameter estimates and their standard errors. Computational Statistics & Data Analysis, 46, 427–440. doi:10.1016/j.csda.2003.08.006
- Mallidou, A. A., Cummings, G. G., Estabrooks, C. A., & Giovannetti, P. B. (2011). Nurse specialty subcultures and patient outcomes in acute care hospitals: A multiple-group structural equation modeling. International Journal of Nursing Studies, 48, 81–93. doi:10.1016/j.ijnurstu.2010.06.002
- Muthén, L., & Muthén, B. (1998 –2007). Mplus user's guide ( 5th ed.). Los Angeles, CA: Author.
- Muthén, B. O., & Satorra, A. (1995). Complex sample data in structural equation modeling. In P. Marsden (Ed.), Sociological methodology (pp. 267–316). Washington, DC: American Sociological Association.
- Morgeson, F. P., & Hofmann, D. A. (1999). The structure and function of collective constructs: Implications for multilevel research and theory development. Academy of Management Review, 24, 249–255. doi:10.5465/AMR.1999.1893935
- O'Daniel, M., & Rosenstein, A. H. (2008). Professional communication and team collaboration. In R. G. Hughes (Ed.), Patient safety and quality: An evidence-based handbook for nurses. Rockville, MD: Agency for Healthcare Research and Quality.
-
Pearlin, L. I. (1999). The stress process revisited: Reflections on concepts and their interrelationships. In C. S. Aneshensel & J. C. Phelan (Eds.),
Handbook of the sociology of mental health (pp. 395–415).
New York, NY:
Kluwer Academic/Plenum Publishers.
10.1007/0-387-36223-1_19 Google Scholar
- Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903. doi:10.1037/0021-9010.88.5.879
- Quinn, R., & Staines, G. (1979). The 1977 Quality of Employment Survey. Ann Arbor, MI: Institute for Social Research.
- Rafferty, A., Ball, J., & Aiken, L. (2001). Are teamwork and professional autonomy compatible, and do they result in improved hospital care? Quality Health Care, 10, 32–37. doi:10.1136/qhc.0100032
- Raudenbush, S., & Bryk, A. (2002). Hierarchical linear models. Thousand Oaks, CA: Sage.
- Richardson, H. A., Simmering, M. J., & Sturman, M. C. (2009). A tale of three perspectives examining post hoc statistical techniques for detection and correction of common method variance. Organizational Research Methods, 12, 762–800. doi:10.1177/1094428109332834
- Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15, 351–357.
- Steiger, J. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180. doi: 10.1002/s15327906mbr2502_4
- Tri-Council for Nursing. (2010). Joint statement from the Tri-council for Nursing on recent registered nurse supply and demand projections. Retrieved from http://www.aacn.nche.edu/Media/NewsReleases/2010/tricouncil.html
- Tucker, L., & Lewis, C. (1973). A reliability coefficient for maximum likelihood of factor analysis. Psychometrika, 38, 1–10. doi:10.1007/BF02291170
- U.S. Department of Labor, Bureau of Labor Statistics. (2012). The 30 occupations with the largest projected employment growth, 2010–20. Retrieved from http://www.bls.gov/news.release/ecopro.t06.htm
- Vahey, D., Aiken, L., Sloane, D., Clarke, S., & Vargas, D. (2004). Nurse burnout and patient satisfaction. Medical Care, 42, 1157–1166.
- Van Bogaert, P., Clarke, S., Roelant, E., Meulemans, H., & Van de Heyning, P. (2010). Impacts of unit-level nurse practice environment and burnout on nurse-reported outcomes: A multilevel modeling approach. Journal of Clinical Nursing, 19, 1664–1674. doi:10.1111/j.1365-2702.2009.03128.x
- Van Bogaert, P., Clarke, S., Vermeyen, K., Meulemans, H., & Van de Heyning, P. (2009). Practice environments and their associations with nurse-reported outcomes in Belgian hospitals: Development and preliminary validation of a Dutch adaptation of the Revised Nursing Work Index. International Journal of Nursing Studies, 46, 55–65. doi:10.1016/j.ijnurstu.2008.07.009
-
Vandenberg, R., &
Lance, C. (2000).
A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research.
Organizational Research Methods,
3, 3–70. doi:10.1177/109442810031002
doi:10.1177/109442810031002 Google Scholar
- Warshawsky, N., & Havens, D. (2011). Global use of the practice environments scale of the nursing work index. Nursing Research, 60, 17–31.
- Wharton, A. (1993). The affective consequences of service work: Managing emotions on the job. Work and Occupations, 20, 205–232. doi:10.1177/0730888493020002004
Citing Literature
