SINGLE-ATTRIBUTE UTILITY ANALYSIS MAY BE FUTILE, BUT THIS CAN’T BE THE END OF THE STORY: CAUSAL CHAIN ANALYSIS AS AN ALTERNATIVE
and requests for reprints should be addressed to Silvan Winkler, Psychologisches Institut der Universität Zürich, Arbeits- und Organisationspsychologie, Binzmühlestrasse 14/12, CH-8050 Zürich, Switzerland; [email protected].
We acknowledge Gary P. Latham for his valuable suggestions on a previous version of this article.
Abstract
Research on providing single-attribute utility analysis has shown moderate or even negative effects on the acceptance of selection and training tests by human resource decision makers. In this study, we contrasted the perceived utility of single-attribute utility analysis with causal chain analysis as an alternative way of conducting utility analysis. Causal chain analysis focuses on measuring the linkages between HRM interventions and organizational outcomes mediated by employee attitudes and customer perceptions. We compared 144 managers' reactions to both methods of utility analysis concerning the variables understandability, information quality, perceived usefulness, user information satisfaction, and intention to use. Causal chain analysis yielded higher results than single-attribute analysis for these variables, and a compound measure of these constructs supported this finding. This indicates that causal chain analysis is a valuable alternative method of communicating the utility of HRM interventions.
REFERENCES
- Aguinis H, Harden E. (2004). Will banding benefit my organization? An application of multi-attribute utility analysis. In H Aguinis (Ed.), Test score banding: Legal, technical, and societal issues (pp. 193–216). Westport , CT : Praeger.
-
Baroudi JJ,
Orlikowski WJ. (1988). A short-form measure of user information satisfaction: A psychometric evaluation and notes on use.
Management Information Systems, 4, 44–59.
10.1080/07421222.1988.11517807 Google Scholar
- Birdi K, Clegg C, Patterson M, Robinson A, Stride CB, Wall TD. (2008). The impact of human resource and operational management practices on company productivity: A longitudinal study. Personnel Psychology, 61, 467–501.
- Bobko P, Karren R, Kerkar SP. (1987). Systematic research needs for understanding supervisory-based estimates of SDy in utility analysis. Organizational Behavior and Human Decision Processes, 40, 69–95.
-
Boselie P,
Dietz G,
Boon C. (2005). Commonalities and contradictions in HRM performance research.
Human Resource Management Journal, 15, 67–94.
10.1111/j.1748-8583.2005.tb00154.x Google Scholar
- Bosnjak M. (2001). Participation in non-restrictive web surveys: A typology and explanatory model for item non-response. In U-D Reips, M Bosnjak (Eds.), Dimensions of internet science (pp. 193–208). Lengerich , Germany : Pabst Science.
- Boudreau JW. (1990). Utility analysis for decisions in human resource management. In MD Dunnette, LM Houghs (Eds.), Handbook of industrial and organizational psychology ( 2nd ed., pp. 621–745). Palo Alto , CA : Consulting Psychologists Press.
- Boudreau JW, Ramstad PM. (2003). Strategic industrial and organizational psychology and the role of utility analysis models. In DRI Bormann, RJ Klimoski (Eds.), Handbook of industrial and organizational psychology (pp. 193–217). New York : Wiley.
- Boudreau JW, Ramstad PM. (2007). Beyond HR: The new science of human capital. Boston : Harvard Business School Press.
- Brogden HE. (1949). A new coefficient: Application to biserial correlation and to estimation of selective efficiency. Psychometrika, 14, 169–182.
- Brown SP, Lam SK. (2008). A meta-analysis of relationships linking employee satisfaction to customer responses. Journal of Retailing, 84, 243–255.
- Burke MJ, Pearlman K. (1988). Recruiting, selecting, and matching people with jobs. In JP Campbell, RJ Campbell (Eds.), Productivity in organizations (pp. 97–142). San Francisco : Jossey-Bass.
- Cabrera EF, Raju NS. (2001). Utility analysis: Current trends and future directions. International Journal of Selection and Assessment, 9, 92–102.
- Carson KP, Becker JS, Henderson JA. (1997). Is utility really futile? A failure to replicate and an extension. Journal of Applied Psychology, 83, 84–96.
- Cascio WF. (2000). Costing human resources ( 4th ed.). Cincinnati , OH : South-Western College Publishing.
- Cascio WF, Aguinis H. (2008). Research in industrial and organizational psychology from 1963 to 2007: Changes, choices, and trends. Journal of Applied Psychology, 93, 1062–1081.
- Cascio WF, Boudreau JW. (2008). Investing in people: Financial impact of human resource initiatives. Upper Saddle River , NJ : Pearson Education.
- Chen MJ, Farh JL, Macmillan IC. (1993). An exploration of the expertness of outside informants. Academy of Management Journal, 36, 1614–1632.
- Choragwicka B, Janta B. (2008). Why is it so hard to apply professional selection methods in business practice? Industrial and Organizational Psychology, 1, 355–358.
- Cohen J. (1992). A power primer. Psychological Bulletin, 112, 155–159.
- Combs J, Liu YM, Hall A, Ketchen D. (2006). How much do high-performance work practices matter? A meta-analysis of their effects on organizational performance. Personnel Psychology, 59, 501–528.
- Cronbach LJ, Gleser GC. (1965). Psychological tests and personnel decision ( 2nd ed.). Urbana , IL : University of Illinois Press.
- Cronshaw SF. (1997). Lo! The stimulus speaks: The insider's view on Whyte and Latham's “the futility of utility analysis. Personnel Psychology, 50, 611–615.
- Dalal RS, Bonaccio S, Highhouse S, Ilgen DR, Mohammed S, Slaughter JE. (in press). What if industrial-organizational psychology decided to take workplace decisions seriously?
- Davis FD. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 319–340.
- Davis FD, Bagozzi RP, Warshaw PR. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35, 982–1003.
- Gelade GA, Ivery M. (2003). The impact of human resource management and work climate on organizational performance. Personnel Psychology, 56, 383–404.
- Gelade GA, Young S. (2005). Test of a service profit chain model in the retail banking sector. Journal of Occupational and Organizational Psychology, 78, 1–22.
-
Gigerenzer G,
Gaissmaier W,
Kurz-Milcke E,
Schwartz L,
Woloshin S. (2008). Helping doctors and patients make sense of health statistics.
Psychological Science in the Public Interest, 8, 53–96.
10.1111/j.1539-6053.2008.00033.x Google Scholar
- Harrison DA, Newman DA, Roth PL. (2006). How important are job attitudes? Meta-analytic comparisons of integrative behavioral outcomes and time sequences. Academy of Management Journal, 49, 305–325.
- Harter JK, Schmidt FL, Hayes TL. (2002). Business-unit-level relationship between employee satisfaction, employee engagement, and business outcomes: A meta-analysis. Journal of Applied Psychology, 87, 268–279.
- Hazer JT, Highhouse S. (1997). Factors influencing managers’ reactions to utility analysis: Effects of SDy method, information frame, and focal intervention. Journal of Applied Psychology, 82, 104–112.
- Heskett JL, Jones TO, Loveman GW, Sasser WE, Schlesinger LA. (1994). Putting the service-profit chain to work. Harvard Business Review, 72, 164–174.
- Highhouse S. (1996). The utility estimate as a communication device: Practical questions and research directions. Journal of Business and Psychology, 11, 85–100.
- Kamakura WA, Mittal V, De Rosa F, Mazzon JA. (2002). Assessing the service-profit chain. Marketing Science, 21, 294–317.
- Kaplan RS, Norton DP. (1992). The balanced scorecard: Measures that drive performance. Harvard Business Review, 70, 71–79.
- Kassinis GI, Soteriou AC. (2003). Greening the service profit chain: The impact of environmental management practices. Production and Operations Management, 12, 386–403.
- Krosnick JA. (1999). Survey research. Annual Review of Psychology, 50, 537–567.
- Kumar N, Stern LW, Anderson JC. (1993). Conducting interorganizational research using key informants. Academy of Management Journal, 36, 1633–1651.
- Lado AA, Wilson MC. (1994). Human resource systems and sustained competitive advantage: A competency-based perspective. Academy of Management Review, 19, 699–727.
- Lariviere B. (2008). Linking perceptual and behavioral customer metrics to multiperiod customer profitability: A comprehensive service-profit chain application. Journal of Service Research, 11, 3–21.
- Latham GP. (1988). Human resource training and development. Annual Review of Psychology, 39, 545–582.
- Latham GP, Whyte G. (1994). The futility of utility analysis. Personnel Psychology, 47, 31–46.
- Lawler EE. (2008). Talent: Making people your competitive advantage. San Francisco : Jossey-Bass.
- Lawler EE, Levenson A, Boudreau JW. (2004). HR metrics and analytics: Use and impact. Human Resource Planning, 27, 27–35.
- Lemming MR, Macan TH. (2009, April). Adjustment and restructuring effects of UA information on managerial acceptance. Paper presented at the 24th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans , LA .
- Macan TH, Foster J. (2004). Managers’ reactions to utility analysis and perceptions of what influences their decisions. Journal of Business and Psychology, 19, 241–253.
-
Macan TH,
Highhouse S. (1994). Communicating the utility of human resource activities: A survey of I/O and HR professionals.
Journal of Business and Psychology, 8, 425–436.
10.1007/BF02230958 Google Scholar
-
Mattson BW. (2003). The effects of alternative reports of human resource development results on managerial support.
Human Resource Development Quarterly, 14, 127–151.
10.1002/hrdq.1056 Google Scholar
- Mirvis PH, Lawler EE. (1977). Measuring financial impact of employee attitudes. Journal of Applied Psychology, 62, 1–8.
- Mirvis PH, Lawler EE. (1983). Systems are not solutions: Issues in creating information-systems that account for the human organization. Accounting Organizations and Society, 8, 175–190.
- Morrow CC, Jarrett MQ, Rupinski MT. (1997). An investigation of the effect and economic utility of corporate-wide training. Personnel Psychology, 50, 91–119.
- Mowday RT, Steers RM, Porter LW. (1979). Measurement of organizational commitment. Journal of Vocational Behavior, 14, 224–247.
- Paul AK, Anantharaman RN. (2003). Impact of people management practices on organizational performance: Analysis of a causal model. International Journal of Human Resource Management, 14, 1246–1266.
- Petter S, DeLone W, McLean E. (2008). Measuring information systems success: Models, dimensions, measures, and interrelationships. European Journal of Information Systems, 17, 236–263.
- Pritchard M, Silvestro R. (2005). Applying the service profit chain to analyse retail performance: The case of the managerial strait-jacket? International Journal of Service Industry Management, 16, 337–356.
-
Purcell J,
Hutchinson S. (2007). Front-line managers as agents in the HRM-performance causal chain: Theory, analysis and evidence.
Human Resource Management Journal, 17, 3–20.
10.1111/j.1748-8583.2007.00022.x Google Scholar
- Rai A, Lang SS, Welker RB. (2002). Assessing the validity of IS success models: An empirical test and theoretical analysis. Information Systems Research, 13, 50–69.
-
Rauschenberger JM,
Schmidt FL. (1987). Measuring the economic impact of human resource programs.
Journal of Business and Psychology, 2, 50–59.
10.1007/BF01061524 Google Scholar
- Reips U-D. (2002). Standards for internet-based experimenting. Experimental Psychology, 49, 243–256.
- Rogg KL, Schmidt DB, Shull C, Schmitt N. (2001). Human resource practices, organizational climate, and customer satisfaction. Journal of Management, 27, 431–449.
- Roth PL. (1994). Multiattribute utility analysis using the PROMES approach. Journal of Business and Psychology, 9, 69–80.
- Roth PL, Bobko P. (1997). A research agenda for multi-attribute utility analysis in human resource management. Human Resource Management Review, 7, 341–368.
- Roth PL, Bobko P, Mabon H. (2002). Utility analysis: A review and analysis at the turn of the century. In A Neil, DS Ones, SH Kepir, C Visvesvaran (Eds.), Handbook of industrial, work and organizational psychology ( Vol . 1, pp. 362–384). Thousand Oaks , CA : Sage.
-
Rowold J,
Mönninghoff M. (2005). Strategic human resource utility analysis.
Journal of Human Resource Costing & Accounting, 9, 10–25.
10.1108/14013380510636676 Google Scholar
- Rucci AJ, Kirn SP, Quinn RT. (1998). The employee-customer profit chain at Sears. Harvard Business Review, 76, 82–97.
- Ryan AM, Schmit MJ, Johnson R. (1996). Attitudes and effectiveness: Examining relations at an organizational level. Personnel Psychology, 49, 853–882.
- Schmidt FL. (1993). Personnel psychology at the cutting edge. In N Schmitt, WC Borrnan (Eds.), Personnel selection in organizations (pp. 497–515). San Francisco : Jossey-Bass.
- Schneider B, Ashworth SD, Higgs CA, Carr L. (1996). Design, validity, and use of strategically focused employee attitude surveys. Personnel Psychology, 49, 695–705.
- Schneider B, Hanges PJ, Smith DB, Salvaggio AN. (2003). Which comes first: Employee attitudes or organizational financial and market performance? Journal of Applied Psychology, 88, 836–851.
- Seddon PB. (1997). A respecification and extension of the DeLone and McLean model of IS success. Information System Research, 8, 240–253.
- Sturman MC. (2000). Implications of utility analysis adjustments for estimates of human resource intervention value. Journal of Management, 26, 281–299.
- Sturman MC, Trevor CO, Boudreau JW, Gerhart B. (2003). Is it worth to win the talent war? Evaluating the utility of performance-based pay. Personnel Psychology, 56, 997–1035.
- Subramony M. (2006). Why organizations adopt some human resource management practices and reject others: An exploration of rationales. Human Resource Management, 45, 195–210.
- Wanous JP, Hudy MJ. (2001). Single-item reliability: A replication and extension. Organizational Research Methods, 4, 361–375.
- Wanous JP, Reichers AE, Hudy MJ. (1997). Overall job satisfaction: How good are single-item measures? Journal of Applied Psychology, 82, 247–252.
- Wempen F. (2007). Powerpoint 2007 bible. Indianapolis , IN : Wiley.
- Whyte G, Latham G. (1997). The futility of utility analysis revisited: When even an expert fails. Personnel Psychology, 50, 601–610.
- Winkler S, König CJ, Kleinmann M. (2009). What makes human resource information successful? Manuscript submitted for publication. University of Zurich , Switzerland .
- Wintermantel RE, Mattimore KL. (1997). In the changing world of human resources: Matching measures to mission. Human Resource Management, 36, 337–342.
- Wright PM, Gardner TM, Moynihan LM, Allen MR. (2005). The relationship between HR practices and firm performance: Examining causal order. Personnel Psychology, 58, 409–446.
- Yeung AK, Berman B. (1997). Adding value through human resources: Reorienting human resource measurement to drive business performance. Human Resource Management, 36, 321–335.
