A META-ANALYSIS OF CONDITIONAL REASONING TESTS OF AGGRESSION
and requests for reprints should be addressed to Christopher M. Berry, Texas A&M University, Department of Psychology, 4235 TAMU, College Station, TX 77843; [email protected].
An earlier version of this manuscript was presented at the 2007 conference of the Society for Industrial and Organizational Psychology.
Abstract
James et al. (2005) reported an estimate of criterion-related validity (corrected only for dichotomization of criteria) of r = .44 across 11 conditional reasoning test of aggression (CRT-Aggression) validity studies. This meta-analysis incorporated a total sample size more than twice that of James et al. Our comparable validity estimate for CRT-Aggression scales predicting counterproductive work behaviors was r = .16. Validity for the current, commercially marketed test version (CRT-A) was lower (r = .10). These validity estimates increased somewhat (into the .24–.26 range) if studies using dichotomous criteria with low base rates were excluded from the meta-analysis. CRT-Aggression scales were correlated r = .14 with measures of job performance. As we differed with James et al. in some of our coding decisions, we reran all analyses using James et al.'s coding decisions and arrived at extremely similar results.
REFERENCES
- Note: References marked with an asterisk (*) provided one or more independent primary samples for the meta-analyses.
- Becker TE. (1998). Integrity in organizations: Beyond honesty and conscientiousness. Academy of Management Review, 23, 154–161.
- Berry CM, Ones DS, Sackett PR. (2007). Interpersonal deviance, organizational deviance, and their common correlates: A review and meta-analysis. Journal of Applied Psychology, 92, 410–424.
- Berry CM, Sackett PR, Wiemann S. (2007). A review of recent developments in integrity test research. Personnel Psychology, 60, 271–301.
- *Bing MN, Stewart SM, Davison HK, Green PD, McIntyre MD, James LR. (2007). An integrative typology of personality assessment for aggression: Implications for predicting counterproductive workplace behavior. Journal of Applied Psychology, 92, 722–744.
- Burke MJ, Landis RS. (2003). Methodological and conceptual challenges in conducting and interpreting meta-analyses. In KR Murphy (Ed.), Validity generalization: A critical review (pp. 287–309). Mahwah , NJ : Erlbaum.
- Douglas SC, Martinko MJ. (2001). Exploring the role of individual differences in the prediction of workplace aggression. Journal of Applied Psychology, 86, 547–559.
- *Frost BC. (2002). Implicit versus explicit aggression: Who's ready to rumble? Unpublished manuscript, University of Tennessee.
- *Frost BC. (2005). Implicit and explicit personality: An integrative approach to predicting aggressive behavior in a field setting. Unpublished doctoral dissertation, University of Tennessee.
- Frost BC, Ko CE, James LR. (2007). Implicit and explicit personality: A test of a channeling hypothesis for aggressive behavior. Journal of Applied Psychology, 92, 1299–1319.
- Ghiselli EE, Campbell JP, Zedeck S. (1981). Measurement theory for the behavioral sciences. San Francisco : W. H. Freeman.
- *Green PD. (1999). The visual-oral conditional reasoning test: Predicting scholastic misconduct and deception. Unpublished doctoral dissertation, University of Tennessee .
- *Hawes SR. (2000). A comparison of biodata, ability, and a conditional reasoning test as predictors of reliable behavior in the workplace. Unpublished doctoral dissertation, University of Tennessee .
- *Hornick CW, Fox KA, Axton TR, Wyatt BS. (1999). The relative contribution of conditional reasoning and multiple intelligence measures in predicting firefighter and law enforcement officer job performance. Unpublished manuscript .
- Hough LM. (1992). The “Big Five” personality variables – construct confusion: Description vs. prediction. Human Performance, 5, 139–155.
- Hunter JE, Schmidt FL. (1990a). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park , CA : Sage.
- Hunter JE, Schmidt FL. (1990b). Dichotomization of continuous variables: The implications for meta-analysis. Journal of Applied Psychology, 75, 334–349.
-
Hunter JE,
Schmidt FL. (2004). Methods of meta-analysis: Correcting error and bias in research findings
(2nd edition).
New York
: Sage.
10.4135/9781412985031 Google Scholar
- *James LR, McIntyre MD. (2000). Conditional reasoning test of aggression test manual. Knoxville , TN : Innovative Assessment Technology, LLC.
- James LR, McIntyre MD, Glisson CA, Green PD, Patton TW, LeBreton JM, et al. (2005). A conditional reasoning measure for aggression. Organizational Research Methods, 8, 69–99.
- Kagan J. (1988). The meaning of personality predicates. American Psychologist, 43, 614–620.
- *LeBreton JM (2002). Use of differential framing to measure implicit social cognitions associated with aggression. Unpublished doctoral dissertation, University of Tennessee .
- LeBreton JM, Barksdale CD, Robin JD, James LR. (2007). Measurement issues associated with conditional reasoning tests: Indirect measurement and test faking. Journal of Applied Psychology, 92, 1–16.
- Levenson MR, Kiehl KA, Fitzpatrick CM. (1995). Assessing psychopathic attributes in a noninstitutionalized population. Journal of Personality and Social Psychology, 68, 151–158.
- McIntyre MD. (1995). A feasibility study of a conditional reasoning measure of aggressiveness and prosociability. Unpublished doctoral dissertation, University of Tennessee.
- Morgeson FP. (2004, April). Won't get fooled again? Editors discuss faking in personality testing. Symposium presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago , IL .
- Ones DS, Viswesvaran C, Schmidt F. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78, 679–703.
- Ones DS, Viswesvaran C, Schmidt FL. (2003). Personality and absenteeism: A meta-analysis of integrity tests. European Journal of Personality, 17(Suppl 1), S19–S38.
- Ones DS, Viswesvaran C, Schmidt FL, Reiss AD. (1994, August). The validity of honesty and violence scales of integrity tests in predicting violence at work. Paper presented at the annual meeting of the Academy of Management, Dallas, TX.
- *Patton TW. (1998). Measuring personal reliability via conditional reasoning: Identifying people who will work reliably. Unpublished doctoral dissertation, University of Tennessee .
- Raju NS, Brand PA. (2003). Determining the significance of correlations corrected for unreliability and range restriction. Applied Psychological Measurement, 27, 52–71.
- *Russell SM, James LR, McIntyre MD. (2004, April). Predicting lying, cheating, and defiance in an internet-based environment. Poster presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago , IL .
- *Sablynski CJ, Mitchell TR. (2006, May). Post hoc analyses of interactions between the aggression questionnaire and conditional reasoning test of aggression. In JM Lebreton (Chair), Bringing the implicit personality into I-O psychology. Symposium presented at the 21st Annual Conference of the Society for Industrial and Organizational Psychology, Dallas , TX .
- Salgado JF. (2002). The big five personality dimensions and counterproductive behaviors. International Journal of Selection and Assessment, 10, 117–125.
- Skarlicki DP, Folger R, Tesluk P. (1999). Personality as a moderator in the relationship between fairness and retaliation. Academy of Management Journal, 42, 100–108.
- Schmidt FL, Viswesvaran C, Ones DS. (1997). Validity of integrity tests for predicting drug and alcohol abuse: A meta-analysis. In WJ Bukoski (Ed.), Meta-analysis of drug abuse prevention programs (pp. 69–95). Rockville , MD : NIDA Press.
- Spector PE, Fox S, Penney LM, Bruursema K, Goh A, Kessler S. (2006). The dimensionality of counterproductivity: Are all counterproductive behaviors created equal? Journal of Vocational Behavior, 68, 446–460.
- *Walton WR. (2004). Justification of antisocial behavior. Unpublished doctoral dissertation, University of Tennessee.
- Wanous JP, Sullivan SE, Malinak J. (1989). The role of judgment calls in meta-analysis. Journal of Applied Psychology, 74, 259–264.
- Whitener EM. (1990). Confusion of confidence intervals and credibility intervals in meta-analysis. Journal of Applied Psychology, 75, 315–321.
