Methods of coping with social desirability bias: A review
Anton J. Nederhof
LISPOR, University of Leyden, Stationsplein 242, 2372 AR Leiden, The Netherlands
Search for more papers by this authorAnton J. Nederhof
LISPOR, University of Leyden, Stationsplein 242, 2372 AR Leiden, The Netherlands
Search for more papers by this authorAbstract
Social desirability is one of the most common sources of bias affecting the validity of experimental and survey research findings. From a self-presentational perspective, social desirability can be regarded as the resultant of two separate factors: self-deception and other-deception. Two main modes of coping with social desirability bias are distinguished. The first mode comprises two methods aimed at the detection and measurement of social desirability bias: the use of social desirability scales, and the rating of item desirability. A second category comprises seven methods to prevent or reduce social desirability bias, including the use of forced-choice items, the randomized response technique, the bogus pipeline, self-administration of the questionnaire, the selection of interviewers, and the use of proxy subjects. Not one method was found to excel completely and under all conditions in coping with both other-deceptive and self-deceptive social desirability bias. A combination of prevention and detection methods offers the best choice available.
References
- Arkin R. M. and Lake, E. A. (1983). ‘Plumbing the depths of the bogus pipeline: A reprise’. Journal of Research in Personality, 17: 81–88.
-
Atteslander, P. and
Kneubühler, H. V.
(1975).
Verzerrungen im Interview.
Westdeutscher Verlag,
Opladen, West Germany.
10.1007/978-3-322-88724-5 Google Scholar
- Barber, T. X. (1976). Pitfalls in Human Research: Ten Pivotal Points, Pergamon Press, New York.
- Baumeister, R. F. (1982). A self-presentational view of social phenomena, Psychological Bulletin, 91: 3–26.
- Berg, I. A. (1967). Response Set in Personality Assessment, Aldine Press, Chicago, Illinois.
- Blake B. F. and Heslin, R. (1971). ‘Evaluation apprehension and subject bias in experiments’, Journal of Experimental Research in Personality, 5: 57–63.
- Block, J. M. (1965). The Challenge of Response Set: Unfounding Meaning, Acquiescence. and Social Desirability in the MMPI, Appleton-Century-Crofts, New York.
- Bourke, P. D. (1984). ‘Estimation of proportions using symmetric randomized response designs’, Psychological Bulletin, 96: 166–172.
- Bradburn N. M. and Sudman, S. (1979). Improving Interview Methods and Questionnaire Design, Jossey-Bass, San Francisco, California.
- Bradburn, N. M. Sudman, S., Blair, E. and Stocking, C. (1978). ‘Question threat and response bias’, Public Opinion Quarterly, 42: 221–234.
- Brigham, J. C., Bloom, L. M., Gunn S. P. and Torok, T. (1974). ‘Attitude measurement via the bogus pipeline: A dry well?’ Representative Research in Social Psychology, 5: 97–114.
- Campbell D. T. and Stanley, J. C. (1966). Experimental and Quasi-Experimental Designs for Research, Rand McNally. Chicago, Illinois.
- Cohen, J. and Cohen, P. (1975). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, Wiley, New York.
- Cook T. D. and Campbell, D. T. (1979). Quasi-Experimentation, Rand McNally, Chicago, Illinois.
- Crandall, R. (1976). ‘Validation of self-report measures using ratings by others’, Sociological Methods and Research, 4: 380–400.
- Crandall, V. (1966). ‘Personality characteristics and social achievement behaviors associated with children's social desirability response tendencies’, Journal of Personality and Social Psychology, 4: 447–486.
- Cronbach, L. J. (1950). ‘Further evidence on response set and test design’, Educational and Psychological Measurement, 10: 3–31.
- Crowne D. P. and Marlowe, D. (1960). ‘A new scale of social desirability independent of psychopathology’, Journal of Consulting Psychology, 24: 344–354.
- Crowne D. P. and Marlowe, D. (1964). The Approval Motive: Studies in Evaluative Dependence, Wiley, New York.
- Dickensberger, D., Holtz, S. and Gniech, G. (1978). ‘Bedürfnis nach sozialer anerkennung: validierung der Marlowe-Crowne Social Desirability Scale über ein konzept individuell relevanter gruppen’, Diagnostica, 24: 24–38.
- Dillman, D. A. (1978). Mail and Telephone Surveys: The Total Design Method, Wiley, New York.
- Dohrenwend, B. S. (1969). ‘Interviewer biasing effects: towards a reconciliation of findings’, Public Opinion Quarterly, 33: 121–125.
- Dohrenwend, B. S., Colombotos, J. and Dohrenwend, B. P., (1968). ‘Social distance and interviewer effects’, Public Opinion Quarterly, 32: 410–422.
- Edgell, S. E., Himmelfarb, S. and Duchan, K. L. (1982). ‘Validity of responses in a randomized response model’, Sociological Methods and Research, 11, 89–100.
- Edwards, A. L. (1953). ‘The relationship between the judged desirability of a trait and the probability that the trait will be endorsed’, Journal of Applied Psychology, 37: 90–93.
- Edwards, A. L. (1957). The Social Desirability Variable in Personality and Assessment and Research, Dryden, New York.
- Edwards, A. L. (1970). The Measurement of Personality Traits by Scales and Inventories, Holt, Reinhard and Winston, New York.
- Edwards A. L. and Diers, C. J. (1962). ‘Social desirability and the factorial interpretation of the MMPI’, Educational and Psychological Measurement, 22: 501–509.
- Ganster, D. C., Hennessey H. W. and Luthans, F. (1983). ‘Social desirability response effects: Three alternative models’, Academy of Management Journal, 26: 321–331.
- Goffman, E. (1959). The Presentation of Self in Everyday Life, Doubleday, New York.
- Goudy W. J. and Potter, H. R. (1975). ‘Interview rapport: demise of a concept’, Public Opinion Quarterly, 39: 529–543.
- Gove W. R. and Geerken, M. R. (1977). ‘Response bias in surveys of mental health: an empirical investigation’, American Journal of Sociology, 82: 1289–1317.
- Grabitz-Gniech, G. (1971). ‘Bericht über eine analyse von sieven persönlichkeits-fragebogen’. Bericht aus der Sonderforschungsbereich 24, Universität Mannheim.
- Greenwald H. J. and Satow, Y. (1970). ‘A short social desirability scale’, Psychological Reports, 27: 131–135.
- Gur R. C. and Sackeim, M. A. (1979). ‘Self-deception: A concept in search of a phenomenon’, Journal of Personality and Social Psychology, 37: 147–169.
- Hermans, H. (1967). Motivatie en Prestatie, Swets and Zeitlinger, Amsterdam, The Netherlands.
- Himmelfarb, S. and Lickteig, C. (1982). Social desirability and the randomized response technique. Journal of Personality and Social Psychology, 43: 710–717.
- Humm, D. G. and Wadsworth, G. W. Jr (1939). The Humm-Wadsworth Temperament Scale, Doncaster G Humm, Los Angeles, California.
- Hyman, H. H., Cobb, W. J., Feldman, J. J., Hart C. W. and Stember, C. H. (1954). Interviewing in Social Research, University of Chicago Press, Chicago, Illinois.
- Jackson, D. N. (1967). Personality Research Form Manual, Research Psychologists Press, New York.
- Jones E. E. and Sigall, H. (1971). ‘The bogus pipeline: A new paradigm for measuring affect and attitude’, Psychological Bulletin, 76: 349–364.
- Kane, J. S. and Lawler, E. E. III (1978). ‘Methods of peer assessment’, Psychological Bulletin, 85: 555–586.
- Klassen, D., Hornstra R. K. and Anderson, P. B. (1976). ‘Influence of social desirability on symptom and mood reporting in a community survey’, Journal of Consulting and Clinical Psychology, 43, 448–452.
- Kuder, G. F. (1939). Preference Record, Science Research Associates, Chicago, Illinois.
- Lana, R. E. (1969). ‘ Pretest Sensitization’. In: R. Rosenthal and R. L. Rosnow (Eds) Artifact in Behavioral Research, Academic Press, New York.
- Larsen, K. S., Martin, H. J., Ettinger R. H. and Nelson, J. (1976). ‘Approval seeking, social cost, and agression: a scale and some dynamics’, Journal of Psychology, 94: 3–11.
- Locander, W., Sudman, S. and Bradburn, N. M. (1976). ‘An investigation of interview methods, threat, and response distortion’, Journal of the American Statistical Association, 71, 269–275.
- Martin H. J. and Greenstein, T. N. (1983). ‘Individual differences in status generalization: Effects of need for social approval, anticipated interpersonal contact, and instrumental task abilities’, Journal of Personality and Social Psychology, 45, 641–662.
- Martin, J. and Butcher, B. (1982). ‘The quality of proxy information. Some results from a large-scale study’, The Statistician, 31: 293–319.
- McCrae, R. R. (1982). ‘Consensual validation of personality traits: Evidence from self-reports and ratings’, Journal of Personality and Social Psychology, 43: 293–303.
- McCrae R. R. and Costa, P. T. (1983). ‘Social desirability scales: More substance than style’, Journal of Consulting and Clinical Psychology, 51: 882–888.
- McGuire, W. J. (1969). ‘ Suspiciousness of experimenter's intent’. In: R. Rosenthal and R. L. Rosnow (Eds). Artifact in Behavioral Research, Academic Press, New York.
- Meehl P. E. and Hathaway, S. R. (1946). ‘The K-factor as a suppressor variable in the MMPI’, Journal of Applied Psychology, 30, 525–564.
- Messick, S. (1968). ‘Response sets’. In: International Encyclopedia of the Social Sciences, 13: 492–496.
- Miller, J. P. (1981). ‘Complexities of the randomized response solution’, American Sociological Review, 46: 928–930.
- Millham, J. (1974). ‘Two components of need of approval score and their relationship to cheating following success and failure’, Journal of Research in Personality, 8, 378–392.
- Millham, J. and Kellogg, R. W. (1980). ‘Need for social approval: Impression management of self-deception?’ Journal of Research in Personality, 14: 445–457.
- Millham, J. and Jacobson, L. I. (1978). ‘ The need for social approval’. In: H. London and J. E. Exner (Eds) Dimensions of Personality, Wiley, New York.
- Nederhof, A. J. (1981). Beter Onderzoek. Bestrijding van Foutenbronnen in Sociaal-Wetenschappelijk Onderzoek, VUGA, The Hague, The Netherlands.
- Nederhof, A. J. (1983). ‘The effects of material incentives in mail surveys: Two studies’, Public Opinion Quarterly, 47: 103–111.
- Nederhof, A. J. (1984). ‘Visibility of response as mediating factor in equity research’, Journal of Social Psychology, 122: 211–215.
- Nederhof, A. J. (1985). Artifact in Social Science Research: Coping With Sources of Error in Data Collection, Irvington, New York.
- Nederhof A. J. and Zwier, A. G. (1983). ‘The “crisis” in social psychology, an empirical approach’, European Journal of Social Psychology, 13: 255–280.
- Nunnally, J. C. (1978). Psychometric Theory, McGraw Hill, New York.
- Orne, M. T. (1973). ‘ Communication by the total experimental situation’. In: P. Pliner, L. Krames and T. Alloway (Eds) Communication and Affect: Language and Thought, Academic Press, New York.
- Ostrom, T. M. (1973). ‘The bogus pipeline: A new ignis fatuus?’ Psychological Bulletin, 79: 776–783.
- Paulhus, D. L. (1981). ‘Statistical control of socially desirable responding in personality inventories: Principal-factor deletion’, Journal of Research in Personality, 15: 383–388.
- Paulhus, D. L. (1982). ‘Individual differences, impression management, and cognitive dissonance: Their concurrent operation in forced compliance’, Journal of Personality and Social Psychology, 43: 838–852.
- Paulhus, D. L. (1984). ‘Two-component models of socially desirable responding’, Journal of Personality and Social Psychology, 46 598–609.
- Phillips, D. L. (1971). Knowledge from What? Rand McNally, Chicago.
- Phillips, D. L. (1973). Abandoning Method, Jossey-Bass, San Francisco, California.
- Phillips D. L. and Clancy, K. J. (1970). ‘Response biases in field studies of mental illness’, American Sociological Review, 35: 503–515.
- Phillips D. L. and Clancy, K. J. (1972). ‘Some effects of “social desirability” in survey studies’, American Journal of Sociology, 77: 921–940.
- Quigley-Fernandez, B. and Tedeschi, J. T. (1978). ‘The bogus pipeline as lie detector: Two validity studies’, Journal of Personality and Social Psychology, 36: 247–256.
- Ramanaiah N. V. and Martin, H. J. (1980). ‘On the two-dimensional nature of the Marlowe-Crowne social desirability scale’, Journal of Personality Assessment, 44: 507–514.
-
Ries, M.,
Kalle R. J. and
Tedeschi, J. T.
(1981).
‘The bogus pipeline and attitude moderation following induced compliance: Misattribution of dissonance arousal or impression management inhibition?’
Journal of Social Psychology,
115: 247–258.
10.1080/00224545.1981.9711664 Google Scholar
- Rogers, T. F. (1976). ‘Interviews by telephone and in person: quality of responses and field performance’, Public Opinion Quarterly, 40: 51–65.
- Rorer, L. G. (1965). ‘The great response-style myth’, Psychological Bulletin, 63: 129–156.
- Rosenberg, M. J. (1969). ‘ The conditions and consequences of evaluation apprehension’. In: R. Rosenthal and R. L. Rosnow (Eds) Artifact in Behavioral Research, Academic Press, New York.
- Rosenthal, R. (1976). Experimenter Effects in Behavioral Research, Irvington, New York.
- R. Rosenthal and R. L. Rosnow (Eds (1969). Artifact in Behavioral Research, Academic Press, New York.
- Rosenthal, R. and Rosnow, R. L. (1975). The Volunteer Subject, Wiley, New York.
- Rosnow R. L. and Aiken, L. S. (1973). ‘Mediation of artifacts in behavioral research’, Journal of Experimental Social Psychology, 9: 181–201.
- Sackeim H. A. and Gur, R. C. (1978). ‘ Self-deception, self-confrontation, and consciousness’. In: G. I. Schwartz and R. D. Shapiro (Eds) Consciousness and Self-regulation. Advances in Research and Theory, Vol. 2, Plenum, New York.
- Sackeim H. A. and Gur, R. C. (1979). ‘Self-deception, other-deception, and self-reported psychopathology’, Journal of Consulting and Clinical Psychology, 47: 213–215.
- Schuessler, K. F. (1982). Measuring Social Life Feelings, Jossey-Bass, San Francisco.
- Schuessler, K. F., Hittle, D. and Cardascia, J. (1978). ‘Measuring responding desirability with attitude-opinion items’, Social Psychology, 41: 224–235.
- Scott, W. A. (1963). ‘Social desirability and individual conceptions of the desirable’, Journal of Abnormal and Social Psychology, 67: 574–585.
- Scott, W. A. (1968). ‘ Attitude measurement’. In: G. Lindzey and E. Aronson (Eds) The Handbook of Social Psychology, Volume II, Addison Wesley, Reading, Massachusetts.
- Shulman A. D. and Silverman, I. (1974). ‘Social desirability and need approval: some paradoxial data and a conceptual re-evaluation’, British Journal of Social and Clinical Psychology, 13: 27–32.
- Sigall, H. and Page, R. (1971). ‘Current stereotypes: A little fading, a little faking’, Journal of Personality and Social Psychology, 18: 247–255.
- Soeken K. L. and Macready, G. B. (1982). ‘Respondents' perceived protection when using randomized response’, Psychological Bulletin, 92: 487–489.
- Stocking, C. (1979). ‘ Re-interpreting the Marlowe-Crowne Scale’. In: N. M. Bradburn, S. Sudman and Associates (Eds) Improving Interview Methods and Questionnaire Design, Jossey-Bass, San Francisco.
- Strickland, B. R. (1977). ‘ Approval motivation’. In: T. Blass (Ed.) Personality Variables in Social Behavior, Erlbaum, Hillsdale, New Jersey.
- Sudman, S. and Bradburn, N. M. (1974). Response Effects in Surveys, Aldine, Chicago, Illinois.
- Tracy P. E. and Fox, J. A. (1981). ‘The validity of randomized responses for sensitive measurements’, American Sociological Review, 46: 187–200.
- Warner, S. L. (1965). ‘Randomized response: A survey technique for eliminating evasive answer bias’, Journal of the American Statistical Association, 60: 63–69.
- Weber S. J. and Cook, T. D. (1972). ‘Subject effects in laboratory research: an examination of subject roles, demand characteristics, and valid inference.’ Psychological Bulletin, 77: 273–295.
- Weiss, C. H. (1968). ‘Validity of welfare mother's interview response’, Public Opinion Quarterly, 32: 622–633.
- Weiss, C. H. (1969). ‘Interviewer biasing effects: toward a reconciliation of findings’, Public Opinion Quarterly, 33: 127–129.
- Weiss, C. H. (1970). ‘Interaction in the research interview: the effects of rapport on response’. In: Proceedings of the Social Statistics Section, American Statistical Association, 17–20.
-
Wicklund, R. A.
(1975).
‘ Objective self-awareness’.
In: L. Berkowitz (Ed.)
Advances in Experimental Social Psychology,
Vol. 8.
Academic Press,
New York.
10.1016/S0065-2601(08)60252-X Google Scholar
- Wiggins, J. S. (1959). ‘Interrelationships among MMPI measures of dissimulation under standard and social desirability instructions’, Journal of Consulting Psychology, 23: 419–427.
- Williams, J. A. (1968). ‘Interviewer role performance: a further note on bias in the information interview’, Public Opinion Quarterly, 32: 287–294.
- Williams, J. A. (1969). ‘Interviewer biasing effects: toward a reconciliation of findings’, Public Opinion Quarterly, 33: 125–127.
- Wise, S. L. (1980). ‘An approach to sensitive questions: the randomized response technique’. Paper presented at the annual meetings of the American Educational Research Association, Boston, Massachusetts, April.
- Wiseman, F. (1972). ‘Methodological bias in public opinion surveys’, Public Opinion Quarterly, 36: 105–108.