Along the Convergent–Divergent Continuum: The Role of Task Structure in the PISA Creative Thinking Assessment
Corresponding Author
Selcuk Acar
Department of Educational Psychology, University of North Texas, Denton, Texas, USA
Correspondence:
Selcuk Acar ([email protected])
Search for more papers by this authorYuyang Shen
Department of Educational Psychology, University of North Texas, Denton, Texas, USA
Search for more papers by this authorCorresponding Author
Selcuk Acar
Department of Educational Psychology, University of North Texas, Denton, Texas, USA
Correspondence:
Selcuk Acar ([email protected])
Search for more papers by this authorYuyang Shen
Department of Educational Psychology, University of North Texas, Denton, Texas, USA
Search for more papers by this authorABSTRACT
Creativity tests, like creativity itself, vary widely in their structure and use. These differences include instructions, test duration, environments, prompt and response modalities, and the structure of test items. A key factor is task structure, referring to the specificity of the number of responses requested for a given prompt. Classic creativity assessments often use divergent thinking tasks, which allow for multiple responses. In contrast, other measures, such as insight tasks or the Remote Associates Test, require a single correct answer. This distinction suggests that a creativity test's correlates could depend on its placement along the convergent–divergent continuum. The PISA Creative Thinking assessment leans toward the divergent end, as none of its items require a single correct answer. However, it differs from traditional divergent thinking tests by not explicitly instructing participants to generate as many responses as possible. Instead, PISA items allow varying numbers of responses—some requiring one, others two or three. This variation reflects different levels of divergence, with one-response items being more convergent than three-response items. We argue that this difference in task structure should be considered when examining the relationship between PISA creativity scores and factors like academic achievement and socioeconomic status.
Conflicts of Interest
The authors declare no conflicts of interest.
Open Research
Data Availability Statement
Data sharing is not applicable to this article as no new data were created or analyzed in this study.
References
- Acar, S. 2023. “Does the Task Structure Impact the Fluency Confound in Divergent Thinking? An Investigation With TTCT-Figural.” Creativity Research Journal 35, no. 1: 1–14. https://doi.org/10.1080/10400419.2022.2044656.
- Acar, S., D. Dumas, P. Organisciak, and K. Berthiaume. 2024. “Measuring Original Thinking in Elementary School: Development and Validation of a Computational Psychometric Approach.” Journal of Educational Psychology 116, no. 6: 953–981. https://doi.org/10.1037/edu0000844.
- Acar, S., U. Ogurlu, and A. Zorychta. 2023. “Exploration of Discriminant Validity in Divergent Thinking Tasks: A Meta-Analysis.” Psychology of Aesthetics, Creativity, and the Arts 17, no. 6: 705–724. https://doi.org/10.1037/aca0000469.
- Acar, S., and M. A. Runco. 2015. “Thinking in Multiple Directions: Hyperspace Categories in Divergent Thinking.” Psychology of Aesthetics, Creativity, and the Arts 9, no. 1: 41–53.
- Acar, S., M. A. Runco, and H. Park. 2020. “What Should People Be Told When They Take a Divergent Thinking Test? A Meta-Analytic Review of Explicit Instructions for Divergent Thinking.” Psychology of Aesthetics, Creativity, and the Arts 14, no. 1: 39–49. https://doi.org/10.1037/aca0000256.
- Acar, S., H. Tadik, R. Uysal, D. Myers, and B. Inetas. 2023. “Socio-Economic Status and Creativity: A Meta-Analysis.” Journal of Creative Behavior 57, no. 1: 138–172.
- Amabile, T. M. 1996. Creativity in Context: An Update to the Social Psychology of Creativity. Westview Press.
- Barbot, B. 2018. “The Dynamics of Creative Ideation: Introducing a New Assessment Paradigm.” Frontiers in Psychology 9: 2529. https://doi.org/10.3389/fpsyg.2018.02529.
- Baird, B., J. Smallwood, M. D. Mrazek, J. W. Kam, M. S. Franklin, and J. W. Schooler. 2012. “Inspired by Distraction: Mind Wandering Facilitates Creative Incubation.” Psychological Science 23, no. 10: 1117–1122. https://doi.org/10.1177/0956797612446024.
- Barth, P., and G. Stadtmann. 2024. “Creativity in the West and the East: A Meta-Analysis of Cross-Cultural Differences.” Creativity Research Journal 1-47: 1–47. https://doi.org/10.1080/10400419.2024.2369442.
- Beghetto, R. A., and J. C. Kaufman. 2009. “Intellectual Estuaries: Connecting Learning and Creativity in Programs of Advanced Academics.” Journal of Advanced Academics 20, no. 2: 296–324. https://doi.org/10.1177/1932202X0902000205.
10.1177/1932202X0902000205 Google Scholar
- Beghetto, R. A., and J. A. Plucker. 2016. “ Revisiting the Relationship Among Schooling, Learning, and Creativity.” In Creativity and Reason in Cognitive Development, edited by J. C. Kaufman and J. Baer, 72–91. Cambridge University Press. https://doi.org/10.1017/CBO9781139941969.005.
10.1017/CBO9781139941969.005 Google Scholar
- Benedek, M., T. Könen, and A. C. Neubauer. 2012. “Associative Abilities Underlying Creativity.” Psychology of Aesthetics, Creativity, and the Arts 6, no. 3: 273–281. https://doi.org/10.1037/a0027059.
- Benedek, M., C. Mühlmann, E. Jauk, and A. C. Neubauer. 2013a. “Assessment of Divergent Thinking by Means of the Subjective Top-Scoring Method: Effects of the Number of Top-Ideas and Time-On-Task on Reliability and Validity.” Psychology of Aesthetics, Creativity, and the Arts 7, no. 4: 341–352.
- Benedek, M., C. Mühlmann, E. Jauk, and A. C. Neubauer. 2013b. “Assessment of Divergent Thinking by Means of the Subjective Top-Scoring Method: Effects of the Number of Top-Ideas and Time-On-Task on Reliability and Validity.” Psychology of Aesthetics, Creativity, and the Arts 7: 341–349. https://doi.org/10.1037/a0033644.
- Bowles, S., H. Gintis, and M. Osborne. 2001. “The Determinants of Earnings: A Behavioral Approach.” Journal of Economic Literature 39, no. 4: 1137–1176.
- Callan, G. L., L. DaVia Rubenstein, L. M. Ridgley, K. Speirs Neumeister, M. Hernandez Finch, and D. Longhurst. 2021. “Measuring and Predicting Divergent Thinking With a Self-Report Questionnaire, Teacher Rating Scale, and Self-Regulated Learning Microanalysis.” Journal of Psychoeducational Assessment 39, no. 5: 549–562. https://doi.org/10.1177/07342829211005288.
- Carson, S. H., J. B. Peterson, and D. M. Higgins. 2005. “Reliability, Validity, and Factor Structure of the Creative Achievement Questionnaire.” Creativity Research Journal 17, no. 1: 37–50. https://doi.org/10.1207/s15326934crj1701_4.
- Clark, P. M., and H. L. Mirels. 1970. “Fluency as a Pervasive Element in the Measurement of Creativity.” Journal of Educational Measurement 7, no. 2: 83–86. https://doi.org/10.1111/j.1745-3984.1970.tb00699.x.
- Forthmann, B., C. Szardenings, and H. Holling. 2020. “Understanding the Confounding Effect of Fluency in Divergent Thinking Scores: Revisiting Average Scores to Quantify Artifactual Correlation.” Psychology of Aesthetics, Creativity, and the Arts 14, no. 1: 94–112. https://doi.org/10.1037/aca0000196.
- Guilford, J. P. 1967. The Nature of Human Intelligence. McGraw-Hill.
- Guilford, J. P., P. R. Christensen, P. R. Merrifield, and R. C. Wilson. 1960. Alternative Uses Manual. Sheridan Supply Co.
- Hocevar, D. 1979. “Ideational Fluency as a Confounding Factor in the Measurement of Originality.” Journal of Educational Psychology 71, no. 2: 191–196. https://doi.org/10.1037/0022-0663.71.2.191.
- Hornberg, J., and R. Reiter-Palmon. 2017. “ Creativity and the Big Five Personality Traits: Is the Relationship Dependent on the Creativity Measure?” In The Cambridge Handbook of Creativity and Personality Research, edited by G. J. Feist, R. Reiter-Palmon, and J. C. Kaufman, 275–293. Cambridge University Press. https://doi.org/10.1017/9781316228036.015.
10.1017/9781316228036.015 Google Scholar
- Karwowski, M. 2014. “Creative Mindsets: Measurement, Correlates, Consequences.” Psychology of Aesthetics, Creativity, and the Arts 8, no. 1: 62–70. https://doi.org/10.1037/a0034898.
- Karwowski, M. 2022. “School Does Not Kill Creativity.” European Psychologist 27, no. 3: 263–275. https://doi.org/10.1027/1016-9040/a000449.
- Kaufman, J. C. 2012. “Counting the Muses: Development of the Kaufman Domains of Creativity Scale (K-DOCS).” Psychology of Aesthetics, Creativity, and the Arts 6, no. 4: 298–308. https://doi.org/10.1037/a0029751.
- Kaufman, J. C., J. A. Plucker, and J. Baer. 2008. Essentials of Creativity Assessment. John Wiley & Sons.
- Mednick, M. T., and S. Halpern. 1962. Remote Associates Test (RAT) [Database Record]. APA PsycTests.
- Miroshnik, K. G., B. Forthmann, M. Karwowski, and M. Benedek. 2023. “The Relationship of Divergent Thinking With Broad Retrieval Ability and Processing Speed: A Meta-Analysis.” Intelligence 98: 101739. https://doi.org/10.1016/j.intell.2023.101739.
- Morris, M. W., and K. Leung. 2010. “Creativity East and West: Perspectives and Parallels.” Management and Organization Review 6, no. 3: 313–327. https://doi.org/10.1111/j.1740-8784.2010.00193.x.
- Ng, T. W. H., L. T. Eby, K. L. Sorensen, and D. C. Feldman. 2005. “Predictors of Objective and Subjective Career Success: A Meta-Analysis.” Personnel Psychology 58, no. 2: 367–408.
- Nusbaum, E. C., and P. J. Silvia. 2011. “Are Intelligence and Creativity Really So Different?: Fluid Intelligence, Executive Processes, and Strategy Use in Divergent Thinking.” Intelligence 39, no. 1: 36–45. https://doi.org/10.1016/j.intell.2010.11.002.
- OECD. 2022. “Thinking Outside the Box: The PISA 2022 Creative Thinking Assessment.” https://www.oecd.org/en/topics/sub-issues/creative-thinking/pisa-2022-creative-thinking.html.
- OECD. 2024. PISA 2022 Results (Volume III): Creative Minds, Creative Schools. PISA, OECD Publishing, Paris. https://doi.org/10.1787/765ee8c2-en.
10.1787/765ee8c2-en Google Scholar
- Reiter-Palmon, R., and N. J. Arreola. 2015. “Does Generating Multiple Ideas Lead to Increased Creativity? A Comparison of Generating One Idea vs. Many.” Creativity Research Journal 27, no. 4: 369–374. https://doi.org/10.1080/10400419.2015.1087274.
- Paek, S. H., A. M. A. Alabbasi, S. Acar, and M. A. Runco. 2021. “Is More Time Better for Divergent Thinking? A Meta-Analysis of the Time-On-Task Effect on Divergent Thinking.” Thinking Skills and Creativity 41: 100894. https://doi.org/10.1016/j.tsc.2021.100894.
- Parnes, S. J. 1961. “Effects of Extended Effort in Creative Problem Solving.” Journal of Educational Psychology 52, no. 3: 117–122. https://doi.org/10.1037/h0044650.
- Piaget, J. 1973. To Understand Is to Invent: The Future of Education. Grossman.
- Plucker, J. A., M. Qian, and S. L. Schmalensee. 2014. “Is What You See What You Really Get? Comparison of Scoring Techniques in the Assessment of Real-World Divergent Thinking.” Creativity Research Journal 26, no. 2: 135–143. https://doi.org/10.1080/10400419.2014.901023.
- Plucker, J. A., and J. S. Renzulli. 1999. “ Psychometric Approaches to the Study of Human Creativity.” In Handbook of Creativity, edited by R. J. Sternberg, 35–61. Cambridge University Press.
- Puccio, G. J., C. Burnett, S. Acar, J. A. Yudess, M. Holinger, and J. F. Cabra. 2020. “Creative Problem Solving in Small Groups: The Effects of Creativity Training on Idea Generation, Solution Creativity, and Leadership Effectiveness.” Journal of Creative Behavior 54, no. 2: 453–471. https://doi.org/10.1002/jocb.381.
- Rawlings, B. S., D. Chetwynd-Talbot, E. Husband, et al. 2025. “Divergent Thinking Is Linked With Convergent Thinking: Implications for Models of Creativity.” Thinking & Reasoning: 1–23. https://doi.org/10.1080/13546783.2025.2485059.
10.1080/13546783.2025.2485059 Google Scholar
- Reiter-Palmon, R., B. Forthmann, and B. Barbot. 2019. “Scoring Divergent Thinking Tests: A Review and Systematic Framework.” Psychology of Aesthetics, Creativity, and the Arts 13, no. 2: 144–152. https://doi.org/10.1037/aca0000227.
- Reiter-Palmon, R., M. Y. Illies, L. Kobe Cross, C. Buboltz, and T. Nimps. 2009. “Creativity and Domain Specificity: The Effect of Task Type on Multiple Indexes of Creative Problem-Solving.” Psychology of Aesthetics, Creativity, and the Arts 3, no. 2: 73–80. https://doi.org/10.1037/a0013410.
- Reiter-Palmon, R., M. D. Mumford, J. O'Connor Boes, and M. A. Runco. 1997. “Problem Construction and Creativity: The Role of Ability, Cue Consistency, and Active Processing.” Creativity Research Journal 10, no. 1: 9–23. https://doi.org/10.1207/s15326934crj1001_2.
- Runco, M. A. 1991. Divergent Thinking. Ablex Publishing Corporation.
- Runco, M. A. 2008. “Commentary: Divergent Thinking Is Not Synonymous With Creativity.” Psychology of Aesthetics, Creativity, and the Arts 2, no. 2: 93–96. https://doi.org/10.1037/1931-3896.2.2.93.
10.1037/1931-3896.2.2.93 Google Scholar
- Runco, M. A., and S. Acar. 2012. “Divergent Thinking as an Indicator of Creative Potential.” Creativity Research Journal 24, no. 1: 66–75. https://doi.org/10.1080/10400419.2012.652929.
- M. A. Runco, and S. Acar, eds. 2024. Handbook of Creativity Assessment. Edward Elgar Publishing.
10.4337/9781839102158 Google Scholar
- Runco, M. A., and R. E. Charles. 1993. “Judgments of Originality and Appropriateness as Predictors of Creativity.” Personality and Individual Differences 15, no. 5: 537–546. https://doi.org/10.1016/0191-8869(93)90337-3.
- Runco, M. A., J. J. Illies, and R. Eisenman. 2005. “Creativity, Originality, and Appropriateness: What Do Explicit Instructions Tell Us About Their Relationships?” Journal of Creative Behavior 39, no. 2: 137–148. https://doi.org/10.1002/j.2162-6057.2005.tb01255.x.
- Runco, M. A., and G. J. Jaeger. 2012. “The Standard Definition of Creativity.” Creativity Research Journal 24, no. 1: 92–96. https://doi.org/10.1080/10400419.2012.650092.
- Said-Metwaly, S., B. Fernández-Castilla, E. Kyndt, and W. Van den Noortgate. 2020. “Testing Conditions and Creative Performance: Meta-Analyses of the Impact of Time Limits and Instructions.” Psychology of Aesthetics, Creativity, and the Arts 14, no. 1: 15–38. https://doi.org/10.1037/aca0000244.
- Saretzki, J., R. Andrae, B. Forthmann, and M. Benedek. 2024. “Investigation of Response Aggregation Methods in Divergent Thinking Assessments.” Journal of Creative Behavior. https://doi.org/10.1002/jocb.1527.
- Saretzki, J., B. Forthmann, M. Benedek, et al. 2024. “A Systematic Quantitative Review of Divergent Thinking Assessments.” Psychology of Aesthetics, Creativity, and the Arts. https://doi.org/10.1037/aca0000691.
- Silvia, P. J. 2008. “Discernment and Creativity: How Well Can People Identify Their Most Creative Ideas?” Psychology of Aesthetics, Creativity, and the Arts 2, no. 3: 139–146. https://doi.org/10.1037/1931-3896.2.3.139.
10.1037/1931-3896.2.3.139 Google Scholar
- Silvia, P. J. 2011. “Subjective Scoring of Divergent Thinking: Examining the Reliability of Unusual Uses, Instances, and Consequences Tasks.” Thinking Skills and Creativity 6, no. 1: 24–30. https://doi.org/10.1016/j.tsc.2010.06.001.
- Silvia, P. J. 2015. “Intelligence and Creativity Are Pretty Similar After All.” Educational Psychology Review 27, no. 4: 599–606. https://doi.org/10.1007/s10648-015-9299-1.
- Silvia, P. J., B. Wigert, R. Reiter-Palmon, and J. C. Kaufman. 2012. “Assessing Creativity With Self-Report Scales: A Review and Empirical Evaluation.” Psychology of Aesthetics, Creativity, and the Arts 6, no. 1: 19–34. https://doi.org/10.1037/a0024071.
- Silvia, P. J., B. P. Winterstein, J. T. Willse, et al. 2008. “Assessing Creativity With Divergent Thinking Tasks: Exploring the Reliability and Validity of New Subjective Scoring Methods.” Psychology of Aesthetics, Creativity, and the Arts 2, no. 2: 68–85. https://doi.org/10.1037/1931-3896.2.2.68.
10.1037/1931-3896.2.2.68 Google Scholar
- Sirin, S. R. 2005. “Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research.” Review of Educational Research 75, no. 3: 417–453. https://doi.org/10.3102/00346543075003417.
- Stein, M. I. 1953. “Creativity and Culture.” Journal of Psychology 36, no. 2: 311–322. https://doi.org/10.1080/00223980.1953.9712897.
- Taylor, C. W. 1988. “ Various Approaches to and Definitions of Creativity.” In The Nature of Creativity: Contemporary Psychological Perspectives, edited by R. J. Sternberg, 99–121. Cambridge University Press.
- Tierney, P., and S. M. Farmer. 2002. “Creative Self-Efficacy: Its Potential Antecedents and Relationship to Creative Performance.” Academy of Management Journal 45, no. 6: 1137–1148. https://doi.org/10.5465/3069429.
- Torrance, E. P. 1998. The Torrance Tests of Creative Thinking Norms—Technical Manual Figural (Streamlined) Forms A & B. Scholastic Testing Service, Inc.
- Treffinger, D. J., and E. C. Selby. 2004. “Problem Solving Style: A New Approach to Understanding and Using Individual Differences.” Korean Journal of Thinking and Problem Solving 14, no. 1: 5–10.
- Wallach, M. A., and N. Kogan. 1965. Modes of Thinking in Young Children: A Study of the Creativity–Intelligence Distinction. Holt, Rinehart, & Winston.
- White, K. R. 1982. “The Relation Between Socioeconomic Status and Academic Achievement.” Psychological Bulletin 91, no. 3: 461–481. https://doi.org/10.1037/0033-2909.91.3.461.
- Zarnegar, Z., D. Hocevar, and W. B. Michael. 1988. “Components of Original Thinking in Gifted Children.” Educational and Psychological Measurement 48, no. 1: 5–16. https://doi.org/10.1177/001316448804800103.