Writing to advance knowledge: The impact of readability on knowledge diffusion in OSCM
Seongkyoon Jeong
W.P. Carey School of Business, Arizona State University, Tempe, Arizona, USA
Search for more papers by this authorCorresponding Author
Zachary S. Rogers
Colorado State University, Fort Collins, Colorado, USA
Correspondence
Zachary S. Rogers, Assistant Professor of Supply Chain Management, Colorado State University, Fort Collins, CO
Email: [email protected]
Search for more papers by this authorSeongkyoon Jeong
W.P. Carey School of Business, Arizona State University, Tempe, Arizona, USA
Search for more papers by this authorCorresponding Author
Zachary S. Rogers
Colorado State University, Fort Collins, Colorado, USA
Correspondence
Zachary S. Rogers, Assistant Professor of Supply Chain Management, Colorado State University, Fort Collins, CO
Email: [email protected]
Search for more papers by this authorAbstract
The sophistication of academic research often creates a cognitive barrier for readers when they understand and utilize new knowledge. Cognizant of this issue, scholars in various fields, including Operations and Supply Chain Management (OSCM), have called for improved communication in academic research. Readability is a key pillar of written communication and is particularly important in OSCM. This is partially because OSCM articles tend to be diverse in terms of methods, theoretical lenses used, and author origins. OSCM is also a field where knowledge is created with the purpose of interfacing with real business problems closely and engaging with diverse external stakeholders. The purpose of this study is to explore the relationship between readability and knowledge diffusion in academic OSCM research. Using cognitive load as the theoretical lens for readability, we analyze a full-text dataset of 1476 articles published in leading OSCM journals between 1998 and 2018. We find that readability has a positive impact on citations garnered. This relationship holds over 3-year short-term spans and 6-year long-term spans, indicating lasting effects. In addition, the results show that the impact of readability on knowledge diffusions is nonlinear. This finding confirms the additive nature of cognitive load and suggests that there is a level authors and journal editors should achieve to make their work more understandable and more likely to be diffused. Suggestions are made to help researchers reduce cognitive loads and to increase the likelihood that knowledge generated in their research is more likely to be disseminated by future researchers.
Supporting Information
Filename | Description |
---|---|
deci12543-sup-0001-Appendix.docx37.3 KB | Table A1. Robustness Check with Rounded Readability Measure Dummy Variables Table A2. Robustness Check with Alternative Author Visibility Measures Table A3. Robustness Check with FRE and FKG |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- Allison, P. (2012) Do we really need zero-inflated models? Statistical horizons. https://statisticalhorizons.com/zero-inflated-models
- Bentler, P.M. (1990) Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238.
- Bhowmick, S., Chandra, A., Harper, J.S. & Sweetin, V. (2015) Collaborative learning using a project across multiple business courses: a cognitive load and knowledge convergence approach. Decision Sciences Journal of Innovative Education, 13(2), 197–219. https://doi.org/10.1111/dsji.12060
- Bonifay, W.E., Reise, S.P., Scheines, R. & Meijer, R.R. (2015) When are multidimensional data unidimensional enough for structural equation modeling? An evaluation of the DETECT multidimensionality index. Structural Equation Modeling: A Multidisciplinary Journal, 22(4), 504–516.
- Bottle, R.T., Rennie, J.S., Russ, S. & Sardar, Z. (1983) Changes in the communication of chemical information I: some effects of growth. Journal of Information Science, 6(4), 103–108. https://doi.org/10.1177/016555158300600402
- Brandt, P.T. & Williams, J.T. (2001) A linear Poisson autoregressive model: the Poisson AR (p) model. Political Analysis, 9(2), 164–184.
10.1093/oxfordjournals.pan.a004869 Google Scholar
- Brown, S.W., Webster, F.E., Steenkamp, J.-B.E., Wilkie, W.L., Sheth, J.N., Sisodia, R.S., Kerin, R.A., MacInnis, D.J., McAlister, L., Raju, J.S., Bauerly, R.J., Johnson, D.T., Singh, M. & Staelin, R. (2005) Marketing renaissance: opportunities and imperatives for improving marketing thought, practice, and infrastructure. Journal of Marketing, 69(4), 1–25.
- Burke, L.A. (2007) Lessons learned from instructional design theory: an application in management education. Business Communication Quarterly, 70(4), 414–430. https://doi.org/10.1177/1080569907309009
10.1177/1080569907309009 Google Scholar
- Campbell, D., Picard-Aitken, M., Côté, G., Caruso, J., Valentim, R., Edmonds, S., Williams, G. T., Macaluso, B., Robitaille, J.-P., Bastien, N., Laframboise, M.-C., Lebeau, L.-M., Mirabel, P., Larivière, V., & Archambault, É. (2010) Bibliometrics as a performance measurement tool for research evaluation: the case of research funded by the National Cancer Institute of Canada. American Journal of Evaluation, 31(1), 66–83.
- Carter, C.R., Rogers, D.S. & Choi, T.Y. (2015) Toward the theory of the supply chain. Journal of Supply Chain Management, 51(2), 89–97. https://doi.org/10.1111/jscm.12073
- Causse, M., Chua, Z.K. & Rémy, F. (2019) Influences of age, mental workload, and flight experience on cognitive performance and prefrontal activity in private pilots: a fNIRS study. Scientific Reports, 9(1), 1–12. https://doi.org/10.1038/s41598-019-44082-w
- Cohen, K.B., Johnson, H.L., Verspoor, K., Roeder, C. & Hunter, L.E. (2010) The structural and content aspects of abstracts versus bodies of full text journal articles are different. BMC Bioinformatics, 11(1), 492. https://doi.org/10.1186/1471-2105-11-492
- Cudeck, R. & Klebe, K.J. (2002) Multiphase mixed-effects models for repeated measures data. Psychological Methods, 7(1), 41.
- Davis, D.F., Golicic, S.L. & Boerstler, C.N. (2011) Benefits and challenges of conducting multiple methods research in marketing. Journal of the Academy of Marketing Science, 39(3), 467–479. https://doi.org/10.1007/s11747-010-0204-7
- De Jong, T. (2010) Cognitive load theory, educational research, and instructional design: some food for thought. Instructional Science, 38, 105–134. https://doi.org/10.1007/s11251-009-9110-0
- DeLeeuw, K.E. & Mayer, R.E. (2008) A comparison of three measures of cognitive load: evidence for separable measures of intrinsic, extraneous, and germane load. Journal of Educational Psychology, 100(1), 223–234. https://doi.org/10.1037/0022-0663.100.1.223
- Dibbern, J. & Krancher, O. (2012) Learning software-maintenance tasks in offshoring projects: a cognitive-load perspective [Application/pdf]. https://doi.org/10.7892/BORIS.39356
10.7892/BORIS.39356 Google Scholar
- Didegah, F. & Thelwall, M. (2013) Which factors help authors produce the highest impact research? Collaboration, journal and document properties. Journal of Informetrics, 7(4), 861–873. https://doi.org/10.1016/j.joi.2013.08.006
- Dolnicar, S. & Chapple, A. (2015) The readability of articles in tourism journals. Annals of Tourism Research, 52, 161–166. https://doi.org/10.1016/j.annals.2015.03.003
- Dooley, K.J. (2009) The empiricism-modeling dichotomy in operations and supply chain management. Journal of Supply Chain Management, 45(1), 38–43. https://doi.org/10.1111/j.1745-493X.2009.03154.x
- Eltorai, A.E., Naqvi, S.S., Ghanian, S., Eberson, C.P., Weiss, A.-P.C., Born, C.T. & Daniels, A. H. (2015) Readability of invasive procedure consent forms. Clinical and Translational Science, 8(6), 830–833.
- Fakhoury, S., Ma Venera Arnaoudova, Y., Adesope, O., Ma, Y. & Arnaoudova, V. (2018) The effect of poor source code lexicon and readability on developers’ cognitive load. In: ICPC '18: Proceedings of the 26th Conference on Program Comprehension, May 28–29, Gothenburg, Sweden. New York: Association for Computing Machinery, pp. 286–296. https://doi.org/10.1145/3196321.3196347
10.1145/3196321.3196347 Google Scholar
- Fang, B., Ye, Q., Kucukusta, D. & Law, R. (2016) Analysis of the perceived value of online tourism reviews: influence of readability and reviewer characteristics. Tourism Management, 52, 498–506. https://doi.org/10.1016/j.tourman.2015.07.018
- Flesch, R. (1948) A new readability yardstick. Journal of Applied Psychology, 32(3), 221–233.
- Flora, D.B. (2008) Specifying piecewise latent trajectory models for longitudinal data. Structural Equation Modeling: A Multidisciplinary Journal, 15(3), 513–533.
- Fry, E. (1968) A readability formula that saves time. Journal of Reading, 11(7), 575–578.
- Gazni, A. (2011) Are the abstracts of high impact articles more readable? Investigating the evidence from top research institutions in the world. Journal of Information Science, 37(3), 273–281. https://doi.org/10.1177/0165551511401658
- Gilbert, N.G. (1977) Referencing as persuasion. Social Studies of Science, 7(1), 112–122.
- Graff, G. (2000) Scholars and sound bites: the myth of academic difficulty. PMLA, 115(5), 1041. https://doi.org/10.2307/463269
10.2307/463269 Google Scholar
- Guerini, M., Pepe, A. & Lepri, B. (2012) Do linguistic style and readability of scientific abstracts affect their virality? Sixth international AAAI conference on weblogs and social media.
- Harris, T.L. & Hodges, R.E. (1995) The literacy dictionary: the vocabulary of reading and writing. (Vol., 138). Newark, DE: International Reading Association.
- Hartley, J. (2016) Is time up for the Flesch measure of reading ease? Scientometrics, 107(3), 1523–1526. https://doi.org/10.1007/s11192-016-1920-7
- Hirsch, J.E. (2005) An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences, 102(46), 16569–16572.
- Huang, W., Eades, P. & Hong, S.-H. (2009) Measuring effectiveness of graph visualizations: a cognitive load perspective. Information Visualization, 8(3), 139–152. https://doi.org/10.1057/ivs.2009.10
- Jacobs, N. (2001) Scholarly communication, the information chain and technology: analyses and reflexions. Loughborough, UK: Loughborough University.
- Jamadar Sharna D. (2020) The CRUNCH model does not account for load-dependent changes in visuospatial working memory in older adults. Neuropsychologia, 142, 107446. https://doi.org/10.1016/j.neuropsychologia.2020.107446
- Judge, T.A., Cable, D.M., Colbert, A.E. & Rynes, S.L. (2007) What causes a management article to be cited—article, author, or journal? Academy of Management Journal, 50(3), 491–506.
- Kaiser, H.F. (1960) The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151.
- Kirkland, M.R. & Saunders, M.A.P. (1991) Maximizing student performance in summary writing: managing cognitive load. TESOL Quarterly, 25(1), 105. https://doi.org/10.2307/3587030
- Kirsh, D. (2000) A few thoughts on cognitive overload. Intellectica, 2000/1(30), 19–51.
- Laker, L.F., Froehle, C.M., Windeler, J.B. & Lindsell, C.J. (2018) Quality and efficiency of the clinical decision-making process: information overload and emphasis framing. Production and Operations Management, 27(12), 2213–2225. https://doi.org/10.1111/poms.12777
- Laughlin, G.H. (1969) SMOG grading-a new readability formula. Journal of Reading, 12(8), 639–646.
- Lee, S. & French, N. (2011) The readability of academic papers in the Journal of Property Investment & Finance. Journal of Property Investment & Finance, 29(6), 693–704. https://doi.org/10.1108/14635781111171814
10.1108/14635781111171814 Google Scholar
- Lei, L. & Yan, S. (2016) Readability and citations in information science: evidence from abstracts and articles of four journals (2003–2012). Scientometrics, 108(3), 1155–1169. https://doi.org/10.1007/s11192-016-2036-9
- Loveland, J., Whatley, A., Ray, B. & Reidy, R. (1973) An analysis of the readability of selected management journals. Academy of Management Journal, 16(3), 522–524. https://doi.org/10.5465/255014
- Maloni & Carter. (2018) Publication productivity in the SCM discipline: 2014–2016. Transportation Journal, 57(1), 1. https://doi.org/10.5325/transportationj.57.1.0001
- Maydeu-Olivares, A., Shi, D. & Rosseel, Y. (2018) Assessing fit in structural equation models: a Monte-Carlo evaluation of RMSEA versus SRMR confidence intervals and tests of close fit. Structural Equation Modeling: A Multidisciplinary Journal, 25(3), 389–402. https://doi.org/10.1080/10705511.2017.1389611
- Mayer, R.E. & Moreno, R. (2003) Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52.
- McCannon, B.C. (2019) Readability and research impact. Economics Letters, 180, 76–79. https://doi.org/10.1016/j.econlet.2019.02.017
- McDonald, R.P. (1970) The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23(1), 1–21. https://doi.org/10.1111/j.2044-8317.1970.tb00432.x
- Merton, R.K. (1968) The Matthew effect in science: the reward and communication systems of science are considered. Science, 159(3810), 56–63.
- Miles, J. & Shevlin, M. (2007) A time and a place for incremental fit indices. Personality and Individual Differences, 42(5), 869–874.
- Miser, H.J. (1987) OR forum—presidents’ symposium: science and professionalism in operations research. Operations Research, 35(2), 314–319. https://doi.org/10.1287/opre.35.2.314
- Mitchell, T.R. (2007) The academic life: realistic changes needed for business school students and faculty. Academy of Management Learning & Education, 6(2), 236–251.
- Moskowitz, H. & Ward, J. (1998) A three-phase approach to instilling a continuous learning culture in manufacturing education and training. Production and Operations Management, 7(2), 201–209. https://doi.org/10.1111/j.1937-5956.1998.tb00452.x
10.1111/j.1937-5956.1998.tb00452.x Google Scholar
- Paas, F. & Sweller, J. (2012) An evolutionary upgrade of cognitive load theory: using the human motor system and collaboration to support the learning of complex cognitive tasks. Educational Psychology Review, 24(1), 27–45. https://doi.org/10.1007/s10648-011-9179-2
- Plavén-Sigray, P., Matheson, G.J., Schiffler, B.C. & Thompson, W.H. (2017) The readability of scientific texts is decreasing over time. Elife, 6, e27725.
- Raudenbush, S.W. & Bryk, A.S. (2002) Hierarchical linear models: applications and data analysis methods (Vol., 1). Thousand Oaks, CA: SAGE.
- Reed, D.A., Cook, D.A., Beckman, T.J., Levine, R.B., Kern, D.E. & Wright, S.M. (2007) Association between funding and quality of published medical education research. Jama, 298(9), 1002. https://doi.org/10.1001/jama.298.9.1002
- Roberts, J.C. (1994) Effects of peer review and editing on the readability of articles published in annals of internal medicine. JAMA: The Journal of the American Medical Association, 272(2), 119. https://doi.org/10.1001/jama.1994.03520020045012
- Ryan, L., Logsdon, M.C., McGill, S., Stikes, R., Senior, B., Helinger, B., Small, B., & Davis, D. W. (2014) Evaluation of printed health education materials for use by low-education families: suitability and readability of materials. Journal of Nursing Scholarship, 46(4), 218–228. https://doi.org/10.1111/jnu.12076
- Sandström, U. (2009) Research quality and diversity of funding: a model for relating research money to output of research. Scientometrics, 79(2), 341–349.
- Sawyer, A.G., Laran, J. & Xu, J. (2008) The readability of marketing journals: are award-winning articles better written? Journal of Marketing, 72(1), 108–117. https://doi.org/10.1509/jmkg.72.1.108
- Schermelleh-Engel, K., Moosbrugger, H. & Müller, H. (2003) Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8(2), 23–74.
- Shi, D., Maydeu-Olivares, A. & Rosseel, Y. (2020) Assessing fit in ordinal factor analysis models: SRMR vs. RMSEA. Structural Equation Modeling: A Multidisciplinary Journal, 27(1), 1–15. https://doi.org/10.1080/10705511.2019.1611434
- Shubik, M. (1987) What is an application and when is theory a waste of time? Management Science, 33(12), 1511–1522.
- Simonton, D.K. (2003) Scientific creativity as constrained stochastic behavior: the integration of product, person, and process perspectives. Psychological Bulletin, 129(4), 475–494. https://doi.org/10.1037/0033-2909.129.4.475
- Straus, S. & Haynes, R.B. (2009) Managing evidence-based knowledge: the need for reliable, relevant and readable resources. Canadian Medical Association Journal, 180(9), 942–945. https://doi.org/10.1503/cmaj.081697
- Stremersch, S. & Verhoef, P.C. (2005) Globalization of authorship in the marketing discipline: does it help or hinder the field? Marketing Science, 24(4), 585–594.
- Stremersch, S., Verniers, I. & Verhoef, P.C. (2007) The quest for citations: drivers of article impact. Journal of Marketing, 71(3), 171–193. https://doi.org/10.1509/jmkg.71.3.171
- Sweller, J. (1994) Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4(4), 295–312. https://doi.org/10.1016/0959-4752(94)90003-5
10.1016/0959-4752(94)90003-5 Google Scholar
- Sweller, J., van Merienboer, J.J.G. & Paas, F.G.W.C. (1998) Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251–296.
- Taylor, W.L. (1953) Cloze procedure: a new tool for measuring readability. Journalism Bulletin, 30(4), 415–433.
- The SCM Journal List. (2020) Customized rankings report. The SCM Journal List. http://www.scmlist.com/home/university-rankings/custom-report/
- Trochim, W.M., Marcus, S.E., Mâsse, L.C., Moser, R.P. & Weld, P.C. (2008) The evaluation of large research initiatives: a participatory integrative mixed-methods approach. American Journal of Evaluation, 29(1), 8–28.
- Uzzi, B., Mukherjee, S., Stringer, M. & Jones, B. (2013) Atypical combinations and scientific impact. Science, 342, 468–472. https://doi.org/10.1126/science.1243651
- van Eck, N.J. & Waltman, L. (2017) Citation-based clustering of publications using CitNetExplorer and VOSviewer. Scientometrics, 111, 1053–1070.
- van Merrienboer, J.J.G. & Ayres, P. (2005) Research on cognitive load theory and its design implications for e-learning. Educational Technology Research and Development, 53(3), 5–13. https://doi.org/10.1007/BF02504793
- van Merrienboer, J.J.G., Kirschner, P.A. & Kester, L. (2003) Taking the load off a learner's mind: Instructional design for complex learning. Educational Psychologist, 38(1), 5–13. https://doi.org/10.1207/S15326985EP3801_2
- van Merrienboer, J.J.G. & Sweller, J. (2005) Cognitive load theory and complex learning: recent developments and future directions. Educational Psychology Review, 17, 147–177. https://doi.org/10.1007/s10648-005-3951-0
- van Merrienboer, J.J.G. & Sweller, J. (2010) Cognitive load theory in health professional education: design principles and strategies. Medical Education, 44(1), 85–93. https://doi.org/10.1111/j.1365-2923.2009.03498.x
- Walkington, C., Clinton, V., Ritter, S.N. & Nathan, M.J. (2015) How readability and topic incidence relate to performance on mathematics story problems in computer-based curricula. Journal of Educational Psychology, 107(4). https://doi.org/10.1037/edu0000036
- Wang, J. & Shapira, P. (2015) Is there a relationship between research sponsorship and publication impact? An analysis of funding acknowledgments in nanotechnology papers. PLoS One, 10(2), e0117727. https://doi.org/10.1371/journal.pone.0117727
- Weisberg, R.W. (2006) Creativity: understanding innovation in problem solving, science, invention, and the arts. Hoboken, NJ: John Wiley & Sons.
- Zepke, N. & Leach, L. (2002) Appropriate pedagogy and technology in a cross-cultural distance education context. Teaching in Higher Education, 7(3), 309–321. https://doi.org/10.1080/13562510220144806
10.1080/13562510220144806 Google Scholar