Chapter 24
Cognitive Performance Modeling
Maryam Zahabi,
Junho Park,
Maryam Zahabi
Wm Michael Barnes ‘64 Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, USA
Search for more papers by this authorJunho Park
Wm Michael Barnes ‘64 Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, USA
Search for more papers by this authorMaryam Zahabi,
Junho Park,
Maryam Zahabi
Wm Michael Barnes ‘64 Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, USA
Search for more papers by this authorJunho Park
Wm Michael Barnes ‘64 Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, USA
Search for more papers by this authorBook Editor(s):Giancarlo Fortino, David Kaber, Andreas Nürnberger,
David Mendonça,
Andreas Nürnberger
Otto-von-Guericke-Universität Magdeburg, Germany
Search for more papers by this authorFirst published: 07 July 2023
Summary
Cognitive performance models are computational models that represent humans’ performance as they interact with interfaces and provide information on user intentions and information processing. These models can analyze the tasks in great detail, predict operator task performance and cognitive workload, and identify serial and parallel operations. Cognitive performance models started with the goals, operators, methods, and selection rules (GOMS) family, including simple keystroke-level models (KLM) to more advanced cognitive structures and models including Executive Process Interactive Control (EPIC), Queuing Network-Model Human Processor (QN-MHP), and Adaptive Control of Thought-Rational (ACT-R). This chapter reviews cognitive performance modeling approaches in the human-systems engineering area and some of the challenges and limitations of applying these methods. In addition, a set of guidelines is provided for future research.
References
- Al Seraj , M.S. , Pastel , R. , and Al-Hasan , Md. ( 2018 ). A survey on user modeling in HCI . Computer Applications: An International Journal (CAIJ) 5 ( 1 ): 1 – 8 .
- Anderson , J.R. ( 1993 ). Rules of the Mind , 319p . Hillsdale, NJ : Lawrence Erlbaum Associates, Inc .
- Anderson , J.R. , Matessa , M. , and Lebiere , C. ( 1997 ). ACT-R: a theory of higher level cognition and its relation to visual attention . Human–Computer Interaction 12 ( 4 ): 439 – 462 .
- Bolkhovsky , J. , Ritter , F.E. , Chon , K.H. , and Qin , M. ( 2018 ). Performance trends during sleep deprivation .
- Boring , R.L. and Rasmussen , M. ( 2016 ). GOMS-HRA: a method for treating subtasks in dynamic human reliability analysis . Proceedings of the 2016 European Safety and Reliability Conference , 956 – 963 .
- Card , S.K. , Moran , T.P. , and Newell , A. ( 1980 ). The keystroke-level model for user performance time with interactive systems . Communications of the ACM 23 ( 7 ): 396 – 410 .
- Card , S.K. , Moran , T.P. , and Newell , A. ( 1983 ). The Psychology of Human–Computer Interaction . Hillsdale, NJ : Lawrence Erlbaum Associates, Inc .
- Card , S. , Moran , T. , and Newell , A. ( 1986 ). The model human processor: an engineering model of human performance . In: Handbook of Perception and Human Performance, Cognitive Processes and Performance , vol. 2 (ed. K.R. Boff , L. Kaufman , and J.P. Thomas ), 1 – 35 . Wiley .
- Dancy , C.L. ( 2019 ). A hybrid cognitive arch itecture with primal affect and physiology . IEEE Transactions on Affective Computing 12 ( 2 ): 318 – 328 .
- Dudzik , K.A.T. ( 2019 ). Cognitive modeling as a method for agent development in artificial intelligence . PhD thesis. Carleton University .
- Fincham , J.M. ( 2005 ). Cognitive modeling and fMRI: an integrated approach toward understanding mechanisms of complex skill performance . PhD thesis. Carnegie Mellon University .
- Fitts , P.M. ( 1954 ). The information capacity of the human motor system in controlling the amplitude of movement . Journal of Experimental Psychology 47 ( 6 ): 381 .
- Gil , G.-H. ( 2010 ). An accessible cognitive modeling tool for evaluation of human–automation interaction in the systems design process . PhD thesis. North Carolina State University .
- Gunzelmann , G. and Gluck , K.A. ( 2008 ). Approaches to modeling the effects of fatigue on cognitive performance . Proceedings of the 17th Conference on Behavior Representation in Modeling and Simulation , 136 – 145 . Citeseer .
- Hick , W.E. ( 1952 ). On the rate of gain of information . Quarterly Journal of Experimental Psychology 4 ( 1 ): 11 – 26 .
- John , B.E. and Gray , W.D. ( 1995 ). CPM-GOMS: an analysis method for tasks with parallel activities . Conference Companion on Human Factors in Computing Systems , 393 – 394 .
-
Kieras , D.E.
(
1988
).
Towards a practical GOMS model methodology for user interface design
. In:
Handbook of Human–Computer Interaction
,
135
–
157
.
Elsevier
.
10.1016/B978-0-444-70536-5.50012-9 Google Scholar
- Kieras , D. ( 1994 ). A Guide to GOMS Task Analysis . University of Michigan .
- Kieras , D.E. ( 1999 ). A Guide to GOMS Model Usability Evaluation Using GOMSL and GLEAN3 , 313 . University of Michigan .
- Kieras , D. ( 2001 ). Using the Keystroke-Level Model to Estimate Execution Times , 555 . University of Michigan .
- Kieras , D.E. and Meyer , D.E. ( 1995 ). Predicting human performance in dual-task tracking and decision making with computational models using the epic architecture . Proceedings of the 1st International Symposium on Command and Control Research and Technology , June 1995. Washington, DC : National Defense University, Citeseer .
- Kieras , D.E. and Wakefield , G.H. ( 2016 ). Extending and Applying the Epic Architecture for Human Cognition and Performance: Auditory and Spatial Components . Technical report . FR-11/ONR-EPIC-17. University of Michigan Division of Research Development Ann Arbor United States . https://apps.dtic.mil/sti/pdfs/ADA535789.pdf .
- Kotseruba , I. and Tsotsos , J.K. ( 2020 ). 40 years of cognitive architectures: core cognitive abilities and practical applications . Artificial Intelligence Review 53 ( 1 ): 17 – 94 .
- Laird , J.E. and Nielsen , E. ( 1994 ). Coordinated behavior of computer generated forces in TacAir-SOAR . AD-A280 63 ( 1001 ): 57 .
-
Laird , J.
,
Hucka , M.
,
Huffman , S.
, and
Rosenbloom , P.
(
1991
).
An analysis of SOAR as an integrated architecture
.
ACM SIGART Bulletin
2
(
4
):
98
–
103
.
10.1145/122344.122364 Google Scholar
- Leiden , K. and Best , B. ( 2005 ). A Cross-Model Comparison of Human Performance Modeling Tools Applied to Aviation Safety . Boulder, CO : Micro Analysis & Design, Inc .
- Leiden , K. , Laughery , K.R. , Keller , J. et al. ( 2001 ). A review of human performance models for the prediction of human error . Ann Arbor 1001: 48105.
- Li , N. , Huang , J. , and Feng , Y. ( 2020 ). Human performance modeling and its uncertainty factors affecting decision making: a survey . Soft Computing 24 ( 4 ): 2851 – 2871 .
- Liu , Y. ( 2009 ). QN-ACES: integrating queuing network and ACT-R, CAPS, EPIC, and SOAR architectures for multitask cognitive modeling . International Journal of Human–Computer Interaction 25 ( 6 ): 554 – 581 .
-
Liu , Y.
,
Feyen , R.
, and
T simhoni , O.
(
2006
).
Queuing Network-Model Human Processor (QN-MHP) a computational architecture for multitask performance in human–machine systems
.
ACM Transactions on Computer–Human Interaction (TOCHI)
13
(
1
):
37
–
70
.
10.1145/1143518.1143520 Google Scholar
- Moran , T.P. ( 1981 ). The command language grammar: a representation for the user interface of interactive computer systems . International Journal of Man-Machine Studies 15 ( 1 ): 3 – 50 .
- Oyewole , S.A. , Farde , A.M. , Haight , J.M. , and Okareh , O.T. ( 2011 ). Evaluation of complex and dynamic safety tasks in human learning using the ACT-R and SOAR skill acquisition theories . Computers in Human Behavior 27 ( 5 ): 1984 – 1995 .
- Redding , R.E. ( 1992 ). Cognitive Task Analysis of Prioritization in Air Traffic Control .
- Ritter , F.E. , Tehranchi , F. , Dancy , C.L. , and Kase , S.E. ( 2020 ). Some futures for cognitive modeling and architectures: design patterns for including better interaction with the world, moderators, and improved model to data fits (and so can you) . Computational and Mathematical Organization Theory 26 ( 3 ): 278 – 306 .
- Salvucci , D.D. and Lee , F.J. ( 2003 ). Simple cognitive modeling in a complex cognitive architecture . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 265 – 272 .
- Sanders , P. ( 1996 ). DoD Modeling and Simulation (M&S) Verification, Validation, and Accreditation (VV&A) . Technical Report . NSN 7540-01-280-5500. Office of the Under Secretary of Defense for Acquisition and Technology . https://apps.dtic.mil/sti/pdfs/ADA315867.pdf .
- St. Amant , R. , Horton , T.E. , and Ritter , F.E. ( 2004 ). Model-based evaluation of cell phone menu interaction . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 343 – 350 .
- Swets , J.A. ( 1964 ). Signal Detection and Recognition in Human Observers: Contemporary Readings . Wiley .
- Taatgen , N. and Anderson , J.R. ( 2010 ). The past, present, and future of cognitive architectures . Topics in Cognitive Science 2 ( 4 ): 693 – 704 .
- Tsimhoni , O. and Reed , M.P. ( 2007 ). The virtual driver: integrating task planning and cognitive simulation with human movement models . SAE Transactions 116 : 1525 – 1531 .
- Van Rijn , H. , Johnson , A. , and Taatgen , N. ( 2011 ). Cognitive user modeling . In: Handbook of Human Factors in Web Design , (eds. A. Johnson , R. Proctor ), 527 – 542 . CRC Press .
- West , R.L. and Nagy , G. ( 2000 ). Situating GOMS models within complex, sociotechnical systems . Proceedings of the Annual Meeting of the Cognitive Science Society , volume 22 .
- Wiendahl , M. , Wierling , P.S. , Nielsen , J. et al. ( 2008 ). High throughput screening for the design and optimization of chromatographic processes–miniaturization, automation and parallelization of breakthrough and elution studies . Chemical Engineering & Technology: Industrial Chemistry-Plant Equipment-Process Engineering-Biotechnology 31 ( 6 ): 893 – 903 .
-
Wilson , M.D.
,
Boag , R.J.
, and
Strickland , L.
(
2019
).
All models are wrong, some are useful, but are they reproducible? Commentary on Lee et al.(2019)
.
Computational Brain & Behavior
2
(
3
):
239
–
241
.
10.1007/s42113-019-00054-x Google Scholar
- Zahabi , M. , White , M.M. , Zhang , W. et al. ( 2019 ). Application of cognitive task performance modeling for assessing usability of transradial prostheses . IEEE Transactions on Human–Machine Systems 49 ( 4 ): 381 – 387 .
