SlideShare a Scribd company logo
goal and task hierarchies linguistic physical and device architectural Cognitive models
Cognitive models They model aspects of user: understanding knowledge intentions processing Common categorisation: Competence Performance Computational flavour No clear divide
Goal and task hierarchies Mental processing as divide-and-conquer Example: sales report produce report gather data .  find book names .  .  do keywords search of names database  -  further sub-goals .  .  sift through names and abstracts by hand  - further sub-goals .  search sales database  -  further sub-goals layout tables and histograms  -  further sub-goals write description  -  further sub-goals
Issues for goal hierarchies Granularity Where do we start? Where do we stop? Routine learned behaviour, not problem solving The unit task Conflict More than one way to achieve a goal Error
Techniques Goals, Operators, Methods and Selection   (GOMS) Cognitive Complexity Theory (CCT) Hierarchical Task Analysis (HTA)  -  Chapter 7
GOMS Goals what the user wants to achieve Operators basic actions user performs Methods decomposition of a goal into   subgoals/operators Selection means of choosing between   competing methods
GOAL: ICONISE-WINDOW .  [select GOAL: USE-CLOSE-METHOD .  MOVE-MOUSE-TO-WINDOW-HEADER .  POP-UP-MENU .  CLICK-OVER-CLOSE-OPTION GOAL: USE-L7-METHOD .  PRESS-L7-KEY] For a particular user: Rule 1: Select USE-CLOSE-METHOD unless   another rule applies Rule 2: If the application is GAME, select L7-METHOD GOMS example
CCT Two parallel descriptions: User production rules Device generalised transition networks Production rules are of the form: if condition then action Transition networks covered under dialogue   models
Example: editing with vi Production rules are in long-term memory Model contents of working memory as   attribute-value mapping (GOAL perform unit task) (TEXT task is insert space) (TEXT task is at 5 23) (CURSOR 8 7) Rules are pattern-matched to working memory, e.g.,   LOOK-TEXT task is at %LINE %COLUMN   is true, with LINE = 5 COLUMN = 23.
Four rules to model inserting a space Active rules: SELECT-INSERT-SPACE INSERT-SPACE-MOVE-FIRST INSERT-SPACE-DOIT INSERT-SPACE-DONE New  working memory (GOAL insert space) (NOTE executing insert space) (LINE 5)   (COLUMN 23) SELECT-INSERT-SPACE matches current working memory (SELECT-INSERT-SPACE IF (AND (TEST-GOAL perform unit task) (TEST-TEXT task is insert space) (NOT (TEST-GOAL insert space)) (NOT (TEST-NOTE executing insert space))) THEN (  (ADD-GOAL insert space) (ADD-NOTE executing insert space) (LOOK-TEXT task is at %LINE %COLUMN)))
Notes on CCT Parallel model Proceduralisation of actions Novice versus expert style rules Error behaviour can be represented Measures depth of goal structure number of rules comparison with device description
Problems with goal hierarchies a post hoc technique expert versus novice   How cognitive are they?
Linguistic notations Understanding the user's behaviour and cognitive  difficulty  based on analysis of language between   user and system. Similar in emphasis to dialogue models Backus-Naur Form (BNF) Task-Action Grammar (TAG)
BNF Very common notation from computer science A purely syntactic view of the dialogue Terminals lowest level of user behaviour e.g. CLICK-MOUSE, MOVE-MOUSE Nonterminals  ordering of terminals higher   level of abstraction e.g. select-menu, position-mouse
Example of BNF Basic syntax: nonterminal ::= expression An expression contains terminals and nonterminals combined in sequence (+) or as alternatives (|) draw line  ::=  select line + choose points + last point select line  ::=  pos mouse + CLICK MOUSE choose points ::=  choose one  |  choose one + choose points choose one  ::=  pos mouse + CLICK MOUSE last point  ::=  pos mouse + DBL CLICK MOUSE pos mouse  ::=  NULL  |  MOVE MOUSE+ pos mouse
Measurements with BNF Number of rules (not so good) Number of + and | operators Complications same syntax for different semantics no reflection of user's perception minimal consistency checking
TAG Making consistency more explicit Encoding user's world knowledge Parameterised grammar rules Nonterminals are modified to include additional   semantic features
Consistency in TAG In BNF, three UNIX commands would be   described as   copy ::= cp + filename + filename | cp + filenames + directory move ::= mv + filename + filename | mv + filenames + directory link ::= ln + filename + filename | ln + filenames + directory   No BNF measure could distinguish between this   and a less consistent grammar in which link ::= ln + filename + filename  |  ln + directory + filenames
Consistency in TAG (cont'd) consistency of argument order made explicit using a parameter, or semantic feature for file operations Feature Possible values Op = copy; move; link Rules file-op[Op] ::= command[Op] + filename + filename | command[Op] + filenames + directory command[Op = copy] ::= cp command[Op = move] ::= mv command[Op = link] ::= ln
Other uses of TAG Users existing knowledge Congruence between features and commands These are modeled as derived rules
Physical and device models Based on empirical knowledge of human motor   system User's task: acquisition then execution. These only address execution Complementary with goal hierarchies The Keystroke Level Model (KLM) Buxton's 3-state model
KLM Six execution phase operators Physical motor K - keystroking P - pointing H - homing D - drawing Mental M - mental preparation System R - response Times are empirically determined. Texecute = TK + TP + TH + TD + TM + TR
Example GOAL: ICONISE-WINDOW [select GOAL: USE-CLOSE-METHOD .  MOVE-MOUSE-TO-WINDOW-HEADER .  POP-UP-MENU .  CLICK-OVER-CLOSE-OPTION GOAL: USE-L7-METHOD PRESS-L7-KEY] assume hand starts on mouse USE-CLOSE-METHOD P[to menu]  1.1 B[LEFT down]  0.1 M  1.35 P[to option]  1.1 B[LEFT up]  0.1 Total  3.75 secs USE-L7-METHOD   H[to kbd]  0.40 M  1.35 K[L7 key]  0.28 Total  2.03 secs
Architectural models All of these cognitive models make assumptions   about the architecture of the human mind. Long-term/Short-term memory Problem spaces Interacting Cognitive Subsystems Connectionist ACT
Display-based interaction Most cognitive models do not deal with user   observation and perception. Some techniques have been extended to handle   system output (e.g., BNF with sensing terminals,   Display-TAG) but problems persist. Level of granularity Exploratory interaction versus planning

More Related Content

PPT
HCI 3e - Ch 12: Cognitive models
PPT
HCI 3e - Ch 13: Socio-organizational issues and stakeholder requirements
PPTX
Wimp interface
PPTX
PPTX
Multimodal Interaction
PPT
Hypertext, multimedia and www
PPT
CS8079 Human Computer Interaction
PPTX
Socio organizational issues ppt
HCI 3e - Ch 12: Cognitive models
HCI 3e - Ch 13: Socio-organizational issues and stakeholder requirements
Wimp interface
Multimodal Interaction
Hypertext, multimedia and www
CS8079 Human Computer Interaction
Socio organizational issues ppt

What's hot (20)

PPT
HCI 3e - Ch 3: The interaction
PPT
HCI 3e - Ch 14: Communication and collaboration models
PPT
HCI 3e - Ch 7: Design rules
PPTX
PPTX
Human Computer Interaction Chapter 3 HCI in the Software Process and Design ...
PDF
Mobile Information Architecture
PPTX
hci in software development process
PPTX
Unit iii ppt
PPTX
Human Computer Interaction unit 1
PPT
HCI 3e - Ch 15: Task analysis
PPTX
Hci in software process
PPT
HCI 3e - Ch 10: Universal design
PPT
7 distributed and real systems
PPT
Cognitive models unit 3
PPTX
Design process interaction design basics
PPTX
Unit2 hci
PPT
Use case Diagram and Sequence Diagram
PDF
User Interface Design Module 5 screen based controls
PPT
Groupware
PDF
User Interface Design - Module 1 Introduction
HCI 3e - Ch 3: The interaction
HCI 3e - Ch 14: Communication and collaboration models
HCI 3e - Ch 7: Design rules
Human Computer Interaction Chapter 3 HCI in the Software Process and Design ...
Mobile Information Architecture
hci in software development process
Unit iii ppt
Human Computer Interaction unit 1
HCI 3e - Ch 15: Task analysis
Hci in software process
HCI 3e - Ch 10: Universal design
7 distributed and real systems
Cognitive models unit 3
Design process interaction design basics
Unit2 hci
Use case Diagram and Sequence Diagram
User Interface Design Module 5 screen based controls
Groupware
User Interface Design - Module 1 Introduction
Ad

Similar to Cognitive Models (20)

PPT
human computer Interaction cognitive models.ppt
PPT
human computer Interaction cognitive models.ppt
PPT
E3 chap-12
PPT
e3-chap-12b vgggggggggggggggggggggggggggggggg.ppt
PPT
e3-chap-12-GOMS.ppt Human Computer interaction
DOC
Chapter 6
PPTX
UNIT-1.pptx python for engineering first year students
PPT
HCI Cognitive models.ppt
PPTX
Group19.pptx
PPTX
clean architecture uncle bob AnalysisAndDesign.el.en.pptx
PPTX
ProgrammingPrimerAndOOPS
PPTX
2-Algorithms and Complexity analysis.pptx
PDF
S-CUBE LP: Service Discovery and Task Models
PDF
GE3151 PSPP _Unit 1 notes and Question bank.pdf
PPTX
CS 542 -- Query Execution
PDF
maXbox Starter 43 Work with Code Metrics ISO Standard
PPT
Analysis Is Painless
PDF
2-Algorithms and Complexit data structurey.pdf
PDF
Overview of TensorFlow For Natural Language Processing
PPTX
Fundamentals of Data Structures Unit 1.pptx
human computer Interaction cognitive models.ppt
human computer Interaction cognitive models.ppt
E3 chap-12
e3-chap-12b vgggggggggggggggggggggggggggggggg.ppt
e3-chap-12-GOMS.ppt Human Computer interaction
Chapter 6
UNIT-1.pptx python for engineering first year students
HCI Cognitive models.ppt
Group19.pptx
clean architecture uncle bob AnalysisAndDesign.el.en.pptx
ProgrammingPrimerAndOOPS
2-Algorithms and Complexity analysis.pptx
S-CUBE LP: Service Discovery and Task Models
GE3151 PSPP _Unit 1 notes and Question bank.pdf
CS 542 -- Query Execution
maXbox Starter 43 Work with Code Metrics ISO Standard
Analysis Is Painless
2-Algorithms and Complexit data structurey.pdf
Overview of TensorFlow For Natural Language Processing
Fundamentals of Data Structures Unit 1.pptx
Ad

More from ahmad bassiouny (20)

PPTX
Work Study & Productivity
PPT
Work Study
PPT
Motion And Time Study
PPT
Motion Study
PPT
The Christmas Story
PPS
Turkey Photos
PPT
Mission Bo Kv3
PPT
PPT
Linearization
PPT
Kblmt B000 Intro Kaizen Based Lean Manufacturing
PPT
How To Survive
PPT
Ancient Hieroglyphics
PPS
Dubai In 2009
PPT
DesignPeopleSystem
PPT
Organizational Behavior
PPT
Work Study Workshop
PPT
Workstudy
PPT
Time And Motion Study
Work Study & Productivity
Work Study
Motion And Time Study
Motion Study
The Christmas Story
Turkey Photos
Mission Bo Kv3
Linearization
Kblmt B000 Intro Kaizen Based Lean Manufacturing
How To Survive
Ancient Hieroglyphics
Dubai In 2009
DesignPeopleSystem
Organizational Behavior
Work Study Workshop
Workstudy
Time And Motion Study

Recently uploaded (20)

PDF
Classroom Observation Tools for Teachers
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPTX
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
Anesthesia in Laparoscopic Surgery in India
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PDF
Pre independence Education in Inndia.pdf
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
Insiders guide to clinical Medicine.pdf
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PDF
RMMM.pdf make it easy to upload and study
PPTX
Pharma ospi slides which help in ospi learning
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
Sports Quiz easy sports quiz sports quiz
Classroom Observation Tools for Teachers
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
Module 4: Burden of Disease Tutorial Slides S2 2025
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
Abdominal Access Techniques with Prof. Dr. R K Mishra
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Anesthesia in Laparoscopic Surgery in India
human mycosis Human fungal infections are called human mycosis..pptx
O7-L3 Supply Chain Operations - ICLT Program
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Pre independence Education in Inndia.pdf
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Insiders guide to clinical Medicine.pdf
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
RMMM.pdf make it easy to upload and study
Pharma ospi slides which help in ospi learning
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
Sports Quiz easy sports quiz sports quiz

Cognitive Models

  • 1. goal and task hierarchies linguistic physical and device architectural Cognitive models
  • 2. Cognitive models They model aspects of user: understanding knowledge intentions processing Common categorisation: Competence Performance Computational flavour No clear divide
  • 3. Goal and task hierarchies Mental processing as divide-and-conquer Example: sales report produce report gather data . find book names . . do keywords search of names database - further sub-goals . . sift through names and abstracts by hand - further sub-goals . search sales database - further sub-goals layout tables and histograms - further sub-goals write description - further sub-goals
  • 4. Issues for goal hierarchies Granularity Where do we start? Where do we stop? Routine learned behaviour, not problem solving The unit task Conflict More than one way to achieve a goal Error
  • 5. Techniques Goals, Operators, Methods and Selection (GOMS) Cognitive Complexity Theory (CCT) Hierarchical Task Analysis (HTA) - Chapter 7
  • 6. GOMS Goals what the user wants to achieve Operators basic actions user performs Methods decomposition of a goal into subgoals/operators Selection means of choosing between competing methods
  • 7. GOAL: ICONISE-WINDOW . [select GOAL: USE-CLOSE-METHOD . MOVE-MOUSE-TO-WINDOW-HEADER . POP-UP-MENU . CLICK-OVER-CLOSE-OPTION GOAL: USE-L7-METHOD . PRESS-L7-KEY] For a particular user: Rule 1: Select USE-CLOSE-METHOD unless another rule applies Rule 2: If the application is GAME, select L7-METHOD GOMS example
  • 8. CCT Two parallel descriptions: User production rules Device generalised transition networks Production rules are of the form: if condition then action Transition networks covered under dialogue models
  • 9. Example: editing with vi Production rules are in long-term memory Model contents of working memory as attribute-value mapping (GOAL perform unit task) (TEXT task is insert space) (TEXT task is at 5 23) (CURSOR 8 7) Rules are pattern-matched to working memory, e.g., LOOK-TEXT task is at %LINE %COLUMN is true, with LINE = 5 COLUMN = 23.
  • 10. Four rules to model inserting a space Active rules: SELECT-INSERT-SPACE INSERT-SPACE-MOVE-FIRST INSERT-SPACE-DOIT INSERT-SPACE-DONE New working memory (GOAL insert space) (NOTE executing insert space) (LINE 5) (COLUMN 23) SELECT-INSERT-SPACE matches current working memory (SELECT-INSERT-SPACE IF (AND (TEST-GOAL perform unit task) (TEST-TEXT task is insert space) (NOT (TEST-GOAL insert space)) (NOT (TEST-NOTE executing insert space))) THEN ( (ADD-GOAL insert space) (ADD-NOTE executing insert space) (LOOK-TEXT task is at %LINE %COLUMN)))
  • 11. Notes on CCT Parallel model Proceduralisation of actions Novice versus expert style rules Error behaviour can be represented Measures depth of goal structure number of rules comparison with device description
  • 12. Problems with goal hierarchies a post hoc technique expert versus novice How cognitive are they?
  • 13. Linguistic notations Understanding the user's behaviour and cognitive difficulty based on analysis of language between user and system. Similar in emphasis to dialogue models Backus-Naur Form (BNF) Task-Action Grammar (TAG)
  • 14. BNF Very common notation from computer science A purely syntactic view of the dialogue Terminals lowest level of user behaviour e.g. CLICK-MOUSE, MOVE-MOUSE Nonterminals ordering of terminals higher level of abstraction e.g. select-menu, position-mouse
  • 15. Example of BNF Basic syntax: nonterminal ::= expression An expression contains terminals and nonterminals combined in sequence (+) or as alternatives (|) draw line ::= select line + choose points + last point select line ::= pos mouse + CLICK MOUSE choose points ::= choose one | choose one + choose points choose one ::= pos mouse + CLICK MOUSE last point ::= pos mouse + DBL CLICK MOUSE pos mouse ::= NULL | MOVE MOUSE+ pos mouse
  • 16. Measurements with BNF Number of rules (not so good) Number of + and | operators Complications same syntax for different semantics no reflection of user's perception minimal consistency checking
  • 17. TAG Making consistency more explicit Encoding user's world knowledge Parameterised grammar rules Nonterminals are modified to include additional semantic features
  • 18. Consistency in TAG In BNF, three UNIX commands would be described as copy ::= cp + filename + filename | cp + filenames + directory move ::= mv + filename + filename | mv + filenames + directory link ::= ln + filename + filename | ln + filenames + directory No BNF measure could distinguish between this and a less consistent grammar in which link ::= ln + filename + filename | ln + directory + filenames
  • 19. Consistency in TAG (cont'd) consistency of argument order made explicit using a parameter, or semantic feature for file operations Feature Possible values Op = copy; move; link Rules file-op[Op] ::= command[Op] + filename + filename | command[Op] + filenames + directory command[Op = copy] ::= cp command[Op = move] ::= mv command[Op = link] ::= ln
  • 20. Other uses of TAG Users existing knowledge Congruence between features and commands These are modeled as derived rules
  • 21. Physical and device models Based on empirical knowledge of human motor system User's task: acquisition then execution. These only address execution Complementary with goal hierarchies The Keystroke Level Model (KLM) Buxton's 3-state model
  • 22. KLM Six execution phase operators Physical motor K - keystroking P - pointing H - homing D - drawing Mental M - mental preparation System R - response Times are empirically determined. Texecute = TK + TP + TH + TD + TM + TR
  • 23. Example GOAL: ICONISE-WINDOW [select GOAL: USE-CLOSE-METHOD . MOVE-MOUSE-TO-WINDOW-HEADER . POP-UP-MENU . CLICK-OVER-CLOSE-OPTION GOAL: USE-L7-METHOD PRESS-L7-KEY] assume hand starts on mouse USE-CLOSE-METHOD P[to menu] 1.1 B[LEFT down] 0.1 M 1.35 P[to option] 1.1 B[LEFT up] 0.1 Total 3.75 secs USE-L7-METHOD H[to kbd] 0.40 M 1.35 K[L7 key] 0.28 Total 2.03 secs
  • 24. Architectural models All of these cognitive models make assumptions about the architecture of the human mind. Long-term/Short-term memory Problem spaces Interacting Cognitive Subsystems Connectionist ACT
  • 25. Display-based interaction Most cognitive models do not deal with user observation and perception. Some techniques have been extended to handle system output (e.g., BNF with sensing terminals, Display-TAG) but problems persist. Level of granularity Exploratory interaction versus planning