Chap05

© 2010 Pearson Addison-Wesley. All rights reserved.
Addison Wesley
is an imprint of
Designing the User Interface:
Strategies for Effective Human-Computer Interaction
Fifth Edition
Ben Shneiderman & Catherine Plaisant
in collaboration with
Maxine S. Cohen and Steven M. Jacobs
CHAPTER 5:
Direct Manipulation and Virtual Environments

1-3
Introduction
• Positive feelings associated with good user
interfaces:
– Mastery of the interface
– Competence in performing tasks
– Ease in learning the system originally and in
assimilating advanced features
– Confidence in the capacity to retain mastery over time
– Enjoyment in using the system
– Eagerness to show the system off to novices
– Desire to explore more powerful aspects of the system
6-3

1-4
Examples of
Direct-Manipulation Systems
Command line vs. display editors and word processors
• Training times with display editors are much less than line editors
• Line editors are generally more flexible and powerful
• The advances of WYSIWYG word processors:
– Display a full page of text
– Display of the document in the form that it will appear when the
final printing is done
– Show cursor action
– Control cursor motion through physically obvious and intuitively
natural means
– Use of labeled icon for actions
– Display of the results of an action immediately
– Provide rapid response and display
– Offer easily reversible actions
6-4

1-5
Examples of
Direct-Manipulation Systems:
WYSIWYG word processing
6-5

1-6
Examples of Direct-Manipulation
Systems (cont.)
Technologies that derive from the word processor:
• Integration
• Desktop publication software
• Slide-presentation software
• Hypermedia environments
• Improved macro facilities
• Spell checker and thesaurus
• Grammar checkers
6-6

1-7
Systems (cont.)
The VisiCalc spreadsheet and its descendants
• VisiCalc users delighted in watching the program
propagate changes across the screen.
• In some cases, spatial representations provide a better
model of reality
• Successful spatial data-management systems depend on
choosing appropriate:
– Icons
– Graphical representations
– Natural and comprehensible data layouts
6-7

1-8
Systems (cont.): spreadsheet
6-8

1-9
Systems (cont.)
spatial data management
6-9

1-10
Systems (cont.)
Video games
• Nintendo Wii, Sony PlayStation, and Microsoft Xbox
• Field of action is visual and compelling
• Commands are physical actions whose results are immediately
shown on the screen
• No syntax to remember
• Most games continuously display a score
• Direct manipulation in SimSity
• Second Life virtual world
• Spore
• Myst well received
• DOOM and Quake controversial
6-10

1-11
Systems (cont.)
Guitar Hero video game
6-11

1-12
Systems (cont.)
Computer-aided design
• Computer-aided design (CAD) use direct manipulation
• Manipulate the object of interest
• Generate alternatives easily
• Explain the impact
• Problem solving by analogy to the real-world
Office automation
• Xerox Star was a pioneer with sophisticated formatting
• Apple Lisa System
• Rapid and continuous graphical interaction
• Microsoft Windows is a descendant
6-12

1-13
Continuing evolution of Direct-
Manipulation Systems
Direct-Manipulation interfaces are being used in a wide range of
applications, e.g. management dashboard for a retail store
6-13

1-14
Continuing evolution of Direct-
Manipulation Systems (cont.)
6-14

1-15
Discussion of Direct
Manipulation
Problems with direct manipulation
• Spatial or visual representations can be too spread out
• High-level flowcharts and database-schema can become
confusing
• Designs may force valuable information off of the screen
• Users must learn the graphical representations
• The visual representation may be misleading
• Typing commands with the keyboard may be faster
6-15

1-16
Principles of Direct Manipulation
1. Continuous representations of the objects and
actions of interest with meaningful visual
metaphors.
2. Physical actions or presses of labeled buttons,
instead of complex syntax.
3. Rapid, incremental, reversible actions whose
effects on the objects of interest are visible
immediately.
6-16

1-17
Interface-Building Tools
Visual Thinking and Icons
• The visual nature of computers can challenge the
first generation of hackers
• An icon is an image, picture, or symbol representing
a concept
• Icon-specific guidelines
– Represent the object or action in a familiar manner
– Limit the number of different icons
– Make icons stand out from the background
– Consider three-dimensional icons
– Ensure a selected icon is visible from unselected icons
– Design the movement animation
– Add detailed information
– Explore combinations of icons to create new objects or
actions
6-17

1-18
3D Interfaces
• “Pure” 3D interfaces have strong utility in some contexts,
e.g., medical, product design. In other situations, more
constrained interaction may actually be preferable to
simplify interactions.
• “Enhanced” interfaces, better than reality, can help
reduce the limitations of the real-world, e.g., providing
simultaneous views.
• Avatars in multiplayer 3-D worlds
• First person games
6-18

1-19
3D Interfaces (cont.)
6-19

1-20
Features for effective 3D
– Use occlusion, shadows, perspective, and other 3D techniques
carefully.
– Minimize the number of navigation steps for users to
accomplish their tasks.
– Keep text readable.
– Avoid unnecessary visual clutter, distraction, contrast shifts, and
reflections.
– Simplify user movement.
– Prevent errors.
– Simplify object movement
– Organize groups of items in aligned structures to allow rapid
visual search.
– Enable users to construct visual groups to support spatial recall.
6-20

1-21
Guidelines for inclusion of enhanced 3D features:
– Provide overviews so users can see the big picture
– Allow teleoperation
– Offer X-ray vision so users can see into or beyond
objects.
– Provide history keeping
– Permit rich user actions on objects
– Enable remote collaboration
– Give users control over explanatory text and let users
select for details on demand.
– Offer tools to select, mark, and measure.
6-21

1-22
Guidelines for inclusion of enhanced 3D features
(cont.):
– Implement dynamic queries to rapidly filter out
unneeded items.
– Support semantic zooming and movement
– Enable landmarks to show themselves even at a
distance
– Allow multiple coordinated views
– Develop novel 3D icons to represent concepts that are
more recognizable and memorable.
6-22

1-23
Teleoperation
• Two “parents”: direct manipulation in personal
computers and process control in complex environments
• Physical operation is remote
• Complicating factors in the architecture of remote
environments:
– Time delays
• transmission delays
• operation delays
– Incomplete feedback
– Feedback from multiple sources
– Unanticipated interferences
6-23

1-24
Virtual and Augmented Reality
• Virtual reality breaks the physical limitations of space and
allow users to act as though they were somewhere else
• Augmented reality shows the real world with an overlay
of additional overlay
• Situational awareness shows information about the real
world that surrounds you by tracking your movements in
a computer model
• Augmented reality is an important variant
– Enables users to see the real world with an overlay of
additional interaction.
6-24

1-25
Virtual and
Augmented Reality (cont.)
• Successful virtual environments depend on the
smooth integration of:
– Visual Display
– Head position sensing
– Hand-position sensing
– Force feedback
– Sound input and output
– Other sensations
– Cooperative and competitive virtual reality
6-25

1-26
Impact of this technology in our
everyday lives
6-26

Chap05

More Related Content

What's hot (20)

Viewers also liked (8)

Similar to Chap05 (20)

More from Nada G.Youssef (20)

Recently uploaded (20)

Chap05