SlideShare a Scribd company logo
IWMW Glasgow
Mark Simpson
De Montfort University - Leicester
Managed Learning Environment - MLE
September 2000 to September 2002
Joint Information Systems Committee -
IWMW Glasgow
User Issues - Formative and
Summative Assessment
Designing for Usability
•How did we specify the system?
•How did we decide on content?
•How did we verify content?
•Develop conventions for pages?
•Usability trade-offs and compromises?
IWMW Glasgow
What is a MLE?
University Electronic resources linked together
•Student record system - QLS
•Timetabling and Calendar system
•Library databases
•Module and Results database
•Online learning resources - WebCT
•Social databases
•Email and discussion pages
Other student oriented data resources
IWMW Glasgow
MLE
Architecture
MLE (Web) Server
User Manager
Resource Manager
MLE Usage Database
Student Record System
Authentication System
Client Application
(Web Browser)
BIDS
EDINA
e-Journals
etc
Remote Authorised Resources
Timetabling
Finance System
Course Management
Secure, Authorised Access
e-Learning – VLE App
Course Notes,
Study Guides, Exam Papers
Library
Diary
Discussion Lists,
Groupware, email
Entertainment, Social
outside firewall
inside
Resources
Crossing
Firewall
IWMW Glasgow
Usability how hard is it?
Everybody has an opinion
“I hate …… …… …”
“Frames / Flash / PDF are rubbish”
Not useful comments
Anything new will not satisfy X % of users, until
they have used it.
IWMW Glasgow
What is this in your opinion ?
RED
IWMW Glasgow
BLUE
What colour is this in your opinion?
IWMW Glasgow
Development cycle
Web Site Requirements / Specification
Develop Content List
Preparing
Content / Layout
Designing initial
prototype
October
2000
March 2001
September
2001
December
2001
1st user testing
Modifying prototype
2nd user testing
4th
Navigation &
Logic Testing
Correcting
Navigation
Issues –
uportal
February
2002
3rd user
testing
Modifying
design
April
2002
June
2002
June 2002
August
2002
Writing
Training
Material
User Log
Tracking
IWMW Glasgow
Specification
What does the system do?
•What are the users like
•What do they want the system to do
•What can we do from the users want list
•What are the usability issues with current systems
•Can the MLE solve these issues
•Project team produced a list of what they wanted
as indicative student users
IWMW Glasgow
User Requirements
• Ask yourself / project team / steering committee
• Ask users
• Research other systems or similar sites
• What is unique to your project - QLS
• Produce a list of content
• Refine list to remove duplication / impossible
content
• Record list with reasons
IWMW Glasgow
Sources of Requirements
1. DMU PC ownership and use
survey 1997, 98, 99, & 00
2. Collaboration in Research
Support by Academic Libraries in
Leicestershire survey [CORSALL]
3. ANGEL user analysis results
4. DMU Nursing School, online
course survey
5. DMU Library survey of student
information needs
6. DMU Research papers on
using the Internet for teaching.
7. DMU Keyskills survey of all first
year students
8. Student Experience Unit
feedback from students leaving
the university
9. DMU Student focus group
meeting
10. Usage reports from similar
11. User interviews with users of
similar existing systems
IWMW Glasgow
Results of Specification
• Consistent trend that PC ownership is increasing and that online use
is also increasing
• Users ask for more content than they need
• Academic users want the MLE to be integrated in university
and not isolated
• Students are unconcerned about security and privacy of online
information
• Navigation must be mouse rather than keyboard based, back arrow
used in preference to all other navigation devices
Contents List
IWMW Glasgow
IWMW Glasgow
IWMW Glasgow
Dendrogram
IWMW Glasgow
IWMW Glasgow
MLE Version 2
IWMW Glasgow
Further login trials, testing navigation
•Login trials - user name and password
•Simple content location
•Logging out
•Interface issues
Don’t look at too much each time
IWMW Glasgow
Testing login
&
photographs
IWMW Glasgow
Login trails with HNC, BA, MA students
12 first year students HNC Housing Part-time
7 second year students BA Accounting and
Finance Full-time
26 postgraduates taking MA degrees Full-time
Between each test correct problems and
develop a new feature for testing
IWMW Glasgow
How many times do you test it, how many
subjects do you need?
•As many times as you can which will yield useful data
•Between 4 and 10 subjects at a time
•What are you testing ?
•what is the question
•what will you do with the results
•What resources are available
•Don’t leave it hoping it will be alright
IWMW Glasgow
MLE Version 3
IWMW Glasgow
IWMW Glasgow
User tracking data
• User Logs for six months
Logon Data, route through site, User Names
Course being studied, Self assessments
completed, discussion involvement
• Didn’t match interview or focus group reports
IWMW Glasgow
Pathways, which way do people go.
Track routes taken by users
Particular attention to successful students
Use data to provide mentoring support to students
having problems
Use data to provide a list of shortcuts
Do people do what they said they wanted in the
specification
IWMW Glasgow
Future Usability:
Training and Help pages
Focus groups – face to face
Online Questionnaires
Feedback from modules with teaching resources
online
IWMW Glasgow
Benefits of the methods
• Provide a handle on the university administration
information issues
• Publicity and visibility for project
• Resolve problems as they were discovered
• Kept in touch with all types of users
IWMW Glasgow
How would we do it differently
• Have an off-line non development system for
testing usability
• Use external evaluation only in the second half of
the project
• When carrying out usability testing freeze the
design
IWMW Glasgow
What should you do?
• Set-up a steering group or panel
• Think about what the site / page / system is
providing
• Do testing using a prototype of content and
navigation regularly
• Always have a usability issue to hand
• Use conventions and standard layouts
– what did the users tell you
IWMW Glasgow
Summary
•3 Formative and 2 Summative methods of
assessment
•Ask users what they want
•Test navigation regularly
•Implement changes and test again
•Don’t expect to please everybody
IWMW Glasgow
Where am I now ?

More Related Content

PPTX
An Alternative to Open Source Textbooks: A Case Study of a Library Spearheadi...
PPTX
OCLS 2010: Tracking the Elusive Student
PPT
Intute Virtual Training Suite: LILAC 2009
PPTX
PPT
Teaching internet research skills - new directions for the Intute: Virtual Tr...
PPTX
Desire2Learn at the University of Wisconsin-Madison (Nov. 2012)
PPT
Cpd25 Moodle at LSE: Library support issues
PPT
Making it Work...Taking the Frustration Out of Course Reserves
An Alternative to Open Source Textbooks: A Case Study of a Library Spearheadi...
OCLS 2010: Tracking the Elusive Student
Intute Virtual Training Suite: LILAC 2009
Teaching internet research skills - new directions for the Intute: Virtual Tr...
Desire2Learn at the University of Wisconsin-Madison (Nov. 2012)
Cpd25 Moodle at LSE: Library support issues
Making it Work...Taking the Frustration Out of Course Reserves

What's hot (20)

DOCX
What is the virtual learning environment
PDF
Research Topic: Creating a Market for Innovation in Teaching and Learning
PPTX
RUSA MERS forum midwinter 2015
PPTX
Experience of Coursera Moocs
PPTX
MOOCs at UVa for eLearn October 2015
PDF
Online evaluation System: What support for higher education teachers?
PPTX
Online 101
PPT
Assessing Information Literacy Online
PPT
Next Generation CMS Research
PPTX
Offline solutions for online learning eLA 2014
PPT
Ministry support for moodle (and mahara)
PPTX
Opening the Box: Building online learning communities with multiuser blogging...
PPT
Oer
PPT
Classroom Management Systems
PPTX
What's so special about blended learning?
PPT
LILO and Laulima: Assessing Information Literacy Local-style
PPTX
Introduction to Naviance for Higher Education - ELCA
POT
App4 Dutterer M
PPTX
CMS-Future Trend in Higher Education
What is the virtual learning environment
Research Topic: Creating a Market for Innovation in Teaching and Learning
RUSA MERS forum midwinter 2015
Experience of Coursera Moocs
MOOCs at UVa for eLearn October 2015
Online evaluation System: What support for higher education teachers?
Online 101
Assessing Information Literacy Online
Next Generation CMS Research
Offline solutions for online learning eLA 2014
Ministry support for moodle (and mahara)
Opening the Box: Building online learning communities with multiuser blogging...
Oer
Classroom Management Systems
What's so special about blended learning?
LILO and Laulima: Assessing Information Literacy Local-style
Introduction to Naviance for Higher Education - ELCA
App4 Dutterer M
CMS-Future Trend in Higher Education
Ad

Viewers also liked (10)

PDF
Fuzzy Logic Based Energy Management System for Hybrid Electric Vehicle
ODP
Tic
PPS
PDF
Analgezja regionalna do porodu. algorytm postępowania
PDF
T&T Australia
PDF
8 A Cellular Neural Network based system for cell counting in culture of biol...
PPTX
Releu(antena)
PDF
Apostila de antena coletiva
PDF
Thiagarajar School of Management Business Quiz Prelims
PPTX
Strengths-Based Education Through Strengths-Based Leadership
Fuzzy Logic Based Energy Management System for Hybrid Electric Vehicle
Tic
Analgezja regionalna do porodu. algorytm postępowania
T&T Australia
8 A Cellular Neural Network based system for cell counting in culture of biol...
Releu(antena)
Apostila de antena coletiva
Thiagarajar School of Management Business Quiz Prelims
Strengths-Based Education Through Strengths-Based Leadership
Ad

Similar to IWMW 2002: Designing for Usability (20)

PPTX
LMS-Learning Management System IYAPPAN TEAM.pptx
PDF
Ravi Chandran - WESST - NUS’ Technology Enhanced Learning Environment
PDF
Development of a WCAG theme for a learning management system
PPTX
Sloan-C Mobile Mastery
PDF
Adaptive Support for Educational Question Answering @ EC-TEL 2013 DC
PPT
Ringing the changes: reflections on delivering an information literacy module...
PPTX
Cross-faculty implementation of Myprogress
PPTX
Current trends in online delivery and assessment in ANZ
PPTX
IP&T 692R: Week 2-History of the LMS
PPTX
MEAS Course on E-learning: 4 The online environment within the university and...
PPTX
MEAS Course on E-Learning: 4 The online environment within the university and...
PPTX
SMART STUDENT MANAGEMENT project of internet of things.pptx
PPTX
Learning management system
PDF
Learning Analytics and MOOCs
PPT
It proforum template final
PPTX
The Roadmap to Distance Learning Technology: Retooling Traditional Outreach b...
PPTX
Munassir etec647 e presentation
PDF
Lessons from 10 years of E-xcellence quality reviews for e-learning
PPT
Learning management-system-lms
PDF
Excellence rome - v03 2016
LMS-Learning Management System IYAPPAN TEAM.pptx
Ravi Chandran - WESST - NUS’ Technology Enhanced Learning Environment
Development of a WCAG theme for a learning management system
Sloan-C Mobile Mastery
Adaptive Support for Educational Question Answering @ EC-TEL 2013 DC
Ringing the changes: reflections on delivering an information literacy module...
Cross-faculty implementation of Myprogress
Current trends in online delivery and assessment in ANZ
IP&T 692R: Week 2-History of the LMS
MEAS Course on E-learning: 4 The online environment within the university and...
MEAS Course on E-Learning: 4 The online environment within the university and...
SMART STUDENT MANAGEMENT project of internet of things.pptx
Learning management system
Learning Analytics and MOOCs
It proforum template final
The Roadmap to Distance Learning Technology: Retooling Traditional Outreach b...
Munassir etec647 e presentation
Lessons from 10 years of E-xcellence quality reviews for e-learning
Learning management-system-lms
Excellence rome - v03 2016

More from IWMW (20)

PPT
Look who's talking now
PPTX
Introduction to IWMW 2000 (Liz Lyon)
PPTX
Web Tools report
PPT
Personal Contingency Plan - Beat The Panic
PPT
Whose site is it anyway?
PPT
Open Source - the case against
PPT
IWMW 2002: Avoiding Portal Wars - an MIS view
PDF
What does open source mean for the institutional web manager?
PDF
Library 2.0
PPT
Social participation in student recruitment
PDF
Supporting Institutions in Changing Times: Manifesto
PPTX
IWMW 2019 photo scavenger hunt highlights
PDF
How to Turn a Web Strategy into Web Services
PPTX
Static Site Generators - Developing Websites in Low-resource Condition
PPTX
Looking to the Future
PPTX
Looking to the Future
PPTX
Developing Communities of Practice
PDF
How to train your content- so it doesn't slow you down...
PPTX
Grassroots & Guerrillas: The Beginnings of a UX Revolution
PPTX
Connecting Your Content: How to Save Time and Improve Content Quality through...
Look who's talking now
Introduction to IWMW 2000 (Liz Lyon)
Web Tools report
Personal Contingency Plan - Beat The Panic
Whose site is it anyway?
Open Source - the case against
IWMW 2002: Avoiding Portal Wars - an MIS view
What does open source mean for the institutional web manager?
Library 2.0
Social participation in student recruitment
Supporting Institutions in Changing Times: Manifesto
IWMW 2019 photo scavenger hunt highlights
How to Turn a Web Strategy into Web Services
Static Site Generators - Developing Websites in Low-resource Condition
Looking to the Future
Looking to the Future
Developing Communities of Practice
How to train your content- so it doesn't slow you down...
Grassroots & Guerrillas: The Beginnings of a UX Revolution
Connecting Your Content: How to Save Time and Improve Content Quality through...

Recently uploaded (20)

PDF
A systematic review of self-coping strategies used by university students to ...
PDF
Trump Administration's workforce development strategy
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PPTX
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Classroom Observation Tools for Teachers
PDF
advance database management system book.pdf
PDF
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PDF
1_English_Language_Set_2.pdf probationary
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PPTX
Lesson notes of climatology university.
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
PDF
Hazard Identification & Risk Assessment .pdf
PPTX
Introduction to Building Materials
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PPTX
Cell Types and Its function , kingdom of life
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
A systematic review of self-coping strategies used by university students to ...
Trump Administration's workforce development strategy
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
Final Presentation General Medicine 03-08-2024.pptx
Classroom Observation Tools for Teachers
advance database management system book.pdf
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
1_English_Language_Set_2.pdf probationary
History, Philosophy and sociology of education (1).pptx
LDMMIA Reiki Yoga Finals Review Spring Summer
Lesson notes of climatology university.
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
Hazard Identification & Risk Assessment .pdf
Introduction to Building Materials
Chinmaya Tiranga quiz Grand Finale.pdf
Cell Types and Its function , kingdom of life
202450812 BayCHI UCSC-SV 20250812 v17.pptx

IWMW 2002: Designing for Usability

  • 1. IWMW Glasgow Mark Simpson De Montfort University - Leicester Managed Learning Environment - MLE September 2000 to September 2002 Joint Information Systems Committee -
  • 2. IWMW Glasgow User Issues - Formative and Summative Assessment Designing for Usability •How did we specify the system? •How did we decide on content? •How did we verify content? •Develop conventions for pages? •Usability trade-offs and compromises?
  • 3. IWMW Glasgow What is a MLE? University Electronic resources linked together •Student record system - QLS •Timetabling and Calendar system •Library databases •Module and Results database •Online learning resources - WebCT •Social databases •Email and discussion pages Other student oriented data resources
  • 4. IWMW Glasgow MLE Architecture MLE (Web) Server User Manager Resource Manager MLE Usage Database Student Record System Authentication System Client Application (Web Browser) BIDS EDINA e-Journals etc Remote Authorised Resources Timetabling Finance System Course Management Secure, Authorised Access e-Learning – VLE App Course Notes, Study Guides, Exam Papers Library Diary Discussion Lists, Groupware, email Entertainment, Social outside firewall inside Resources Crossing Firewall
  • 5. IWMW Glasgow Usability how hard is it? Everybody has an opinion “I hate …… …… …” “Frames / Flash / PDF are rubbish” Not useful comments Anything new will not satisfy X % of users, until they have used it.
  • 6. IWMW Glasgow What is this in your opinion ? RED
  • 7. IWMW Glasgow BLUE What colour is this in your opinion?
  • 8. IWMW Glasgow Development cycle Web Site Requirements / Specification Develop Content List Preparing Content / Layout Designing initial prototype October 2000 March 2001 September 2001 December 2001 1st user testing Modifying prototype 2nd user testing 4th Navigation & Logic Testing Correcting Navigation Issues – uportal February 2002 3rd user testing Modifying design April 2002 June 2002 June 2002 August 2002 Writing Training Material User Log Tracking
  • 9. IWMW Glasgow Specification What does the system do? •What are the users like •What do they want the system to do •What can we do from the users want list •What are the usability issues with current systems •Can the MLE solve these issues •Project team produced a list of what they wanted as indicative student users
  • 10. IWMW Glasgow User Requirements • Ask yourself / project team / steering committee • Ask users • Research other systems or similar sites • What is unique to your project - QLS • Produce a list of content • Refine list to remove duplication / impossible content • Record list with reasons
  • 11. IWMW Glasgow Sources of Requirements 1. DMU PC ownership and use survey 1997, 98, 99, & 00 2. Collaboration in Research Support by Academic Libraries in Leicestershire survey [CORSALL] 3. ANGEL user analysis results 4. DMU Nursing School, online course survey 5. DMU Library survey of student information needs 6. DMU Research papers on using the Internet for teaching. 7. DMU Keyskills survey of all first year students 8. Student Experience Unit feedback from students leaving the university 9. DMU Student focus group meeting 10. Usage reports from similar 11. User interviews with users of similar existing systems
  • 12. IWMW Glasgow Results of Specification • Consistent trend that PC ownership is increasing and that online use is also increasing • Users ask for more content than they need • Academic users want the MLE to be integrated in university and not isolated • Students are unconcerned about security and privacy of online information • Navigation must be mouse rather than keyboard based, back arrow used in preference to all other navigation devices Contents List
  • 18. IWMW Glasgow Further login trials, testing navigation •Login trials - user name and password •Simple content location •Logging out •Interface issues Don’t look at too much each time
  • 20. IWMW Glasgow Login trails with HNC, BA, MA students 12 first year students HNC Housing Part-time 7 second year students BA Accounting and Finance Full-time 26 postgraduates taking MA degrees Full-time Between each test correct problems and develop a new feature for testing
  • 21. IWMW Glasgow How many times do you test it, how many subjects do you need? •As many times as you can which will yield useful data •Between 4 and 10 subjects at a time •What are you testing ? •what is the question •what will you do with the results •What resources are available •Don’t leave it hoping it will be alright
  • 24. IWMW Glasgow User tracking data • User Logs for six months Logon Data, route through site, User Names Course being studied, Self assessments completed, discussion involvement • Didn’t match interview or focus group reports
  • 25. IWMW Glasgow Pathways, which way do people go. Track routes taken by users Particular attention to successful students Use data to provide mentoring support to students having problems Use data to provide a list of shortcuts Do people do what they said they wanted in the specification
  • 26. IWMW Glasgow Future Usability: Training and Help pages Focus groups – face to face Online Questionnaires Feedback from modules with teaching resources online
  • 27. IWMW Glasgow Benefits of the methods • Provide a handle on the university administration information issues • Publicity and visibility for project • Resolve problems as they were discovered • Kept in touch with all types of users
  • 28. IWMW Glasgow How would we do it differently • Have an off-line non development system for testing usability • Use external evaluation only in the second half of the project • When carrying out usability testing freeze the design
  • 29. IWMW Glasgow What should you do? • Set-up a steering group or panel • Think about what the site / page / system is providing • Do testing using a prototype of content and navigation regularly • Always have a usability issue to hand • Use conventions and standard layouts – what did the users tell you
  • 30. IWMW Glasgow Summary •3 Formative and 2 Summative methods of assessment •Ask users what they want •Test navigation regularly •Implement changes and test again •Don’t expect to please everybody

Editor's Notes

  • #9: Design Cycle Dates are in the inner circle and activities outside the circle Not a linear process, progress can jump ahead or seem to stall for periods thorough out the design. At 3 o’clock position technical change to MLE form using JAVA To U portal.
  • #10: Users of MLE are STUDENTS Content providers secondary users are support and academic staff. To start use your own ideas and content. Your opinion is as valid as any body else.
  • #12: First 8 sources already reported and summarised Take the findings and apply 9, 10 11 – Done by the MLE project team to complete picture Resulted in surveying hundreds of potential users Effective way of specifying requirements.
  • #13: Content list had 31 items.
  • #14: First design Use conventions, may not like them but users are familiar Menus, buttons, Logos in the top left had corner Microsoft panel controls Help features Ensure you design to least techically advance machines in the University Slowest update rates over campus and home use. JAVA code
  • #15: 31 Content Cards + Blanks Menu Names Content Groups Priority Staff 21 Students134 Total155