SlideShare a Scribd company logo
School of Medicine Technology Enhanced Learning
University of Leeds
Using MyProgress in Workplace Based Assessment, Small
Group teaching and Peer Assessment.
Gareth Frith
Technology Enhanced Learning Manager, School of Medicine
g.s.frith@leeds.ac.uk
June 2015
Innovation in portfolio and mobile
learning for Medical undergraduates
Leeds Institute of Medical Education
University of Leeds
Supporting medical education with technology
Challenges for students and staff
Students spend a large amount of time off campus in clinical practice
Students need access to systems from clinical practice e.g. VLE / timetable
Students need to get good and immediate assessment and feedback
Opportunities for student to be assessed and follow patient cases
Opportunities for students to observe specific conditions
Students need to rehearse responses - e.g. for OSCE or real situations
Students learn in different individual ways
Undergraduate Medicine in Leeds - MBChB
Five or six year course - 260 students per year
New Curriculum launched in 2010
IDEALS and RESS - developing skills to be leaders
Students are learning in hospitals, clinics and the
community
Work based practice crucial to success
New clinical placements:
• Year 1 & 2 – Primary & Secondary Care
• Year 3 – Elderly Medicine & Special Senses (2012)
• Year 4 – Acute & Critical Care; Cancer & long term care
• Year 5 – Assistantships and transitions to practice
Mobile Learning supports learning and assessment
Small Group Teaching
IDEALS and RESS
IDEALS (innovation, development, enterprise, leadership and safety)
RESS (research, evaluation and special studies)
IDEALS and RESS
• Professional and research aspects of a medical career
• Taught as small groups for 12 to 15 students per group
• longitudinal over 3 years
• Portfolio is a key elements of teaching
• Exercises set through the portfolio
• Tutor gives feedback through portfolio
Peer Feedback
• Passport for progression at end of each term
• Peer feedback functionality
• Blind feedback within group
Mobile Learning in work-based Practice
Leeds placement locations
Why Mobile MBChB?
Where are our students coming from (educationally, technologically,
culturally)?
What might they look like (and be doing as doctors in 2015-2020?)
What are doctors using mobile for at present?
• Apps
• iPads
• Hard wired
Why Mobile Learning?
Helping Students become better doctors
Support of MBChB Students in practice
Near patient experience
Access to medical information
Assessments undertaken with practice professionals
Reflection, evidence and assessment outcomes recorded and
sent to an e-portfolio
Mobile Learning Delivery
Provide access to published medical content
from practice
Provide a number of assessments that can
be completed as self assessment or with
practice professional
Provide a method of recording assessment
outcomes and publishing them through the
e-portfolio for CPD and Lifelong Learning
Solution
Each Year 4 and Year 5 medical student is loaned
an iPhone 5 which they can use as their device
(260 each year)
Medical Content such as the Oxford Handbooks
(standard Medical texts) and the BNF
(prescribing manual).
Applications for assessment of students
O2 3G Network with unlimited broadband and
voice and txt
Dr Companion
BNF
Oxford Handbook titles
Delivered by Medhand
Other apps
RRAPID
OSCE Toolkit
Instant ECG
Medscape
Medical Content
Apps for Assessment and
Learning
Reflection Tools
Reflection and recording of evidence
through progress file.
Publishing to e-portfolio (private and
public)
either Assessment for Learning
(formative) or Assessment for
Progression (summative)
Delivered by MyKnowledgeMap
Feedback
Assessment Tools
Based on the ALPS assessment suite
of inter-professional assessments
Others which prepare for postgraduate
medicine such as:
miniCEX - mini Clinical examination
Work Place Based Assessment
10,655
Number of items of formative feedback recorded by students from
clinical and healthcare professionals in academic year 2013 / 2014
10,655
276 year 5 students completed 3514 MiniCEX assessments
269Year 4 students completed 7141 Workplace Based
Assessments
Assessment Tools
Learning Suite application (lecturers can
build their own assessment questions)
The e-portfolio - The progress file
Space for reflection
Space for recording evidence
Space for publishing assessment outcomes
preparing for Life Long Learning
developing skills for CPD
key tool for Mobile learning
Mapping to Tomorrows Doctors
Some Outcomes
Students Views
GP Clinical Teacher
MiniCEX
“I think we always did give feedback, but actually this just
formalises it and makes you do it really, and makes the
student really ask for specific feedback, so I think that’s really
good, and it makes it timely because you are doing it you
know at the end of, shortly after seeing the patient (GP
clinical teacher)
F2 doctor - non Leeds Graduate“And I also think from a foundation point of view for the future portfolio, well the portfolio I do at the moment, the more exposure you get earlier on as a student, it makes it easier for you to understand what an e-portfolio is, and makes your own portfolio better. Because when I started my foundation year we hadn’t done any electronic evidence, it was quite an adjustment to make.” (F2 Doctor – non-Leeds graduate)
E-Portfolio
“And I also think from a foundation point of view for the future
portfolio, well the portfolio I do at the moment, the more exposure
you get earlier on as a student, it makes it easier for you to
understand what an e-portfolio is, and makes your own portfolio
better.  Because when I started my foundation year we hadn’t done
any electronic evidence, it was quite an adjustment to make.” (F2
Doctor – non-Leeds graduate)
F2 Doctor - Graduated 2011“And I also think from a foundation point of view for the future portfolio, well the portfolio I do at the moment, the more exposure you get earlier on as a student, it makes it easier for you to understand what an e-portfolio is, and makes your own portfolio better. Because when I started my foundation year we hadn’t done any electronic evidence, it was quite an adjustment to make.” (F2 Doctor – non-Leeds graduate)
Mobile Learning
“It’s definitely changed the way that I use my mobile now and
use technology now to learn, to have like ongoing learning
whilst working, and I think sort of that the resources are
endless which is what I quite like, and there are still things
that are out there which I know would help me in my career
that I haven’t found yet or downloaded yet, so it’s quite good
to know that I have this sort of endless resource out there to
use.”
What did the students think?
On Dr Companion:
It’s like learning to drive, you wonder how you coped before you could
drive. I mean I’ve been onto placement and I remember specifically a
day when I forgot my phone, and I felt like I was without an arm, not
because I couldn’t text but because I didn’t have my Dr Companion app
or something that I could just pick up. You forget how reliant actually
you do become on them.
Year 5 student
Success - Programme View
Programme
• Enhancing our assessment for learning + profiling
• Encouraging open book / ‘look up, practice and record’
• Which clinical staff are assessing – and what is feedback
like?
Students & Unexpected developments
• Value of near patient encounters and feedback/supervision
• Breaking down barriers with others
• Remote usage - revision and preparation
Success - Clinical view
Enhancing clinical practice learning (cf. postgrad)
• More engaged students
• ‘Upping the stakes’ of a clinical encounter
• Value of seeing positive feedback loops
Opportunistic
• Students increasing self select – ‘Can I do’
• Better use of everyday material
Resources
• We use them as much as the students!
Questions?

More Related Content

PDF
Innovation in placement assessment
PPTX
Program level design using e-Portfolios: Getting the big picture - Panos Vlac...
PPT
D school assignment 2 ideate
PPTX
Analysis of the effects on academic performance...
PPTX
Fpt uni student presentation
PDF
Delivery Models Faculty Development Model - Competency-Based Education
PPTX
A study on effectiveness of online education
PPTX
Making Connections - Students' Use of Past Feedback
Innovation in placement assessment
Program level design using e-Portfolios: Getting the big picture - Panos Vlac...
D school assignment 2 ideate
Analysis of the effects on academic performance...
Fpt uni student presentation
Delivery Models Faculty Development Model - Competency-Based Education
A study on effectiveness of online education
Making Connections - Students' Use of Past Feedback

What's hot (19)

PPTX
Making Connections: How Students Use Feedback to Inform Future Learning
PPTX
Towards increasing interprofessional learning - Mehigan and Taylor
PPT
DLA Training Spring 2009
PDF
APSCU 2013
PPTX
Early Reporting: BTC
PPTX
Nft101 wk2 lesson
PPT
e_teaching
PDF
Bob Emiliani, Arnhem June 2014, Lean Teaching
PDF
Gloucestershire College BTEC Level 3 Construction Handbook 2018
PDF
Gloucestershire College BTEC Level 3 Construction Handbook 2019
PPT
Persuasive writing
PPT
Milestones to Teach and Evaluate Handoffs
PPTX
How To Have Prospective Students Fall in Love With Your RTO
PPTX
Introducing ReallyManaging Assessment
PPTX
Setting Expectations for e-Education
PPTX
Gloucestershire College BTEC Level 3 Construction and the Built Environment H...
Making Connections: How Students Use Feedback to Inform Future Learning
Towards increasing interprofessional learning - Mehigan and Taylor
DLA Training Spring 2009
APSCU 2013
Early Reporting: BTC
Nft101 wk2 lesson
e_teaching
Bob Emiliani, Arnhem June 2014, Lean Teaching
Gloucestershire College BTEC Level 3 Construction Handbook 2018
Gloucestershire College BTEC Level 3 Construction Handbook 2019
Persuasive writing
Milestones to Teach and Evaluate Handoffs
How To Have Prospective Students Fall in Love With Your RTO
Introducing ReallyManaging Assessment
Setting Expectations for e-Education
Gloucestershire College BTEC Level 3 Construction and the Built Environment H...
Ad

Similar to Using MyProgress in workplace based assessment, small group teaching and peer assessment (20)

PPTX
Online mentor-update
PPTX
Online Mentor Update - PSNET online resource
PPT
E portfolios iphones
PPTX
SLO Across the Division
PPTX
In their own words: Understanding and Enhancing Our Students’ Experience of B...
PPT
Online Learning and Student Success
PPTX
Are you future ready? Preparing students for living and working in a digital ...
PPTX
Distance education
PPT
APP and Controlled Assessment in History - June 2009
PPTX
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
PPTX
APE_PowerPoint_Presentation_Example2015.pptx
DOCX
LDCC Project
PPTX
Data-Driven Student Success Programming in Residence Life - ACUHO-I 2013
PDF
ABLE - Ready for Retention
PPTX
researchED Scotland 2015 - How well am I doing as an evidence-informed pract...
DOCX
Your paper must be written as a research paper in.docx
PPTX
Admissions Counselor Training
PDF
(eBook PDF) Teaching Physical Education for Learning 8th Edition
PPT
DOCX
Formative Assessment TemplateInformational Text Reading I.docx
Online mentor-update
Online Mentor Update - PSNET online resource
E portfolios iphones
SLO Across the Division
In their own words: Understanding and Enhancing Our Students’ Experience of B...
Online Learning and Student Success
Are you future ready? Preparing students for living and working in a digital ...
Distance education
APP and Controlled Assessment in History - June 2009
Moving Forward on Learning Analytics - A/Professor Deborah West, Charles Darw...
APE_PowerPoint_Presentation_Example2015.pptx
LDCC Project
Data-Driven Student Success Programming in Residence Life - ACUHO-I 2013
ABLE - Ready for Retention
researchED Scotland 2015 - How well am I doing as an evidence-informed pract...
Your paper must be written as a research paper in.docx
Admissions Counselor Training
(eBook PDF) Teaching Physical Education for Learning 8th Edition
Formative Assessment TemplateInformational Text Reading I.docx
Ad

More from myknowledgemap (20)

PPTX
Enhancing Employability Skills with the St George's University of London Award
PPTX
Electronic Practice Assessment: The road ahead
PPTX
Electronic Practice Assessment: Get set - Creating Electronic Assessments
PPTX
Electronic Practice Assessment: Creating a user community
PPTX
Electronic Practice Assessment: Get Ready
PPTX
Electronic Practice Assessment: Meeting regulatory requirements
PPTX
Myprogress Version 6 overview
PPTX
Implementing a mobile e portfolio system-lessons learned a year on
PPTX
Planning an Implementation of Myshowcase for Medical Education
PPTX
From strategy to practice
PPTX
Introducing Myshowcase.me
PPTX
e-Assessment: Developing New Approaches
PPT
Using MyProgress to Assess Nurses in Clinical Practice
PPTX
Targets, Assessment, Intervention, Progress: Our progress with MyProgress
PPTX
A Paperless Pilot: A perspective from Nottingham
PDF
The Use of a Mobile Application to Enhance Communication Within Initial Teach...
PPTX
The e-Assessment Question: Developing New Approaches
PPT
Implementation of an electronic portfolio
PPTX
Direct observation and feedback
PDF
Cross faculty implementation of myprogress
Enhancing Employability Skills with the St George's University of London Award
Electronic Practice Assessment: The road ahead
Electronic Practice Assessment: Get set - Creating Electronic Assessments
Electronic Practice Assessment: Creating a user community
Electronic Practice Assessment: Get Ready
Electronic Practice Assessment: Meeting regulatory requirements
Myprogress Version 6 overview
Implementing a mobile e portfolio system-lessons learned a year on
Planning an Implementation of Myshowcase for Medical Education
From strategy to practice
Introducing Myshowcase.me
e-Assessment: Developing New Approaches
Using MyProgress to Assess Nurses in Clinical Practice
Targets, Assessment, Intervention, Progress: Our progress with MyProgress
A Paperless Pilot: A perspective from Nottingham
The Use of a Mobile Application to Enhance Communication Within Initial Teach...
The e-Assessment Question: Developing New Approaches
Implementation of an electronic portfolio
Direct observation and feedback
Cross faculty implementation of myprogress

Recently uploaded (20)

PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PPTX
Lesson notes of climatology university.
PPTX
GDM (1) (1).pptx small presentation for students
PDF
Trump Administration's workforce development strategy
PPTX
Cell Structure & Organelles in detailed.
PPTX
Cell Types and Its function , kingdom of life
PDF
Yogi Goddess Pres Conference Studio Updates
PPTX
master seminar digital applications in india
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
Anesthesia in Laparoscopic Surgery in India
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PDF
01-Introduction-to-Information-Management.pdf
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
RMMM.pdf make it easy to upload and study
PDF
A systematic review of self-coping strategies used by university students to ...
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
Lesson notes of climatology university.
GDM (1) (1).pptx small presentation for students
Trump Administration's workforce development strategy
Cell Structure & Organelles in detailed.
Cell Types and Its function , kingdom of life
Yogi Goddess Pres Conference Studio Updates
master seminar digital applications in india
O7-L3 Supply Chain Operations - ICLT Program
Supply Chain Operations Speaking Notes -ICLT Program
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Anesthesia in Laparoscopic Surgery in India
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
01-Introduction-to-Information-Management.pdf
Chinmaya Tiranga quiz Grand Finale.pdf
RMMM.pdf make it easy to upload and study
A systematic review of self-coping strategies used by university students to ...
O5-L3 Freight Transport Ops (International) V1.pdf
Module 4: Burden of Disease Tutorial Slides S2 2025

Using MyProgress in workplace based assessment, small group teaching and peer assessment

  • 1. School of Medicine Technology Enhanced Learning University of Leeds Using MyProgress in Workplace Based Assessment, Small Group teaching and Peer Assessment. Gareth Frith Technology Enhanced Learning Manager, School of Medicine g.s.frith@leeds.ac.uk June 2015
  • 2. Innovation in portfolio and mobile learning for Medical undergraduates Leeds Institute of Medical Education University of Leeds
  • 3. Supporting medical education with technology Challenges for students and staff Students spend a large amount of time off campus in clinical practice Students need access to systems from clinical practice e.g. VLE / timetable Students need to get good and immediate assessment and feedback Opportunities for student to be assessed and follow patient cases Opportunities for students to observe specific conditions Students need to rehearse responses - e.g. for OSCE or real situations Students learn in different individual ways
  • 4. Undergraduate Medicine in Leeds - MBChB Five or six year course - 260 students per year New Curriculum launched in 2010 IDEALS and RESS - developing skills to be leaders Students are learning in hospitals, clinics and the community Work based practice crucial to success New clinical placements: • Year 1 & 2 – Primary & Secondary Care • Year 3 – Elderly Medicine & Special Senses (2012) • Year 4 – Acute & Critical Care; Cancer & long term care • Year 5 – Assistantships and transitions to practice Mobile Learning supports learning and assessment
  • 5. Small Group Teaching IDEALS and RESS IDEALS (innovation, development, enterprise, leadership and safety) RESS (research, evaluation and special studies)
  • 6. IDEALS and RESS • Professional and research aspects of a medical career • Taught as small groups for 12 to 15 students per group • longitudinal over 3 years • Portfolio is a key elements of teaching • Exercises set through the portfolio • Tutor gives feedback through portfolio
  • 7. Peer Feedback • Passport for progression at end of each term • Peer feedback functionality • Blind feedback within group
  • 8. Mobile Learning in work-based Practice
  • 10. Why Mobile MBChB? Where are our students coming from (educationally, technologically, culturally)? What might they look like (and be doing as doctors in 2015-2020?) What are doctors using mobile for at present? • Apps • iPads • Hard wired
  • 11. Why Mobile Learning? Helping Students become better doctors Support of MBChB Students in practice Near patient experience Access to medical information Assessments undertaken with practice professionals Reflection, evidence and assessment outcomes recorded and sent to an e-portfolio
  • 12. Mobile Learning Delivery Provide access to published medical content from practice Provide a number of assessments that can be completed as self assessment or with practice professional Provide a method of recording assessment outcomes and publishing them through the e-portfolio for CPD and Lifelong Learning
  • 13. Solution Each Year 4 and Year 5 medical student is loaned an iPhone 5 which they can use as their device (260 each year) Medical Content such as the Oxford Handbooks (standard Medical texts) and the BNF (prescribing manual). Applications for assessment of students O2 3G Network with unlimited broadband and voice and txt
  • 14. Dr Companion BNF Oxford Handbook titles Delivered by Medhand Other apps RRAPID OSCE Toolkit Instant ECG Medscape Medical Content
  • 15. Apps for Assessment and Learning
  • 16. Reflection Tools Reflection and recording of evidence through progress file. Publishing to e-portfolio (private and public) either Assessment for Learning (formative) or Assessment for Progression (summative) Delivered by MyKnowledgeMap
  • 18. Assessment Tools Based on the ALPS assessment suite of inter-professional assessments Others which prepare for postgraduate medicine such as: miniCEX - mini Clinical examination Work Place Based Assessment
  • 19. 10,655 Number of items of formative feedback recorded by students from clinical and healthcare professionals in academic year 2013 / 2014
  • 20. 10,655 276 year 5 students completed 3514 MiniCEX assessments 269Year 4 students completed 7141 Workplace Based Assessments
  • 21. Assessment Tools Learning Suite application (lecturers can build their own assessment questions)
  • 22. The e-portfolio - The progress file Space for reflection Space for recording evidence Space for publishing assessment outcomes preparing for Life Long Learning developing skills for CPD key tool for Mobile learning Mapping to Tomorrows Doctors
  • 25. GP Clinical Teacher MiniCEX “I think we always did give feedback, but actually this just formalises it and makes you do it really, and makes the student really ask for specific feedback, so I think that’s really good, and it makes it timely because you are doing it you know at the end of, shortly after seeing the patient (GP clinical teacher)
  • 26. F2 doctor - non Leeds Graduate“And I also think from a foundation point of view for the future portfolio, well the portfolio I do at the moment, the more exposure you get earlier on as a student, it makes it easier for you to understand what an e-portfolio is, and makes your own portfolio better. Because when I started my foundation year we hadn’t done any electronic evidence, it was quite an adjustment to make.” (F2 Doctor – non-Leeds graduate) E-Portfolio “And I also think from a foundation point of view for the future portfolio, well the portfolio I do at the moment, the more exposure you get earlier on as a student, it makes it easier for you to understand what an e-portfolio is, and makes your own portfolio better.  Because when I started my foundation year we hadn’t done any electronic evidence, it was quite an adjustment to make.” (F2 Doctor – non-Leeds graduate)
  • 27. F2 Doctor - Graduated 2011“And I also think from a foundation point of view for the future portfolio, well the portfolio I do at the moment, the more exposure you get earlier on as a student, it makes it easier for you to understand what an e-portfolio is, and makes your own portfolio better. Because when I started my foundation year we hadn’t done any electronic evidence, it was quite an adjustment to make.” (F2 Doctor – non-Leeds graduate) Mobile Learning “It’s definitely changed the way that I use my mobile now and use technology now to learn, to have like ongoing learning whilst working, and I think sort of that the resources are endless which is what I quite like, and there are still things that are out there which I know would help me in my career that I haven’t found yet or downloaded yet, so it’s quite good to know that I have this sort of endless resource out there to use.”
  • 28. What did the students think? On Dr Companion: It’s like learning to drive, you wonder how you coped before you could drive. I mean I’ve been onto placement and I remember specifically a day when I forgot my phone, and I felt like I was without an arm, not because I couldn’t text but because I didn’t have my Dr Companion app or something that I could just pick up. You forget how reliant actually you do become on them. Year 5 student
  • 29. Success - Programme View Programme • Enhancing our assessment for learning + profiling • Encouraging open book / ‘look up, practice and record’ • Which clinical staff are assessing – and what is feedback like? Students & Unexpected developments • Value of near patient encounters and feedback/supervision • Breaking down barriers with others • Remote usage - revision and preparation
  • 30. Success - Clinical view Enhancing clinical practice learning (cf. postgrad) • More engaged students • ‘Upping the stakes’ of a clinical encounter • Value of seeing positive feedback loops Opportunistic • Students increasing self select – ‘Can I do’ • Better use of everyday material Resources • We use them as much as the students!