SlideShare a Scribd company logo
How to avoid research debt
a workshop on ResearchOps
for user research in service design
Caroline Jarrett Stephanie Rosenbaum
cj@effortmark.co.uk stephanie@teced.com
#SDinGov
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
User research is crucial
for service design
https://www.gov.uk/service-manual/service-standard
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
What happens after user research?
• Decisions made, do you
move on and forget it?
• Do you preserve that
research for re-use?
• How to you communicate
research to someone new?
Image credit: https://picryl.com/media/goodby-mother-goodby-sweetheart-song
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
ResearchOps is
work that we do
to do good research
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
“ResearchOps is
the mechanisms and strategies
that set user research in motion.
It provides the roles, tools and processes
needed to support researchers
in delivering and scaling
the impact of the craft across an organisation.”
@teamreops / @katetowsey
https://www.slideshare.net/uxbri/what-is-researchops-kate-towsey
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
“our user researchers are only actually
researching about 30% of their time”
• “We work with the team to improve the service”
• “We communicate what we know”
• “We prepare for research”
• “We look at site analytics”
Leisa Reichelt
https://userresearch.blog.gov.uk/2014/09/10/what-user-researchers-do-when-theyre-not-researching/
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
There can be a surprisingly large quantity of pieces of
paper after an evaluation
Jarrett, C (2001) “Unit 7: Evaluation in Practice” in
Open University course M873 User Interface Design and Evaluation
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Missing items?
• We review previous research for relevant insights
• “We work with the team to improve the service”
• “We communicate what we know”
• “We prepare for research”
• “We look at site analytics”
• We organise what we have done for reuse later
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Research debt is
work that we assign
to our future selves
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Technology evolves, people move on
https://web.archive.org/web/20170429074727/
https://servicemanual.hackpad.com/User-research-on-design-patterns-di8PSAAShG1
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
https://twitter.com/Lorna_Wall/status/1006441548488331269
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
This workshop is in three parts
1. Describe:
What things does
research create?
2. Compare:
What do we currently do
with those things?
3. Improve:
What does best practice
look like?
Image credit: https://www.flickr.com/photos/boston_public_library/8557193567
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Describe – on your own at first
• What things does your research create?
• Consider:
Tangible: such as objects, things you pick up / set down / back up
Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’
Immediate: answers to the research questions, explorations of hypotheses
Longer-term: deeper understanding of users, better ideas about how to meet
their needs
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Pair up and swap ideas
• What things does your research create?
• Consider:
Tangible: such as objects, things you pick up / set down / back up
Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’
Immediate: answers to the research questions, explorations of hypotheses
Longer-term: deeper understanding of users, better ideas about how to meet
their needs
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Pool ideas in larger groups
• What things does your research create?
• Consider:
Tangible: such as objects, things you pick up / set down / back up
Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’
Immediate: answers to the research questions, explorations of hypotheses
Longer-term: deeper understanding of users, better ideas about how to meet
their needs
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Compare – on your own at first
• What things do you (or your organisation) currently do?
1. We have a clear policy for this and we do it immediately
2. We have a policy and we get round to it occasionally
3. We don't have a policy but we wish we did
4. We don't have a policy and we don't see any need for one
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Improve:
What does best practice look like?
• What are your ideas for making this happen regularly?
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Tips for a good handover - Nadia Huq
• Write down names and job titles of everyone involved in the build, from
senior management to developers to contacts at GOV.UK.
• Keep a list of additional functionality or design changes you would have
explored if you’d had the time.
• If you can, put together a map of the end to end journey. They’re great for
quickly getting a bird’s-eye view of a service.
• If you do a heuristic review of an existing service, include screenshots of it
at the time of review. Years down the line, without screenshots, it can be
really tricky to work out what you were looking at.
• Save everything in one place, with a clear taxonomy and naming
conventions.
https://hodigital.blog.gov.uk/2017/10/27/take-note-why-you-should-keep-records-of-service-decisions/
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Idea 1: The Research Debt Sprint
(mainly for agile teams working in 2-week sprints)
• Set aside one sprint each quarter for paying research debt
• No new research
• Organise and clear up the stuff
• Think about the insights and gaps
• Write some reports, publications, blog posts
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Idea 2: The Project Close-Down
(mainly for agencies working on specific engagements)
• Set aside a week of close-down time after each
• Organise and clear up the stuff
• Do a retro on the project
– What went well
– What went badly
– What we’ll do more of next time
– What we’ll avoid next time
• Write a whitepaper, case study, marketing literature
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Keep in touch
Caroline cj@effortmark.co.uk
Stephanie stephanie@teced.com

More Related Content

PPTX
How to design a form: Discussing a curriculum
PPTX
Discussing a Topic Map for How to Design a Better Form 2019 March
PPTX
Inwards and outwards research: choosing your research methods according to th...
PPTX
The inevitable survey 2021
PPTX
Better UX Surveys part 1
PPT
Label placement on forms, STC Seattle 2010
PPTX
Better UX Surveys at UCD2012 by @cjforms
PPTX
Why do usability problems go unfixed?
How to design a form: Discussing a curriculum
Discussing a Topic Map for How to Design a Better Form 2019 March
Inwards and outwards research: choosing your research methods according to th...
The inevitable survey 2021
Better UX Surveys part 1
Label placement on forms, STC Seattle 2010
Better UX Surveys at UCD2012 by @cjforms
Why do usability problems go unfixed?

What's hot (20)

PPTX
But the light-bulb has to want to change: Why do usability problems so often...
PPTX
Six crucial survey concepts that UX professionals need to know
PPTX
Surveys in practice and theory
PPTX
10 tips for a better UX survey
PPTX
Five Steps to Better Surveys: part of the Surveys that Work training course f...
PPTX
10 tips for a better survey at UX Bristol
PDF
Effective Use of Surveys in UX | Triangle UXPA Workshop
PDF
Design tips for complex forms by @cjforms 2013
PPTX
Surveys that work EBI_2017
PPTX
Buttons on forms and surveys: a look at some research 2012
PDF
Web Survey and Forms Usability Design & Testing
PPTX
Taxonomy Validation
PDF
Creating a Virtuous Cycle - The Research and Design Feedback Loop
PDF
Raskar Entrepreneurship in Imaging, Imaging Ventures, CVPR 2012
PDF
Exploratory user research (How to figure out what to test)
PDF
Success takes teams, not working together
PDF
UXPA DC UX 101 - User Research
PPT
SY 7034 Week8
PDF
UX Lesson 2: User Research
PPTX
Guerrilla (or Agile) Evaluation for Learning
But the light-bulb has to want to change: Why do usability problems so often...
Six crucial survey concepts that UX professionals need to know
Surveys in practice and theory
10 tips for a better UX survey
Five Steps to Better Surveys: part of the Surveys that Work training course f...
10 tips for a better survey at UX Bristol
Effective Use of Surveys in UX | Triangle UXPA Workshop
Design tips for complex forms by @cjforms 2013
Surveys that work EBI_2017
Buttons on forms and surveys: a look at some research 2012
Web Survey and Forms Usability Design & Testing
Taxonomy Validation
Creating a Virtuous Cycle - The Research and Design Feedback Loop
Raskar Entrepreneurship in Imaging, Imaging Ventures, CVPR 2012
Exploratory user research (How to figure out what to test)
Success takes teams, not working together
UXPA DC UX 101 - User Research
SY 7034 Week8
UX Lesson 2: User Research
Guerrilla (or Agile) Evaluation for Learning
Ad

Similar to How to avoid research debt (20)

PDF
Field Research at the Speed of Business
PPT
Winter school 2012
PDF
Product Anonymous: After Research - Creating Useful & Well Executed Research ...
PDF
Making Research Count
PPTX
User Experience Service showcase lightning talks - December 2018
PPTX
Creating a collaborative research & testing culture.
PDF
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
PDF
The Report is Dead, Long Live the Report ! Communicating Usability Research F...
PDF
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
PDF
Bright ideas for UX Researchers
PDF
"Open" includes users - Leverage their input
PDF
3 Steps to Create a Habit of User Research on Your Product Team
PPTX
Digital approaches to service design | Sarah Prag | September 2015
PPTX
DBA #15 Sweating the Method: Getting the Most Out of Your (Limited) Research ...
PDF
Jam Input Notes Stefan Müller
PDF
UserTesting 2016 webinar: Research to inform product design in Agile environm...
PDF
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
PPT
Assn 1 opportunity spotting through user experience tasksheet (40%) 28 feb 20...
PPTX
Startup Research and Design Toolkit
PDF
Getting Started with UX Research OCUX Camp CRossi Aug 2017
Field Research at the Speed of Business
Winter school 2012
Product Anonymous: After Research - Creating Useful & Well Executed Research ...
Making Research Count
User Experience Service showcase lightning talks - December 2018
Creating a collaborative research & testing culture.
The Report is Dead, Long Live the Report! How to Communicate UX Research Find...
The Report is Dead, Long Live the Report ! Communicating Usability Research F...
UXPA 2023: The Report is Dead, Long Live the Report! How to Communicate Usabi...
Bright ideas for UX Researchers
"Open" includes users - Leverage their input
3 Steps to Create a Habit of User Research on Your Product Team
Digital approaches to service design | Sarah Prag | September 2015
DBA #15 Sweating the Method: Getting the Most Out of Your (Limited) Research ...
Jam Input Notes Stefan Müller
UserTesting 2016 webinar: Research to inform product design in Agile environm...
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
Assn 1 opportunity spotting through user experience tasksheet (40%) 28 feb 20...
Startup Research and Design Toolkit
Getting Started with UX Research OCUX Camp CRossi Aug 2017
Ad

More from Caroline Jarrett (20)

PPTX
2025 UX Connect Aarhus - garbage in garbage out.pptx
PPTX
Errors and error rates: workshop for X-Gov content clubpptx
PPTX
2025 Agile Manchester - error rates and data quality.pptx
PPTX
Some thoughts about surveys: Olin 2024.pptx
PPTX
Getting forms right: how better words lead to better results
PPTX
Creating truly accessible forms: workshop at SDinGov 2024.pptx
PPTX
2024 Creating truly accessible forms, Ladies that UX Seattle
PPTX
Creating truly accessible forms, SDinGov 2024
PPTX
Using surveys to uncover audience insights
PPTX
2023 Surveys that work Olin.pptx
PPTX
The Phylogenetic Tree in forms design - making forms work for complex academ...
PPTX
Four ways to make a better survey WebExpo2023
PPTX
Content design in practice May 2023.pptx
PPTX
Two ways to improve your survey, webinar for Delib 2023.pptx
PPTX
How to save money by fixing forms, WebExpo2023
PPTX
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
PPTX
How to look at a form Boye 22.pptx
PPTX
Prune tune postpone explain.pptx
PPTX
What is a service designer SDinGOV 22 with all stickies.pptx
PPTX
Helping teenage boys to become responsible adults.pptx
2025 UX Connect Aarhus - garbage in garbage out.pptx
Errors and error rates: workshop for X-Gov content clubpptx
2025 Agile Manchester - error rates and data quality.pptx
Some thoughts about surveys: Olin 2024.pptx
Getting forms right: how better words lead to better results
Creating truly accessible forms: workshop at SDinGov 2024.pptx
2024 Creating truly accessible forms, Ladies that UX Seattle
Creating truly accessible forms, SDinGov 2024
Using surveys to uncover audience insights
2023 Surveys that work Olin.pptx
The Phylogenetic Tree in forms design - making forms work for complex academ...
Four ways to make a better survey WebExpo2023
Content design in practice May 2023.pptx
Two ways to improve your survey, webinar for Delib 2023.pptx
How to save money by fixing forms, WebExpo2023
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
How to look at a form Boye 22.pptx
Prune tune postpone explain.pptx
What is a service designer SDinGOV 22 with all stickies.pptx
Helping teenage boys to become responsible adults.pptx

Recently uploaded (20)

PDF
Skskkxiixijsjsnwkwkaksixindndndjdjdjsjjssk
PDF
GREEN BUILDING MATERIALS FOR SUISTAINABLE ARCHITECTURE AND BUILDING STUDY
PPT
Machine printing techniques and plangi dyeing
PPTX
AC-Unit1.pptx CRYPTOGRAPHIC NNNNFOR ALL
PPTX
BSCS lesson 3.pptxnbbjbb mnbkjbkbbkbbkjb
PPTX
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
PDF
Phone away, tabs closed: No multitasking
PPTX
mahatma gandhi bus terminal in india Case Study.pptx
PDF
Urban Design Final Project-Site Analysis
PDF
SEVA- Fashion designing-Presentation.pdf
PPTX
areprosthodontics and orthodonticsa text.pptx
PPTX
Entrepreneur intro, origin, process, method
PDF
Design Thinking - Module 1 - Introduction To Design Thinking - Dr. Rohan Dasg...
PDF
Facade & Landscape Lighting Techniques and Trends.pptx.pdf
PPT
EGWHermeneuticsffgggggggggggggggggggggggggggggggg.ppt
PPTX
YV PROFILE PROJECTS PROFILE PRES. DESIGN
PPTX
Complete Guide to Microsoft PowerPoint 2019 – Features, Tools, and Tips"
PDF
YOW2022-BNE-MinimalViableArchitecture.pdf
PPTX
joggers park landscape assignment bandra
PPTX
HPE Aruba-master-icon-library_052722.pptx
Skskkxiixijsjsnwkwkaksixindndndjdjdjsjjssk
GREEN BUILDING MATERIALS FOR SUISTAINABLE ARCHITECTURE AND BUILDING STUDY
Machine printing techniques and plangi dyeing
AC-Unit1.pptx CRYPTOGRAPHIC NNNNFOR ALL
BSCS lesson 3.pptxnbbjbb mnbkjbkbbkbbkjb
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
Phone away, tabs closed: No multitasking
mahatma gandhi bus terminal in india Case Study.pptx
Urban Design Final Project-Site Analysis
SEVA- Fashion designing-Presentation.pdf
areprosthodontics and orthodonticsa text.pptx
Entrepreneur intro, origin, process, method
Design Thinking - Module 1 - Introduction To Design Thinking - Dr. Rohan Dasg...
Facade & Landscape Lighting Techniques and Trends.pptx.pdf
EGWHermeneuticsffgggggggggggggggggggggggggggggggg.ppt
YV PROFILE PROJECTS PROFILE PRES. DESIGN
Complete Guide to Microsoft PowerPoint 2019 – Features, Tools, and Tips"
YOW2022-BNE-MinimalViableArchitecture.pdf
joggers park landscape assignment bandra
HPE Aruba-master-icon-library_052722.pptx

How to avoid research debt

  • 1. How to avoid research debt a workshop on ResearchOps for user research in service design Caroline Jarrett Stephanie Rosenbaum cj@effortmark.co.uk stephanie@teced.com #SDinGov
  • 2. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced User research is crucial for service design https://www.gov.uk/service-manual/service-standard
  • 3. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced What happens after user research? • Decisions made, do you move on and forget it? • Do you preserve that research for re-use? • How to you communicate research to someone new? Image credit: https://picryl.com/media/goodby-mother-goodby-sweetheart-song
  • 4. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced ResearchOps is work that we do to do good research
  • 5. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced “ResearchOps is the mechanisms and strategies that set user research in motion. It provides the roles, tools and processes needed to support researchers in delivering and scaling the impact of the craft across an organisation.” @teamreops / @katetowsey https://www.slideshare.net/uxbri/what-is-researchops-kate-towsey
  • 6. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced “our user researchers are only actually researching about 30% of their time” • “We work with the team to improve the service” • “We communicate what we know” • “We prepare for research” • “We look at site analytics” Leisa Reichelt https://userresearch.blog.gov.uk/2014/09/10/what-user-researchers-do-when-theyre-not-researching/
  • 7. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced There can be a surprisingly large quantity of pieces of paper after an evaluation Jarrett, C (2001) “Unit 7: Evaluation in Practice” in Open University course M873 User Interface Design and Evaluation
  • 8. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Missing items? • We review previous research for relevant insights • “We work with the team to improve the service” • “We communicate what we know” • “We prepare for research” • “We look at site analytics” • We organise what we have done for reuse later
  • 9. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Research debt is work that we assign to our future selves
  • 10. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Technology evolves, people move on https://web.archive.org/web/20170429074727/ https://servicemanual.hackpad.com/User-research-on-design-patterns-di8PSAAShG1
  • 11. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced https://twitter.com/Lorna_Wall/status/1006441548488331269
  • 12. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced This workshop is in three parts 1. Describe: What things does research create? 2. Compare: What do we currently do with those things? 3. Improve: What does best practice look like? Image credit: https://www.flickr.com/photos/boston_public_library/8557193567
  • 13. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Describe – on your own at first • What things does your research create? • Consider: Tangible: such as objects, things you pick up / set down / back up Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’ Immediate: answers to the research questions, explorations of hypotheses Longer-term: deeper understanding of users, better ideas about how to meet their needs
  • 14. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Pair up and swap ideas • What things does your research create? • Consider: Tangible: such as objects, things you pick up / set down / back up Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’ Immediate: answers to the research questions, explorations of hypotheses Longer-term: deeper understanding of users, better ideas about how to meet their needs
  • 15. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Pool ideas in larger groups • What things does your research create? • Consider: Tangible: such as objects, things you pick up / set down / back up Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’ Immediate: answers to the research questions, explorations of hypotheses Longer-term: deeper understanding of users, better ideas about how to meet their needs
  • 16. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Compare – on your own at first • What things do you (or your organisation) currently do? 1. We have a clear policy for this and we do it immediately 2. We have a policy and we get round to it occasionally 3. We don't have a policy but we wish we did 4. We don't have a policy and we don't see any need for one
  • 17. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Improve: What does best practice look like? • What are your ideas for making this happen regularly?
  • 18. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Tips for a good handover - Nadia Huq • Write down names and job titles of everyone involved in the build, from senior management to developers to contacts at GOV.UK. • Keep a list of additional functionality or design changes you would have explored if you’d had the time. • If you can, put together a map of the end to end journey. They’re great for quickly getting a bird’s-eye view of a service. • If you do a heuristic review of an existing service, include screenshots of it at the time of review. Years down the line, without screenshots, it can be really tricky to work out what you were looking at. • Save everything in one place, with a clear taxonomy and naming conventions. https://hodigital.blog.gov.uk/2017/10/27/take-note-why-you-should-keep-records-of-service-decisions/
  • 19. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Idea 1: The Research Debt Sprint (mainly for agile teams working in 2-week sprints) • Set aside one sprint each quarter for paying research debt • No new research • Organise and clear up the stuff • Think about the insights and gaps • Write some reports, publications, blog posts
  • 20. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Idea 2: The Project Close-Down (mainly for agencies working on specific engagements) • Set aside a week of close-down time after each • Organise and clear up the stuff • Do a retro on the project – What went well – What went badly – What we’ll do more of next time – What we’ll avoid next time • Write a whitepaper, case study, marketing literature
  • 21. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Keep in touch Caroline cj@effortmark.co.uk Stephanie stephanie@teced.com

Editor's Notes

  • #3: Successful service design integrates ongoing user research and usability testing throughout the design process, to continuously improve the service.