SlideShare a Scribd company logo
The security marking for this document is UNCLASSIFIEDThe security marking for this document is UNCLASSIFIED
Open Policy Making –
the HMRC Journey
Nicola Hardaker
Rohan Grove
UNCLASSIFIED
Presentation title | 16/05/14 | 2
WHAT WE WILL COVER
Open Policy Making – what it is and constraints
Where does customer insight fit within the policy making
process (and what tools and techniques are available)
Exploration of a couple of tools and techniques
∙ Customer Insight
∙ Customer Closeness
∙ Mapping customer journeys
∙ Randomised controlled trials
∙ Behaviour Change
Potential threads of insight for tax policy
Final thoughts
UNCLASSIFIED
Presentation title | 16/05/14 | 3
Permission
Constrained Opportunities to experiment
Ambition
LowHigh
Informed policy making
Developing policy with users at the heart
Collaborative policy making
Multidisciplinary team
Evidence
gathering
Expert engagement
Consultation
Public engagement
Multidisciplinary reference
group
Scenario testing
Testing
Coproduction
Public
experience map
Insight tools Call for challenge
Stakeholder map
Persona testing
Crowdsourcing
Open Policy has to be done within the constraints of your subject
and Department
Open Policy Making mindsetOpen Policy Making mindset
HMRC
NOV/NOW
HMRC
Ambition
UNCLASSIFIED
Presentation title | 16/05/14 | 4
Current Policy ProcessCustomer Insight in the Policy Process
Monitor
Review
Evaluate
Idea/problem
Communications
& Guidance
Ministerial
decision
Pilot/
Implementation
Recommendation
to Minister
Consultation
& Appraisal
Identify Options
Establish objectives
& outcomes
Success criteria for
HMRC & customers
Who are the
customers?
What do we
know about
them?
Research & Insight
Customer Closeness
Customer Journeys
Behavioural Science
Customer Closeness
Customer Journeys
Total Cost to Serve
Journey Mapping
Evaluation Checklist
Communication:lab
Behavioural
comms trials
User testing
Speak to stakeholders
Look at it through
the customer’s eyes
What behaviours do we want?
Test with customers Research & Insight
What is the
burden?
Test / Learn / Improve
Write in language
customers (& staff)
understand
Assess outcomes
& performance
Make improvements
Learn & evolve
Trials
Empirical and experimental evidence
Frame your ideas, e.g.
what are the behaviours
you want, tax take etc
Hypotheses killer questions
Consult the experts
Data Hotspot explorer
Submit the
evidence
UNCLASSIFIED
Presentation title | 16/05/14 | 5
Using Insight in HMRC:
Gift Aid - moving Gift Aid repayments online
Charities and Community Amateur Sports Clubs (CASCs)
Business issue: Charities/ CASCs currently claiming Gift Aid using the R68i form
(40% estimated to use ‘print and post’ method: fill in online, download from the HMRC website
and print form and 60% estimated to use paper forms)
Desired position: 95-100% of Charities/ CASCs registered with the Government gateway and filing their Gift Aid
repayment claims online
HMRC approach: send all Charities/ CASCs repeated mail shots and lengthy letters to increase awareness and
influence behavioural change
Concerns: quality and reliability of HMRC charities and CASCs data leading to targeting the ‘wrong’ population, cost
versus effectiveness of these forms of communication and either lower or higher than expected take up and the
implications of that
Research: clear definition and understanding of the target population. Clear steers on likely take-up, communication
and support needs.
Contact by
phone doubled
– however, this
was expected
and planned for
as a result of
the research
Contact by
phone doubled
– however, this
was expected
and planned for
as a result of
the research
Of 87,000
known charities,
45,000 are
registered & file
their Gift Aid
repayment
claims online
Of 87,000
known charities,
45,000 are
registered & file
their Gift Aid
repayment
claims online
Since 29 April
2013, over
600,000 hits on
HMRC’s
dedicated
Charities Online
web page
Since 29 April
2013, over
600,000 hits on
HMRC’s
dedicated
Charities Online
web page
From an original
planned 8 page
mail shot –
reduced to 1
page and phased
From an original
planned 8 page
mail shot –
reduced to 1
page and phased
ImpactImpact
7 months
Post Launch
7 months
Post Launch
UNCLASSIFIED
Presentation title | 16/05/14 | 6
SCHOOL MEALS: This was
initially a case of classic
‘marketing myopia’. We
focused on the food on the
plate. But with the insight we
understood that more
children would eat school
lunch ONLY if we improved
the experience e.g. no
waiting time, a more
sociable environment, letting
friends eat together
REMOVING THE ADMIN
BURDEN FROM SMEs: The
Better Regulation Executive
now understands that what
small businesses most dislike
is any change - even if it is ‘for
their own good’. Constant
small improvements can, in
fact, be felt to increase the
regulatory burden
CARERS STRATEGY: In all
literature we made the mistake
of assuming people knew they
were carers and would willingly
seek help. In fact there was a
real barrier – people didn’t
identify themselves as “carers”
and using that word was
ineffective because the people
we needed to reach didn’t realise
the message was targeted
at them.
“I’m not a carer. I’m
just looking after the
person I love”
“Lunch isn’t about
food- It’s about my
friends”
“Just tell me what to doand when to do it- then
leave me alone”
Examples of Insight from Government
UNCLASSIFIED
Presentation title | 16/05/14 | 7
Customer Closeness
What is Customer Closeness?
Spending time with your customers in order to help you understand the
reality of their lives by
• Listening
• Observing
∙ Asking questions carefully
What do we get out of it?
Customer closeness activities have delivered a greater
appreciation of how customers find HMRC products & processes . They
• Challenge our assumptions
• Create greater empathy
• Raise belief in the value of designing around the customer
• Gives us a better basis for engaging with them
UNCLASSIFIED
Presentation title | 16/05/14 | 7
UNCLASSIFIED
Customer Closeness in action
The Event Outcome
•Large event with 50 self
employed individuals who pay
Class 2 NICS
•Structured conversations and
•product stimulus
• Customers told us they were
confused by the process,
products and communications
• Springboard to further
investigation and exploration
•Products simplified and
submission to Minister on further
simplification
•Led to a reduction in telephone
calls of 100,000 with projected
savings (over 5 years) of £10m
•And Budget Announcement on
simplified collection via self
assessment
UNCLASSIFIED
What are Customer Journeys?
Cabinet Office definition:
“A customer journey is a description of the experience a customer has as they
encounter a service or a set of services, taking into account not only what
happens to them but their responses to the experience.”
There are different types of journey from a customer perspective:
∙ Literal - physical journey from A to B
∙ Experiential – an interaction with an organisation
∙ Relationship Building - journeys that will endure over time
∙ Transactional - journeys that involve fixed steps
∙ Emotional/Rite of Passage - journeys that have a significant emotional
element
UNCLASSIFIED
Presentation title | 16/05/14 | 10
Improved
customer
experience
See and approach
things from a
customer perspective
Meet expectations
(often raised by
private sector)
Understand how much
we can expect people
to do
Getting it right when
it really matters
Deliver information
and messages at
the best time
Deliver seamless,
streamlined
experience that cuts
across silos
Greater
efficiency
Plan the most efficient
and effective
experience
Anticipate
demands
Prioritise between
competing calls
on resources
Identify ‘baton-change’
points where things
are most likely to fall
down
Identify cheapest
cost to serve for
HMRC and customers
Set performance
indicators
Mapping customer journeys
UNCLASSIFIED
Presentation title | 16/05/14 | 11
Behavioural insights and randomised control trials
UNCLASSIFIED
Presentation title | 16/05/14 | 12
Chasing debt : Two letters, one difference
UNCLASSIFIED
Presentation title | 16/05/14 | 13
Source: Hallsworth et al. (2014) ‘The Behavioralist as Tax Collector’, NBER Working Paper
Findings: More specific norms had more impact:
“The great
majority of
people in
your local
area pay
their tax on
time. Most
people with
a debt like
yours have
paid it by
now.”
UNCLASSIFIED
Presentation title | 16/05/14 | 14
Findings: Hard economic incentives didn’t
perform better
Source: Hallsworth et al. (2014) ‘The Behavioralist as Tax Collector’, NBER Working Paper.
UNCLASSIFIED
Presentation title | 16/05/14 | 15
15
Emails to UK businesses offering support
• Much of HMRC’s support for small business is now provided digitally
• HMRC theory of change - use of support reduces error, increases tax
compliance and improves customer experience
UNCLASSIFIED
Presentation title | 16/05/14 | 16
Increasing use of digital services is as important as existence of these services as part of a
policy: Multiple trials (w/ BIS / BIT) looking at >10 different designs of emails & 75k emails
sent.
Almost doubled effectiveness as measured by click through to tax information and support –
rolled out into business as usual.
Supports policy objective and political imperative - i.e. help citizens avoid errors, make tax
easier for them and reduce tax evasion etc.
0% 2% 4% 6% 8% 10% 12% 14% 16% 18%
VAT trial
Employer trial
Number of Clicks as a Percentage of Viewed Emails
Simplified Original
Trial results - very successful in increasing response to offers of
support in emails
UNCLASSIFIED
Presentation title | 16/05/14 | 17
In one of the trials a social norm message didn’t have a significant
effect in increasing click through to non-tax support
The variable applicability of behavioural insights in different
contexts is not a cause of concern for us – underlines the
importance of test and learn.
0.0% 0.5% 1.0% 1.5% 2.0% 2.5% 3.0% 3.5%
Mentorsme
EFG
Number of Clicks as a Percentage of Viewed Emails
No social norm
Social norm
UNCLASSIFIED
Presentation title | 16/05/14 | 18
Example of wider work: how to increase honesty and reduce errors in
an online portal where citizens declare information
C
O
M
M
U
N
I
C
A
T
I
O
N
S
Log in /
identification
Online service / product
– e.g. declaration of
income / payments
C
O
M
M
U
N
I
C
A
T
I
O
N
S
Portal Exit from
portal
1. Reporting and payment cycles
2. Prompting
honesty in
declarations
3. Agency
and
information
4. Outbound
communications
that work in digital
Accountability
threats
Moral
reminders
Norms
Prompts / messagesTimebound
instructions
Provide
feedback on
potential
error
Third party
data / pre-
population
Framing
of
penalties
/ audits
Defaults
Personal
isation
C
O
M
M
U
N
I
C
A
T
I
O
N
S
Log in /
identification
Online service / product
– e.g. declaration of
income / payments
C
O
M
M
U
N
I
C
A
T
I
O
N
S
Portal Exit from
portal
1. Reporting and payment cycles
2. Prompting
honesty in
declarations
3. Agency
and
information
4. Outbound
communications
that work in digital
Accountability
threats
Moral
reminders
Norms
Prompts / messagesTimebound
instructions
Provide
feedback on
potential
error
Third party
data / pre-
population
Framing
of
penalties
/ audits
Defaults
Personal
isation
1. Reporting and payment cycles5. Making it easier for customers to interact with the tax system, avoid error and comply (/fairness)
UNCLASSIFIED
Presentation title | 16/05/14 | 19
Summary
• Our focus:
∙ Tax compliance but also work on other outcomes/issues
∙ Outcomes and problems – i.e. policy issues.
∙ Distilling range of evidence/insights to solve specific problems.
• What works is what works! We as ‘experts’ can provide
options/opinions but RCTs and other robust evaluation
techniques support a test, learn and adapt process.
• HMRC has had considerable success using behavioural
insights & experimental approach to deliver policy outcomes.
E.g. £220m debt repayments brought forward in 12-13.
UNCLASSIFIED
Presentation title | 16/05/14 | 20
Product from:Current Policy ProcessThe Policy Process
Monitor
Review
Evaluate
Idea/problem
Communications
& Guidance
Ministerial
decision
Pilot/
Implementation Recommendation
To Minister
Consultation
& Appraisal
Identify Options
Establish objectives
& outcomes
Success criteria for
HMRC & customers
Who are the
customers?
What do we
know about
them?
Research & Insight
Customer Closeness
Customer Journeys
Behavioural Science
Customer Closeness
Customer Journeys
Total Cost to Serve
Journey Mapping
Evaluation Checklist
Communication:lab
Behavioural
comms trials
User testing
BE&IT
CC&A
BCT
Legend
Speak to stakeholders
Look at it through
the customer’s eyes
What behaviours do we want?
Test with customers Research & Insight
What is the
burden?
Test / Learn / Improve
Write in language
customers (& staff)
understand
Assess outcomes
& performance
Make improvements
Learn & evolve
Qun Trials
Empirical and
experimental
evidence
Background of
insights from
behavioural
research on tax
and beyond
Background of
insights from
behavioural
research on tax
and beyond
Understanding of
what works in similar
circumstances –
getting close to
customers
Understanding of
what works in similar
circumstances –
getting close to
customers
Control trials (/ A-B
testing)
Control trials (/ A-B
testing)
Open policy making and
seeking behavioural
insights from customers
& external organisations
Open policy making and
seeking behavioural
insights from customers
& external organisations
Ministerial
interest in
customer
evidence &
behavioural
economics
Ministerial
interest in
customer
evidence &
behavioural
economics
Evaluation is key to
understanding actual
customer behaviour
and therefore
effectiveness of policy
Evaluation is key to
understanding actual
customer behaviour
and therefore
effectiveness of policy
Adaptable off the
shelf policy
levers
Adaptable off the
shelf policy
levers
Behavioural
communications –
vital to successful
policy delivery
Behavioural
communications –
vital to successful
policy delivery
The security marking for this document is UNCLASSIFIED
For more information contact:
Thank you
Name Rohan.Grove email rohan.grove@hmrc.gsi.gov.uk
Nicola Hardaker email nicola.l.hardaker@hmrc.gsi.gov.uk
Location: File path and Name

More Related Content

PPTX
PPT
PPT
Sprint policy - DfT
PPT
Sprint policy dh
PPT
Sprint policy - Nesta
PPT
Sprint policy fco
PPT
Sprint policy -_breakout_-_bis[1]
PPTX
Sprint policy - DfT
Sprint policy dh
Sprint policy - Nesta
Sprint policy fco
Sprint policy -_breakout_-_bis[1]

Similar to Sprint policy - HMRC (20)

PDF
Case Study Delivering Major Public Sector Change Managing The Portfolio Reali...
PDF
Unlocking the value of customer (or citizen) experience (Cx)
PPT
Inland Revenue Senior Management Conference - February 2000
PPTX
Inspiring SMEs to do more with digital (Paul Davies)
PDF
Home Office Digital user research, service design and agile
PPT
10 05-21 capita conf1-2
PPT
10 05-21 capita conf1-2
PDF
HMRC's Digital Journey
PPTX
Behavioural Insights and Public Policy: Lessons from Around the World Case St...
PPTX
Don’t just ask what your supporters can do for you gary hancock - customer ...
PPTX
SUMA 2017 Presentation - The Keys to Innovative Government
PDF
Smart Cities - a guide to Customer Insight Profiling and Service Design
PDF
Three Strategies to Improve the Citizen Experience
PDF
Softer Skills workshop for #DTS16 event in Edinburgh
PDF
implication of digital economy toward public sector
PDF
Simpler, Clearer, Faster Government Services
PPT
Service Delivery - Directions and Changes at the Commonwealth Level
PPT
PPMA Annual Seminar 2014 - Keynote - Government's Public Service Reform Progr...
PDF
Farzad's Innovation Portfolio
PPT
The COI's May Race's presentation at the Digital Talent Roadshow in Bournemouth
Case Study Delivering Major Public Sector Change Managing The Portfolio Reali...
Unlocking the value of customer (or citizen) experience (Cx)
Inland Revenue Senior Management Conference - February 2000
Inspiring SMEs to do more with digital (Paul Davies)
Home Office Digital user research, service design and agile
10 05-21 capita conf1-2
10 05-21 capita conf1-2
HMRC's Digital Journey
Behavioural Insights and Public Policy: Lessons from Around the World Case St...
Don’t just ask what your supporters can do for you gary hancock - customer ...
SUMA 2017 Presentation - The Keys to Innovative Government
Smart Cities - a guide to Customer Insight Profiling and Service Design
Three Strategies to Improve the Citizen Experience
Softer Skills workshop for #DTS16 event in Edinburgh
implication of digital economy toward public sector
Simpler, Clearer, Faster Government Services
Service Delivery - Directions and Changes at the Commonwealth Level
PPMA Annual Seminar 2014 - Keynote - Government's Public Service Reform Progr...
Farzad's Innovation Portfolio
The COI's May Race's presentation at the Digital Talent Roadshow in Bournemouth
Ad

More from Policy Lab (20)

PDF
Introduction to Policy Lab (Jan 2021)
PDF
Innovation in Government Conference Feb 28th
PDF
Design in Policy meetup - What kind of communities?
PPTX
How can public sector innovation help to meet global challenges?
PDF
Introduction to Policy Lab
PDF
Smart shipping evidence cards
PDF
Mapping Policy Maker's Experience
PDF
Civil society strategy Policy Labs
PDF
Smart shipping by Policy Lab
PPTX
Styles of intervention for government policy-making
PPTX
Spring 2018 edition of the Introduction to Policy Lab UK
PPTX
Introduction to Policy Lab UK - Winter edition 2017
PDF
Homelessness Prevention Project and Prototypes
PDF
Measuring the impact of design: the pitfalls and potential - a view from Poli...
PDF
Methodbank and toolkit for design in Government
PDF
PolicyLab Change Cards
PDF
Policy Lab change cards - other-worlds
PDF
Policy Lab change cards - multi-disciplinary
PDF
Policy Lab change cards_intro
PDF
Policy Lab change cards_ingenious
Introduction to Policy Lab (Jan 2021)
Innovation in Government Conference Feb 28th
Design in Policy meetup - What kind of communities?
How can public sector innovation help to meet global challenges?
Introduction to Policy Lab
Smart shipping evidence cards
Mapping Policy Maker's Experience
Civil society strategy Policy Labs
Smart shipping by Policy Lab
Styles of intervention for government policy-making
Spring 2018 edition of the Introduction to Policy Lab UK
Introduction to Policy Lab UK - Winter edition 2017
Homelessness Prevention Project and Prototypes
Measuring the impact of design: the pitfalls and potential - a view from Poli...
Methodbank and toolkit for design in Government
PolicyLab Change Cards
Policy Lab change cards - other-worlds
Policy Lab change cards - multi-disciplinary
Policy Lab change cards_intro
Policy Lab change cards_ingenious
Ad

Recently uploaded (20)

PPTX
DFARS Part 253 - Forms - Defense Contracting Regulations
PPTX
Robotics_Presentation.pptxdhdrhdrrhdrhdrhdrrh
PPTX
Parliamentary procedure in meeting that can be use
PDF
Concept_Note_-_GoAP_Primary_Sector_-_The_Great_Rural_Reset_-_Updated_18_June_...
PPTX
cpgram enivaran cpgram enivaran cpgram enivaran
PPTX
Chapter 1: Philippines constitution laws
PPTX
DFARS Part 252 - Clauses - Defense Regulations
PPTX
Developing_An_Advocacy_Agenda_by_Kevin_Karuga.pptx
PDF
Building Bridges (of Hope) over Our Troubled Waters_PART 1
DOCX
EAPP.docxdffgythjyuikuuiluikluikiukuuuuuu
PDF
eVerify Overview and Detailed Instructions to Set up an account
PDF
2024-Need-Assessment-Report-March-2025.pdf
PPTX
International Tracking Project Unloading Guidance Manual V1 (1) 1.pptx
PPTX
Part II LGU Accreditation of CSOs and Selection of Reps to LSBs ver2.pptx
PDF
PPT Item # 5 - 5307 Broadway St (Final Review).pdf
PPTX
CHS rollout Presentation by Abraham Lebeza.pptx
PPTX
Portland FPDR Oregon Legislature 2025.pptx
PPTX
Empowering Teens with Essential Life Skills 🚀
PDF
The Detrimental Impacts of Hydraulic Fracturing for Oil and Gas_ A Researched...
PDF
Items # 6&7 - 900 Cambridge Oval Right-of-Way
DFARS Part 253 - Forms - Defense Contracting Regulations
Robotics_Presentation.pptxdhdrhdrrhdrhdrhdrrh
Parliamentary procedure in meeting that can be use
Concept_Note_-_GoAP_Primary_Sector_-_The_Great_Rural_Reset_-_Updated_18_June_...
cpgram enivaran cpgram enivaran cpgram enivaran
Chapter 1: Philippines constitution laws
DFARS Part 252 - Clauses - Defense Regulations
Developing_An_Advocacy_Agenda_by_Kevin_Karuga.pptx
Building Bridges (of Hope) over Our Troubled Waters_PART 1
EAPP.docxdffgythjyuikuuiluikluikiukuuuuuu
eVerify Overview and Detailed Instructions to Set up an account
2024-Need-Assessment-Report-March-2025.pdf
International Tracking Project Unloading Guidance Manual V1 (1) 1.pptx
Part II LGU Accreditation of CSOs and Selection of Reps to LSBs ver2.pptx
PPT Item # 5 - 5307 Broadway St (Final Review).pdf
CHS rollout Presentation by Abraham Lebeza.pptx
Portland FPDR Oregon Legislature 2025.pptx
Empowering Teens with Essential Life Skills 🚀
The Detrimental Impacts of Hydraulic Fracturing for Oil and Gas_ A Researched...
Items # 6&7 - 900 Cambridge Oval Right-of-Way

Sprint policy - HMRC

  • 1. The security marking for this document is UNCLASSIFIEDThe security marking for this document is UNCLASSIFIED Open Policy Making – the HMRC Journey Nicola Hardaker Rohan Grove
  • 2. UNCLASSIFIED Presentation title | 16/05/14 | 2 WHAT WE WILL COVER Open Policy Making – what it is and constraints Where does customer insight fit within the policy making process (and what tools and techniques are available) Exploration of a couple of tools and techniques ∙ Customer Insight ∙ Customer Closeness ∙ Mapping customer journeys ∙ Randomised controlled trials ∙ Behaviour Change Potential threads of insight for tax policy Final thoughts
  • 3. UNCLASSIFIED Presentation title | 16/05/14 | 3 Permission Constrained Opportunities to experiment Ambition LowHigh Informed policy making Developing policy with users at the heart Collaborative policy making Multidisciplinary team Evidence gathering Expert engagement Consultation Public engagement Multidisciplinary reference group Scenario testing Testing Coproduction Public experience map Insight tools Call for challenge Stakeholder map Persona testing Crowdsourcing Open Policy has to be done within the constraints of your subject and Department Open Policy Making mindsetOpen Policy Making mindset HMRC NOV/NOW HMRC Ambition
  • 4. UNCLASSIFIED Presentation title | 16/05/14 | 4 Current Policy ProcessCustomer Insight in the Policy Process Monitor Review Evaluate Idea/problem Communications & Guidance Ministerial decision Pilot/ Implementation Recommendation to Minister Consultation & Appraisal Identify Options Establish objectives & outcomes Success criteria for HMRC & customers Who are the customers? What do we know about them? Research & Insight Customer Closeness Customer Journeys Behavioural Science Customer Closeness Customer Journeys Total Cost to Serve Journey Mapping Evaluation Checklist Communication:lab Behavioural comms trials User testing Speak to stakeholders Look at it through the customer’s eyes What behaviours do we want? Test with customers Research & Insight What is the burden? Test / Learn / Improve Write in language customers (& staff) understand Assess outcomes & performance Make improvements Learn & evolve Trials Empirical and experimental evidence Frame your ideas, e.g. what are the behaviours you want, tax take etc Hypotheses killer questions Consult the experts Data Hotspot explorer Submit the evidence
  • 5. UNCLASSIFIED Presentation title | 16/05/14 | 5 Using Insight in HMRC: Gift Aid - moving Gift Aid repayments online Charities and Community Amateur Sports Clubs (CASCs) Business issue: Charities/ CASCs currently claiming Gift Aid using the R68i form (40% estimated to use ‘print and post’ method: fill in online, download from the HMRC website and print form and 60% estimated to use paper forms) Desired position: 95-100% of Charities/ CASCs registered with the Government gateway and filing their Gift Aid repayment claims online HMRC approach: send all Charities/ CASCs repeated mail shots and lengthy letters to increase awareness and influence behavioural change Concerns: quality and reliability of HMRC charities and CASCs data leading to targeting the ‘wrong’ population, cost versus effectiveness of these forms of communication and either lower or higher than expected take up and the implications of that Research: clear definition and understanding of the target population. Clear steers on likely take-up, communication and support needs. Contact by phone doubled – however, this was expected and planned for as a result of the research Contact by phone doubled – however, this was expected and planned for as a result of the research Of 87,000 known charities, 45,000 are registered & file their Gift Aid repayment claims online Of 87,000 known charities, 45,000 are registered & file their Gift Aid repayment claims online Since 29 April 2013, over 600,000 hits on HMRC’s dedicated Charities Online web page Since 29 April 2013, over 600,000 hits on HMRC’s dedicated Charities Online web page From an original planned 8 page mail shot – reduced to 1 page and phased From an original planned 8 page mail shot – reduced to 1 page and phased ImpactImpact 7 months Post Launch 7 months Post Launch
  • 6. UNCLASSIFIED Presentation title | 16/05/14 | 6 SCHOOL MEALS: This was initially a case of classic ‘marketing myopia’. We focused on the food on the plate. But with the insight we understood that more children would eat school lunch ONLY if we improved the experience e.g. no waiting time, a more sociable environment, letting friends eat together REMOVING THE ADMIN BURDEN FROM SMEs: The Better Regulation Executive now understands that what small businesses most dislike is any change - even if it is ‘for their own good’. Constant small improvements can, in fact, be felt to increase the regulatory burden CARERS STRATEGY: In all literature we made the mistake of assuming people knew they were carers and would willingly seek help. In fact there was a real barrier – people didn’t identify themselves as “carers” and using that word was ineffective because the people we needed to reach didn’t realise the message was targeted at them. “I’m not a carer. I’m just looking after the person I love” “Lunch isn’t about food- It’s about my friends” “Just tell me what to doand when to do it- then leave me alone” Examples of Insight from Government
  • 7. UNCLASSIFIED Presentation title | 16/05/14 | 7 Customer Closeness What is Customer Closeness? Spending time with your customers in order to help you understand the reality of their lives by • Listening • Observing ∙ Asking questions carefully What do we get out of it? Customer closeness activities have delivered a greater appreciation of how customers find HMRC products & processes . They • Challenge our assumptions • Create greater empathy • Raise belief in the value of designing around the customer • Gives us a better basis for engaging with them UNCLASSIFIED Presentation title | 16/05/14 | 7
  • 8. UNCLASSIFIED Customer Closeness in action The Event Outcome •Large event with 50 self employed individuals who pay Class 2 NICS •Structured conversations and •product stimulus • Customers told us they were confused by the process, products and communications • Springboard to further investigation and exploration •Products simplified and submission to Minister on further simplification •Led to a reduction in telephone calls of 100,000 with projected savings (over 5 years) of £10m •And Budget Announcement on simplified collection via self assessment
  • 9. UNCLASSIFIED What are Customer Journeys? Cabinet Office definition: “A customer journey is a description of the experience a customer has as they encounter a service or a set of services, taking into account not only what happens to them but their responses to the experience.” There are different types of journey from a customer perspective: ∙ Literal - physical journey from A to B ∙ Experiential – an interaction with an organisation ∙ Relationship Building - journeys that will endure over time ∙ Transactional - journeys that involve fixed steps ∙ Emotional/Rite of Passage - journeys that have a significant emotional element
  • 10. UNCLASSIFIED Presentation title | 16/05/14 | 10 Improved customer experience See and approach things from a customer perspective Meet expectations (often raised by private sector) Understand how much we can expect people to do Getting it right when it really matters Deliver information and messages at the best time Deliver seamless, streamlined experience that cuts across silos Greater efficiency Plan the most efficient and effective experience Anticipate demands Prioritise between competing calls on resources Identify ‘baton-change’ points where things are most likely to fall down Identify cheapest cost to serve for HMRC and customers Set performance indicators Mapping customer journeys
  • 11. UNCLASSIFIED Presentation title | 16/05/14 | 11 Behavioural insights and randomised control trials
  • 12. UNCLASSIFIED Presentation title | 16/05/14 | 12 Chasing debt : Two letters, one difference
  • 13. UNCLASSIFIED Presentation title | 16/05/14 | 13 Source: Hallsworth et al. (2014) ‘The Behavioralist as Tax Collector’, NBER Working Paper Findings: More specific norms had more impact: “The great majority of people in your local area pay their tax on time. Most people with a debt like yours have paid it by now.”
  • 14. UNCLASSIFIED Presentation title | 16/05/14 | 14 Findings: Hard economic incentives didn’t perform better Source: Hallsworth et al. (2014) ‘The Behavioralist as Tax Collector’, NBER Working Paper.
  • 15. UNCLASSIFIED Presentation title | 16/05/14 | 15 15 Emails to UK businesses offering support • Much of HMRC’s support for small business is now provided digitally • HMRC theory of change - use of support reduces error, increases tax compliance and improves customer experience
  • 16. UNCLASSIFIED Presentation title | 16/05/14 | 16 Increasing use of digital services is as important as existence of these services as part of a policy: Multiple trials (w/ BIS / BIT) looking at >10 different designs of emails & 75k emails sent. Almost doubled effectiveness as measured by click through to tax information and support – rolled out into business as usual. Supports policy objective and political imperative - i.e. help citizens avoid errors, make tax easier for them and reduce tax evasion etc. 0% 2% 4% 6% 8% 10% 12% 14% 16% 18% VAT trial Employer trial Number of Clicks as a Percentage of Viewed Emails Simplified Original Trial results - very successful in increasing response to offers of support in emails
  • 17. UNCLASSIFIED Presentation title | 16/05/14 | 17 In one of the trials a social norm message didn’t have a significant effect in increasing click through to non-tax support The variable applicability of behavioural insights in different contexts is not a cause of concern for us – underlines the importance of test and learn. 0.0% 0.5% 1.0% 1.5% 2.0% 2.5% 3.0% 3.5% Mentorsme EFG Number of Clicks as a Percentage of Viewed Emails No social norm Social norm
  • 18. UNCLASSIFIED Presentation title | 16/05/14 | 18 Example of wider work: how to increase honesty and reduce errors in an online portal where citizens declare information C O M M U N I C A T I O N S Log in / identification Online service / product – e.g. declaration of income / payments C O M M U N I C A T I O N S Portal Exit from portal 1. Reporting and payment cycles 2. Prompting honesty in declarations 3. Agency and information 4. Outbound communications that work in digital Accountability threats Moral reminders Norms Prompts / messagesTimebound instructions Provide feedback on potential error Third party data / pre- population Framing of penalties / audits Defaults Personal isation C O M M U N I C A T I O N S Log in / identification Online service / product – e.g. declaration of income / payments C O M M U N I C A T I O N S Portal Exit from portal 1. Reporting and payment cycles 2. Prompting honesty in declarations 3. Agency and information 4. Outbound communications that work in digital Accountability threats Moral reminders Norms Prompts / messagesTimebound instructions Provide feedback on potential error Third party data / pre- population Framing of penalties / audits Defaults Personal isation 1. Reporting and payment cycles5. Making it easier for customers to interact with the tax system, avoid error and comply (/fairness)
  • 19. UNCLASSIFIED Presentation title | 16/05/14 | 19 Summary • Our focus: ∙ Tax compliance but also work on other outcomes/issues ∙ Outcomes and problems – i.e. policy issues. ∙ Distilling range of evidence/insights to solve specific problems. • What works is what works! We as ‘experts’ can provide options/opinions but RCTs and other robust evaluation techniques support a test, learn and adapt process. • HMRC has had considerable success using behavioural insights & experimental approach to deliver policy outcomes. E.g. £220m debt repayments brought forward in 12-13.
  • 20. UNCLASSIFIED Presentation title | 16/05/14 | 20 Product from:Current Policy ProcessThe Policy Process Monitor Review Evaluate Idea/problem Communications & Guidance Ministerial decision Pilot/ Implementation Recommendation To Minister Consultation & Appraisal Identify Options Establish objectives & outcomes Success criteria for HMRC & customers Who are the customers? What do we know about them? Research & Insight Customer Closeness Customer Journeys Behavioural Science Customer Closeness Customer Journeys Total Cost to Serve Journey Mapping Evaluation Checklist Communication:lab Behavioural comms trials User testing BE&IT CC&A BCT Legend Speak to stakeholders Look at it through the customer’s eyes What behaviours do we want? Test with customers Research & Insight What is the burden? Test / Learn / Improve Write in language customers (& staff) understand Assess outcomes & performance Make improvements Learn & evolve Qun Trials Empirical and experimental evidence Background of insights from behavioural research on tax and beyond Background of insights from behavioural research on tax and beyond Understanding of what works in similar circumstances – getting close to customers Understanding of what works in similar circumstances – getting close to customers Control trials (/ A-B testing) Control trials (/ A-B testing) Open policy making and seeking behavioural insights from customers & external organisations Open policy making and seeking behavioural insights from customers & external organisations Ministerial interest in customer evidence & behavioural economics Ministerial interest in customer evidence & behavioural economics Evaluation is key to understanding actual customer behaviour and therefore effectiveness of policy Evaluation is key to understanding actual customer behaviour and therefore effectiveness of policy Adaptable off the shelf policy levers Adaptable off the shelf policy levers Behavioural communications – vital to successful policy delivery Behavioural communications – vital to successful policy delivery
  • 21. The security marking for this document is UNCLASSIFIED For more information contact: Thank you Name Rohan.Grove email rohan.grove@hmrc.gsi.gov.uk Nicola Hardaker email nicola.l.hardaker@hmrc.gsi.gov.uk Location: File path and Name

Editor's Notes

  • #4: As a Department, we are further ahead in terms of the 3 aspects of open policy making in our operational areas - we are less advanced in using this systematically as we design policy – (Gathering new insights, engaging full range of views and testing solutions in the real world) I would say we currently fluctuate between informed policy and developing policy with users at the heart in terms of policy development – however for operational changes we do, on occasion, move into the collaborative policy making space Our ambition is high though there are constraints - As with other Departments, there is a need for some policy to be developed on a ‘need to know’ basis so much of what is described is difficult. However, even with that constraint, this does not mean that we can not and should do more. We have recognised this and are taking steps to implement, such as the design of learning products for policy professionals – we will now go through some of our approaches; some examples of where these have reaped benefits and what we have planned for the future to ensure this is a systematic way of working
  • #5: Where does customer fit into the Policy process? Answer – in every step! Good policies are developed through understanding which customers are affected, how they will be affected and how they are likely to react. It’s important to understand the target audience’s potential attitudes and behaviours towards the policy that is being developed – beware the law of unintended consequences! Worth mentioning that although communications and evaluation are at the end of the process if these are not planned for from the start there will be problems We recognise that policies can be developed over a matter of hours, months or years – you may question whether there is time for any of this when you are up against a tight timeframe – you must make time; we may have information readily available that will help in your policies development AND it does provide benefits
  • #6: Saving from printing and postage alone of £10,000 (reduced from £39k to 29k) – PLUS people read the information 12:02–12:03 Insight in customer language and satisfies the 4R test Real Relevant Ring Bells Reaction
  • #7: To bring this alive for you, I’ve got a few examples of where Insight has been used in Government. You may have come across these examples before and one quite well known and pretty genius piece of insight comes from looking at how children view school meals. The traditional way of trying to encourage kids to eat their school meals was focussed on the food. But in actual fact, they were looking at it from the wrong angle. The kids were much less interested in the food and what was important to them was the environment and the experience of school meals. They wanted to be able to eat with their friends in a sociable environment. The Insight here is ‘lunch isn’t about food – it’s about my friends’.
  • #8: Change the mindset and create belief You may have heard of Immersion – Closeness uses same principles. Its about spending some time with your customers. This usually run as a type of focus group whereby you bring customers together and have an informal chat with them on certain topics. Or there are different activities you might want to undertake, such as listening into customer phone calls, individual depths interviews or visiting their environment. Ive also designed sessions where we co-create products with customers and introduce stimulus material and products. Ultimately it is designed so you can understand their agenda and get a better understanding of things from their perspective. Allows you to develop an appreciation of: What their lives are like What is important to them How they think, feel and act What they think of particular aspects of taxation How they feel about dealing with HMRC However, it’s important not to mix this up with proper research
  • #9: Closeness Is best used as an informal way of learning and understanding real customer issues Can be used as part of a specific project or as an on-going way of keeping in touch with customers Encourages staff to step inside the life of a customer and contemplate the context in which they respond to and manage tax matters Is complementary to other sources of customer knowledge and can offer some insights… But cannot be used as the sole basis of business decisions
  • #10: So what is a customer Journey? A customer journey is a description of the experience a customer has as they encounter a service or a set of services, taking into account not only what happens to them but their responses to the experience.” Not just HMRC - it is being actively promoted by the Cabinet Office & the Service Transformation Contact Council Following FST agreement , the individuals Costing Customer time methodology was published on the HMRC internet site. Actual – Post Office Experiential – NHS – You might have an ongoing reason for using (dodgy knees) so you have a round of appointments with the Dr, physio, scans, consultants etc. Your experience of this will colour your perceptions and how you react to that organisation in the future. Relationship – Large Business (Dedicated Customer Relationship Managers) Transactional – VAT Returns Emotional/ Rite of Passage – Birth / Death/Pensioners. These are journeys precipitated by one-off events Having child for the first time – can move from Willing & Able to Willing but need Help Often focus on transactional because it is the interaction we see with customers but there are all sorts of angles EXAMPLE - becoming a pensioner – quite a cliff edge to fall off & it’s important that we understand that so that we can plan to make becoming a pensioner a better experience for customers & a more efficient process for us. Why do we need Customer Journeys? HMRC Purpose, Vision and Way is to be customer focused but traditionally looked at processes from an internal perspectiveNow have a Customer Centric Business Strategy built from what we know about customers Need to understand where customer behaviour impacts on our (and other government departments) processes and operations Aim to minimise customer burden and improve our reputation, efficiency and yield And our customers are both Businesses and Individuals and in the past as you’ll see we used different tools to measure our impacts. The ABT for business and TCS for Individuals
  • #11: What are customer journeys? The end to end experience – in a supermarket it may be parking, finding what you want, queuing to pay. Traditionally inward focused- this allows us to look at all the interactions a customer has with us as it negotiates our products and proceses Need to understand where customer behaviour impacts on our (and other government departments) processes and operations For policy development cj mapping allows us to understand the real impact on customers of proposed change and considr the relative merits of various options. We use TCS to map customer journeys and high and low spots of the experience (heart monitor) Improved Customer Experience not highly unusual journeys and take into account the good and the bad Greater Efficiency
  • #12: Behavioural science insights for tax: Drawn from behavioural economics, psychology and a range of associated disciplines: insight from academic study of decision making specific insight from tax experiments / evaluation / empirical work interlinked insight from academic study of tax and compliance Background if questions: 1. Wider empirical and evaluation work: E.g. evidence looking at the withholding/regular payments and the withholding paradox 2. Experimental work E.g. wide ranging evidence on honesty in declarations HMRC’s Tax administration research centre 3. Theory and evidence from outside tax E.g. Prospect theory. Defaults – pensions. 4. Real life evidence from field experiments / trials E.g. large scale trial on impact of audits in Denmark (Kleven et al) 5. Our own evaluations – although at the moment minimal evidence on “policy”
  • #13: Here is an example of a new, simplified letter that created. HMRC then created variations of this letter that were identical except for a short phrase. The example here is “Nine out of ten people pay their tax on time.” This is an accurate statistic that was intended to act as a prompt that the social norm is to pay tax on time.
  • #14: [UK Norm] “Nine out of ten people in the UK pay their tax on time.” [Local Norm] “The great majority of people in your local area pay their tax on time.” [Debt Norm] “Most people with a debt like yours have paid it by now.” [Local + debt norm] “The great majority of people in your local area pay their tax on time. Most people with a debt like yours have paid it by now.” Norms based on geographic similarity and debt similarity increase payment rates. Norms that refer to the recipient significantly increased payment rates, whereas a norm that did not make such a reference did not. Geographic similarity and debt similarity have an additive effect; increasing the specificity of the norm increases its effect.
  • #15: Some people might argue that this focus on norms is misplaced. Rather, you should just apply some hard economic incentives and you will get much bigger results. Well, we tested this – we warned about the main economic incentive to pay (daily interest charges). But we found that warning of interest charges had about the same effect as the norm messages (and did not do much differently from simply providing more information on how to pay). NB: Maybe mention procedural fairness and tax morale.
  • #16: E.g. In communications it is important to focus on what the customer needs to know and not everything we would like them to know. The action they need to take should be clear and easy for them to undertake. This seems like common sense but in my experience many government communications fail this test. Also worth considering using life events and‘moments of change’ in people’s lives as opportunities to engage on related behaviours (e.g. new job, moving out, new home, having a baby, retirement)
  • #18: We thought a message that ‘other people used this scheme and like it’ would positively influence behaviour. The results were mixed – it needs to be explored further.