SlideShare a Scribd company logo
Counter to intent
Voters’ mental models of
alternative counting methods

Dana Chisnell
@danachis
@ChadButterfly
Counter to intent: Voters' mental models of alternative counting methods
Not.
Ranked Choice Voting

Instant Run-off Voting

Fusion or Cumulative Voting
How are the
votes counted?
Ballot design problems are
well understood
Ballot design problems are
well understood
split contests across columns   overvoting

there are responses on both
                                overvoting
sides of names

arrows rather than bubbles      marking incorrectly

formatting is inconsistent or
                                undervoting
too consistent
instructions are complicated
                                all kinds of crazy things
or lacking
voters don’t know how to
                                lost votes
correct their ballots
Ranked Choice
Voting
adds a twist
San Francisco and Oakland,
December 2011

EVN, March 2012
Portland, Maine 2011
Alameda Co. demo ballot
Minneapolis 2011
New York state demo
Voter slate
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
How RCV works
Counter to intent: Voters' mental models of alternative counting methods
n=52
n=52
n=52
       Joe
What we found
Mental models


 People make inferences about how
 things work based on available
 information and context
Mental models
Mental models
            This is what we
            teach people
Mental models
Mental models




Sometimes it really is this simple -
but not in the US
Mental models




Sometimes it really is this simple -
but not in the US
Counter to intent: Voters' mental models of alternative counting methods
Much more like signing for a mortgage
This is the ballot
we test
NIST medium complexity ballot
Mental models
Mental models

 Point system
Mental models

 Point system
 Weighted
Mental models

 Point system
 Weighted
 Reversed
Alameda Co. demo ballot
Alameda Co. demo ballot
Point / weight system
Point / weight system
Point / weight system
1. Voters develop faulty
   mental models
2. Voters don’t understand the
   consequences of their actions
3. Voters vote counter to their
   intentions
Portland, Maine 2011
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
Top 2 primary
Top 2 primary
+ regular contests
Top 2 primary
+ regular contests
            + RCV
Top 2 primary
+ regular contests
            + RCV
+ multi-candidate
Top 2 primary
  + regular contests
              + RCV
  + multi-candidate
+ retention contests
Top 2 primary
  + regular contests
              + RCV
  + multi-candidate
+ retention contests
         + measures
Top 2 primary
  + regular contests
              + RCV
  + multi-candidate
+ retention contests
         + measures

6 different models
We’re pretty sure there’s a problem
Implications and
outcomes
Poor design and instructions
on ballots make
understanding, marking, and casting
difficult, time-consuming, and
complicated
Poor design and instructions
on ballots make
counting, verifying, and audits
difficult, time-consuming, and
complicated
Raises questions about what is being
secured.
RCV = lost votes
RCV + VBM = lost votes
RCV + multi-language = lost votes
Counter to intent: Voters' mental models of alternative counting methods
RCV
RCV
+ VBM
RCV
           + VBM
+ multi-language
RCV
           + VBM
+ multi-language

 = thousands of
      lost votes
Counter to intent: Voters' mental models of alternative counting methods
Lack of trust in elections

Lack of trust in officials

Recalls

Scrambling county boards
Counter to intent: Voters' mental models of alternative counting methods
Security = Counted as cast
Security = Cast as intended +
           counted as cast
This moment
Voter ed is not the answer.
Next steps
Next steps
 Develop & test versions of on-ballot
 instructions
Next steps
 Develop & test versions of on-ballot
 instructions
 Develop & test versions of pre-voting
 instructions
Next steps
 Develop & test versions of on-ballot
 instructions
 Develop & test versions of pre-voting
 instructions
 Study combinations of designs with
 instructions
Next steps
 Develop & test versions of on-ballot
 instructions
 Develop & test versions of pre-voting
 instructions
 Study combinations of designs with
 instructions
 Study combinations of voting modes on the
 same ballot
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
If it’s not usable, it’s not valid.
If it’s not usable, it’s not countable.
If it’s not usable, it’s not verifiable.
If it’s not usable, it’s not auditable.
If it’s not usable, it’s not secure.
Thank you
Rick Bond         Jared Spool

Cyd Harrell       David Cary

Ethan Newby       Rebecca Sherrill

Callie Wheeler    Frank Castro

Chelsey Glasson   Sandy Olson

Sara Cambridge    Nancy Frishberg

Laura Paajanen    Yelena Nakhimovsky

Beth Lingard      Whitney Quesenbery

Beth Pickard
New tools.
Field Guides series




Research          Research          SOP and Usability   Research
commissioned by   commissioned by   and Civic Life      commissioned by
EAC               NIST              Project             NIST
Counter to intent: Voters' mental models of alternative counting methods
Counter to intent: Voters' mental models of alternative counting methods
Coming soon
Coming soon

Effective election
department
web sites




 Research partially
 funded by
 Kickstarter &
 MacArthur
Coming soon

Effective election Delivering useful
department         voter education
web sites




 Research partially   Research partially
 funded by            funded by
 Kickstarter &        Kickstarter &
 MacArthur            MacArthur
Coming soon

Effective election Delivering useful Effective design
department         voter education for vote-by-mail
web sites




 Research partially   Research partially   Research to be
 funded by            funded by            funded by the
 Kickstarter &        Kickstarter &        MacArthur
 MacArthur            MacArthur            Foundation
Coming soon

Effective election Delivering useful Effective design       Designing multi-
department         voter education for vote-by-mail         language ballots
web sites




 Research partially   Research partially   Research to be   Research to be
 funded by            funded by            funded by the    funded by the
 Kickstarter &        Kickstarter &        MacArthur        MacArthur
 MacArthur            MacArthur            Foundation       Foundation
Field Guides
 To Ensuring
Voter Intent


civicdesigning.org
       /fieldguides
Dana Chisnell
dana@usabilityworks.net
civicdesign@usabilityworks.net

civicdesigning.org

@danachis
@ChadButterfly

More Related Content

PDF
Using voter personas to understand who is coming to your election department ...
PDF
Fooled by best practice
PDF
Making sense of the data
PDF
Usability and security in future voting systems
PDF
Making Voting Accessible
PPTX
Designing ballot cure forms that invite voters to act
PDF
Usability of County Election Websites
PDF
Answering voters' questions at county election websites
Using voter personas to understand who is coming to your election department ...
Fooled by best practice
Making sense of the data
Usability and security in future voting systems
Making Voting Accessible
Designing ballot cure forms that invite voters to act
Usability of County Election Websites
Answering voters' questions at county election websites

What's hot (18)

PPT
Looking across the voter experience
PDF
Usability and security in future voting systems
PPTX
Plain Language: Writing so voters understand
PDF
Don't make me read! Less is more in information for voters
PPTX
Forms that work: Understanding forms to improve their design by @cjforms
PDF
Users at the end of the mouse - Persona modeler
PPTX
Defects by design: Ballots that fool voters
PPTX
Better UX Surveys part 1
PDF
User Experience Design and Human Computer Interaction
PPTX
Why do usability problems go unfixed?
PDF
Design Research Synthesis
PPTX
Designing the voting experience: Making elections easy for voters to understand
PPTX
Breaking Barriers: Ballot Access and Plain Language
PDF
Nodd.co - Quick summary v0.2.1
PPTX
Diamonds in the Rough (Sentiment(al) Analysis
PDF
Voting presentation phase2_synthesis
PPTX
Egocentric Design - Mobile UX Meetup
PPTX
Designing our civic life
Looking across the voter experience
Usability and security in future voting systems
Plain Language: Writing so voters understand
Don't make me read! Less is more in information for voters
Forms that work: Understanding forms to improve their design by @cjforms
Users at the end of the mouse - Persona modeler
Defects by design: Ballots that fool voters
Better UX Surveys part 1
User Experience Design and Human Computer Interaction
Why do usability problems go unfixed?
Design Research Synthesis
Designing the voting experience: Making elections easy for voters to understand
Breaking Barriers: Ballot Access and Plain Language
Nodd.co - Quick summary v0.2.1
Diamonds in the Rough (Sentiment(al) Analysis
Voting presentation phase2_synthesis
Egocentric Design - Mobile UX Meetup
Designing our civic life
Ad

Viewers also liked (20)

PPTX
Presentation2
PPT
m-Survey from Viplav Communications
PPSX
Voter Meets the Ballot
PDF
TARGET CRM
PPT
Constituency Management Software from Viplav Communications
PPTX
Owen Sound Election 2014 Voters Guide - Owen Sound Hub
PDF
Stranger in My Own Country
PPT
Political Campaign Planning parte2
PPT
Unit 2
PDF
2008 obamas presidential campaign as a project prezi pdf
PDF
Election Management Solution
PDF
SAP Services
PPT
Voting behaviour2
PPT
Election Constituency Management Software
PPTX
UP Election 2017
PPTX
Gramny - Connecting SHG's with Corporates
PDF
How to Pull Your Own Trump
PPTX
Mcd election 2017
PDF
Guiding voters through the polling place
PPT
Voting and Elections
Presentation2
m-Survey from Viplav Communications
Voter Meets the Ballot
TARGET CRM
Constituency Management Software from Viplav Communications
Owen Sound Election 2014 Voters Guide - Owen Sound Hub
Stranger in My Own Country
Political Campaign Planning parte2
Unit 2
2008 obamas presidential campaign as a project prezi pdf
Election Management Solution
SAP Services
Voting behaviour2
Election Constituency Management Software
UP Election 2017
Gramny - Connecting SHG's with Corporates
How to Pull Your Own Trump
Mcd election 2017
Guiding voters through the polling place
Voting and Elections
Ad

Similar to Counter to intent: Voters' mental models of alternative counting methods (20)

PDF
IACREOT - Plain language for voters and poll workers
PPTX
New e voting
PPTX
The UX of Voting
PPTX
Ux of voting
PDF
The Journey of 500 Journeys
PPTX
Study Guide for Chapter 10 of "The Struggle for Democracy"
PPT
Ε-Democracy as Humanistic Communication
PDF
Communicating with voters
PDF
The Case for Mobile Voting
PPTX
E-Voting Technology
PDF
Journey of 500 journeys
PPT
Day 9 notes
PDF
Reventing How America Votes Through Open Source Solutions - Gregory Miller OS...
DOC
Public accountability pattern in plml format
PDF
Epic journey of American voters
PPT
Field and Targeting
PPT
Field and Targeting
PDF
PREVENTION OF VOTER FRAUD USING BLOCKCHAIN TECHNOLOGY
PPTX
Merle King, Elections Administrators are IT Managers
IACREOT - Plain language for voters and poll workers
New e voting
The UX of Voting
Ux of voting
The Journey of 500 Journeys
Study Guide for Chapter 10 of "The Struggle for Democracy"
Ε-Democracy as Humanistic Communication
Communicating with voters
The Case for Mobile Voting
E-Voting Technology
Journey of 500 journeys
Day 9 notes
Reventing How America Votes Through Open Source Solutions - Gregory Miller OS...
Public accountability pattern in plml format
Epic journey of American voters
Field and Targeting
Field and Targeting
PREVENTION OF VOTER FRAUD USING BLOCKCHAIN TECHNOLOGY
Merle King, Elections Administrators are IT Managers

More from Dana Chisnell (19)

PDF
Next generation of civic designers
PDF
I can't find what i'm looking for
PDF
Gaining design insight through recruiting research participants
PPT
Anywhere Ballot iterations
PDF
Iterations paper prototype
PDF
Rethinking user research for social web
PDF
Persona modeler
PDF
Rethinking user research for social web
PDF
The users at the end of the mouse - using the 3As to model personas
PDF
Democracy is a design problem
PDF
California's top lessons learned in design and language
PDF
Deconstructing delight
PDF
Character creator
PDF
Pleasure, Flow, and Meaning in Design
PDF
Design and Critique for Challenging Problems
KEY
Super powers that could change the world
PDF
Beyond frustration: 3 levels of happy design
KEY
Rethinking user research for social design
KEY
Usability Testing in Local Jurisdictions
Next generation of civic designers
I can't find what i'm looking for
Gaining design insight through recruiting research participants
Anywhere Ballot iterations
Iterations paper prototype
Rethinking user research for social web
Persona modeler
Rethinking user research for social web
The users at the end of the mouse - using the 3As to model personas
Democracy is a design problem
California's top lessons learned in design and language
Deconstructing delight
Character creator
Pleasure, Flow, and Meaning in Design
Design and Critique for Challenging Problems
Super powers that could change the world
Beyond frustration: 3 levels of happy design
Rethinking user research for social design
Usability Testing in Local Jurisdictions

Recently uploaded (20)

PPTX
Complete Guide to Microsoft PowerPoint 2019 – Features, Tools, and Tips"
PPTX
areprosthodontics and orthodonticsa text.pptx
PPTX
Special finishes, classification and types, explanation
PPTX
mahatma gandhi bus terminal in india Case Study.pptx
PPTX
6- Architecture design complete (1).pptx
PPTX
CLASS_11_BUSINESS_STUDIES_PPT_CHAPTER_1_Business_Trade_Commerce.pptx
PPTX
YV PROFILE PROJECTS PROFILE PRES. DESIGN
PDF
Facade & Landscape Lighting Techniques and Trends.pptx.pdf
PPTX
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
PDF
Urban Design Final Project-Context
PPTX
Tenders & Contracts Works _ Services Afzal.pptx
PDF
Urban Design Final Project-Site Analysis
PPTX
Wisp Textiles: Where Comfort Meets Everyday Style
PPT
pump pump is a mechanism that is used to transfer a liquid from one place to ...
PPTX
AD Bungalow Case studies Sem 2.pptxvwewev
PPTX
HPE Aruba-master-icon-library_052722.pptx
PPTX
Media And Information Literacy for Grade 12
PPTX
DOC-20250430-WA0014._20250714_235747_0000.pptx
PPTX
12. Community Pharmacy and How to organize it
PPTX
Fundamental Principles of Visual Graphic Design.pptx
Complete Guide to Microsoft PowerPoint 2019 – Features, Tools, and Tips"
areprosthodontics and orthodonticsa text.pptx
Special finishes, classification and types, explanation
mahatma gandhi bus terminal in india Case Study.pptx
6- Architecture design complete (1).pptx
CLASS_11_BUSINESS_STUDIES_PPT_CHAPTER_1_Business_Trade_Commerce.pptx
YV PROFILE PROJECTS PROFILE PRES. DESIGN
Facade & Landscape Lighting Techniques and Trends.pptx.pdf
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
Urban Design Final Project-Context
Tenders & Contracts Works _ Services Afzal.pptx
Urban Design Final Project-Site Analysis
Wisp Textiles: Where Comfort Meets Everyday Style
pump pump is a mechanism that is used to transfer a liquid from one place to ...
AD Bungalow Case studies Sem 2.pptxvwewev
HPE Aruba-master-icon-library_052722.pptx
Media And Information Literacy for Grade 12
DOC-20250430-WA0014._20250714_235747_0000.pptx
12. Community Pharmacy and How to organize it
Fundamental Principles of Visual Graphic Design.pptx

Counter to intent: Voters' mental models of alternative counting methods