SlideShare a Scribd company logo
Crowds & Creativity
    Mike Krieger
    Stanford HCI Group
    Adobe Plerk Workshop
Big Picture
How can we tap into
the creative potential
of online crowds?
Big Picture              Outline
                         1. C urrent projects
How can we tap into      2. When do crowds
the creative potential   ma  ke sense for a
of online crowds?         project?
                          3. How  can we design
                          for better
                          collaboration &
                           creativity?
                           (4 principles)
Wisdom of      ...or tyranny
the crowd...   of the
                m  asses?
Positive traits
diversity of
background,
expertise, thoughts,
ideas
power in numbers
“collective
intelligence”
validation &
feedback
Successful
Projects
Evaluating Scenarios




                       6
Evaluating Scenarios




                       6
Evaluating Scenarios




                       6
7
7
7
“Persona    lly I think the
 Reactions                      idea fr  om storyboard g.
                                one is m    ore compellin
“Personally I prefer the idea    The re   ason for this is
of storyboard one. This is       that I would be ding out
because the user freely          in terested in fin ation
walks around the museum as       inte  resting inform work
they would traditionally, yet     about   a piece of art at
automatically receive info        or a par  ticular artist th
about exhibits - a virtual        I couldn't    just get at the
guide without user input.         museum      . The map of
Much more impressive.”             th e museum is an get
                                   som   ething that I c
                                   at the  museum on a
                                    pie ce of paper that to be
                                    does  n't require me
                                    pulling  out my phone
                                    and wast     ing the battery
                                    to get t  o an exhibit.”
!"#$%&!'()*+,-*#+.'(&/.!




                                   (;<15'=45>19




01223'4556718'49'9:1'8;<15=45>19
*>43?'2@A'=4>1'4'89@53'@B'
3@;5'@A2C'D471'B;2E
-6FF'68'A4F>62G'H@A2'4'I;83'895119?'F621H'A69:'8:@<8?'51894;54298'42H'9:1'F6>1C
D68'B5612H'%:6F'68'62'9:1'J@K11'8:@<'514H62G'9:1'21A8<4<15C
Phil’s in
             the
           Coffee
            Shop!




-6FFL8'<:@21'4F1598':6='9:49':68'B5612H'68'2145I3':4762G'4'J@K11C
Hi Phil!




-6FF'H1J6H18'9@'H5@<'62'42H':471'4'J@K11'A69:'%:6FC
! Price Latte




#8':1'129158'9:1'8:@<?':68'<:@21'4F1598':6='9@'9:1'H43L8'8<1J64F'@K158C
Why sucessful?

fun activities
hidden ambitions
small, parallelized
tasks
encouraging
experimentation &
iteration
right representation
Not-so-
successful
ones
Why not
sucessful?
lack of conceptual
integrity
lack of constructive
behavior
asking too much, or
in the wrong way
9 guidelines
1. When diversity      6. Lea rn from hacks,
   matters                 mods, re-use from
                           crowd
2. Small chunks/
   delegate-able       7.  Enable novel
   actions                 knowledge
                           discovery
3. Easy verification
                        8.  Maintain vision &
4. Fun activity, or         design consistency
   hidden ambition
                        9 . Not just about
5. Better than              lowering costs
   computers at
   performing a task
Designing
for crowd
creativity
to let them run
wild, you need
careful design &
constraints
Project:
Crowd
Brai nstorming
In
brainstorming,
constructive
                 “yes,
ideation is      and...”
critical
Current
systems look
like Digg...
Current
systems look
like Digg...
S o folks act
like they’re on
Digg

(no constructive
ideation)
Our project:

Ideas2Ideas
Our project:

Ideas2Ideas
Our project:
                        Ideas2Ideas      Dell IdeaStorm Clone




   Non-building ideas   35               52


Ideas2Ideas
   Constructive ideas   43               25




           !2 test of independence = 10.8776, p < 0.001
2 design
principles
1. the value of
designing for
constructive
ideation
2. reducing
staleness by
visualizing “long
tail” of crowd
contributions
Project 2
Not just building
off ideas, but
others’ work as
well
Project 2
Not just building
off ideas, but
others’ work as
well                Wi kiTasks
Question
How does the
Wikipedia crowd
of editors
organize their
actions (to-dos),
on a personal
and site-wide
level?
Insights

1. Bottom-up             4 . Disconnect
structure                between
                         ind  ividual & site-
2. Existing system       wide goals
doesn’t encourage
“next action” thinking    5. La ck of support
                          for contextual
3. Lack of triage         discovery
WikiTasks
Prototype
WikiTasks
Prototype
Findings
Lowers barriers to
participation
Encourages
collaborative task-
making
70% of completed
actions originated
from someone else
design
principles

1. Contextual display   2. Sliding scale of
of task and work        part icipation and
information alongside   bottom-up
crowd’s work            creation
wrapping it up
1. strong potential for
creative crowds
2. but need to
consider right
applications for
crowds
3. and keep design
principles in mind
when building
“crowd-powered”
sites
thanks!
                            Scott Klemmer &
                            Joel Brandt for
                            guidance and
                            feedback
mkrieger@hci.stanford.edu   C ollaborators &
                             Wikipedia
                             participants
                             Eve ryone here for
                             participating

More Related Content

PDF
Data Visualisation Literacy - Learning to See
PDF
Andy Kirk's talk at the ACEhp 2015 Conference
PDF
Fresh Thinking on Communicating with Data
PDF
Thoughts on the New Serendipity @SXSW2013
PDF
Design thinking for designing and delivering services
PDF
Let's do some thinking about data visualisation thinking
PDF
Andy Kirk's Webinar for Tableau (July 2016)
PDF
What they didn't know they needed
Data Visualisation Literacy - Learning to See
Andy Kirk's talk at the ACEhp 2015 Conference
Fresh Thinking on Communicating with Data
Thoughts on the New Serendipity @SXSW2013
Design thinking for designing and delivering services
Let's do some thinking about data visualisation thinking
Andy Kirk's Webinar for Tableau (July 2016)
What they didn't know they needed

What's hot (19)

PDF
Understanding design thinking in practice: a qualitative study of design led ...
PDF
OpenIDEO i20 Presentation 1.13.11
PDF
Crowdsourcing Week 2014 Copenhagen: Community, Collaboration & Impact
PDF
Cognitve biases and project management
PDF
from concept to capability: developing design thinking in a professional serv...
PDF
Immerse, Imagine, Invent, Articulate: A framework for disruptive innovation
PPSX
Lego Serious Play & Business Model Canvas
PDF
Developing design thinking practice in complex organisations
PDF
A speed date with design thinking
PPTX
Human centered design and Social media
PDF
Design Kit: Facilitator's guide to introducing Human-centered Design
PDF
UX Australia 2015 Redux
PDF
The 10 1/2 Commandments of Visual Thinking: The "Lost Chapter" from The Back ...
PDF
Investing in local communities by sharing the power of design
KEY
Creativity & Technology: Learning to Play Well in the Internet Sandbox
PDF
Office Playgrounds: Can Freedom Be Programmed?
PDF
Visual and Creative Thinking:What We Learned From Peter Pan and Willy Wonka
PDF
Getting To Thank You: A practitioner's guide to innovation
PDF
Desperately Seeking Theory: Gamification, Theory, and the Promise of a Data/A...
Understanding design thinking in practice: a qualitative study of design led ...
OpenIDEO i20 Presentation 1.13.11
Crowdsourcing Week 2014 Copenhagen: Community, Collaboration & Impact
Cognitve biases and project management
from concept to capability: developing design thinking in a professional serv...
Immerse, Imagine, Invent, Articulate: A framework for disruptive innovation
Lego Serious Play & Business Model Canvas
Developing design thinking practice in complex organisations
A speed date with design thinking
Human centered design and Social media
Design Kit: Facilitator's guide to introducing Human-centered Design
UX Australia 2015 Redux
The 10 1/2 Commandments of Visual Thinking: The "Lost Chapter" from The Back ...
Investing in local communities by sharing the power of design
Creativity & Technology: Learning to Play Well in the Internet Sandbox
Office Playgrounds: Can Freedom Be Programmed?
Visual and Creative Thinking:What We Learned From Peter Pan and Willy Wonka
Getting To Thank You: A practitioner's guide to innovation
Desperately Seeking Theory: Gamification, Theory, and the Promise of a Data/A...
Ad

Viewers also liked (17)

PDF
Banking In The Survivor's World
PDF
Client Side Development with Brunch
PPTX
2010 11 publishing and copyright in hci
PDF
101015 BluePrint Delft presentation Board of Dire
PDF
AgileMeetup_2016-03-10_KH
PDF
Gruppo Bassilichi @ Branch Transformation 2014
PDF
Managing the Digital Branch
PDF
10 Tips to Help You Navigate the Funding Process
PPS
Branch Transformation Slide Show
PDF
Building the Digital Branch: Designing Effective Library Websites
PDF
Bank world conference diebold branch transformation presentation_011813
PPTX
Inovation of motorola inc
PDF
Branch Bank of the Future – Transforming to Stay Relevant
PDF
Designing the Digital Branch: it's Everyone's Job
PDF
Bank Branch Network Reorganization and Optimization proram
PDF
Branch of the future
PDF
Spotify Developer Brunch @ SXSW
Banking In The Survivor's World
Client Side Development with Brunch
2010 11 publishing and copyright in hci
101015 BluePrint Delft presentation Board of Dire
AgileMeetup_2016-03-10_KH
Gruppo Bassilichi @ Branch Transformation 2014
Managing the Digital Branch
10 Tips to Help You Navigate the Funding Process
Branch Transformation Slide Show
Building the Digital Branch: Designing Effective Library Websites
Bank world conference diebold branch transformation presentation_011813
Inovation of motorola inc
Branch Bank of the Future – Transforming to Stay Relevant
Designing the Digital Branch: it's Everyone's Job
Bank Branch Network Reorganization and Optimization proram
Branch of the future
Spotify Developer Brunch @ SXSW
Ad

Similar to Crowds and Creativity (20)

PDF
Crowds and Creativity
PDF
Collective Intelligence Lecture 1: Introduction
PDF
Intro to Design Thinking
PDF
Connect, Communicate, Collaborate: Powering Learning
DOC
Introduction to Social Computing - Book Chapter
PPTX
Crowdsourcing
PDF
Enabling co-­creation of e-services through virtual worlds
PDF
Timreitzes portfolio
PPTX
Ideation,demos
PDF
Visual Design Project Brief
PDF
Guiding UX Principles
PPTX
Designing Interactive Library Spaces - Seminar w/ EdLab, Teachers College of ...
PDF
Validating Ideas Through Prototyping
PPTX
Plan, Adapt, Emerge: Unthinkable keynote to the Arts Marketing Association
PDF
How to come up with digital ideas.
PDF
Guerilla Design
PDF
designthinking
PDF
Akonga #M
PPT
MIT Course - What is Experience Design
PDF
Conole Lams
Crowds and Creativity
Collective Intelligence Lecture 1: Introduction
Intro to Design Thinking
Connect, Communicate, Collaborate: Powering Learning
Introduction to Social Computing - Book Chapter
Crowdsourcing
Enabling co-­creation of e-services through virtual worlds
Timreitzes portfolio
Ideation,demos
Visual Design Project Brief
Guiding UX Principles
Designing Interactive Library Spaces - Seminar w/ EdLab, Teachers College of ...
Validating Ideas Through Prototyping
Plan, Adapt, Emerge: Unthinkable keynote to the Arts Marketing Association
How to come up with digital ideas.
Guerilla Design
designthinking
Akonga #M
MIT Course - What is Experience Design
Conole Lams

More from Innovation Excellence (20)

PDF
Top 40 Innovation Bloggers of 2014
PDF
How Performance Recognition Impacts Innovation and Employee Engagement
PDF
100 Things to Watch in 2014 - JWT
PDF
Innovation Excellence Weekly Issue 37
PDF
Innovation Excellence Weekly - Issue 36
PDF
Innovation Excellence Weekly - Issue 35
PDF
Innovation Excellence Weekly - Issue 34
PDF
Innovation Excellence Weekly - Issue 31
PDF
Innovation Excellence Weekly - Issue 30
PDF
Innovation Excellence Weekly - Issue 28
PDF
Innovation Excellence Weekly - Issue 27
PDF
Innovation Excellence Weekly - Issue 26
PDF
Innovation Excellence Weekly - Issue 25
PDF
Innovation Excellence Weekly - Issue 24
PDF
Innovation Excellence Weekly - Issue 23
PDF
Innovation Excellence Weekly - Issue 22
PDF
Innovation Excellence Weekly - Issue 21
PDF
Innovation Excellence Weekly - Issue 20
PDF
Innovation Excellence Weekly - Issue 19
PDF
Innovation Excellence Weekly - Issue 18
Top 40 Innovation Bloggers of 2014
How Performance Recognition Impacts Innovation and Employee Engagement
100 Things to Watch in 2014 - JWT
Innovation Excellence Weekly Issue 37
Innovation Excellence Weekly - Issue 36
Innovation Excellence Weekly - Issue 35
Innovation Excellence Weekly - Issue 34
Innovation Excellence Weekly - Issue 31
Innovation Excellence Weekly - Issue 30
Innovation Excellence Weekly - Issue 28
Innovation Excellence Weekly - Issue 27
Innovation Excellence Weekly - Issue 26
Innovation Excellence Weekly - Issue 25
Innovation Excellence Weekly - Issue 24
Innovation Excellence Weekly - Issue 23
Innovation Excellence Weekly - Issue 22
Innovation Excellence Weekly - Issue 21
Innovation Excellence Weekly - Issue 20
Innovation Excellence Weekly - Issue 19
Innovation Excellence Weekly - Issue 18

Recently uploaded (20)

PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
TLE Review Electricity (Electricity).pptx
PDF
Mushroom cultivation and it's methods.pdf
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Hybrid model detection and classification of lung cancer
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Approach and Philosophy of On baking technology
PDF
Getting Started with Data Integration: FME Form 101
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
PDF
Web App vs Mobile App What Should You Build First.pdf
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
August Patch Tuesday
Programs and apps: productivity, graphics, security and other tools
TLE Review Electricity (Electricity).pptx
Mushroom cultivation and it's methods.pdf
Assigned Numbers - 2025 - Bluetooth® Document
Building Integrated photovoltaic BIPV_UPV.pdf
A novel scalable deep ensemble learning framework for big data classification...
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Hybrid model detection and classification of lung cancer
Group 1 Presentation -Planning and Decision Making .pptx
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Approach and Philosophy of On baking technology
Getting Started with Data Integration: FME Form 101
SOPHOS-XG Firewall Administrator PPT.pptx
NewMind AI Weekly Chronicles - August'25-Week II
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Web App vs Mobile App What Should You Build First.pdf
gpt5_lecture_notes_comprehensive_20250812015547.pdf
August Patch Tuesday

Crowds and Creativity