SlideShare a Scribd company logo
Free As In Puppies:
Compensating for ICT
Constraints in Citizen Science

 Andrea Wiggins
 University of New Mexico & Cornell University
 andrea.wiggins@cornell.edu @AndreaWiggins
Citizen Science
A few examples




                 3
Related Work
✦   Participant-focused
    ✦   Individual learning            Trumbull et al., 2000
        (many more in Informal Science Education)

    ✦   Motivation         Nov et al., 2011; Rotman et al., 2012;
        Raddick et al., 2009
Related Work
✦   Project-focused
    ✦   Typologies       Cooper et al., 2007; Bonney et al., 2009;
        Wiggins & Crowston, 2010

    ✦   Data quality          Sheppard & Terveen, 2011; Wiggins et
        al., 2011; Wiggins et al., 2012
Assumptions

                        More
                       people

      Cool   Miracle   More     Better
$$$   new    occurs    data     science
      ICT

                       Better
                        data
Reality
✦   There is no money


✦   Free ICT are “free as in puppies”


✦   ICT is just one part of a complex
    sociotechnical system
Research Question
✦   RQ: How do citizen science project
    organizers address key issues related
    to participation & data quality when
    resource constraints limit ICT options?
Research Question
✦   RQ: How do citizen science project
    organizers address key issues related
    to participation & data quality when
    resource constraints limit ICT options?
✦   Answer: Creatively!
    ✦   Improving participation processes
    ✦   Expanding participation options
    ✦   Investing money & time strategically
Research Design
✦   Comparative case study
    ✦   Theoretical sampling
    ✦   Project-level focus
Research Design
✦   Data
    ✦   Interviews
    ✦   Documents
    ✦   Participation
    ✦   Observation
✦   Analysis
    ✦   Inductive & deductive qualitative
        content analysis
Case Selection
✦   Same core tasks
    ✦   Go outside, look at stuff, submit
        data
✦   Similar purpose
    ✦   Conservation, education, research
✦   Contrasting resources
    ✦   eBird: 4.5 FTE, ~$300K/yr
    ✦   GSP & MW: 0.5/1.5 FTE, ~$15K/yr
Free as in Puppies: Compensating for ICT Constraints in Citizen Science
Free as in Puppies: Compensating for ICT Constraints in Citizen Science
Free as in Puppies: Compensating for ICT Constraints in Citizen Science
Recruitment
✦   #1 strategy: direct in-person contact
✦   ICT solution
    ✦   Effortless social recommendation
        via existing community practices:
        “This report was generated
        automatically by eBird v3”
✦   Alternate solution
    ✦   Data collected on paper
    ✦   Saturation marketing
Retention
✦   ICT solution
    ✦   Mind-blowing data visualizations
Indigo Bunting (Passerina cyanea)
Retention
✦   ICT solution
    ✦   Mind-blowing data visualizations
✦   Alternate solutions
    ✦   Optimize participation processes
    ✦   Expand participation options*
    ✦   New communication strategies*


          *bonus research opportunities!
Data Quality




X
Dogbird         Catbird
Data Quality
✦   ICT solution
    ✦   Algorithmically flag outliers for
        review by small army of experts
✦   Alternate solutions
    ✦   Hone protocols
    ✦   Invest in good data
        entry forms
    ✦   Use complementary
        data sources
Implications for Practice
✦   Good ICT is awesome - when you can
    afford it
✦   When you can’t...
    ✦   Combine available ICT with other
        (human, organizational) resources
    ✦   Unique resources often
        taken for granted
    ✦   Beware of free puppies
Implications for Policy
✦   Citizen science is growing up
    ✦   Valid to fund on scientific merit
    ✦   Need better means of evaluating
        scientific merit of citizen science
✦   Consider ROI of research
    ✦   1 week on oceanographic research
        vessel for a handful of researchers
    ✦   1 year of eBird & 60M global data
        points used by 120K people/day
Implications for CSCW
✦   When ICT options are limited, look for
    complementary resources &
    compensatory strategies
✦   Opportunity for cross-context
    comparisons
    ✦   Online communities
    ✦   Distributed scientific work
    ✦   Peer production
Questions?
✦   Research made
    possible by...
                         ✦ U.S.   NSF
    ✦ eBird


                          VOSS-0943049,
    ✦ The   Great Sunf    SOCS-0968470, &
                          OCI-0830944

                         ✦ Awesome      CSCW
    ✦                     reviewers

                         ✦ Mydissertation
                          committee

More Related Content

PPT
Citizen Science Phenotypes
PDF
Crowdsourcing Science
PDF
Online Communities in Citizen Science
PDF
Little eScience
PDF
Online Communities in Citizen Science & BirdCams
PPTX
CHI2015 - Citizen Science || Zooniverse
PPT
The Evolving Landscape of Citizen Science
KEY
Open Source, Open Science, & Citizen Science
Citizen Science Phenotypes
Crowdsourcing Science
Online Communities in Citizen Science
Little eScience
Online Communities in Citizen Science & BirdCams
CHI2015 - Citizen Science || Zooniverse
The Evolving Landscape of Citizen Science
Open Source, Open Science, & Citizen Science

What's hot (20)

PPT
Data Management for Citizen Science
PDF
Citizen Science 101: What Every Researcher Should Know About Crowdsourcing Sc...
PPTX
Citizen science
PDF
Data Intensive Collaboration in Science and Engineering: CSCW workshop themes
PPTX
Michael Pocock: Citizen Science Project Design
PPTX
"Breaking the Barriers to Citizen Science"
PPTX
Ian Thornhill Citizen Science Training Day
PPTX
Domain-specific Knowledge Extraction from the Web of Data
PDF
Into the Night - Technology for citizen science
PPTX
What is eScience, and where does it go from here?
PPTX
Web Observatories and e-Research
PPTX
Massive-Scale Analytics Applied to Real-World Problems
PPTX
Big Data Talent in Academic and Industry R&D
PPT
Supporting Libraries in Leading the Way in Research Data Management
PPTX
AHM 2014: The iPlant Collaborative, Community Cyberinfrastructure for Life Sc...
PDF
New and Emerging Forms of Data
PPT
What is Research Data Management? UAL
PPTX
Location aware apps: patterns and solutions - Ben Butchart - Jisc Digital Fes...
PPTX
Nicole Nogoy at the Auckland BMC RoadShow
Data Management for Citizen Science
Citizen Science 101: What Every Researcher Should Know About Crowdsourcing Sc...
Citizen science
Data Intensive Collaboration in Science and Engineering: CSCW workshop themes
Michael Pocock: Citizen Science Project Design
"Breaking the Barriers to Citizen Science"
Ian Thornhill Citizen Science Training Day
Domain-specific Knowledge Extraction from the Web of Data
Into the Night - Technology for citizen science
What is eScience, and where does it go from here?
Web Observatories and e-Research
Massive-Scale Analytics Applied to Real-World Problems
Big Data Talent in Academic and Industry R&D
Supporting Libraries in Leading the Way in Research Data Management
AHM 2014: The iPlant Collaborative, Community Cyberinfrastructure for Life Sc...
New and Emerging Forms of Data
What is Research Data Management? UAL
Location aware apps: patterns and solutions - Ben Butchart - Jisc Digital Fes...
Nicole Nogoy at the Auckland BMC RoadShow
Ad

Viewers also liked (15)

PDF
Motivation by Design: Technologies, Experiences, and Incentives
PPTX
Citizen science presentation
PPTX
Mechanisms for Data Quality and Validation in Citizen Science
PPT
GeoChronos - CANARIE NEP Showcase 2009 Presentation
PPT
Intellectual Diversity in the iSchools: Past, Present and Future
PPT
Tales of the Field: Building Small Science Cyberinfrastructure
PPT
E scidocdays review
PPT
Exploring Peer Prestige in Academic Hiring Networks Brown Bag
PDF
Crowdsourcing Scientific Work: A Comparative Study of Technologies, Processes...
PDF
4. sistema nervioso autonomo
PDF
Citizen Science - What's policy got to do with it?
PPTX
Climate Change and Citizen Science (West)
PPT
Go4It Activity/ Questions
PPT
All About me
PPTX
Eight Steps to an Effective Vulnerability Assessment
Motivation by Design: Technologies, Experiences, and Incentives
Citizen science presentation
Mechanisms for Data Quality and Validation in Citizen Science
GeoChronos - CANARIE NEP Showcase 2009 Presentation
Intellectual Diversity in the iSchools: Past, Present and Future
Tales of the Field: Building Small Science Cyberinfrastructure
E scidocdays review
Exploring Peer Prestige in Academic Hiring Networks Brown Bag
Crowdsourcing Scientific Work: A Comparative Study of Technologies, Processes...
4. sistema nervioso autonomo
Citizen Science - What's policy got to do with it?
Climate Change and Citizen Science (West)
Go4It Activity/ Questions
All About me
Eight Steps to an Effective Vulnerability Assessment
Ad

Similar to Free as in Puppies: Compensating for ICT Constraints in Citizen Science (20)

PPTX
Data Science Meets Academia - What Comes Next?
PDF
Geographies of crowdsourced information and their implications (VGI-Alive Key...
PPT
Improving Access to Research Data: What does changing legislation mean for y...
PPTX
A coordinated framework for open data open science in Botswana/Simon Hodson
PDF
Proposal for the Theme on Big Data.pdf
PPTX
Data driven innovation for education
PDF
Better Data for a Better World
PDF
Getting Started in Data Science
PPTX
ppt1.pptx
PPTX
Big Data and Data Science: Opportunities for Biomedical Engineering
PDF
Career in Data Science (July 2017, DTLA)
PDF
Open Data and IATI
PDF
ODI at Future Everything 2013 #futr
PPT
Data Science BD2K Update for NIH
PPTX
Digital capabilities for research
PPTX
Big Data and Analytics Across the Interdisciplinary Divide
PPTX
GODAN presentation with South Chinese Scientific Institutions
PPTX
Open for all – the benefits of open data in a digital age_Thorley
PPTX
1. Data Science overview - part1.pptx
Data Science Meets Academia - What Comes Next?
Geographies of crowdsourced information and their implications (VGI-Alive Key...
Improving Access to Research Data: What does changing legislation mean for y...
A coordinated framework for open data open science in Botswana/Simon Hodson
Proposal for the Theme on Big Data.pdf
Data driven innovation for education
Better Data for a Better World
Getting Started in Data Science
ppt1.pptx
Big Data and Data Science: Opportunities for Biomedical Engineering
Career in Data Science (July 2017, DTLA)
Open Data and IATI
ODI at Future Everything 2013 #futr
Data Science BD2K Update for NIH
Digital capabilities for research
Big Data and Analytics Across the Interdisciplinary Divide
GODAN presentation with South Chinese Scientific Institutions
Open for all – the benefits of open data in a digital age_Thorley
1. Data Science overview - part1.pptx

More from Andrea Wiggins (15)

PDF
Crowdsourcing Citizen Science Data Quality with a Human-Computer Learning Net...
PDF
With Great Data Comes Great Responsibility
KEY
Open Source & Citizen Science
PPT
From Conservation to Crowdsourcing: A Typology of Citizen Science
PDF
Secondary data analysis with digital trace data
PPT
Reclassifying Success and Tragedy in FLOSS Projects
PPT
Distributed Scientific Collaboration: Research Opportunities in Citizen Science
PPT
Designing Virtual Organizations for Citizen Science
PPT
National Park System Property Designations
PPT
Collaborative Data Analysis with Taverna Workflows
PPT
Coordination Dynamics in Free/Libre and Open Source Software
PPT
Heartbeat: Measuring Active User Base and Potential User Interest
PPT
Replicating FLOSS Research as eResearch
PPT
Social dynamics of FLOSS team communication across channels
PPT
eResearch workflows for studying free and open source software development
Crowdsourcing Citizen Science Data Quality with a Human-Computer Learning Net...
With Great Data Comes Great Responsibility
Open Source & Citizen Science
From Conservation to Crowdsourcing: A Typology of Citizen Science
Secondary data analysis with digital trace data
Reclassifying Success and Tragedy in FLOSS Projects
Distributed Scientific Collaboration: Research Opportunities in Citizen Science
Designing Virtual Organizations for Citizen Science
National Park System Property Designations
Collaborative Data Analysis with Taverna Workflows
Coordination Dynamics in Free/Libre and Open Source Software
Heartbeat: Measuring Active User Base and Potential User Interest
Replicating FLOSS Research as eResearch
Social dynamics of FLOSS team communication across channels
eResearch workflows for studying free and open source software development

Recently uploaded (20)

PPTX
Big Data Technologies - Introduction.pptx
PDF
Encapsulation theory and applications.pdf
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
Spectroscopy.pptx food analysis technology
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Machine learning based COVID-19 study performance prediction
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
sap open course for s4hana steps from ECC to s4
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Empathic Computing: Creating Shared Understanding
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Approach and Philosophy of On baking technology
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Big Data Technologies - Introduction.pptx
Encapsulation theory and applications.pdf
Understanding_Digital_Forensics_Presentation.pptx
Encapsulation_ Review paper, used for researhc scholars
Spectroscopy.pptx food analysis technology
20250228 LYD VKU AI Blended-Learning.pptx
Machine learning based COVID-19 study performance prediction
“AI and Expert System Decision Support & Business Intelligence Systems”
sap open course for s4hana steps from ECC to s4
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Advanced methodologies resolving dimensionality complications for autism neur...
Mobile App Security Testing_ A Comprehensive Guide.pdf
Unlocking AI with Model Context Protocol (MCP)
Empathic Computing: Creating Shared Understanding
Building Integrated photovoltaic BIPV_UPV.pdf
Approach and Philosophy of On baking technology
NewMind AI Weekly Chronicles - August'25 Week I
Dropbox Q2 2025 Financial Results & Investor Presentation
Review of recent advances in non-invasive hemoglobin estimation
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy

Free as in Puppies: Compensating for ICT Constraints in Citizen Science

  • 1. Free As In Puppies: Compensating for ICT Constraints in Citizen Science Andrea Wiggins University of New Mexico & Cornell University andrea.wiggins@cornell.edu @AndreaWiggins
  • 4. Related Work ✦ Participant-focused ✦ Individual learning Trumbull et al., 2000 (many more in Informal Science Education) ✦ Motivation Nov et al., 2011; Rotman et al., 2012; Raddick et al., 2009
  • 5. Related Work ✦ Project-focused ✦ Typologies Cooper et al., 2007; Bonney et al., 2009; Wiggins & Crowston, 2010 ✦ Data quality Sheppard & Terveen, 2011; Wiggins et al., 2011; Wiggins et al., 2012
  • 6. Assumptions More people Cool Miracle More Better $$$ new occurs data science ICT Better data
  • 7. Reality ✦ There is no money ✦ Free ICT are “free as in puppies” ✦ ICT is just one part of a complex sociotechnical system
  • 8. Research Question ✦ RQ: How do citizen science project organizers address key issues related to participation & data quality when resource constraints limit ICT options?
  • 9. Research Question ✦ RQ: How do citizen science project organizers address key issues related to participation & data quality when resource constraints limit ICT options? ✦ Answer: Creatively! ✦ Improving participation processes ✦ Expanding participation options ✦ Investing money & time strategically
  • 10. Research Design ✦ Comparative case study ✦ Theoretical sampling ✦ Project-level focus
  • 11. Research Design ✦ Data ✦ Interviews ✦ Documents ✦ Participation ✦ Observation ✦ Analysis ✦ Inductive & deductive qualitative content analysis
  • 12. Case Selection ✦ Same core tasks ✦ Go outside, look at stuff, submit data ✦ Similar purpose ✦ Conservation, education, research ✦ Contrasting resources ✦ eBird: 4.5 FTE, ~$300K/yr ✦ GSP & MW: 0.5/1.5 FTE, ~$15K/yr
  • 16. Recruitment ✦ #1 strategy: direct in-person contact ✦ ICT solution ✦ Effortless social recommendation via existing community practices: “This report was generated automatically by eBird v3” ✦ Alternate solution ✦ Data collected on paper ✦ Saturation marketing
  • 17. Retention ✦ ICT solution ✦ Mind-blowing data visualizations
  • 19. Retention ✦ ICT solution ✦ Mind-blowing data visualizations ✦ Alternate solutions ✦ Optimize participation processes ✦ Expand participation options* ✦ New communication strategies* *bonus research opportunities!
  • 21. Data Quality ✦ ICT solution ✦ Algorithmically flag outliers for review by small army of experts ✦ Alternate solutions ✦ Hone protocols ✦ Invest in good data entry forms ✦ Use complementary data sources
  • 22. Implications for Practice ✦ Good ICT is awesome - when you can afford it ✦ When you can’t... ✦ Combine available ICT with other (human, organizational) resources ✦ Unique resources often taken for granted ✦ Beware of free puppies
  • 23. Implications for Policy ✦ Citizen science is growing up ✦ Valid to fund on scientific merit ✦ Need better means of evaluating scientific merit of citizen science ✦ Consider ROI of research ✦ 1 week on oceanographic research vessel for a handful of researchers ✦ 1 year of eBird & 60M global data points used by 120K people/day
  • 24. Implications for CSCW ✦ When ICT options are limited, look for complementary resources & compensatory strategies ✦ Opportunity for cross-context comparisons ✦ Online communities ✦ Distributed scientific work ✦ Peer production
  • 25. Questions? ✦ Research made possible by... ✦ U.S. NSF ✦ eBird VOSS-0943049, ✦ The Great Sunf SOCS-0968470, & OCI-0830944 ✦ Awesome CSCW ✦ reviewers ✦ Mydissertation committee