SlideShare a Scribd company logo
amazon
                                               web services



Crowdsourcing for
    improving
 Business Process



October, 2012 - Optimized for 1280x960   -   © Amazon Web Services
_ Presented by
John Hoskins, hoskins @ amazon.com
Mechanical Turk, Amazon




       [         Before we start
                                     ]
                           2
How does it
High     Crowdsourcing           work             Examples
Level

                                                         Questions



Detail           What is MTurk?         How is it used




         [   Our plan for today                          ]

                             3
[                    ]
What is Crowdsourcing?




          4
[   Crowd Labor Trends   ]
            5
1. Crowdsourcing



       6
[   Crowdsourcing:
    Key Advantages   ]

          7
[   1. Elastic Capacity   ]

             8
On and Off           Fast Growth




Variable peaks       Predictable peaks


   [  Staffing Usage Patterns      ]

                 9
On and Off        WASTE     Fast Growth



              Missed
Variable peaks Opportunity Predictable peaks


    [  Staffing Usage Patterns            ]

                       10
On and Off               Fast Growth




Variable peaks           Predictable peaks


   [         Usage Patterns:
             Crowdsourcing             ]

                    11
[   2. On Demand Availability   ]

                12
[                                    ]
    3. Pay as you go, for what you use




                    13
$                             $

    Lower costs               Capital efficiency




Improve productivity        Focus on your business



[       Business Benefits
        of Crowdsourcing                   ]

                       14
2. What is MTurk?



        15
Marketplace for Work
_ Access to global workforce, on demand
_ Quality controls and workflow “building blocks”
_ Pay as you go, only when satisfied with results
_ Programmatic Access (API)



   [      What is Mechanical Turk?                  ]

                              16
_ 500,000 Workers
_ 190+ Countries




       [      Global Workforce
                                 ]
                     17          (as of Apr 19th, 2012)
3. How it works



       18
[   How it works   ]
         19
Highest
Performing


                 Average
MASTERS
                           Unknown




  [          Mturk Workforce   ]
                     20
Highest
  Performing




                   Average
MASTERS                      Unknown
               Your Custom
                Workforce




    [      Custom Workforce      ]
                        21
Speed


      Price

                 Accuracy




[   Balances & Levers
                            ]

                  22
4. How is it used?



        23
Data Management                       Analysis/Research
_ Verification                        _ Sentiment
_ Entry & Collection                  _ Relevance
_ De-dupe                             _ Online Research
_ Algorithm Training




Content Management                    Annotation
_ Moderation (Photos, Content)        _ Tagging
_ Transcription                       _ Classification
_ Localization/Translation



          [       Common Use Cases                       ]
                                 24
How can we assess relevance of
tweets in real-time?
How can we research and categorize
merchants in our database?

How can we verify accuracy of low
confidence OCR scans?

How do we build a dictionary to
categorize ads on the internet?


[    Examples     ]
          25
Categorization


Web Research


Transcription


Categorization and DeDupe



[    Examples     ]
           26
amazon
                               web services



http://www.mturk.com
   John Hoskins, Mechanical Turk
      hoskins@amazon.com




                 27

More Related Content

PDF
Amazon mechanical turk intro to govt partners v2
PPTX
ICML- CROWDML - Ioannis (Yanni) Antonellis, Senior Director, Data Science at...
PDF
Connectvity and Back Office Management Platform for the Internet of Things
PDF
Crowdsourcing & Human Computation Labeling Data & Building Hybrid Systems
PPTX
Build, Buy, or Borrow: The Gig Economy Impact on Talent
PDF
Freelance@toptal
PPTX
Amazon Mechanical Turk Overview
PPTX
Crowdsourcing
Amazon mechanical turk intro to govt partners v2
ICML- CROWDML - Ioannis (Yanni) Antonellis, Senior Director, Data Science at...
Connectvity and Back Office Management Platform for the Internet of Things
Crowdsourcing & Human Computation Labeling Data & Building Hybrid Systems
Build, Buy, or Borrow: The Gig Economy Impact on Talent
Freelance@toptal
Amazon Mechanical Turk Overview
Crowdsourcing

Similar to Amazon mechanical turk intro to bpo's v3 (20)

PDF
CrowdCrew team project - Venture Lab 2012 OAP
PPSX
CrowdCrew project - Venture Lab 2012 OAP
PPTX
CrowdSourcing_17_144_163_185.pptx
PDF
Developing an enterprise crowdsourcing strategy
PDF
Beyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms
PPTX
Crowdsourcing for Online Data Collection
PDF
AWS User Group Berlin - Introduction To Amazon Mechanical Turk
PPTX
Leveraging Mechanical Turk for SEO
PPTX
SEO + MTurk
PPTX
Crowdsourcing presentation
PDF
Crowdsourcing: A Survey
PDF
Crowdsourcing for Information Retrieval: Principles, Methods, and Applications
PPTX
Crowdsourcing
PDF
The Power of Crowds
PPTX
Social Media Use Cases - Webinar
PPT
Cloud to crowd talk to COST Virtual work Bucharest 2014
PDF
Crowdsourcing For Research and Engineering (Tutorial given at CrowdConf 2011)
PPT
Amazon Web Services
PPTX
Human computation, crowdsourcing and social: An industrial perspective
PPTX
Amazon Mechanical Turk: Intro & Overview
CrowdCrew team project - Venture Lab 2012 OAP
CrowdCrew project - Venture Lab 2012 OAP
CrowdSourcing_17_144_163_185.pptx
Developing an enterprise crowdsourcing strategy
Beyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms
Crowdsourcing for Online Data Collection
AWS User Group Berlin - Introduction To Amazon Mechanical Turk
Leveraging Mechanical Turk for SEO
SEO + MTurk
Crowdsourcing presentation
Crowdsourcing: A Survey
Crowdsourcing for Information Retrieval: Principles, Methods, and Applications
Crowdsourcing
The Power of Crowds
Social Media Use Cases - Webinar
Cloud to crowd talk to COST Virtual work Bucharest 2014
Crowdsourcing For Research and Engineering (Tutorial given at CrowdConf 2011)
Amazon Web Services
Human computation, crowdsourcing and social: An industrial perspective
Amazon Mechanical Turk: Intro & Overview
Ad

Recently uploaded (20)

PDF
Ôn tập tiếng anh trong kinh doanh nâng cao
PDF
Stem Cell Market Report | Trends, Growth & Forecast 2025-2034
PDF
Reconciliation AND MEMORANDUM RECONCILATION
PPTX
Amazon (Business Studies) management studies
DOCX
unit 2 cost accounting- Tender and Quotation & Reconciliation Statement
PPTX
Belch_12e_PPT_Ch18_Accessible_university.pptx
PDF
Outsourced Audit & Assurance in USA Why Globus Finanza is Your Trusted Choice
PPT
Lecture 3344;;,,(,(((((((((((((((((((((((
PPTX
CkgxkgxydkydyldylydlydyldlyddolydyoyyU2.pptx
PPT
340036916-American-Literature-Literary-Period-Overview.ppt
PPTX
Lecture (1)-Introduction.pptx business communication
PDF
Power and position in leadershipDOC-20250808-WA0011..pdf
PDF
Katrina Stoneking: Shaking Up the Alcohol Beverage Industry
PDF
Unit 1 Cost Accounting - Cost sheet
PDF
COST SHEET- Tender and Quotation unit 2.pdf
PPTX
2025 Product Deck V1.0.pptxCATALOGTCLCIA
PDF
SIMNET Inc – 2023’s Most Trusted IT Services & Solution Provider
PPTX
job Avenue by vinith.pptxvnbvnvnvbnvbnbmnbmbh
PDF
pdfcoffee.com-opt-b1plus-sb-answers.pdfvi
PDF
Chapter 5_Foreign Exchange Market in .pdf
Ôn tập tiếng anh trong kinh doanh nâng cao
Stem Cell Market Report | Trends, Growth & Forecast 2025-2034
Reconciliation AND MEMORANDUM RECONCILATION
Amazon (Business Studies) management studies
unit 2 cost accounting- Tender and Quotation & Reconciliation Statement
Belch_12e_PPT_Ch18_Accessible_university.pptx
Outsourced Audit & Assurance in USA Why Globus Finanza is Your Trusted Choice
Lecture 3344;;,,(,(((((((((((((((((((((((
CkgxkgxydkydyldylydlydyldlyddolydyoyyU2.pptx
340036916-American-Literature-Literary-Period-Overview.ppt
Lecture (1)-Introduction.pptx business communication
Power and position in leadershipDOC-20250808-WA0011..pdf
Katrina Stoneking: Shaking Up the Alcohol Beverage Industry
Unit 1 Cost Accounting - Cost sheet
COST SHEET- Tender and Quotation unit 2.pdf
2025 Product Deck V1.0.pptxCATALOGTCLCIA
SIMNET Inc – 2023’s Most Trusted IT Services & Solution Provider
job Avenue by vinith.pptxvnbvnvnvbnvbnbmnbmbh
pdfcoffee.com-opt-b1plus-sb-answers.pdfvi
Chapter 5_Foreign Exchange Market in .pdf
Ad

Amazon mechanical turk intro to bpo's v3

  • 1. amazon web services Crowdsourcing for improving Business Process October, 2012 - Optimized for 1280x960 - © Amazon Web Services
  • 2. _ Presented by John Hoskins, hoskins @ amazon.com Mechanical Turk, Amazon [ Before we start ] 2
  • 3. How does it High Crowdsourcing work Examples Level Questions Detail What is MTurk? How is it used [ Our plan for today ] 3
  • 4. [ ] What is Crowdsourcing? 4
  • 5. [ Crowd Labor Trends ] 5
  • 7. [ Crowdsourcing: Key Advantages ] 7
  • 8. [ 1. Elastic Capacity ] 8
  • 9. On and Off Fast Growth Variable peaks Predictable peaks [ Staffing Usage Patterns ] 9
  • 10. On and Off WASTE Fast Growth Missed Variable peaks Opportunity Predictable peaks [ Staffing Usage Patterns ] 10
  • 11. On and Off Fast Growth Variable peaks Predictable peaks [ Usage Patterns: Crowdsourcing ] 11
  • 12. [ 2. On Demand Availability ] 12
  • 13. [ ] 3. Pay as you go, for what you use 13
  • 14. $ $ Lower costs Capital efficiency Improve productivity Focus on your business [ Business Benefits of Crowdsourcing ] 14
  • 15. 2. What is MTurk? 15
  • 16. Marketplace for Work _ Access to global workforce, on demand _ Quality controls and workflow “building blocks” _ Pay as you go, only when satisfied with results _ Programmatic Access (API) [ What is Mechanical Turk? ] 16
  • 17. _ 500,000 Workers _ 190+ Countries [ Global Workforce ] 17 (as of Apr 19th, 2012)
  • 18. 3. How it works 18
  • 19. [ How it works ] 19
  • 20. Highest Performing Average MASTERS Unknown [ Mturk Workforce ] 20
  • 21. Highest Performing Average MASTERS Unknown Your Custom Workforce [ Custom Workforce ] 21
  • 22. Speed Price Accuracy [ Balances & Levers ] 22
  • 23. 4. How is it used? 23
  • 24. Data Management Analysis/Research _ Verification _ Sentiment _ Entry & Collection _ Relevance _ De-dupe _ Online Research _ Algorithm Training Content Management Annotation _ Moderation (Photos, Content) _ Tagging _ Transcription _ Classification _ Localization/Translation [ Common Use Cases ] 24
  • 25. How can we assess relevance of tweets in real-time? How can we research and categorize merchants in our database? How can we verify accuracy of low confidence OCR scans? How do we build a dictionary to categorize ads on the internet? [ Examples ] 25
  • 27. amazon web services http://www.mturk.com John Hoskins, Mechanical Turk hoskins@amazon.com 27