SlideShare a Scribd company logo
Startup Metrics for Pirates: AARRR! Rethink Hawaii Startonomics Nov 2009 Dave McClure, Founders Fund http://www.foundersfund.com/   http://500hats.typepad.com/ http://slideshare.net/dmc500hats/
Why I’m Here:  To Kick Your ASS. The Basics 5 Steps: Startup Metrics for Pirates ( AARRR ! ) Iterate, Measure, Optimize. Build a Feedback Loop. ( Loop. Loop. ) KILL  a FEATURE . Something Sucks. Find It.  Kill it. NOW . YOUR SILLY FRIGGIN HOPES & DREAMS, ABOUT TO BE  CRUSHED THE  REALITY : U  SUCK , YOUR PRODUCT  SUCKS , & U WILL  FAIL … HARD.
Dave McClure 2001-2009: Startup Investor:  500 Hats LLC, Founders Fund Tech Marketing : PayPal, Simply Hired, Mint Advisor, Angel Investor : 40+ Startups Conf. Organizer :   Web 2.0, O’Reilly, Startonomics Stanford Visiting Lecturer : Facebook, Startup Metrics 80’s & 90’s: Entrepreneur : Founder/CEO Aslan Computing (acq.) Developer : Windows Apps / SQL DB Admin User Groups : E-Commerce, Internet, Client-Server Engineer : Johns Hopkins ‘88, BS Eng / Applied Math GEEK, CODER, ENTREPRENEUR D-list Blogger, Marketing Hack, Wanna-be Angel/VC
Angel Investments  (Personal, 13 deals, 2004-2008)
Professional Investments (2009) FF Angel – 12 deals @$50-250K fbFund REV – 22 deals @ ~$15-75K
Web 2.0: Hell  Yes , Good Times. # Users, Bandwidth =  Bigger . Lower Startup Costs =  Cheaper . PPC, E-Com $ Growing =  Better . Collect  Usage Metrics  in  Real-Time Decisions  Based on  Measured  User Behavior
Be Bold.  Be Humble. 20% Inspiration   + 80% Perspiration Long-term:  Audacity + Creative Inspiration Short-term:  Humility + Analytic Rigor READ:  To The Smartest Person in the Room   (Chris McDonough)
Just Gimme the GOOD Metrics. Users, Pages, Clicks, Emails, $$$...? Q: Which of these is best?  How do you know? 1,000,000 one-time, unregistered unique visitors 500,000 visitors who view 2+ pages / stay 10+ sec 200,000 visitors who clicked on a link or button 20,000 registered users w/ email address 2,000 passionate fans who refer 5+ users / mo. 1,000 monthly subscribers @ $5/mo the  good  stuff.
Q: What’s My Business Model? Can be one of the following: Get Users  (= Acquisition, Referral) Drive Usage  (= Activation, Retention) Make Money  (= Revenue*) * ideally  profitable   revenue Note:  eventually  need to turn  Users / Usage  ->  Money
The Startup Metrics Religion Progress ≠ Features ( Less   =  More ) Focus on  User Experience  (&  Distribution ) Measure  Conversion ; Compare 2+ Options Fast, Frequent  Iteration  (+  Feedback Loop ) Keep it  Simple  &  Actionable
Minimize  TOTAL  time through the loop LEARN BUILD MEASURE IDEAS CODE DATA Source: Eric Ries, The Lean Startup
The Startup Pyramid (Sean Ellis, Startup-Marketing.com) [email_address] Blog: startup-marketing.com
Design, Optimize for  Conversion
Optimize  4  Happiness  (both User + Business) Define  States of User + Business Value Prioritize   (Estimate) Relative Value of Each State Move   Users: Lower Value -> Higher Value Optimize  for User Happiness / Business $$$ Achieve   Low Cost + High Value @ Scale $$$
Startup Metrics for Pirates A cquisition:   users come to site from various  channels A ctivation:  users enjoy 1 st  visit: " happy ” experience R etention:  users  come back , visit site multiple times R eferral:  users like product enough to  refer others R evenue:  users conduct some  monetization  behavior (note: If you’re in a hurry, Google “Startup Metrics” & watch 5m video) AARRR !
AARRR!: 5-Step Startup Metrics Model Website.com R evenue $$$ Biz Dev Ads, Lead Gen, Subscriptions, ECommerce A CQUISITION SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains R etention Emails & Alerts System Events & Time-based Features Blogs, RSS, News Feeds
Startup Challenges Startups have problems in 3 key areas: Management : Setting Priorities, Defining Key Metrics, Creating Dashboard, Reporting Progress Product : Building the “Right” Features, Getting Product Out Quickly, Testing for User Conversion / Adoption Marketing : Accessing “Web 2.0” Channels (Search, Social, Viral, New Media), Cost-Efficient Distribution
3 Core Models: biz model, conversion dashboard, mktg channels Define  1-Page Biz Model : customer segments + desired actions / behaviors Identify critical  Conversion Events & Dashboard  for each segment & prioritize Test & develop  Marketing Channels ; measure Volume (#), Cost ($), Conv (%) Optimize   product & marketing using  Fast Iteration  Cycles &  A/B Testing
Role: Founder/CEO Q: Which Metrics? Why? A: Focus on  Critical Few Actionable  Metrics (if you don’t use the metric to make a decision, it’s not actionable) Hypothesize Customer Lifecycle Target ~3-5 Conversion Events  (tip: Less = More) Test, Measure, Iterate to Improve
The 1-Page Business Model (Users + Conversions + Priorities) Q1: What  types  of people use your website?  Visitor  = Average User / Buyer Contributor  = Content Contributor / Seller Distributor  = Passionate Fan (unpaid) / Affiliate (paid) Q2: What  actions  could they take to help  you   or  them   ?
TeachStreet Metrics v1: Eye Chart Madness
TeachStreet 1-Page Business Model: Teachers & Students Teachers Students Activation Claim Profile Add Class Contact Teacher View 3 Pages Retention Visit 1x/mo for 3 mo’s Visit 1x/mo for 3 mo’s  Referral Request Review Suggest Teacher
TeachStreet: 45-day Claim Rates ( Seattle ,  Portland )
Role: Product / Engineering Q: What Features to Build?  Why?  When are you “Done”? A:  Easy-to-Find ,  Fun / Useful ,  Unique  Features that   Increase Conversion   (stop iterating when increase decelerates) Wireframes = Conversion Steps Measure, A/B Test, Iterate FAST (daily/weekly) Optimize for Conversion Improvement 80% on existing feature optimization 20% on new feature development
Example Conversion Dashboard (note: *not* actuals… your mileage may vary) Stage Conversion Status Conv.  % Est. Value (*not* cost) Acquisition Visitors -> Site/Widget/Landing Page (2+ pages, 10+ sec, 1+ clicks = don’t abandon) 60% $.05 Activation “ Happy” 1 st  Visit; Usage/Signup (clicks/time/pages, email/profile reg, feature usage) 15% $.25 Retention Users Come Back; Multiple Visits (1-3x visits/mo; email/feed open rate / CTR) 5% $1 Referral Users Refer Others (cust sat >=8; viral K factor > 1; ) 1% $5 Revenue Users Pay / Generate $$$ (first txn, break-even, target profitability) 2% $50
KILL  A FEATURE. Something  Sucks . Find It.  KILL   It. STOP  ADDING FEATURES. Find the ONE THING what users  LOVE . How to figure out?  TAKE. SHIT.  AWAY . When they  SCREAM , you’ve  FOUND   it. Then Bring it  Back … Only  Better. Tip:  KILL  a Feature  Every Week .
Discover Meaning Keywords, Images, Call-to-Action Top 10 - 100 words Your Brand / Products Customer Needs / Benefits Competitor’s Brand / Products Semantic Equivalents Misspellings Relevant images People Products Problems Solutions Call-to-Action Words Images Context Button/Link Emotion Result Positive? Negative? Neutral (= Death) A/B test & Iterate
Role: Marketing / Sales Q: What channels?  Which users?  Why? A: High  Volume  (#), Low  Cost  ($), High  Conv  (%) Design & Test Multiple Marketing Channels + Campaigns Select & Focus on Best-Performing Channels & Themes Optimize for conversion to target CTAs, not just site/landing page Match/Drive channel cost to/below revenue potential Low-Hanging Fruit:  Blogs SEO/SEM Landing Pages Automated Emails
Example Marketing Channels PR Contest Biz Dev Direct Marketing Radio / TV / Print Dedicated Sales Telemarketing Email SEO / SEM Blogs / Bloggers Viral / Referral Affiliate / CPA Widgets / Apps LOLCats ;)
M AARRR keting Plan Marketing Plan = Target Customer Acquisition Channels 3 Important Factors =  Volume  (#),  Cost  ($),  Conversion  (%) Measure conversion to target customer actions Test audience segments, campaign themes, Call-To-Action ( CTA s)  [Gradually] Match Channel Costs =>  Revenue Potential  Increase Vol. & Conversion, Decrease Cost, Optimize for Revenue Potential Avg Txn Value ( ATV ), Ann Rev Per User ( ARPU ), Cust Lifetime Value ( CLV ) Design channels that (eventually) cost  <20-50%  of target ATV, ARPU, CLV Consider Costs, Scarce Resource Tradeoffs Actual $ expenses Marketing time & resources Product/Engineering time & resources Cashflow timing of expense vs. revenue, profit
One Step at a Time. Make a Good Product : Activation & Retention Market the Product : Acquisition & Referral Make Money : Revenue & Profitability “ You probably can’t save your  Ass  and your  Face  at the same time…  choose carefully .”  – DMC
Links & Resources Additional References: Influence: The Psychology of Persuasion  Robert Cialdini (book) Putting the Fun in Functional  Amy Jo Kim (etech 2006 preso) Futuristic Play  Andrew Chen (blog) Don’t Make Me Think  Steve Krug (book) Designing for the Social Web  Joshua Porter (book, website)  Startup Lessons Learned  Eric Ries (blog)  Customer Development Methodology  Steve Blank (presentation,  blog ) Startup-Marketing.com  Sean Ellis (blog) KISSmetrics.com  Hiten Shah / Neil Patel (website) How To Pitch a VC  Dave McClure (slides, NSFW)
Appendix
Startup Metrics Activation
Website.com Activation Criteria: 10-30+ seconds 2-3+ page views 3-5+ clicks 1 key feature usage do LOTS of  landing  page  &  A/B tests  –  make lots of dumb  guesses &  iterate FAST Activation SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains
Activation What do users do on their first visit? Example Activation Goals Click on something! Account sign up / Emails Referrals / Tell a friend Widgets / Embeds Low Bounce Rate Activation Tips Less is more Focus on user experience / usability Provide incentives & call to actions Test and iterate continuously
Activation What do users do on their first visit? Key Metrics to Track Pages per visit Time on site Conversions
Activation Tools Crazy Egg (Visual Click Mapping) http://crazyegg.com   Google Website Optimizer (A/B & Multivariate Testing) http://google.com/websiteoptimizer   Marketo.com (B2B Lead Generation Management) http://marketo.com   Resources Experimentation and Testing: A Primer kaushik.net/avinash/2006/05/experimentation-and-testing-a-primer.html Landing Page Design Toolbox: 100 Tips & Tools http://tinyurl.com/326co6   Landing Page Tutorials & Case Studies http://www.copyblogger.com/landing-pages/   101 Easy Easy to use Google Website Optimizer http://conversion-rate-experts.com/articles/101-google-website-optimizer-tips/
Startup Metrics Retention
Website.com Automated emails: lifecycle emails @ +3, +7, +30d  status / “best of” weekly/monthly “ something happened” emails BUT:  make it  easy  to unsubscribe Tip on emails: > 80% or more on  SUBJECT LINE < 20% or less on BODY TEXT Retention SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains Emails & Alerts System Events & Time-based Features Blogs, RSS, News Feeds
Cohort Analysis: Distrib of Visits over Time Rate of Decay Effective Customer Lifecycle Retention Methods Automated Emails * Track open rate / CTR / Quantity RSS / News Feeds * Track % viewed / CTR / Quantity Widgets / Embeds * Track impressions / CTR / Quantity Retention How do users come back? How often?
Example Retention Goals 1 - 3+ visits per month 20% open rate / 2% CTR High deliverability / Low spam rating Long customer life cycle / Low decay Identify fanatics and cheerleaders Retention Tips Email is simple and it works BUT make unsubscribe easy 80% subject line / 20% body text ACTUALLY 99% subject line / 1% body text Fanatics = virality + affiliate channel (bloggers?) Retention How do users come back? How often?
Retention How do users come back? How often? Key Metrics to Track Source Quantity Conversions Visitor Loyalty Session Length
Retention Tools Campaign Monitor / MailChimp (email newsletter software) campaignmonitor.com / mailchimp.com TriggerMail (site-centric email management) triggermail.net Litmus (email and website design testing - clients / browsers) litmusapp.com Resources 30 free HTML email templates campaignmonitor.com/resources/templates.aspx Best Practices in Writing Email Subject Lines mailchimp.com/resources/best-practices-in-writing-email-subject-lines.phtml Learning Viral: Viral Emails of Tagged.com okdork.com/2008/04/10/learning-viral-studying-taggedcom/
Startup Metrics Acquisition
Website.com Marketing Channels: largest-volume (#)  lowest-cost ($) best-performing (%)  Acquisition SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains
Acquisition Where are users coming from? Acquisition Methods SEO / SEM Blogs Email Social Media & Social Networks Domains
Acquisition Keyword Vocabulary Top 10 - 100 words Your Brand / Products Customer Needs / Benefits Competitor’s Brand / Products Semantic Equivalents Misspellings Things to analyze Sources Volume Cost Conversion
Acquisition Where are users coming from? Key Metrics to Track Quantity (#) Cost ($) Conversions (%) Example
Acquisition Tools Google Analytics (web analytics) google.com/analytics Google Keyword Tool (keyword research tool) adwords.google.com/select/KeywordToolExternal SEO Book Tools (SEO related tools) tools.seobook.com Resources SEO Book Blog seobook.com/blog The Social Media Manual: Read Before You Play searchengineland.com/071120-144401.php Strategies to ruthlessly acquire users andrewchen.typepad.com/andrew_chens_blog/2007/04/10_obvious_stra.html
Startup Metrics Referral
Website.com Focus on driving referrals * after * users have a “ happy ” experience; avg score >=  8 out of 10 Referral Acquisition SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains Retention Emails & Alerts System Events & Time-based Features Blogs, RSS, News Feeds
Referral How do users refer others? Referral Methods Send to Friend: Email / IM Social Media Widgets / Embeds Affiliates
Referral Viral Growth Factor Viral Growth Factor =  X  *  Y  *  Z X = % of users who invite other people Y = average # of people that they invited Z = % of users who accepted an invitation A viral growth factor > 1 means an exponential organic user acquisition.
Referral Tools Gigya (social media distribution & tracking tool) gigya.com ShareThis / AddThis (sharing buttons) sharethis.com / addthis.com GetMyContacts (PHP contacts importing & invitation software) getmycontacts.com Resources Seven Ways to GO VIRAL lsvp.wordpress.com/2007/03/02/seven-ways-to-go-viral/ What’s your viral loop? Understanding the engine of adoption andrewchen.typepad.com/andrew_chens_blog/2007/07/whats-your-vira.html Metrics: Where Users Come From slideshare.net/guest2968b8/rockyou-snap-summit-32508
Startup Metrics Revenue
Website.com Revenue This is the part *you*  still have to figure out…  (we  don’t know jack  about your business) R evenue $$$ Biz Dev Ads, Lead Gen, Subscriptions, ECommerce Acquisition SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains Retention Emails & Alerts System Events & Time-based Features Blogs, RSS, News Feeds
Revenue How do you make money? Revenue Tips Don’t Rely on AdSense (only) Start Free => 2% “ Freemium ” Subscription / Recurring transactions Qualify your customers -> Lead generation (arbitrage) Sell something! (physical or virtual)
Revenue Resources & Tools Revenue Metrics (Andrew Chen) http://tinyurl.com/47r63a How to Create a Profitable “Freemium” Startup (Andrew Chen) http://tinyurl.com/8z9ygk   2008 Affiliate Marketing Review (Scott Jangro) http://tinyurl.com/86wak4
Types of Measurement Qualitative : Usability Testing / Session Monitoring Watch users,  guess problems & solutions from small # of users Quantitative : Traffic Analysis / User Engagement Track users, usage, conv %'s for empirical sample # of users Comparative : A/B, Multivariate Testing Compare what users do in one scenario vs another Measure which copy/graphics/UI are most effective Competitive : Monitoring & Tracking Competitors Track competitor activity & compare against yours (if possible) Compare channels, keyword traffic, demographics, user sat, etc.

More Related Content

PPT
Startup Metrics for Pirates (Nov 2010)
PPT
Startupmetrics 4 Pirates (Haas April, 2010)
PPT
Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)
PPT
Startup Metrics For Pirates: AARRR! (Startonomics SF Oct 2008)
PDF
Building Startup Ecosystems (Berlin, June 2015)
PPT
Startup Metrics for Pirates (March 2009)
PPT
Startup Metrics for Pirates: AARRR! (SXSW March 2008)
PPT
Startup 2.0: From Silicon Valley to Hong Kong
Startup Metrics for Pirates (Nov 2010)
Startupmetrics 4 Pirates (Haas April, 2010)
Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)
Startup Metrics For Pirates: AARRR! (Startonomics SF Oct 2008)
Building Startup Ecosystems (Berlin, June 2015)
Startup Metrics for Pirates (March 2009)
Startup Metrics for Pirates: AARRR! (SXSW March 2008)
Startup 2.0: From Silicon Valley to Hong Kong

What's hot (20)

PPT
Startup Metrics for Pirates (Sept 2010, Vancouver)
PDF
Startup Metrics for Pirates (FounderX, May 2016)
PDF
Building 500 Startups + Changes in VC
PPT
Startup Metrics for Pirates (Chicago, Aug 2010)
PPT
Startup Metrics 4 Pirates (July 2010)
PPT
DO Marketing (It's Not Evil)
PDF
Changes in Venture Capital & Tech Startups (Nov 2013, Mumbai)
PPT
The Lean VC (Sapporo, May 2011)
PDF
Startup Metrics for Pirates (Sept 2012)
PPT
Startup Metrics for Pirates (Aug 2010)
PDF
Build Your Own Valley: Engineering Startup & Investor Ecosystems in Emerging ...
PDF
Silicon Valley 2.0: Make Lots of Little Bets.
PPT
Startup Metrics for Pirates (Foo Camp 2008)
PPT
Startup Metrics for Pirates (Startonomics Beijing, June 2009)
PPT
Silicon Valley 2.0: The Startup Metrics Revolution (Tokyo, December 2008)
PPT
Startup 2.0: A Silicon Valley Story (Oct 2009)
PDF
The Lean Investor (Dallas, Nov 2014)
PPT
The Lean VC, Global Edition (March 2011, London)
PPT
The Lean VC: a Silicon Valley 2.0 Story
PDF
Lean, Little Cockroach Startup
Startup Metrics for Pirates (Sept 2010, Vancouver)
Startup Metrics for Pirates (FounderX, May 2016)
Building 500 Startups + Changes in VC
Startup Metrics for Pirates (Chicago, Aug 2010)
Startup Metrics 4 Pirates (July 2010)
DO Marketing (It's Not Evil)
Changes in Venture Capital & Tech Startups (Nov 2013, Mumbai)
The Lean VC (Sapporo, May 2011)
Startup Metrics for Pirates (Sept 2012)
Startup Metrics for Pirates (Aug 2010)
Build Your Own Valley: Engineering Startup & Investor Ecosystems in Emerging ...
Silicon Valley 2.0: Make Lots of Little Bets.
Startup Metrics for Pirates (Foo Camp 2008)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Silicon Valley 2.0: The Startup Metrics Revolution (Tokyo, December 2008)
Startup 2.0: A Silicon Valley Story (Oct 2009)
The Lean Investor (Dallas, Nov 2014)
The Lean VC, Global Edition (March 2011, London)
The Lean VC: a Silicon Valley 2.0 Story
Lean, Little Cockroach Startup
Ad

Viewers also liked (13)

PPT
Silicon Valley 2.0: The Lean VC
PPTX
Vc flow chart
PDF
steve blank in finland sept 2011
PPTX
Steve blank moneyball and evidence-based entreprenuership
PPT
Startup Metrics 4 Pirates (July 2011)
PPT
Customer Development at Startup2Startup
PPTX
Trace Lessons Learned H4Dip Stanford 2016
PPTX
Aggregate db Lessons Learned H4Dip Stanford 2016
PPTX
Peacekeeping Lessons Learned H4Dip Stanford 2016
PPTX
Space Evaders Lessons Learned H4Dip Stanford 2016
PPTX
Exodus Lessons Learned H4Dip Stanford 2016
PPTX
Hacking CT Lessons Learned H4Dip Stanford 2016
PPTX
Fatal journeys (Team 621) Lessons Learned H4Dip Stanford 2016
Silicon Valley 2.0: The Lean VC
Vc flow chart
steve blank in finland sept 2011
Steve blank moneyball and evidence-based entreprenuership
Startup Metrics 4 Pirates (July 2011)
Customer Development at Startup2Startup
Trace Lessons Learned H4Dip Stanford 2016
Aggregate db Lessons Learned H4Dip Stanford 2016
Peacekeeping Lessons Learned H4Dip Stanford 2016
Space Evaders Lessons Learned H4Dip Stanford 2016
Exodus Lessons Learned H4Dip Stanford 2016
Hacking CT Lessons Learned H4Dip Stanford 2016
Fatal journeys (Team 621) Lessons Learned H4Dip Stanford 2016
Ad

Similar to Startup Metrics for Pirates (Startonomics Hawaii Nov 2009) (20)

PPT
Startup Metrics for Pirates (FOWA/Miami, Feb 2009)
PPT
Startup Metrics for Pirates (Twiistup, Jan 2010)
PPT
Startup Metrics 4 Pirates (May 2010)
PPT
Marketing Metrics 4 Pirates (July 2010)
PPT
Startup Metrics for Pirates: AARRR! (Startonomics SF 2008)
PPT
Startup Metrics 4 Pirates (DogPatch Labs, Boston, March 2010)
PPT
Startup Metrics for Pirates (SF, Jan 2010)
PPT
Startup Metrics 4 Pirates (Montreal, May 2010)
PPT
Numbers not Napkins: Simple Startup Metrics
PPT
Startup Metrics for Pirates (Brazil, Nov 2011)
PPT
Startup Metrics 4 Pirates (London, March 2011)
PPT
How to be a Web 2.0 Metrics Jedi (Web 2.0 Expo, April 2009)
PPT
Startup Metrics for Pirates / KILL a Feature (FOWA London, Oct 2009)
PPT
Startup Metrics for Pirates (SeedCamp 2008)
PPT
Startup Metrics 4 Pirates (Brazil, April 2011)
PPT
Startup Metrics 4 Pirates 2.0 (March 2011, SXSW)
PPT
Startup Metrics For Scottish Pirates (AARRR!) v1.3
PPT
Startup 2.0: a Silicon Valley Story
PPT
Startup 2.0: A Silicon Valley Story
PDF
Startupmetrics4pirates dave mcclure
Startup Metrics for Pirates (FOWA/Miami, Feb 2009)
Startup Metrics for Pirates (Twiistup, Jan 2010)
Startup Metrics 4 Pirates (May 2010)
Marketing Metrics 4 Pirates (July 2010)
Startup Metrics for Pirates: AARRR! (Startonomics SF 2008)
Startup Metrics 4 Pirates (DogPatch Labs, Boston, March 2010)
Startup Metrics for Pirates (SF, Jan 2010)
Startup Metrics 4 Pirates (Montreal, May 2010)
Numbers not Napkins: Simple Startup Metrics
Startup Metrics for Pirates (Brazil, Nov 2011)
Startup Metrics 4 Pirates (London, March 2011)
How to be a Web 2.0 Metrics Jedi (Web 2.0 Expo, April 2009)
Startup Metrics for Pirates / KILL a Feature (FOWA London, Oct 2009)
Startup Metrics for Pirates (SeedCamp 2008)
Startup Metrics 4 Pirates (Brazil, April 2011)
Startup Metrics 4 Pirates 2.0 (March 2011, SXSW)
Startup Metrics For Scottish Pirates (AARRR!) v1.3
Startup 2.0: a Silicon Valley Story
Startup 2.0: A Silicon Valley Story
Startupmetrics4pirates dave mcclure

More from Dave McClure (20)

PDF
How to VC: Creating a VC fund portfolio model
PDF
VC Marketing and Branding Strategies
PDF
The Helpful VC (June 2019)
PDF
Skip the J-Curve: An Intro to Venture Capital Secondary
PDF
Tech and Venture Capital in the Time of Corona
PDF
The Helpful VC
PDF
Bringing Silicon Valley to LatAm: Startup Ecosystems & Investment
PDF
Building #500STRONG
PDF
Take a Walk on the Dark Side: Branding for Startups & Sith Lords
PDF
Startup & VC Tech Trends
PDF
Farming Unicorns: Building Startup & Investor Ecosystems for Emerging Markets
PDF
Farming Unicorns in Emerging Markets (Dubai, Oct 2016) #Gitex
PDF
The Unicorn Hedge: Why Are Corporations Buying Unicorns? (Madrid, Oct 2016)
PDF
Farming Unicorns: Building Startup & Investor Ecosystems
PDF
500 Startups #Batch17 #DemoDay: "Beauty and the GEEK"
PDF
Farming Unicorns: Building Startup & Investor Ecosystems (Stanford, June 2016)
PDF
Dinosaurs vs Unicorns aka "Bubble My Ass, All Dinosaurs Gonna Die" (London, J...
PDF
Farming Unicorns: Building Startup & Investor Ecosystems (Madrid, June 2016)
PDF
Farming Unicorns: Building Startup & Investor Ecosystems (Dublin, June 2016)
PPTX
500 Startups / Batch 16 Demo Day (Q1/2016 update)
How to VC: Creating a VC fund portfolio model
VC Marketing and Branding Strategies
The Helpful VC (June 2019)
Skip the J-Curve: An Intro to Venture Capital Secondary
Tech and Venture Capital in the Time of Corona
The Helpful VC
Bringing Silicon Valley to LatAm: Startup Ecosystems & Investment
Building #500STRONG
Take a Walk on the Dark Side: Branding for Startups & Sith Lords
Startup & VC Tech Trends
Farming Unicorns: Building Startup & Investor Ecosystems for Emerging Markets
Farming Unicorns in Emerging Markets (Dubai, Oct 2016) #Gitex
The Unicorn Hedge: Why Are Corporations Buying Unicorns? (Madrid, Oct 2016)
Farming Unicorns: Building Startup & Investor Ecosystems
500 Startups #Batch17 #DemoDay: "Beauty and the GEEK"
Farming Unicorns: Building Startup & Investor Ecosystems (Stanford, June 2016)
Dinosaurs vs Unicorns aka "Bubble My Ass, All Dinosaurs Gonna Die" (London, J...
Farming Unicorns: Building Startup & Investor Ecosystems (Madrid, June 2016)
Farming Unicorns: Building Startup & Investor Ecosystems (Dublin, June 2016)
500 Startups / Batch 16 Demo Day (Q1/2016 update)

Recently uploaded (20)

PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Empathic Computing: Creating Shared Understanding
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Machine learning based COVID-19 study performance prediction
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
cuic standard and advanced reporting.pdf
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Modernizing your data center with Dell and AMD
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
KodekX | Application Modernization Development
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
Electronic commerce courselecture one. Pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
Diabetes mellitus diagnosis method based random forest with bat algorithm
Empathic Computing: Creating Shared Understanding
The AUB Centre for AI in Media Proposal.docx
Per capita expenditure prediction using model stacking based on satellite ima...
NewMind AI Weekly Chronicles - August'25 Week I
Machine learning based COVID-19 study performance prediction
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Unlocking AI with Model Context Protocol (MCP)
cuic standard and advanced reporting.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
20250228 LYD VKU AI Blended-Learning.pptx
Modernizing your data center with Dell and AMD
Mobile App Security Testing_ A Comprehensive Guide.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
Advanced methodologies resolving dimensionality complications for autism neur...
KodekX | Application Modernization Development
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
Electronic commerce courselecture one. Pdf
Encapsulation_ Review paper, used for researhc scholars
Reach Out and Touch Someone: Haptics and Empathic Computing

Startup Metrics for Pirates (Startonomics Hawaii Nov 2009)

  • 1. Startup Metrics for Pirates: AARRR! Rethink Hawaii Startonomics Nov 2009 Dave McClure, Founders Fund http://www.foundersfund.com/ http://500hats.typepad.com/ http://slideshare.net/dmc500hats/
  • 2. Why I’m Here: To Kick Your ASS. The Basics 5 Steps: Startup Metrics for Pirates ( AARRR ! ) Iterate, Measure, Optimize. Build a Feedback Loop. ( Loop. Loop. ) KILL a FEATURE . Something Sucks. Find It. Kill it. NOW . YOUR SILLY FRIGGIN HOPES & DREAMS, ABOUT TO BE CRUSHED THE REALITY : U SUCK , YOUR PRODUCT SUCKS , & U WILL FAIL … HARD.
  • 3. Dave McClure 2001-2009: Startup Investor: 500 Hats LLC, Founders Fund Tech Marketing : PayPal, Simply Hired, Mint Advisor, Angel Investor : 40+ Startups Conf. Organizer : Web 2.0, O’Reilly, Startonomics Stanford Visiting Lecturer : Facebook, Startup Metrics 80’s & 90’s: Entrepreneur : Founder/CEO Aslan Computing (acq.) Developer : Windows Apps / SQL DB Admin User Groups : E-Commerce, Internet, Client-Server Engineer : Johns Hopkins ‘88, BS Eng / Applied Math GEEK, CODER, ENTREPRENEUR D-list Blogger, Marketing Hack, Wanna-be Angel/VC
  • 4. Angel Investments (Personal, 13 deals, 2004-2008)
  • 5. Professional Investments (2009) FF Angel – 12 deals @$50-250K fbFund REV – 22 deals @ ~$15-75K
  • 6. Web 2.0: Hell Yes , Good Times. # Users, Bandwidth = Bigger . Lower Startup Costs = Cheaper . PPC, E-Com $ Growing = Better . Collect Usage Metrics in Real-Time Decisions Based on Measured User Behavior
  • 7. Be Bold. Be Humble. 20% Inspiration + 80% Perspiration Long-term: Audacity + Creative Inspiration Short-term: Humility + Analytic Rigor READ: To The Smartest Person in the Room (Chris McDonough)
  • 8. Just Gimme the GOOD Metrics. Users, Pages, Clicks, Emails, $$$...? Q: Which of these is best? How do you know? 1,000,000 one-time, unregistered unique visitors 500,000 visitors who view 2+ pages / stay 10+ sec 200,000 visitors who clicked on a link or button 20,000 registered users w/ email address 2,000 passionate fans who refer 5+ users / mo. 1,000 monthly subscribers @ $5/mo the good stuff.
  • 9. Q: What’s My Business Model? Can be one of the following: Get Users (= Acquisition, Referral) Drive Usage (= Activation, Retention) Make Money (= Revenue*) * ideally profitable revenue Note: eventually need to turn Users / Usage -> Money
  • 10. The Startup Metrics Religion Progress ≠ Features ( Less = More ) Focus on User Experience (& Distribution ) Measure Conversion ; Compare 2+ Options Fast, Frequent Iteration (+ Feedback Loop ) Keep it Simple & Actionable
  • 11. Minimize TOTAL time through the loop LEARN BUILD MEASURE IDEAS CODE DATA Source: Eric Ries, The Lean Startup
  • 12. The Startup Pyramid (Sean Ellis, Startup-Marketing.com) [email_address] Blog: startup-marketing.com
  • 13. Design, Optimize for Conversion
  • 14. Optimize 4 Happiness (both User + Business) Define States of User + Business Value Prioritize (Estimate) Relative Value of Each State Move Users: Lower Value -> Higher Value Optimize for User Happiness / Business $$$ Achieve Low Cost + High Value @ Scale $$$
  • 15. Startup Metrics for Pirates A cquisition: users come to site from various channels A ctivation: users enjoy 1 st visit: &quot; happy ” experience R etention: users come back , visit site multiple times R eferral: users like product enough to refer others R evenue: users conduct some monetization behavior (note: If you’re in a hurry, Google “Startup Metrics” & watch 5m video) AARRR !
  • 16. AARRR!: 5-Step Startup Metrics Model Website.com R evenue $$$ Biz Dev Ads, Lead Gen, Subscriptions, ECommerce A CQUISITION SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains R etention Emails & Alerts System Events & Time-based Features Blogs, RSS, News Feeds
  • 17. Startup Challenges Startups have problems in 3 key areas: Management : Setting Priorities, Defining Key Metrics, Creating Dashboard, Reporting Progress Product : Building the “Right” Features, Getting Product Out Quickly, Testing for User Conversion / Adoption Marketing : Accessing “Web 2.0” Channels (Search, Social, Viral, New Media), Cost-Efficient Distribution
  • 18. 3 Core Models: biz model, conversion dashboard, mktg channels Define 1-Page Biz Model : customer segments + desired actions / behaviors Identify critical Conversion Events & Dashboard for each segment & prioritize Test & develop Marketing Channels ; measure Volume (#), Cost ($), Conv (%) Optimize product & marketing using Fast Iteration Cycles & A/B Testing
  • 19. Role: Founder/CEO Q: Which Metrics? Why? A: Focus on Critical Few Actionable Metrics (if you don’t use the metric to make a decision, it’s not actionable) Hypothesize Customer Lifecycle Target ~3-5 Conversion Events (tip: Less = More) Test, Measure, Iterate to Improve
  • 20. The 1-Page Business Model (Users + Conversions + Priorities) Q1: What types of people use your website? Visitor = Average User / Buyer Contributor = Content Contributor / Seller Distributor = Passionate Fan (unpaid) / Affiliate (paid) Q2: What actions could they take to help you or them ?
  • 21. TeachStreet Metrics v1: Eye Chart Madness
  • 22. TeachStreet 1-Page Business Model: Teachers & Students Teachers Students Activation Claim Profile Add Class Contact Teacher View 3 Pages Retention Visit 1x/mo for 3 mo’s Visit 1x/mo for 3 mo’s Referral Request Review Suggest Teacher
  • 23. TeachStreet: 45-day Claim Rates ( Seattle , Portland )
  • 24. Role: Product / Engineering Q: What Features to Build? Why? When are you “Done”? A: Easy-to-Find , Fun / Useful , Unique Features that Increase Conversion (stop iterating when increase decelerates) Wireframes = Conversion Steps Measure, A/B Test, Iterate FAST (daily/weekly) Optimize for Conversion Improvement 80% on existing feature optimization 20% on new feature development
  • 25. Example Conversion Dashboard (note: *not* actuals… your mileage may vary) Stage Conversion Status Conv. % Est. Value (*not* cost) Acquisition Visitors -> Site/Widget/Landing Page (2+ pages, 10+ sec, 1+ clicks = don’t abandon) 60% $.05 Activation “ Happy” 1 st Visit; Usage/Signup (clicks/time/pages, email/profile reg, feature usage) 15% $.25 Retention Users Come Back; Multiple Visits (1-3x visits/mo; email/feed open rate / CTR) 5% $1 Referral Users Refer Others (cust sat >=8; viral K factor > 1; ) 1% $5 Revenue Users Pay / Generate $$$ (first txn, break-even, target profitability) 2% $50
  • 26. KILL A FEATURE. Something Sucks . Find It. KILL It. STOP ADDING FEATURES. Find the ONE THING what users LOVE . How to figure out? TAKE. SHIT. AWAY . When they SCREAM , you’ve FOUND it. Then Bring it Back … Only Better. Tip: KILL a Feature Every Week .
  • 27. Discover Meaning Keywords, Images, Call-to-Action Top 10 - 100 words Your Brand / Products Customer Needs / Benefits Competitor’s Brand / Products Semantic Equivalents Misspellings Relevant images People Products Problems Solutions Call-to-Action Words Images Context Button/Link Emotion Result Positive? Negative? Neutral (= Death) A/B test & Iterate
  • 28. Role: Marketing / Sales Q: What channels? Which users? Why? A: High Volume (#), Low Cost ($), High Conv (%) Design & Test Multiple Marketing Channels + Campaigns Select & Focus on Best-Performing Channels & Themes Optimize for conversion to target CTAs, not just site/landing page Match/Drive channel cost to/below revenue potential Low-Hanging Fruit: Blogs SEO/SEM Landing Pages Automated Emails
  • 29. Example Marketing Channels PR Contest Biz Dev Direct Marketing Radio / TV / Print Dedicated Sales Telemarketing Email SEO / SEM Blogs / Bloggers Viral / Referral Affiliate / CPA Widgets / Apps LOLCats ;)
  • 30. M AARRR keting Plan Marketing Plan = Target Customer Acquisition Channels 3 Important Factors = Volume (#), Cost ($), Conversion (%) Measure conversion to target customer actions Test audience segments, campaign themes, Call-To-Action ( CTA s) [Gradually] Match Channel Costs => Revenue Potential Increase Vol. & Conversion, Decrease Cost, Optimize for Revenue Potential Avg Txn Value ( ATV ), Ann Rev Per User ( ARPU ), Cust Lifetime Value ( CLV ) Design channels that (eventually) cost <20-50% of target ATV, ARPU, CLV Consider Costs, Scarce Resource Tradeoffs Actual $ expenses Marketing time & resources Product/Engineering time & resources Cashflow timing of expense vs. revenue, profit
  • 31. One Step at a Time. Make a Good Product : Activation & Retention Market the Product : Acquisition & Referral Make Money : Revenue & Profitability “ You probably can’t save your Ass and your Face at the same time… choose carefully .” – DMC
  • 32. Links & Resources Additional References: Influence: The Psychology of Persuasion Robert Cialdini (book) Putting the Fun in Functional Amy Jo Kim (etech 2006 preso) Futuristic Play Andrew Chen (blog) Don’t Make Me Think Steve Krug (book) Designing for the Social Web Joshua Porter (book, website) Startup Lessons Learned Eric Ries (blog) Customer Development Methodology Steve Blank (presentation, blog ) Startup-Marketing.com Sean Ellis (blog) KISSmetrics.com Hiten Shah / Neil Patel (website) How To Pitch a VC Dave McClure (slides, NSFW)
  • 35. Website.com Activation Criteria: 10-30+ seconds 2-3+ page views 3-5+ clicks 1 key feature usage do LOTS of landing page & A/B tests – make lots of dumb guesses & iterate FAST Activation SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains
  • 36. Activation What do users do on their first visit? Example Activation Goals Click on something! Account sign up / Emails Referrals / Tell a friend Widgets / Embeds Low Bounce Rate Activation Tips Less is more Focus on user experience / usability Provide incentives & call to actions Test and iterate continuously
  • 37. Activation What do users do on their first visit? Key Metrics to Track Pages per visit Time on site Conversions
  • 38. Activation Tools Crazy Egg (Visual Click Mapping) http://crazyegg.com Google Website Optimizer (A/B & Multivariate Testing) http://google.com/websiteoptimizer Marketo.com (B2B Lead Generation Management) http://marketo.com Resources Experimentation and Testing: A Primer kaushik.net/avinash/2006/05/experimentation-and-testing-a-primer.html Landing Page Design Toolbox: 100 Tips & Tools http://tinyurl.com/326co6 Landing Page Tutorials & Case Studies http://www.copyblogger.com/landing-pages/ 101 Easy Easy to use Google Website Optimizer http://conversion-rate-experts.com/articles/101-google-website-optimizer-tips/
  • 40. Website.com Automated emails: lifecycle emails @ +3, +7, +30d status / “best of” weekly/monthly “ something happened” emails BUT: make it easy to unsubscribe Tip on emails: > 80% or more on SUBJECT LINE < 20% or less on BODY TEXT Retention SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains Emails & Alerts System Events & Time-based Features Blogs, RSS, News Feeds
  • 41. Cohort Analysis: Distrib of Visits over Time Rate of Decay Effective Customer Lifecycle Retention Methods Automated Emails * Track open rate / CTR / Quantity RSS / News Feeds * Track % viewed / CTR / Quantity Widgets / Embeds * Track impressions / CTR / Quantity Retention How do users come back? How often?
  • 42. Example Retention Goals 1 - 3+ visits per month 20% open rate / 2% CTR High deliverability / Low spam rating Long customer life cycle / Low decay Identify fanatics and cheerleaders Retention Tips Email is simple and it works BUT make unsubscribe easy 80% subject line / 20% body text ACTUALLY 99% subject line / 1% body text Fanatics = virality + affiliate channel (bloggers?) Retention How do users come back? How often?
  • 43. Retention How do users come back? How often? Key Metrics to Track Source Quantity Conversions Visitor Loyalty Session Length
  • 44. Retention Tools Campaign Monitor / MailChimp (email newsletter software) campaignmonitor.com / mailchimp.com TriggerMail (site-centric email management) triggermail.net Litmus (email and website design testing - clients / browsers) litmusapp.com Resources 30 free HTML email templates campaignmonitor.com/resources/templates.aspx Best Practices in Writing Email Subject Lines mailchimp.com/resources/best-practices-in-writing-email-subject-lines.phtml Learning Viral: Viral Emails of Tagged.com okdork.com/2008/04/10/learning-viral-studying-taggedcom/
  • 46. Website.com Marketing Channels: largest-volume (#) lowest-cost ($) best-performing (%) Acquisition SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains
  • 47. Acquisition Where are users coming from? Acquisition Methods SEO / SEM Blogs Email Social Media & Social Networks Domains
  • 48. Acquisition Keyword Vocabulary Top 10 - 100 words Your Brand / Products Customer Needs / Benefits Competitor’s Brand / Products Semantic Equivalents Misspellings Things to analyze Sources Volume Cost Conversion
  • 49. Acquisition Where are users coming from? Key Metrics to Track Quantity (#) Cost ($) Conversions (%) Example
  • 50. Acquisition Tools Google Analytics (web analytics) google.com/analytics Google Keyword Tool (keyword research tool) adwords.google.com/select/KeywordToolExternal SEO Book Tools (SEO related tools) tools.seobook.com Resources SEO Book Blog seobook.com/blog The Social Media Manual: Read Before You Play searchengineland.com/071120-144401.php Strategies to ruthlessly acquire users andrewchen.typepad.com/andrew_chens_blog/2007/04/10_obvious_stra.html
  • 52. Website.com Focus on driving referrals * after * users have a “ happy ” experience; avg score >= 8 out of 10 Referral Acquisition SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains Retention Emails & Alerts System Events & Time-based Features Blogs, RSS, News Feeds
  • 53. Referral How do users refer others? Referral Methods Send to Friend: Email / IM Social Media Widgets / Embeds Affiliates
  • 54. Referral Viral Growth Factor Viral Growth Factor = X * Y * Z X = % of users who invite other people Y = average # of people that they invited Z = % of users who accepted an invitation A viral growth factor > 1 means an exponential organic user acquisition.
  • 55. Referral Tools Gigya (social media distribution & tracking tool) gigya.com ShareThis / AddThis (sharing buttons) sharethis.com / addthis.com GetMyContacts (PHP contacts importing & invitation software) getmycontacts.com Resources Seven Ways to GO VIRAL lsvp.wordpress.com/2007/03/02/seven-ways-to-go-viral/ What’s your viral loop? Understanding the engine of adoption andrewchen.typepad.com/andrew_chens_blog/2007/07/whats-your-vira.html Metrics: Where Users Come From slideshare.net/guest2968b8/rockyou-snap-summit-32508
  • 57. Website.com Revenue This is the part *you* still have to figure out… (we don’t know jack about your business) R evenue $$$ Biz Dev Ads, Lead Gen, Subscriptions, ECommerce Acquisition SEO SEM Apps & Widgets Affiliates Email PR Biz Dev Campaigns, Contests Direct, Tel, TV Social Networks Blogs Domains Retention Emails & Alerts System Events & Time-based Features Blogs, RSS, News Feeds
  • 58. Revenue How do you make money? Revenue Tips Don’t Rely on AdSense (only) Start Free => 2% “ Freemium ” Subscription / Recurring transactions Qualify your customers -> Lead generation (arbitrage) Sell something! (physical or virtual)
  • 59. Revenue Resources & Tools Revenue Metrics (Andrew Chen) http://tinyurl.com/47r63a How to Create a Profitable “Freemium” Startup (Andrew Chen) http://tinyurl.com/8z9ygk 2008 Affiliate Marketing Review (Scott Jangro) http://tinyurl.com/86wak4
  • 60. Types of Measurement Qualitative : Usability Testing / Session Monitoring Watch users, guess problems & solutions from small # of users Quantitative : Traffic Analysis / User Engagement Track users, usage, conv %'s for empirical sample # of users Comparative : A/B, Multivariate Testing Compare what users do in one scenario vs another Measure which copy/graphics/UI are most effective Competitive : Monitoring & Tracking Competitors Track competitor activity & compare against yours (if possible) Compare channels, keyword traffic, demographics, user sat, etc.

Editor's Notes

  • #9: I know, too many bullets…
  • #12: BUILT TO LEARN This is the core feedback loop that powers startups. Their goal is not to optimize the time it takes to do any one of these steps. There are many specific practices that can power lean startups, and we’ll cover a few in this presentation. But more important than any specific practice is this core idea: startups should be built to learn.
  • #21: If you don’t remember anything else, perhaps this graphic &amp; the next 2-3 might be useful.
  • #61: Qualitative: SurveyMonkey (surveys), CrazyEgg (heatmap), TechSmith Morae / UserVue (ux recording), RobotReplay, TapeFailure. Quantitative: Google Analytics (free), MyBlogLog, ClickTracks, Index Tools, Visual Sciences / Webside Story, Omniture, WebTrends, etc. Comparative: Google Website Optimizer, SiteSpect, Optimost, Offermatica, Vertster, Kefta. Competitive: Quantcast, Compete.com, Alexa, Hitwise, Comscore, Nielsens. see more info at: http://webanalyticsassociation.com/ (WAA) http://kaushik.net/ (Avinash Kaushik) http://grokdotcom.com/ (Eisenbergs) http://www.emetrics.org/ (Jim Sterne)