SlideShare a Scribd company logo
How launching Software
is Different
(than hardware)
1. Launching Software (15 min)
2. How do we keep our users engaged? (10 min)
3. Tech support 101 (10 min)
4. Live Operations and You (5 min)
5. Q&A (10min)
You will walk away understanding
○ how we launch software
○ how we track progress and improve software
Agenda
How launching software is different
How launching software is different
How launching software is different
Software is different
Delivery Pace!
Delivery Cadence
New Releases
As often as every 3 weeks
Hotfix in minutes to days
1. Service model
1. Different Tradeoffs
Fast delivery pace changes the software game ...
1. Service Model
Tangible Intangible
Lasts - Customer expect to use the
same version
Perishable - Customers expect new
versions constantly
Control Quality with Data Control Quality with Experience
2. Flexible Delivery allows for different Tradeoffs
Good
CheapFast
Very Good
Not
Cheap
Slow
Right Product
Medical Device
Right Product must be do one
thing really well, be reliable,
don’t kill anyone!
2. Software Tradeoffs early stage vs late stage
OK
Medium
Cheap
Very Fast
Very Fast
OK
Very Cheap
Right Product must give users a great experience and solve their
problems. Software startups need more cycles to get to the Right
Product. So we optimize for fast and cheap.
Early Facebook
(Beta)
Our Product (Beta) Today’s Facebook
Good
Not
Cheap
Medium
Fast
● 2-3x the development budget
● 5x the clinical trial budget
● 18 additional months minimum (1-3 cycles of learning)
● We’d run out of runway!
● We’d be behind.
If we wanted to ship software fully baked...
1. App Readiness
○ Testing - human and automated
○ Triage and Bug fix
○ End to end Carrot trial
2. Security
○ Network testing
○ App testing
Getting ready for launch
3. Analytics
○ Mixpanel, Tableau, Dashboards
4. Tech Support
○ FAQs, processes, staffing
5. Dev Ops and Live Ops
○ Cross Training
○ Pager duty
● No production level Blocker-p0 bugs
○ Users are able to download, install, login
○ All intended screens are functional for whitelisted phones
○ Coaches can message users
○ Minimal app crashes
● Improvements come from two places:
○ 1. Not built to specification ← Mostly fixed before we go live
Ready to Launch when...
Launch and Learn with friendlies
Customer
Customer
Oct Nov Dec Jan
We will pull out all the stops!
Customer
Customer
Customer
Customer
What are stops?
● Analytics - Watch what happens, closely, every day
● Tech Support & LiveOps - Be there, help them, make fans of them
● All the stops - We all pitch in to give users….
Launch and Learn
Analytics and tracking
Valuable to track our users to...
1. Identify pool of users to reach out to
i. Users experiencing technical blocks
ii. Disengaged users
2. Measure general app engagement and system health
i. Daily/weekly app opens, time spent inside the app
3. See how users progress through the full journey
i. Identify friction points to inform longer-term design changes
Tech Support
● Email, phone and live chat
● 8 am to 5 pm PST, M - F
● Response time for emails = 24 hours
● We use Freshdesk to handle all tech support
● We will never not have bugs, that’s why I’m here!
Tech Support 101
So what happens when a user reports a bug?
1. I make sure we have all the information we need to
debug, and if we don’t have it, I request it
2. I create a ticket in JIRA for the issue, link it to the
user’s email in Freshdesk, and notify QA
3. QA gets back to me within 2 days to let me know if
there’s a fix, a workaround, or provide an estimated
timeline for resolution to the user
Tech Support 101
How launching software is different
Live Operations
Live Operations And You!
● What is a fire?
P0 (Fire) - Crashes, Freezes, Progression Blockers, Core App Functionality Stops Working.
- Unable to Complete A Core Lesson (This Excludes Build Activities/Challenges)
- Unable to Log Cigarettes.
- Unable to Use the Coaching Tab.
P1 - Incomplete, Incorrect, or Missing Functionality.
- Unable to restart the dashboard tutorial.
- Single Missing Medication Card.
P2 - Visual Cosmetic Issues or App Flow Improvements.
- UI/UX issues, Spelling Mistakes, Minor Graphical Issues.
- Suggestions or Improvements.
● What Are The Different Types of Issues - Knowing The Terms
A fire is any issue that requires immediate attention from the team that must be fixed.
Categories of Issues: P0 | P1 | P2 (P = Priority)
What To Do If You Suspect a Fire?
Do Not Ignore It! Ask For Help!
#Live-Operations
For Urgent Issues
Please Also Message Us
We will look into the issue, log a ticket, and hand it off to the
appropriate team member.
We will pull out all the stops!

More Related Content

PDF
Decision Making
PDF
fireup pro software house - this is who we are
PPTX
Art of Product Management
PDF
The on-call survival guide - how to be confident on-call
PDF
Latest_Portfolio_Anxiao_chen
PDF
The UX of Automation by AJ King, Senior UX Researcher, Ocado
PDF
Strategic DevOps—How Advanced Testing Brings Broad Benefits to Operations and...
PDF
Software Engineering SDLC phases and SRS.pdf
Decision Making
fireup pro software house - this is who we are
Art of Product Management
The on-call survival guide - how to be confident on-call
Latest_Portfolio_Anxiao_chen
The UX of Automation by AJ King, Senior UX Researcher, Ocado
Strategic DevOps—How Advanced Testing Brings Broad Benefits to Operations and...
Software Engineering SDLC phases and SRS.pdf

Similar to How launching software is different (20)

PDF
3. Product Development
PPTX
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...
 
PPTX
Apply Problem Solving Techniques to Routine Malfunctions.pptx
PPT
Workshop 2 presentation
PDF
3 types of monitoring for 2020
DOC
Manualtestinginterviewquestionbyinfotech 100901071035-phpapp01
DOC
Manual testing interview questions by infotech
PDF
Kloudi introduction
PDF
Produkt Tank Amsterdam PULSE UX
PDF
Product Tank Amsterdam Pulse UX Presentation
PDF
Facial Verification - Banking App
PDF
IT In The Park 2016
PDF
Art Center Interactive Design 4 - #4 Usability Testing
PDF
Geminate Screenshot Feedback
PDF
Tell me Feedback with Screenshot
PPTX
provide1923.pptx
PDF
Agile practices for management
PPTX
#speakgeek - Support Processes for iconnect360
DOCX
osd ncc education assingment l4dc
DOCX
426769701-Pet-Shop-Management-System.docx
3. Product Development
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...
 
Apply Problem Solving Techniques to Routine Malfunctions.pptx
Workshop 2 presentation
3 types of monitoring for 2020
Manualtestinginterviewquestionbyinfotech 100901071035-phpapp01
Manual testing interview questions by infotech
Kloudi introduction
Produkt Tank Amsterdam PULSE UX
Product Tank Amsterdam Pulse UX Presentation
Facial Verification - Banking App
IT In The Park 2016
Art Center Interactive Design 4 - #4 Usability Testing
Geminate Screenshot Feedback
Tell me Feedback with Screenshot
provide1923.pptx
Agile practices for management
#speakgeek - Support Processes for iconnect360
osd ncc education assingment l4dc
426769701-Pet-Shop-Management-System.docx
Ad

More from Connie Kwan (11)

PDF
How to craft and deliver your customer pitch for maximum impact
PDF
How to tell a compelling story for every audience
PDF
Decision Making mini-workshop
PDF
Product Management 101 - How to Ask Questions
PPTX
Making Sense of Social Media in Sustainable Food
PPT
Sourcemap Presentation at Google Tech Talk
PPTX
Sustainability Assessment Report – Klean Kanteen
PPTX
Sustainability Assessment - Retail Food industry
PPTX
Food Commodity Markets
PDF
RealMealz: Cook Dinner, Earn Rewards
PDF
Marketing - Dealing With Competition
How to craft and deliver your customer pitch for maximum impact
How to tell a compelling story for every audience
Decision Making mini-workshop
Product Management 101 - How to Ask Questions
Making Sense of Social Media in Sustainable Food
Sourcemap Presentation at Google Tech Talk
Sustainability Assessment Report – Klean Kanteen
Sustainability Assessment - Retail Food industry
Food Commodity Markets
RealMealz: Cook Dinner, Earn Rewards
Marketing - Dealing With Competition
Ad

Recently uploaded (20)

PPTX
Principles of Marketing, Industrial, Consumers,
PDF
How to Get Funding for Your Trucking Business
PDF
Katrina Stoneking: Shaking Up the Alcohol Beverage Industry
DOCX
unit 2 cost accounting- Tender and Quotation & Reconciliation Statement
PPTX
HR Introduction Slide (1).pptx on hr intro
PDF
Daniels 2024 Inclusive, Sustainable Development
PPT
Chapter four Project-Preparation material
PDF
Deliverable file - Regulatory guideline analysis.pdf
PDF
Solara Labs: Empowering Health through Innovative Nutraceutical Solutions
PDF
Roadmap Map-digital Banking feature MB,IB,AB
PDF
Stem Cell Market Report | Trends, Growth & Forecast 2025-2034
PPTX
New Microsoft PowerPoint Presentation - Copy.pptx
PDF
Ôn tập tiếng anh trong kinh doanh nâng cao
PDF
Unit 1 Cost Accounting - Cost sheet
PPTX
2025 Product Deck V1.0.pptxCATALOGTCLCIA
PPT
Lecture 3344;;,,(,(((((((((((((((((((((((
PPTX
ICG2025_ICG 6th steering committee 30-8-24.pptx
PDF
Outsourced Audit & Assurance in USA Why Globus Finanza is Your Trusted Choice
PDF
COST SHEET- Tender and Quotation unit 2.pdf
PPTX
Dragon_Fruit_Cultivation_in Nepal ppt.pptx
Principles of Marketing, Industrial, Consumers,
How to Get Funding for Your Trucking Business
Katrina Stoneking: Shaking Up the Alcohol Beverage Industry
unit 2 cost accounting- Tender and Quotation & Reconciliation Statement
HR Introduction Slide (1).pptx on hr intro
Daniels 2024 Inclusive, Sustainable Development
Chapter four Project-Preparation material
Deliverable file - Regulatory guideline analysis.pdf
Solara Labs: Empowering Health through Innovative Nutraceutical Solutions
Roadmap Map-digital Banking feature MB,IB,AB
Stem Cell Market Report | Trends, Growth & Forecast 2025-2034
New Microsoft PowerPoint Presentation - Copy.pptx
Ôn tập tiếng anh trong kinh doanh nâng cao
Unit 1 Cost Accounting - Cost sheet
2025 Product Deck V1.0.pptxCATALOGTCLCIA
Lecture 3344;;,,(,(((((((((((((((((((((((
ICG2025_ICG 6th steering committee 30-8-24.pptx
Outsourced Audit & Assurance in USA Why Globus Finanza is Your Trusted Choice
COST SHEET- Tender and Quotation unit 2.pdf
Dragon_Fruit_Cultivation_in Nepal ppt.pptx

How launching software is different

  • 1. How launching Software is Different (than hardware)
  • 2. 1. Launching Software (15 min) 2. How do we keep our users engaged? (10 min) 3. Tech support 101 (10 min) 4. Live Operations and You (5 min) 5. Q&A (10min) You will walk away understanding ○ how we launch software ○ how we track progress and improve software Agenda
  • 7. Delivery Cadence New Releases As often as every 3 weeks Hotfix in minutes to days
  • 8. 1. Service model 1. Different Tradeoffs Fast delivery pace changes the software game ...
  • 9. 1. Service Model Tangible Intangible Lasts - Customer expect to use the same version Perishable - Customers expect new versions constantly Control Quality with Data Control Quality with Experience
  • 10. 2. Flexible Delivery allows for different Tradeoffs Good CheapFast Very Good Not Cheap Slow Right Product Medical Device Right Product must be do one thing really well, be reliable, don’t kill anyone!
  • 11. 2. Software Tradeoffs early stage vs late stage OK Medium Cheap Very Fast Very Fast OK Very Cheap Right Product must give users a great experience and solve their problems. Software startups need more cycles to get to the Right Product. So we optimize for fast and cheap. Early Facebook (Beta) Our Product (Beta) Today’s Facebook Good Not Cheap Medium Fast
  • 12. ● 2-3x the development budget ● 5x the clinical trial budget ● 18 additional months minimum (1-3 cycles of learning) ● We’d run out of runway! ● We’d be behind. If we wanted to ship software fully baked...
  • 13. 1. App Readiness ○ Testing - human and automated ○ Triage and Bug fix ○ End to end Carrot trial 2. Security ○ Network testing ○ App testing Getting ready for launch 3. Analytics ○ Mixpanel, Tableau, Dashboards 4. Tech Support ○ FAQs, processes, staffing 5. Dev Ops and Live Ops ○ Cross Training ○ Pager duty
  • 14. ● No production level Blocker-p0 bugs ○ Users are able to download, install, login ○ All intended screens are functional for whitelisted phones ○ Coaches can message users ○ Minimal app crashes ● Improvements come from two places: ○ 1. Not built to specification ← Mostly fixed before we go live Ready to Launch when...
  • 15. Launch and Learn with friendlies Customer Customer Oct Nov Dec Jan We will pull out all the stops! Customer Customer Customer Customer
  • 17. ● Analytics - Watch what happens, closely, every day ● Tech Support & LiveOps - Be there, help them, make fans of them ● All the stops - We all pitch in to give users…. Launch and Learn
  • 19. Valuable to track our users to... 1. Identify pool of users to reach out to i. Users experiencing technical blocks ii. Disengaged users 2. Measure general app engagement and system health i. Daily/weekly app opens, time spent inside the app 3. See how users progress through the full journey i. Identify friction points to inform longer-term design changes
  • 21. ● Email, phone and live chat ● 8 am to 5 pm PST, M - F ● Response time for emails = 24 hours ● We use Freshdesk to handle all tech support ● We will never not have bugs, that’s why I’m here! Tech Support 101
  • 22. So what happens when a user reports a bug? 1. I make sure we have all the information we need to debug, and if we don’t have it, I request it 2. I create a ticket in JIRA for the issue, link it to the user’s email in Freshdesk, and notify QA 3. QA gets back to me within 2 days to let me know if there’s a fix, a workaround, or provide an estimated timeline for resolution to the user Tech Support 101
  • 25. Live Operations And You! ● What is a fire? P0 (Fire) - Crashes, Freezes, Progression Blockers, Core App Functionality Stops Working. - Unable to Complete A Core Lesson (This Excludes Build Activities/Challenges) - Unable to Log Cigarettes. - Unable to Use the Coaching Tab. P1 - Incomplete, Incorrect, or Missing Functionality. - Unable to restart the dashboard tutorial. - Single Missing Medication Card. P2 - Visual Cosmetic Issues or App Flow Improvements. - UI/UX issues, Spelling Mistakes, Minor Graphical Issues. - Suggestions or Improvements. ● What Are The Different Types of Issues - Knowing The Terms A fire is any issue that requires immediate attention from the team that must be fixed. Categories of Issues: P0 | P1 | P2 (P = Priority)
  • 26. What To Do If You Suspect a Fire? Do Not Ignore It! Ask For Help! #Live-Operations For Urgent Issues Please Also Message Us We will look into the issue, log a ticket, and hand it off to the appropriate team member.
  • 27. We will pull out all the stops!

Editor's Notes

  • #12: Why was it ok to settle for OK in early FB? They’re launching to consumer, built-in churn w/ college student, free service. We have a higher bar because we’re launching a medical device, collecting health data from users, but we are offering free pilots right now. Enterprise selling cycles are longer, and a lot rides on these early client testimonials, so we have invested quite a bit more than Early FB, but we still need to move fast and launch as early as possible with software to start refining and getting to the right experience.
  • #20: This is in addition to the client reporting that we’re Doing. This is more granular observation of user engagement, early indicators, so we can take action.