SlideShare a Scribd company logo
Feature Management in Optimizely Full
Stack
Jamie Connolly
Product Manager
Robin Pam
Sr. Product Marketing Manager
Agenda
1. How Product Development Has Changed
2. Intro to Feature Management
3. Demo
Photo by Laurent Perren
Robin Pam
Sr. Product Marketing Manager
Optimizely
Product Manager
Optimizely
Jamie Connolly
• We are recording today’s presentation
• Slides will be available after the webinar is complete
• Please submit questions via the text box
Housekeeping
The way we release
software has changed
[Webinar] Introducing Feature Management
The Old Way
DESIGN BUILD LAUNCH * PRAY
* Infrequently, only when done, with no real-time customer feedback
[Webinar] Introducing Feature Management
The New Way
DESIGN BUILD EXPERIMENT ITERATE
Best-in-class companies:
Release all the time
Measure everything
Iterate rapidly
Feature Flags A/B Tests Multivariate TestsStaged Rollouts
How do they do it?
Release frequently in smaller
pieces to accelerate time to market
How do they do it?
Feature Flags A/B Tests Multivariate TestsStaged Rollouts
Quantify impact on key
business metrics
How do they do it?
Feature Flags A/B Tests Multivariate TestsStaged Rollouts
Monitor for safety prior to
launching for everyone
How do they do it?
Determine the optimal
configuration to drive ROI
Feature Flags A/B Tests Multivariate TestsStaged Rollouts
Feature Flags
Robust Statistical
Analysis
A/B Tests Multivariate Tests
Easy remote
configuration
Analytics & data pipeline
Integrated with
critical systems
Enterprise
readiness
Accessible to
every team
Robust data
infrastructure
Remove
guesswork from
launch decisions
Content management Release process
Staged Rollouts
How do they do it?
Real-time event
pipeline
Program Management
Support for many
languages
Security Zero latencyHigh availability
Monitoring
Compliance
Targeting capabilities
Documentation and
support
Ongoing
maintenance
Segmentation and
reporting
Typical digital leader experimentation stack
Feature Management
Launch silently, roll out gradually, and iterate with
experimentation
Make every feature release an opportunity to learn
Separate code deployment from feature enablement to drive rapid iteration on digital products
Feature Flagging
Create Features in Optimizely to enable
feature release and experimentation
without a code deploy
VS
Feature Rollouts
Gradually roll out a feature to
monitor impact on performance and
business metrics.
Feature Configuration
Instrument features with variables
or parameters that can be
configured remotely.
Feature Tests
Run experiments on variables to iterate to the best
version of your feature.
Demo
DESIGN BUILD EXPERIMENT ITERATE
Experiment-driven product development lifecycle
Discover
Design
Build
Experiment
Roll Out
Iterate
Develop and deploy your Feature behind a Feature Flag
How can you improve your customer experience?
Run a Feature Test to prove business impact
Find a winner, then run a Feature Rollout to launch safely
Leverage your Feature Configuration to continuously improve
Record an idea and plan development in JIRA or Program Management
Discover
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
Design
[Webinar] Introducing Feature Management
Build
opticon2017
[Webinar] Introducing Feature Management
Experiment
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
Roll Out
[Webinar] Introducing Feature Management
[Webinar] Introducing Feature Management
Iterate
[Webinar] Introducing Feature Management
Start with an on/off test to limit blast radius
Feature flags to limit blast radius
“Painted door” experiments to validate customer demand
Feature tests to prove business impact
Staged rollouts to monitor quality and performance
Growth experiments and CRO to improve usage, adoption, and conversion rate
Experiment-driven product development lifecycle
User studies and rapid prototyping to validate feature design
Discover
Design
Build
Experiment
Roll Out
Iterate
Experiment-driven product development lifecycle
Discover
Design
Build
Experiment
Roll Out
Iterate
Test and Learn at Every Step of Product Development
Avoid investing in
building features that
won’t meet goals
Minimize risk when
releasing new features
Optimize for growth
and maximize
performance
Discover
Design
Build
Experiment
Roll Out
Iterate
Learn More
Download our ebook to learn
more about using feature flags for
product experimentation.
www.optimizely.com/resources
Contact your account team today
to get access to Full Stack and
Feature Management.
Q&A

More Related Content

PDF
A/B Testing Framework Design
PPTX
Experimentation Excellence: Mastering the basics
PPTX
DevOps in Action: How Nedbank went from quarterly to weekly releases in no ti...
PDF
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
PPTX
How different Minimum Viable Products helped us understand customers.
PPT
Bug Advocacy
PDF
Shift Left - Approach and practices with IBM
PDF
Product Development for startup
A/B Testing Framework Design
Experimentation Excellence: Mastering the basics
DevOps in Action: How Nedbank went from quarterly to weekly releases in no ti...
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
How different Minimum Viable Products helped us understand customers.
Bug Advocacy
Shift Left - Approach and practices with IBM
Product Development for startup

What's hot (20)

PPTX
AMC Networks Experiments Faster on the Server Side
PDF
Test for Success: 5 Steps to Usability Testing Success
PDF
Product delivery Pawel Dyrek
PPTX
How we work
PPTX
A paradigm shift for testing - how to increase productivity 10x!
PDF
The Apex Interactive Debugger
PDF
Game Testing at Indium Software - Case Study
PDF
Increasing the ROI of Your Beta Tests
PDF
Failure is an Option: Scaling Resilient Feature Delivery
PDF
Game changers
PDF
Hacking Design Sprints
PPTX
Dev ops.enterprise.2014 (1)
PDF
How to feature flag and run experiments in iOS and Android
PDF
7 mobile app usability testing best practices by UserTesting
PDF
Agile Product Development: Small Bets
PDF
The ROI of Beta Testing
PPTX
Startup Product Development
PDF
AIPMM Phase Review Process for Product Management
PDF
Better Decisions with Experimentation
PDF
Using Great Product Management Process for Great Results
AMC Networks Experiments Faster on the Server Side
Test for Success: 5 Steps to Usability Testing Success
Product delivery Pawel Dyrek
How we work
A paradigm shift for testing - how to increase productivity 10x!
The Apex Interactive Debugger
Game Testing at Indium Software - Case Study
Increasing the ROI of Your Beta Tests
Failure is an Option: Scaling Resilient Feature Delivery
Game changers
Hacking Design Sprints
Dev ops.enterprise.2014 (1)
How to feature flag and run experiments in iOS and Android
7 mobile app usability testing best practices by UserTesting
Agile Product Development: Small Bets
The ROI of Beta Testing
Startup Product Development
AIPMM Phase Review Process for Product Management
Better Decisions with Experimentation
Using Great Product Management Process for Great Results
Ad

Similar to [Webinar] Introducing Feature Management (20)

PDF
Lean Product Design
PPTX
Optimizely Product Vision: The Future of Experimentation
PPTX
Martijn Beijk & Charles Goodall
PDF
[Webinar] Visa's Journey to a Culture of Experimentation
PDF
Grothues ndc oslo_2016
PDF
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
PDF
Prototype to production a startup perspective
PDF
Cox Automotive: Testing Across Multiple Brands
PPT
Future of QA
PPT
Futureofqa
PDF
Candid Conversations With Product People: Using Continuous Customer Testing f...
PDF
From MVP to post launch product management
PDF
MAU Vegas 2016 — Lessons Learned From A/B Testing Wins and Losses
PDF
Agile Testing 20021015
PDF
Semiconductor Design Community
PDF
Use Automation to Assist—Not Replace—Manual Testing
PPTX
Making quality visible in Product Engineering
PPTX
Challenges with agile testing process and how to debug and troubleshoot these...
PDF
Agile case studies
PDF
Leaner and Smarter: How Enterprises Can Develop Better Digital Products (v2)
Lean Product Design
Optimizely Product Vision: The Future of Experimentation
Martijn Beijk & Charles Goodall
[Webinar] Visa's Journey to a Culture of Experimentation
Grothues ndc oslo_2016
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
Prototype to production a startup perspective
Cox Automotive: Testing Across Multiple Brands
Future of QA
Futureofqa
Candid Conversations With Product People: Using Continuous Customer Testing f...
From MVP to post launch product management
MAU Vegas 2016 — Lessons Learned From A/B Testing Wins and Losses
Agile Testing 20021015
Semiconductor Design Community
Use Automation to Assist—Not Replace—Manual Testing
Making quality visible in Product Engineering
Challenges with agile testing process and how to debug and troubleshoot these...
Agile case studies
Leaner and Smarter: How Enterprises Can Develop Better Digital Products (v2)
Ad

More from Optimizely (20)

PDF
Clover Rings Up Digital Growth to Drive Experimentation
PPTX
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
PPTX
The Science of Getting Testing Right
PDF
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
PPTX
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
PPTX
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
PDF
The Future of Optimizely for Technical Teams
PPTX
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
PPTX
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
PDF
Building an Experiment Pipeline for GitHub’s New Free Team Offering
PDF
Evolving Experimentation from CRO to Product Development
PDF
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
PPTX
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
PPTX
Making Your Hypothesis Work Harder to Inform Future Product Strategy
PPTX
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
PPTX
Experimentation through Clients' Eyes
PPTX
Shipping to Learn and Accelerate Growth with GitHub
PPTX
Test Everything: TrustRadius Delivers Customer Value with Experimentation
PDF
Optimizely Agent: Scaling Resilient Feature Delivery
PDF
The Future of Software Development
Clover Rings Up Digital Growth to Drive Experimentation
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
The Science of Getting Testing Right
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
The Future of Optimizely for Technical Teams
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Evolving Experimentation from CRO to Product Development
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Experimentation through Clients' Eyes
Shipping to Learn and Accelerate Growth with GitHub
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Optimizely Agent: Scaling Resilient Feature Delivery
The Future of Software Development

Recently uploaded (20)

PPTX
Slides PPTX World Game (s) Eco Economic Epochs.pptx
PDF
Triggering QUIC, presented by Geoff Huston at IETF 123
PPTX
artificial intelligence overview of it and more
PPTX
QR Codes Qr codecodecodecodecocodedecodecode
PPTX
Introuction about ICD -10 and ICD-11 PPT.pptx
PDF
Paper PDF World Game (s) Great Redesign.pdf
PPTX
innovation process that make everything different.pptx
PPTX
introduction about ICD -10 & ICD-11 ppt.pptx
PDF
WebRTC in SignalWire - troubleshooting media negotiation
PPTX
presentation_pfe-universite-molay-seltan.pptx
PDF
💰 𝐔𝐊𝐓𝐈 𝐊𝐄𝐌𝐄𝐍𝐀𝐍𝐆𝐀𝐍 𝐊𝐈𝐏𝐄𝐑𝟒𝐃 𝐇𝐀𝐑𝐈 𝐈𝐍𝐈 𝟐𝟎𝟐𝟓 💰
PDF
Unit-1 introduction to cyber security discuss about how to secure a system
PDF
Slides PDF The World Game (s) Eco Economic Epochs.pdf
PPTX
SAP Ariba Sourcing PPT for learning material
PPTX
Job_Card_System_Styled_lorem_ipsum_.pptx
PDF
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
PPT
tcp ip networks nd ip layering assotred slides
PDF
Tenda Login Guide: Access Your Router in 5 Easy Steps
PDF
Decoding a Decade: 10 Years of Applied CTI Discipline
PDF
An introduction to the IFRS (ISSB) Stndards.pdf
Slides PPTX World Game (s) Eco Economic Epochs.pptx
Triggering QUIC, presented by Geoff Huston at IETF 123
artificial intelligence overview of it and more
QR Codes Qr codecodecodecodecocodedecodecode
Introuction about ICD -10 and ICD-11 PPT.pptx
Paper PDF World Game (s) Great Redesign.pdf
innovation process that make everything different.pptx
introduction about ICD -10 & ICD-11 ppt.pptx
WebRTC in SignalWire - troubleshooting media negotiation
presentation_pfe-universite-molay-seltan.pptx
💰 𝐔𝐊𝐓𝐈 𝐊𝐄𝐌𝐄𝐍𝐀𝐍𝐆𝐀𝐍 𝐊𝐈𝐏𝐄𝐑𝟒𝐃 𝐇𝐀𝐑𝐈 𝐈𝐍𝐈 𝟐𝟎𝟐𝟓 💰
Unit-1 introduction to cyber security discuss about how to secure a system
Slides PDF The World Game (s) Eco Economic Epochs.pdf
SAP Ariba Sourcing PPT for learning material
Job_Card_System_Styled_lorem_ipsum_.pptx
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
tcp ip networks nd ip layering assotred slides
Tenda Login Guide: Access Your Router in 5 Easy Steps
Decoding a Decade: 10 Years of Applied CTI Discipline
An introduction to the IFRS (ISSB) Stndards.pdf

[Webinar] Introducing Feature Management

  • 1. Feature Management in Optimizely Full Stack Jamie Connolly Product Manager Robin Pam Sr. Product Marketing Manager
  • 2. Agenda 1. How Product Development Has Changed 2. Intro to Feature Management 3. Demo Photo by Laurent Perren
  • 3. Robin Pam Sr. Product Marketing Manager Optimizely Product Manager Optimizely Jamie Connolly
  • 4. • We are recording today’s presentation • Slides will be available after the webinar is complete • Please submit questions via the text box Housekeeping
  • 5. The way we release software has changed
  • 7. The Old Way DESIGN BUILD LAUNCH * PRAY * Infrequently, only when done, with no real-time customer feedback
  • 9. The New Way DESIGN BUILD EXPERIMENT ITERATE
  • 10. Best-in-class companies: Release all the time Measure everything Iterate rapidly
  • 11. Feature Flags A/B Tests Multivariate TestsStaged Rollouts How do they do it? Release frequently in smaller pieces to accelerate time to market
  • 12. How do they do it? Feature Flags A/B Tests Multivariate TestsStaged Rollouts Quantify impact on key business metrics
  • 13. How do they do it? Feature Flags A/B Tests Multivariate TestsStaged Rollouts Monitor for safety prior to launching for everyone
  • 14. How do they do it? Determine the optimal configuration to drive ROI Feature Flags A/B Tests Multivariate TestsStaged Rollouts
  • 15. Feature Flags Robust Statistical Analysis A/B Tests Multivariate Tests Easy remote configuration Analytics & data pipeline Integrated with critical systems Enterprise readiness Accessible to every team Robust data infrastructure Remove guesswork from launch decisions Content management Release process Staged Rollouts How do they do it? Real-time event pipeline Program Management Support for many languages Security Zero latencyHigh availability Monitoring Compliance Targeting capabilities Documentation and support Ongoing maintenance Segmentation and reporting Typical digital leader experimentation stack
  • 16. Feature Management Launch silently, roll out gradually, and iterate with experimentation
  • 17. Make every feature release an opportunity to learn Separate code deployment from feature enablement to drive rapid iteration on digital products
  • 18. Feature Flagging Create Features in Optimizely to enable feature release and experimentation without a code deploy VS
  • 19. Feature Rollouts Gradually roll out a feature to monitor impact on performance and business metrics.
  • 20. Feature Configuration Instrument features with variables or parameters that can be configured remotely.
  • 21. Feature Tests Run experiments on variables to iterate to the best version of your feature.
  • 22. Demo
  • 24. Experiment-driven product development lifecycle Discover Design Build Experiment Roll Out Iterate Develop and deploy your Feature behind a Feature Flag How can you improve your customer experience? Run a Feature Test to prove business impact Find a winner, then run a Feature Rollout to launch safely Leverage your Feature Configuration to continuously improve Record an idea and plan development in JIRA or Program Management
  • 32. Build
  • 45. Start with an on/off test to limit blast radius
  • 46. Feature flags to limit blast radius “Painted door” experiments to validate customer demand Feature tests to prove business impact Staged rollouts to monitor quality and performance Growth experiments and CRO to improve usage, adoption, and conversion rate Experiment-driven product development lifecycle User studies and rapid prototyping to validate feature design Discover Design Build Experiment Roll Out Iterate
  • 47. Experiment-driven product development lifecycle Discover Design Build Experiment Roll Out Iterate
  • 48. Test and Learn at Every Step of Product Development Avoid investing in building features that won’t meet goals Minimize risk when releasing new features Optimize for growth and maximize performance Discover Design Build Experiment Roll Out Iterate
  • 49. Learn More Download our ebook to learn more about using feature flags for product experimentation. www.optimizely.com/resources Contact your account team today to get access to Full Stack and Feature Management.
  • 50. Q&A