SlideShare a Scribd company logo
opticon2017
Experiment, Roll Out, and Launch with Full Stack
Jamie Connolly
Product Manager
Optimizely
Robin Pam
Sr. Product Marketing Manager
Optimizely
opticon2017
Feature Management in Optimizely
opticon2017
1880s 1930s 1980s
opticon2017
Innovation in the physical world can take decades
opticon2017
opticon2017
3 YEARS LATER
opticon2017
opticon2017
Innovation by the hour
opticon2017
At any given point in time, there isn't just one version
of Facebook running, there are probably 10,000.
Mark Zuckerberg
“
“
Opticon 2017 Experiment, Roll Out, and Launch
A B
A
B
Opticon 2017 Experiment, Roll Out, and Launch
9,800Google search experiments in 2016
www.google.com/search/howsearchworks/
1,653Google search launches in 2016
www.google.com/search/howsearchworks/
opticon2017opticon2017
Experimentation-Driven
Product Development
LAUNCHBUILD
DESIGN
PRAY
EXPERIMENT
ITERATE
LAUNCH
BUILD
DESIGN PRAY
EXPERIMENT
ITERATE
LAUNCH
BUILDDESIGN PRAY
EXPERIMENT
ITERATE
LAUNCHBUILDDESIGN
PRAY
EXPERIMENT
ITERATE
LAUNCHBUILDDESIGN PRAY
EXPERIMENT
ITERATE
DESIGN BUILD EXPERIMENT ITERATE
LAUNCH
PRAY
opticon2017
opticon2017
opticon2017
FEATURE FLAGS
Deploy quickly
and safely
EXPERIMENTATION
Prove the impact of
product development
opticon2017
TARGETING &
ROLLOUTS
Determine who has
access to which
experience
FEATURE FLAGS
Deploy quickly
and safely
EXPERIMENTATION
Prove the impact of
product development
opticon2017
TARGETING &
MANAGEMENT
Determine who
has access to
TARGETING &
ROLLOUTS
Determine who has
access to which
experience
FEATURE FLAGS
Deploy with
safeguards
EXPERIMENTATION
Prove the impact of
product development
Feature Management
DESIGN BUILD EXPERIMENT ITERATE
LAUNCH
PRAY
DEVELOP DEPLOY FLAG
EXPERIMENT
ROLLOUT
LAUNCH
ITERATE
opticon2017opticon2017
Demo
opticon2017
How many experiments do you run per year?
How many changes do you launch per year?
opticon2017
Your Product
Roadmap is your
Experiment Roadmap
opticon2017
Q&A
Jamie Connolly
jamie@optimizely.com
Robin Pam
robin.pam@optimizely.com
opticon2017


THANK YOU

More Related Content

PPTX
Opticon 2017 Beyond CRO
PPTX
Opticon 2017 Cracking the Code
PDF
“A Playbook for Achieving Product-Market Fit” by Dan Olsen
PDF
Product development - from vision to execution
PPTX
Website optimization through quality experimentation (2)
PDF
Monthly Report For Your Business
PDF
A Short Thought about Ecosystems & Continuity
PDF
The No B.S. Overview of Agile Marketing
Opticon 2017 Beyond CRO
Opticon 2017 Cracking the Code
“A Playbook for Achieving Product-Market Fit” by Dan Olsen
Product development - from vision to execution
Website optimization through quality experimentation (2)
Monthly Report For Your Business
A Short Thought about Ecosystems & Continuity
The No B.S. Overview of Agile Marketing

Similar to Opticon 2017 Experiment, Roll Out, and Launch (20)

PDF
Moll how2012-teams
PPTX
Don Southard,GM, R&D & Innovation Solutions Architecture, Amazon Web Services
PDF
Web Design for SEO
PDF
Innovate with Experimentation: Incorporate A/B Testing Into Your Product Deve...
PDF
Rapid Prototyping for XR: Lecture 3 - Video and Paper Prototyping
PDF
From Concept to Completion: Tips for Designing Great Content
PDF
Are We In a Bubble? #Wayra #CorpAccel #AcceleratedStartup
PDF
2010 And Beyond
PDF
The Technical Seo Renaissance - Mike King
PDF
Lean startup and beyond nicolas sassoli
PDF
Built With ❤ - Why Developer Experience Matters - Web Unleashed 2019
PDF
Experience Innovation
PDF
#SEOisAEO: The Knowledge Graph - How Well is Google doing in 'understanding t...
PPTX
Knowledge Graph and Authorrank iss smx
PDF
Why Design Matters - P&G Keynote
PPTX
Ignition 5 25.02.13
PDF
How games are driving advances in AI research- Unite Copenhagen 2019
PPTX
Seo Intention Via Web Mining
PPTX
Production Log
PPT
新 总交
Moll how2012-teams
Don Southard,GM, R&D & Innovation Solutions Architecture, Amazon Web Services
Web Design for SEO
Innovate with Experimentation: Incorporate A/B Testing Into Your Product Deve...
Rapid Prototyping for XR: Lecture 3 - Video and Paper Prototyping
From Concept to Completion: Tips for Designing Great Content
Are We In a Bubble? #Wayra #CorpAccel #AcceleratedStartup
2010 And Beyond
The Technical Seo Renaissance - Mike King
Lean startup and beyond nicolas sassoli
Built With ❤ - Why Developer Experience Matters - Web Unleashed 2019
Experience Innovation
#SEOisAEO: The Knowledge Graph - How Well is Google doing in 'understanding t...
Knowledge Graph and Authorrank iss smx
Why Design Matters - P&G Keynote
Ignition 5 25.02.13
How games are driving advances in AI research- Unite Copenhagen 2019
Seo Intention Via Web Mining
Production Log
新 总交
Ad

More from Optimizely (20)

PDF
Clover Rings Up Digital Growth to Drive Experimentation
PPTX
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
PPTX
The Science of Getting Testing Right
PDF
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
PPTX
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
PPTX
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
PDF
The Future of Optimizely for Technical Teams
PPTX
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
PPTX
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
PDF
Building an Experiment Pipeline for GitHub’s New Free Team Offering
PPTX
AMC Networks Experiments Faster on the Server Side
PDF
Evolving Experimentation from CRO to Product Development
PDF
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
PPTX
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
PPTX
Making Your Hypothesis Work Harder to Inform Future Product Strategy
PPTX
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
PPTX
Experimentation through Clients' Eyes
PPTX
Shipping to Learn and Accelerate Growth with GitHub
PPTX
Test Everything: TrustRadius Delivers Customer Value with Experimentation
PDF
Optimizely Agent: Scaling Resilient Feature Delivery
Clover Rings Up Digital Growth to Drive Experimentation
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
The Science of Getting Testing Right
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
The Future of Optimizely for Technical Teams
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Building an Experiment Pipeline for GitHub’s New Free Team Offering
AMC Networks Experiments Faster on the Server Side
Evolving Experimentation from CRO to Product Development
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Experimentation through Clients' Eyes
Shipping to Learn and Accelerate Growth with GitHub
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Optimizely Agent: Scaling Resilient Feature Delivery
Ad

Recently uploaded (20)

PDF
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
A comparative analysis of optical character recognition models for extracting...
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PDF
Hybrid model detection and classification of lung cancer
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
August Patch Tuesday
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
cloud_computing_Infrastucture_as_cloud_p
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
PDF
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PPTX
Chapter 5: Probability Theory and Statistics
PPTX
OMC Textile Division Presentation 2021.pptx
PPTX
TLE Review Electricity (Electricity).pptx
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
A novel scalable deep ensemble learning framework for big data classification...
A comparative analysis of optical character recognition models for extracting...
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Hybrid model detection and classification of lung cancer
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
August Patch Tuesday
Encapsulation_ Review paper, used for researhc scholars
cloud_computing_Infrastucture_as_cloud_p
MIND Revenue Release Quarter 2 2025 Press Release
Accuracy of neural networks in brain wave diagnosis of schizophrenia
Group 1 Presentation -Planning and Decision Making .pptx
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
SOPHOS-XG Firewall Administrator PPT.pptx
DASA ADMISSION 2024_FirstRound_FirstRank_LastRank.pdf
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Unlocking AI with Model Context Protocol (MCP)
Chapter 5: Probability Theory and Statistics
OMC Textile Division Presentation 2021.pptx
TLE Review Electricity (Electricity).pptx

Opticon 2017 Experiment, Roll Out, and Launch