SlideShare a Scribd company logo
Delivering New Features to Over 30,000 Customers — Daily
DELIVERING NEW FEATURES TO OVER
30,000 CUSTOMERS DAILY
INSIDE THE DEVELOPMENT TEAM

RYAN THOMAS
DEVELOPMENT TEAM LEAD
DEVELOPER ACCELERATION GROUP, ATLASSIAN
rthomas@atlassian.com
AGENDA
!

Atlassian OnDemand

!

Releasing with Confidence

!

Mechanics of Deploying

!

The Feedback Loop
Delivering New Features to Over 30,000 Customers — Daily
“

“

Atlassian OnDemand takes our awardwinning software for development &
collaboration into the cloud, and makes
getting started easier than ever.
Delivering New Features to Over 30,000 Customers — Daily
35,535
UNICORN
OPERATIONS

INFRASTRUCTURE

SOFTWARE
INFRASTRUCTURE
•
•
•

•

Atlassian owned hardware
Purpose built for OnDemand
3 Datacenters across US & Australia
• Ashburn
• Santa Clara
• Sydney
~57Tb of RAM in our Ashburn DC
OPERATIONS
•

•
•

Dedicated Operations team around the globe
• Australia
• US
• Europe
24x7 Monitoring and support of the platform
and applications
99.972% availability over the last 31 days
SOFTWARE
•
•

•

Traditionally self-hosted applications
We are SaaS’ing them into a true SaaS
solution
• Shared services
• Multi-tenanted applications
The same JIRA, Confluence & Bamboo that
you have already used
• But with more frequent features delivered!
RELEASING WITH CONFIDENCE
?

?

?
?

?

What is a release process?

?

?
UNIT
INTEGRATION
ACCEPTANCE
RELEASE
Delivering New Features to Over 30,000 Customers — Daily
Delivering New Features to Over 30,000 Customers — Daily
Delivering New Features to Over 30,000 Customers — Daily
350
COMMITS A WEEK
TO MASTER
TESTING
REVIEW

! AUTOMATION
TESTING
•
•
•

Keep master releasable
Automatically build on feature branches
We do acceptance testing of:
• The change against current Production
versions
• The change against current Development
versions

!
REVIEW
• Every. Single. Change. Is reviewed
• Code review is part of our definition of done
• Peer review by team / relevant people
• QA comes in once we have reviewed our
own changes
• All stories have QA demos
• All stories have QA testing notes

!
AUTOMATION

!

• We are in the process of automating our
•
•

release process end-to-end
This removes the risk of human error
Allows us to move quicker, with a higher
confidence
#summit13

- Eric
Raymond

“

“

Release early. Release often. And listen to
your customers.
MECHANICS OF DEPLOYING

!
Delivering New Features to Over 30,000 Customers — Daily
Development

Smoke Tests

Dogfooding

Smoke Tests

Production
• Contains all of the releases that go to
Development

•
•

Dogfooding
Production

OnDemand
Developers instances can opt-in to
receiving updates of new plugins &
products
Most likely to encounter bugs here
Development

• We “Eat our own dogfood”
• Contains business-critical systems we
•
Dogfooding

•
•
Production

use every day
All instances updated
• New plugins when available
• Products updates every night
A sub-set of releases in the DEV
environment
Bugs should be found before here :)
Development
Dogfooding

Production

• What our customers use every day
• A sub-set of releases in the DOG
•

environment
Less likely to encounter bugs here
Development
Dogfooding
Production
#summit13

“

“

The environments you deliver to should
continually be refining their output. The aim is
to deliver high quality software.
POWER
POWER
• Large increase is ~ 600W of
•
•

power usage - per rack
We have 37 racks in our
Ashburn DC
This is ~ 22.2kW of power for a
standard US & EMEA upgrade
POWER
Enough to power my
MacBook Air for 29.3
weeks straight
More than 6 months!
Delivering New Features to Over 30,000 Customers — Daily
THE FEEDBACK LOOP
Delivering New Features to Over 30,000 Customers — Daily
POST DEPLOYMENT VERIFICATION
• Ensuring what we’ve deployed is actually
•
•

working
Allows quick pickup of defects in
production
We use the atlassian-healthcheck
plugin for this
INFRASTRUCTURE ANALYTICS
• A deeper level of feedback for our
•
•

operations and infrastructure teams
Check CPU time, IO, JVM statistics,
power usage
Helps us diagnose platform related usage
and problems
PRODUCT ANALYTICS
• Statistics of new feature discovery and
•
•

usage
Consumed by product and plugin teams,
and their product managers
Helps us experiment and A/B test new
features in production
BUG REPORTS & SUPPORT CASES
• The last resort - we want to minimize this
•

kind of feedback
If an issue slips through to production,
and is not picked up by our automated
checking it will generally result in a
support case
• These four types of feedback

•
•

are all critical in pushing
information back to the
developers and PMs
Closes the delivery loop
An awesome delivery pipeline
is next to useless if you can’t
see what’s going on
#summit13

“

“

There are many types of feedback, these four
work for Atlassian. You’ll need to find out
what works for your team and processes remember: having feedback is crucial to
continual improvement.
The environments you deliver to should
continually be refining their output. The aim is
to deliver high quality software.
There are many types of feedback, these four
work for Atlassian. You’ll need to find out
what works for your team and processes remember: having feedback is crucial to
continual improvement.
#summit13

“

“

Release early. Release often. And listen to your
customers.
TYING IT ALL TOGETHER
Enables us to deliver new features to

35,535
customers every day, with confidence
Thank you!
RYAN THOMAS

•

DEVELOPMENT TEAM LEAD

@RYAN_ATLASSIAN •

•

ATLASSIAN

RTHOMAS@ATLASSIAN.COM
Rate this Talk
Delivering New Features to Over 30,000 Customers - Daily
Text code below to 22333
or visit http://bit.ly/19dYF9v
MEH = 25
NO T BA D = 26
P R ET T Y GO O D = 27
A WES O ME = 28

To join this session, send text 136888 to

More Related Content

PPTX
Intro to Puppet Enterprise
PDF
Summit 2014 Keynote
PDF
How Standardizing on Atlassian Products is Helping Publicis.Sapient Scale and...
PPTX
Geek Sync I SQL Server 2016 Performance Tricks You Need to Know
PDF
Making Infrastructure as Awesome as Agile Development
PDF
DevOps Best Practices and Implementation Roadmap
PDF
Building on the Shoulders of Giants: the Story of Bitbucket Pipelines
PPTX
DOES16 San Francisco - David Blank-Edelman - Lessons Learned from a Parallel ...
Intro to Puppet Enterprise
Summit 2014 Keynote
How Standardizing on Atlassian Products is Helping Publicis.Sapient Scale and...
Geek Sync I SQL Server 2016 Performance Tricks You Need to Know
Making Infrastructure as Awesome as Agile Development
DevOps Best Practices and Implementation Roadmap
Building on the Shoulders of Giants: the Story of Bitbucket Pipelines
DOES16 San Francisco - David Blank-Edelman - Lessons Learned from a Parallel ...

What's hot (20)

PDF
Ignite DevOps 2017 @ SEP
PDF
10 Deploys a Day - A Case Study of Continuous Delivery at Envato
PDF
Embracing Jira Cloud: Tips from an ex-Server admin
PPTX
Continuous Integration (CI) is about more than releases
PDF
DevOps - Be Careful What You Wish For
PDF
Product Managers are from Pluto and UXers are from Uranus
PPTX
The Anatomy of Continuous Deployment at Scale - 100 deploys a week at Envato ...
PDF
DevOps with Atlassian
PDF
Continuous Delivery in a Legacy Shop—One Step at a Time
PDF
DOES16 London - Better Faster Cheaper .. How?
PDF
Bycraft Conference - Running operations in 2 hours
PDF
1 2 dev ops - vsts overview
PDF
Black Belt Tips for JIRA Software
PPTX
Comparison of Skype vs team viewer
PPTX
Geek Sync I Surviving the Holidays with SQL Server
PPTX
Infragistics uses DevOps to increase customer engagment
PPTX
Geek Sync | Kick Start SQL Server 2016 Performance Tips and Tricks
PDF
The Secret Sauce of Successful Teams
PPTX
The Anatomy of Continuous Deployment at Scale
PDF
Advance ALM and DevOps Practices with Continuous Improvement
Ignite DevOps 2017 @ SEP
10 Deploys a Day - A Case Study of Continuous Delivery at Envato
Embracing Jira Cloud: Tips from an ex-Server admin
Continuous Integration (CI) is about more than releases
DevOps - Be Careful What You Wish For
Product Managers are from Pluto and UXers are from Uranus
The Anatomy of Continuous Deployment at Scale - 100 deploys a week at Envato ...
DevOps with Atlassian
Continuous Delivery in a Legacy Shop—One Step at a Time
DOES16 London - Better Faster Cheaper .. How?
Bycraft Conference - Running operations in 2 hours
1 2 dev ops - vsts overview
Black Belt Tips for JIRA Software
Comparison of Skype vs team viewer
Geek Sync I Surviving the Holidays with SQL Server
Infragistics uses DevOps to increase customer engagment
Geek Sync | Kick Start SQL Server 2016 Performance Tips and Tricks
The Secret Sauce of Successful Teams
The Anatomy of Continuous Deployment at Scale
Advance ALM and DevOps Practices with Continuous Improvement
Ad

Viewers also liked (17)

PDF
Cultivating Content: Designing Wiki Solutions That Scale
PPTX
Critical Conversations
PDF
HipChat State of the Union
PPT
Leadership Principles for Difficult Conversations
PPT
Three Worlds Of It
PPTX
How to tackle that difficult conversation
PDF
Getting Started with a Remote Team
PDF
CROWDFUNDx - Design Your Day - Nokia - #SmarterEveryday
PPT
Delivering bad news in good ways on projects
PPTX
Optimizing leadership a brain-based approach
DOCX
History of performance appraisal
PDF
Dynamic Teaming and Leading — The New Normal
PDF
Transforming the quality of development conversations at scale
PDF
Difficult Conversations Handouts
PDF
Difficult Conversations Planning Template
PPT
NeuroLeadership in Organization Development
PDF
Neuroscience Of Leadershp Webinar
Cultivating Content: Designing Wiki Solutions That Scale
Critical Conversations
HipChat State of the Union
Leadership Principles for Difficult Conversations
Three Worlds Of It
How to tackle that difficult conversation
Getting Started with a Remote Team
CROWDFUNDx - Design Your Day - Nokia - #SmarterEveryday
Delivering bad news in good ways on projects
Optimizing leadership a brain-based approach
History of performance appraisal
Dynamic Teaming and Leading — The New Normal
Transforming the quality of development conversations at scale
Difficult Conversations Handouts
Difficult Conversations Planning Template
NeuroLeadership in Organization Development
Neuroscience Of Leadershp Webinar
Ad

Similar to Delivering New Features to Over 30,000 Customers — Daily (20)

PPTX
Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...
PDF
Panel Discussion Continuous Deployment in SaaS
PDF
Releasing To Production Every Week
PDF
Beyond the Scrum Team: Delivering "Done" at Scale
PDF
Releasing To Production Every Week India
PDF
Software Release Orchestration and the Enterprise
PDF
WSO2Con EU 2015: Keynote - Cloud Native Apps… from a user point of view
PDF
Continuous delivery
PDF
Continuous delivery is more than dev ops
PPTX
AMIS 25: DevOps Best Practice for Oracle SOA and BPM
PPTX
Higher. Faster. Stronger. Your Applications with Habitat
PPTX
Agility and Control from AWS [FutureStack16]
PDF
Jonny wooldridge DevOps Large and Small
PDF
Untangling Continuous Delivery
PPTX
DevOps Days Toronto: From 6 Months Waterfall to 1 hour Code Deploys
PPTX
The Three Pillars of Continuous Delivery - Boston Continuous Delivery Event
PPTX
Road to Continuous Delivery - Wix.com
PPTX
Keys to Continuous Delivery Success - Mark Warren, Product Director, Perforc...
PDF
Andy singleton continuous delivery-fcb - nov 2014
PDF
Achieving DevOps Success: Enabling Continuous Delivery Goals through Applica...
Continuous Delivery and Continuous Agile by Andy Singleton - Agile Maine Day...
Panel Discussion Continuous Deployment in SaaS
Releasing To Production Every Week
Beyond the Scrum Team: Delivering "Done" at Scale
Releasing To Production Every Week India
Software Release Orchestration and the Enterprise
WSO2Con EU 2015: Keynote - Cloud Native Apps… from a user point of view
Continuous delivery
Continuous delivery is more than dev ops
AMIS 25: DevOps Best Practice for Oracle SOA and BPM
Higher. Faster. Stronger. Your Applications with Habitat
Agility and Control from AWS [FutureStack16]
Jonny wooldridge DevOps Large and Small
Untangling Continuous Delivery
DevOps Days Toronto: From 6 Months Waterfall to 1 hour Code Deploys
The Three Pillars of Continuous Delivery - Boston Continuous Delivery Event
Road to Continuous Delivery - Wix.com
Keys to Continuous Delivery Success - Mark Warren, Product Director, Perforc...
Andy singleton continuous delivery-fcb - nov 2014
Achieving DevOps Success: Enabling Continuous Delivery Goals through Applica...

More from colleenfry (20)

PDF
The 7 habits of high successful atlassian marketplace developers
PDF
True Git
PDF
The 7 habits of high successful atlassian marketplace developers
PDF
The 7 habits of high successful atlassian marketplace developers by dave meyer
PDF
AtlasCamp 2013: Scratch your own itch
PDF
AtlasCamp 2013: Bring your own Stack
PDF
AtlasCamp 2013: A Re-Intriduction to Atlassian Connect: Add-ons for OnDemand
PDF
AtlasCamp 2013: Keynote
PDF
AtlasCamp 2013: Confluence patterns
PDF
AtlasCamp 2013: Modernizing your Plugin UI
PDF
AtlasCamp 2013: Confluence Blueprints
PDF
AtlasCamp 2013: Show Me Number! Automated Browser Performance Testing
PDF
AtlasCamp 2013: Confluence State of the Union
PDF
AtlasCamp 2013: ADG / Lean UX
PDF
Atlassian Summit 2013: Confluence State of the Union
PDF
Atlassian: More Awesome with Add-ons
PDF
Flying at the Speed of Git
PDF
The Experience Canvas: How to Use a Core Tool from the Experience-Driven Play...
PDF
True Git: The Great Migration
PDF
Adopting Continuous Integration in an Ops Group
The 7 habits of high successful atlassian marketplace developers
True Git
The 7 habits of high successful atlassian marketplace developers
The 7 habits of high successful atlassian marketplace developers by dave meyer
AtlasCamp 2013: Scratch your own itch
AtlasCamp 2013: Bring your own Stack
AtlasCamp 2013: A Re-Intriduction to Atlassian Connect: Add-ons for OnDemand
AtlasCamp 2013: Keynote
AtlasCamp 2013: Confluence patterns
AtlasCamp 2013: Modernizing your Plugin UI
AtlasCamp 2013: Confluence Blueprints
AtlasCamp 2013: Show Me Number! Automated Browser Performance Testing
AtlasCamp 2013: Confluence State of the Union
AtlasCamp 2013: ADG / Lean UX
Atlassian Summit 2013: Confluence State of the Union
Atlassian: More Awesome with Add-ons
Flying at the Speed of Git
The Experience Canvas: How to Use a Core Tool from the Experience-Driven Play...
True Git: The Great Migration
Adopting Continuous Integration in an Ops Group

Recently uploaded (20)

PDF
Electronic commerce courselecture one. Pdf
PDF
Encapsulation theory and applications.pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
A Presentation on Artificial Intelligence
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
Empathic Computing: Creating Shared Understanding
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Modernizing your data center with Dell and AMD
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
Understanding_Digital_Forensics_Presentation.pptx
Electronic commerce courselecture one. Pdf
Encapsulation theory and applications.pdf
NewMind AI Weekly Chronicles - August'25 Week I
Review of recent advances in non-invasive hemoglobin estimation
A Presentation on Artificial Intelligence
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Empathic Computing: Creating Shared Understanding
MYSQL Presentation for SQL database connectivity
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
CIFDAQ's Market Insight: SEC Turns Pro Crypto
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Diabetes mellitus diagnosis method based random forest with bat algorithm
Modernizing your data center with Dell and AMD
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
“AI and Expert System Decision Support & Business Intelligence Systems”
Digital-Transformation-Roadmap-for-Companies.pptx
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Reach Out and Touch Someone: Haptics and Empathic Computing
Understanding_Digital_Forensics_Presentation.pptx

Delivering New Features to Over 30,000 Customers — Daily