SlideShare a Scribd company logo
© 2015 CLUSTRIX
The First Scale-out SQL Database Engineered for Today’s Cloud
1
Scaling Techniques to Increase
Magento Capacity
Or How to Get Ready for the Holiday and Cope with
Fast Growth
Kevin Bortnick, Magento Solutions Architect at Clustrix
PROPRIETARY AND CONFIDENTIAL2
• Kevin is a Certified Magento Developer. He has built and maintained some of the
largest and most complex Magento-powered E-commerce sites.
• Kevin lives in Las Vegas and is currently the Magento Solutions Architect for Clustrix.
As a Magento Architect — I think about the future
 How easy is it to maintain?
 Can someone else support it?
 Can it handle growth?
 Can it be used for something else?
 When is it going to break?
PROPRIETARY AND CONFIDENTIAL3
Symptoms of a Problem?
• Increased page load time
•
• Spikes and Errors
•
• Site Crashes
•
• Support Tickets
PROPRIETARY AND CONFIDENTIAL4
If you are seeing issues…
• Look in the obvious places
– Scale your Magento web nodes
– Add Memcached or Redis
– Add Varnish
• If everything else is tuned right, the
database becomes the next
bottleneck
PROPRIETARY AND CONFIDENTIAL5
Ways of Extending MySQL
PROPRIETARY AND CONFIDENTIAL6
Faster Hardware?
Read Slaves?
Multi Master? Partitioning?
Percona?
NoSQL?
Clustrix?
Report Card Grading
7
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads ✔
Scales Writes ✔
No Application Changes
No Single Point of Failure
Percona
• A drop-in replacement for MySQL
• Pros:
– Easy to set up and use
– Retains consistent
performance at high resource
utilization
• Cons:
– Still has MySQL's architecture
limitations
– No high availability or disaster
recovery
8
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads ✔
Scales Writes Limited
No Application Changes ✔
No Single Point of Failure
Faster Hardware
• Pros:
– Immediate performance improvements
• Cons:
– Limit to how large you can go
– High-end hardware can get very
expensive, especially when you include
backup servers
– Excess hardware during off peak
season
9
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads Limited
Scales Writes Limited
No Application Changes ✔
No Single Point of Failure
Master with Read Slaves
• Pros:
– Easy to do
– Magento has this feature built in
• Cons:
– Does not help solve write
checkout bottlenecks
– Eventual consistency
10
Master
SlaveSlave
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads ✔
Scales Writes
No Application Changes ✔
No Single Point of Failure
Master/Master, Store/Admin
• Pros:
– Works well if you do a lot of
updates
– Helps for 24 hour stores
• Cons:
– Have to accommodate edge
cases
– DBA needs to monitor for
replication issues
– Won't fix front-end only
bottlenecks
11
Store
SlaveSlave
Admin
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads ✔
Scales Writes
No Application Changes
No Single Point of Failure
True Multi Master
• Pros
– Can deliver better overall
performance
• Cons
– Application must keep track of
orders and inventory
– Latency can cause sync issues
– Expensive to develop and maintain
– Complexity increases and stability
decreases
12
1
1b1a
2
2b2a
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads ✔
Scales Writes ✔
No Application Changes
No Single Point of Failure
Partitioning (Magento 2 feature CQRS)
• Pros
– Able to distribute load
• Cons
– Can’t join between partitioned
segments
– Amount of tables able to be
partitioned is limited
– Harder to maintain—need to track
configurations
13
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads ✔
Scales Writes Limited
No Application Changes Limited
No Single Point of Failure
NoSQL
• Pros:
– Runs very fast in non-ACID mode
• Cons:
– Gains speed from short-cutting of ACID
– Commits before writing to disk
– No cross-document transactions
– NoSQL requires significant application
development to swap-out MySQL
14
ACID = Transaction and Data Safety
Report Card
MySQL Compatible
Improves Performance
Scales Reads In non-
ACID
mode
Scales Writes ✔
No Application Changes Limited
No Single Point of Failure
Don’t Drop
ACID
ClustrixDB
15
• Pros
– Drop-In Replacement for MySQL
– Scales READS and WRITES
– Distributed
– Shared Nothing
– Data Redundancy
– Built in high availability solution
– Low cost disaster recovery
– Elastic in the cloud and data
center
– Seasonal Flex, Self-Managing
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads ✔
Scales Writes ✔
No Application Changes ✔
No Single Point of Failure ✔
Easy to Administer
ClustrixDB
Flexing up for Seasonal Demand
The Flex Command Center
Wrap Up – Think About the Future
 How easy is it to maintain
 Can someone else support it
 Can it handle growth
 Can it be used for something else
 When is it going to break
20
Report Card
MySQL Compatible ✔
Improves Performance ✔
Scales Reads ✔
Scales Writes ✔
No Application Changes ✔
No Single Point of Failure ✔
PROPRIETARY AND CONFIDENTIAL21
Q & A
PROPRIETARY AND CONFIDENTIAL22
Thank you
ClustrixDB Key Differentiators
Automatic, 100%
fault tolerance
Availability
No single
point of failure
Battle-tested
performance
Flex up and
down, in minutes
Massive,
linear scalability
Capacity
Extreme
concurrency
Productivity
Eliminates
re-architecting
the database
Plug-in MySQL
compatibility
Self-managing
operation
PROPRIETARY AND CONFIDENTIAL23
Engineered
for any cloud
One-click
installation
Cloud
Seamless
scale-out

More Related Content

PDF
MMUG18 - MySQL Failover and Orchestrator
PDF
Experiences testing dev versions of MySQL and why it is good for you
PPTX
Speed-up Your Big Data Applications with Sencha and Speedment
PPTX
Magento Hosting Requirements and Recommendations
PDF
Ideastack web hosting company
PPTX
Continuous architecture improvement of a cross-border online trade platform
PPTX
High Performance and Scalability Database Design
PPTX
London VMUG Presentation 19th July 2012
MMUG18 - MySQL Failover and Orchestrator
Experiences testing dev versions of MySQL and why it is good for you
Speed-up Your Big Data Applications with Sencha and Speedment
Magento Hosting Requirements and Recommendations
Ideastack web hosting company
Continuous architecture improvement of a cross-border online trade platform
High Performance and Scalability Database Design
London VMUG Presentation 19th July 2012

What's hot (19)

PPTX
How not to be a cranky dba
PPT
Website Backup
PPTX
The top integration features you probably didn’t know existed in Service Bus
PPTX
Nimble storage
PPTX
BizTalk Server Performance Tips
PDF
Grokking TechTalk #33: High Concurrency Architecture at TIKI
PPTX
BRE Deep Dive
ODP
WordPress optimization
PPTX
Why does a business need real-time data processing?
PDF
Hard parts paywall - stup
PDF
S3
PDF
Which watcher watches CloudWatch
PDF
Mastering Migration - How to Manage a Move From Another CMS to WordPress with...
PPTX
Scylla Summit 2018: Grow small, Get big — Experiences with Scylla
PPTX
Stacktrace Berlin RC.2
PPTX
Handling your backups
PDF
Netherlands OSUG | Sep 30
PPTX
How to automate your BizTalk Installations and Deployments with Chef
PPT
Cohodatawebinar
How not to be a cranky dba
Website Backup
The top integration features you probably didn’t know existed in Service Bus
Nimble storage
BizTalk Server Performance Tips
Grokking TechTalk #33: High Concurrency Architecture at TIKI
BRE Deep Dive
WordPress optimization
Why does a business need real-time data processing?
Hard parts paywall - stup
S3
Which watcher watches CloudWatch
Mastering Migration - How to Manage a Move From Another CMS to WordPress with...
Scylla Summit 2018: Grow small, Get big — Experiences with Scylla
Stacktrace Berlin RC.2
Handling your backups
Netherlands OSUG | Sep 30
How to automate your BizTalk Installations and Deployments with Chef
Cohodatawebinar
Ad

Viewers also liked (15)

PDF
ClustrixDB 7.5 Announcement
PPTX
Clustrix Database Overview
PPTX
Database Architecture & Scaling Strategies, in the Cloud & on the Rack
PPTX
Beyond Aurora. Scale-out SQL databases for AWS
PDF
Why Traditional Databases Fail so Miserably to Scale with E-Commerce Site Growth
PPTX
Clustrix Database Percona Ruby on Rails benchmark
PDF
E-Commerce Success is a Balancing Act. Ensure Success with ClustrixDB.
PPTX
Moving an E-commerce Site to AWS. A Case Study
PDF
Achieve new levels of performance for Magento e-commerce sites.
PDF
Db performance optimization with indexing
PDF
Clusterix at VDS 2016
PDF
ZF3 introduction
PDF
Magento 2 Frontend le novità - Meet Magento 2015
PPTX
Presto: Distributed sql query engine
PDF
Introduction to InfluxDB, an Open Source Distributed Time Series Database by ...
ClustrixDB 7.5 Announcement
Clustrix Database Overview
Database Architecture & Scaling Strategies, in the Cloud & on the Rack
Beyond Aurora. Scale-out SQL databases for AWS
Why Traditional Databases Fail so Miserably to Scale with E-Commerce Site Growth
Clustrix Database Percona Ruby on Rails benchmark
E-Commerce Success is a Balancing Act. Ensure Success with ClustrixDB.
Moving an E-commerce Site to AWS. A Case Study
Achieve new levels of performance for Magento e-commerce sites.
Db performance optimization with indexing
Clusterix at VDS 2016
ZF3 introduction
Magento 2 Frontend le novità - Meet Magento 2015
Presto: Distributed sql query engine
Introduction to InfluxDB, an Open Source Distributed Time Series Database by ...
Ad

Similar to Scaling Techniques to Increase Magento Capacity (20)

PDF
Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711
PDF
Scaling MySQL -- Swanseacon.co.uk
PPTX
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?
PDF
Introduction to ClustrixDB
PDF
Scaling MySQL in Amazon Web Services
PPTX
Managing MySQL Scale Through Consolidation
PDF
Benchmark: Beyond Aurora. Scale-out SQL databases for AWS.
PPTX
Continuous Availability and Scale-out for MySQL with ScaleBase Lite & Enterpr...
PPTX
ScaleBase Webinar: Scaling MySQL - Sharding Made Easy!
PDF
Guide to NoSQL with MySQL
PDF
Evolution of DBA in the Cloud Era
PDF
20141206 4 q14_dataconference_i_am_your_db
PPTX
Supersizing Magento
PDF
Databases in the hosted cloud
PPTX
A Year in Google - Percona Live Europe 2018
PDF
Cassandra Core Concepts - Cassandra Day Toronto
PDF
MySQL in the Hosted Cloud
PDF
Magento scalability from the trenches (Meet Magento Sweden 2016)
PDF
MySQL in the Hosted Cloud - Percona Live 2015
PDF
Scalable web architecture
Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711
Scaling MySQL -- Swanseacon.co.uk
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?
Introduction to ClustrixDB
Scaling MySQL in Amazon Web Services
Managing MySQL Scale Through Consolidation
Benchmark: Beyond Aurora. Scale-out SQL databases for AWS.
Continuous Availability and Scale-out for MySQL with ScaleBase Lite & Enterpr...
ScaleBase Webinar: Scaling MySQL - Sharding Made Easy!
Guide to NoSQL with MySQL
Evolution of DBA in the Cloud Era
20141206 4 q14_dataconference_i_am_your_db
Supersizing Magento
Databases in the hosted cloud
A Year in Google - Percona Live Europe 2018
Cassandra Core Concepts - Cassandra Day Toronto
MySQL in the Hosted Cloud
Magento scalability from the trenches (Meet Magento Sweden 2016)
MySQL in the Hosted Cloud - Percona Live 2015
Scalable web architecture

Recently uploaded (20)

PDF
Machine learning based COVID-19 study performance prediction
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
KodekX | Application Modernization Development
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
DOCX
The AUB Centre for AI in Media Proposal.docx
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
Cloud computing and distributed systems.
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPT
Teaching material agriculture food technology
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Modernizing your data center with Dell and AMD
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Electronic commerce courselecture one. Pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Chapter 3 Spatial Domain Image Processing.pdf
Machine learning based COVID-19 study performance prediction
Digital-Transformation-Roadmap-for-Companies.pptx
Unlocking AI with Model Context Protocol (MCP)
Network Security Unit 5.pdf for BCA BBA.
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
KodekX | Application Modernization Development
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
The AUB Centre for AI in Media Proposal.docx
“AI and Expert System Decision Support & Business Intelligence Systems”
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Cloud computing and distributed systems.
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Teaching material agriculture food technology
Per capita expenditure prediction using model stacking based on satellite ima...
Modernizing your data center with Dell and AMD
Advanced methodologies resolving dimensionality complications for autism neur...
Electronic commerce courselecture one. Pdf
Encapsulation_ Review paper, used for researhc scholars
Chapter 3 Spatial Domain Image Processing.pdf

Scaling Techniques to Increase Magento Capacity

  • 1. © 2015 CLUSTRIX The First Scale-out SQL Database Engineered for Today’s Cloud 1 Scaling Techniques to Increase Magento Capacity Or How to Get Ready for the Holiday and Cope with Fast Growth Kevin Bortnick, Magento Solutions Architect at Clustrix
  • 2. PROPRIETARY AND CONFIDENTIAL2 • Kevin is a Certified Magento Developer. He has built and maintained some of the largest and most complex Magento-powered E-commerce sites. • Kevin lives in Las Vegas and is currently the Magento Solutions Architect for Clustrix.
  • 3. As a Magento Architect — I think about the future  How easy is it to maintain?  Can someone else support it?  Can it handle growth?  Can it be used for something else?  When is it going to break? PROPRIETARY AND CONFIDENTIAL3
  • 4. Symptoms of a Problem? • Increased page load time • • Spikes and Errors • • Site Crashes • • Support Tickets PROPRIETARY AND CONFIDENTIAL4
  • 5. If you are seeing issues… • Look in the obvious places – Scale your Magento web nodes – Add Memcached or Redis – Add Varnish • If everything else is tuned right, the database becomes the next bottleneck PROPRIETARY AND CONFIDENTIAL5
  • 6. Ways of Extending MySQL PROPRIETARY AND CONFIDENTIAL6 Faster Hardware? Read Slaves? Multi Master? Partitioning? Percona? NoSQL? Clustrix?
  • 7. Report Card Grading 7 Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads ✔ Scales Writes ✔ No Application Changes No Single Point of Failure
  • 8. Percona • A drop-in replacement for MySQL • Pros: – Easy to set up and use – Retains consistent performance at high resource utilization • Cons: – Still has MySQL's architecture limitations – No high availability or disaster recovery 8 Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads ✔ Scales Writes Limited No Application Changes ✔ No Single Point of Failure
  • 9. Faster Hardware • Pros: – Immediate performance improvements • Cons: – Limit to how large you can go – High-end hardware can get very expensive, especially when you include backup servers – Excess hardware during off peak season 9 Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads Limited Scales Writes Limited No Application Changes ✔ No Single Point of Failure
  • 10. Master with Read Slaves • Pros: – Easy to do – Magento has this feature built in • Cons: – Does not help solve write checkout bottlenecks – Eventual consistency 10 Master SlaveSlave Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads ✔ Scales Writes No Application Changes ✔ No Single Point of Failure
  • 11. Master/Master, Store/Admin • Pros: – Works well if you do a lot of updates – Helps for 24 hour stores • Cons: – Have to accommodate edge cases – DBA needs to monitor for replication issues – Won't fix front-end only bottlenecks 11 Store SlaveSlave Admin Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads ✔ Scales Writes No Application Changes No Single Point of Failure
  • 12. True Multi Master • Pros – Can deliver better overall performance • Cons – Application must keep track of orders and inventory – Latency can cause sync issues – Expensive to develop and maintain – Complexity increases and stability decreases 12 1 1b1a 2 2b2a Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads ✔ Scales Writes ✔ No Application Changes No Single Point of Failure
  • 13. Partitioning (Magento 2 feature CQRS) • Pros – Able to distribute load • Cons – Can’t join between partitioned segments – Amount of tables able to be partitioned is limited – Harder to maintain—need to track configurations 13 Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads ✔ Scales Writes Limited No Application Changes Limited No Single Point of Failure
  • 14. NoSQL • Pros: – Runs very fast in non-ACID mode • Cons: – Gains speed from short-cutting of ACID – Commits before writing to disk – No cross-document transactions – NoSQL requires significant application development to swap-out MySQL 14 ACID = Transaction and Data Safety Report Card MySQL Compatible Improves Performance Scales Reads In non- ACID mode Scales Writes ✔ No Application Changes Limited No Single Point of Failure Don’t Drop ACID
  • 15. ClustrixDB 15 • Pros – Drop-In Replacement for MySQL – Scales READS and WRITES – Distributed – Shared Nothing – Data Redundancy – Built in high availability solution – Low cost disaster recovery – Elastic in the cloud and data center – Seasonal Flex, Self-Managing Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads ✔ Scales Writes ✔ No Application Changes ✔ No Single Point of Failure ✔
  • 18. Flexing up for Seasonal Demand
  • 20. Wrap Up – Think About the Future  How easy is it to maintain  Can someone else support it  Can it handle growth  Can it be used for something else  When is it going to break 20 Report Card MySQL Compatible ✔ Improves Performance ✔ Scales Reads ✔ Scales Writes ✔ No Application Changes ✔ No Single Point of Failure ✔
  • 23. ClustrixDB Key Differentiators Automatic, 100% fault tolerance Availability No single point of failure Battle-tested performance Flex up and down, in minutes Massive, linear scalability Capacity Extreme concurrency Productivity Eliminates re-architecting the database Plug-in MySQL compatibility Self-managing operation PROPRIETARY AND CONFIDENTIAL23 Engineered for any cloud One-click installation Cloud Seamless scale-out

Editor's Notes

  • #14: Ecommerce success creates site failure Holiday Flash sale You will hit something Ways to fix your upcoming capacity problem
  • #24: Cloud Designed for seamless installation and scale-out on any cloud-based infrastructure Capacity Flex up and down, in minutes - If you need more capacity or performance, just connect and go. Massive, linear scalability - Readily handles massive volumes of customers, carts, orders, products, and business performance reporting Extreme concurrency - Manages millions of concurrent actions without impacting site response time Availability Automatic, 100% fault tolerance – High availability architecture to meet always-on demands of business-critical operations No single point of failure – No impact from hardware outages; zero downtime Battle-tested performance – Proven rock solid performance at some the world’s fastest-growing companies. E.g., maintained superior service levels during 600% Cyber Monday sales spike (Choxi) Productivity Plug-in MySQL compatibility - Deploy in days, with few or no code changes. ClustrixDB is compatible with any application that uses MySQL, including the popular Magento platform for e-commerce and internally developed solutions. Eliminates re-architecting the database - Does away with complicated scaling strategies like sharding and replication, which are expensive, labor-intensive, and ultimately unsustainable Self-managing operation – Virtually eliminates DBA operations tasks because the management is built into the database itself