SlideShare a Scribd company logo
WEST Interactive’s
Deployment Approach and DevOps Practices
— WSO2 Customer Webinar —
Preston Gross-Rhode - Systems Engineer, West Corporation
Chathura Kulasinghe - Senior Solutions Engineer, WSO2
Agenda
● WEST corporation
● The deployment
● Production hardening
● Scalability, Availability and Disaster Recovery
● Lifecycle management, versioning and artifact distribution
● DevOps automation
● Troubleshooting and Debugging the production system
● Enhancements planned
WSO2 Customer Webinar: WEST Interactive’s Deployment Approach and DevOps Practices
The need of WEST Interactive
To build a,
○ Service Oriented,
○ Multi-channel and Multi-client Platform
○ which leverages common Protocols,
○ Languages and Interfaces
web, mobile, sms, ivr, b2b
The Design of the solution
WSO2
API Manager
3rd Party
System Units
WSO2
Message Broker
WEST
System Units
WSO2
Enterprise Service Bus
WSO2
Data Services Server
WSO2
Application Server
WSO2
Identity Server
Deployment : Clusters and the deployment topology
LB
3rd Party
System Units3rd Party
System Units3rd Party
System Units
DataCenter-01DataCenter-02
WEST Interactive 3rd PartiesClients
Production Hardening - Deployment Model
The deployment model chosen by WEST interactive,
• Was not necessarily based on WSO2.
• Deployed on own VMs on-premise,
• Built some system development prototyping environments on AWS.
Because, WSO2 products
• Are JVM based,
• Support many operating systems,
• and many Infrastructure
Production Hardening - VM based Tuning - WEST
Hardware specification of a particular VM
• Quad Core
• 16 GB of RAM
• 45 GB of hard disk space
With JVM Based tuning as,
• -Xms8g -Xmx8g -XX:MaxPermSize=2g
Production Hardening - VM based Tuning vs WSO2 Spec
Hardware specification of a particular VM
• Quad Core
• 2 Cores
• 16 GB of RAM
• 4 GB of RAM
• 45 GB of hard disk space
• 10 GB of hard disk space
With JVM Based tuning as,
• -Xms8g -Xmx8g -XX:MaxPermSize=2g
• -Xms2g -Xmx2g -XX:MaxPermSize=1g
VM (Virtual Machine)
CPU 2
CPU 1
CPU 1
2 GB RAM2 GB RAM
OS
OSFiles Space
JDK
WSO2Binary
{ZIParchiveextracted}
Carbon/JVM
instance
Production Hardening - Performance Statistics
Example:
Records against a Cluster
of WSO2 Enterprise Service Bus
with 4 instances
Transactions Per Hour (TPH) Transactions Per Second (TPs)
Average load 660,120 184
Historical spikes 2,520,000 700
Load tests 7,200,000 2000
WSO2 ESB
η
Scalability, Availability and Disaster Recovery - Performance vs Capacity
The general equation is,
n = ⌈{ η + η (30/100) } / ω⌉
In this deployment n = 4,
4 = ⌈{ η + η (30/100) } / ω⌉
If ESB capacity = 2000 TPS,
4 = ⌈{ η + η (30/100) } / 2000⌉
Therefore,
η < 6154
WSO2 ESB
η
Scalability, Availability and Disaster Recovery - The real capacity
η < 6154 TPS
Therefore,
• Occasional peak upto 6154 TPS
Targeted,
• 6154/2 TPS ( 3077 TPS )
• for the entire setup
• which is the capacity,
• of 2 ESB instances
• considering HA
WSO2 ESB
WSO2 ESB
6154/2 TPS
Data Center - 01
Data Center - 02
Scalability, Availability and Disaster Recovery : 2 Data Centers
LB
3rd Party
System Units3rd Party
System Units3rd Party
System Units
DataCenter-01DataCenter-02
WEST Interactive 3rd PartiesClients
Scalability, Availability and Disaster Recovery
Our design of the solution attempted to
• drive state below the SOA framework,
• as to steer heavily towards linear scaling
since true clustered communication between the units is not required.
This applies to
• all units apart from Message Broker
• those require Clustering, Monitoring
• and Client-side load-balancing (as a critical requirement).
LCM, Versioning and Artifacts distribution
Systems
Development
Application
Development
Quality
Assurance
Pre-prod Production
Puppet
Chef
Perforce
SVN
Deployment ArtifactsConfiguration Artifacts
Automation
Automation
DevOps and Automation
• Current puppet implementation revolves around the automated
phone systems platform
• In near future, WSO2 platform will be moved into this
infrastructure
• A bonus of the WSO2 product slate is that configuration and
settings are similar across products
• This simplifies this effort.
DevOps and Automation : The Typical WSO2 Product
Carbon Kernel
Features
Collection
Carbon Kernel
Identity
Management
Features
Carbon Kernel
Integration
Features
Carbon Kernel
Application
Server
Features
Identity Server ESB Application Server
Carbon Kernel
Clustering
Server-framework Registry
Logging Data-sources Transports
User-management Multi-Tenancy
Admin-console Feature-manager
Dep-sync
DevOps and Automation : Configuration Files and The Kernel
Systems
Development
Application
Development
Quality
Assurance
Pre-prod Production
Puppet
Chef
Perforce
SVN
Carbon Kernel
Configuration files
Configuration
file templates
Configuration properties
of different servers (key-value)
Troubleshoot and Debug the production system
• A large percentage of services revolve around the ESB
• WSO2 ESB is used to handle errors from other systems
gracefully, which would otherwise create negative
consequences.
• This follows general Integration Error Handling patterns
• Explained comprehensively at http://goo.gl/BzL8L9
Troubleshoot and Debug the production system
• Otherwise the errors are debugged using the WIRE and DEBUG
logs …
• and dynamic level logging within the services as well as packet
captures as needed
• We have employed Bamboo automated Testing suite with
SOAPUI test cases …
• to run every night against all known testable services,
(currently around 140 services)
Enhancements planned
• Integrate WSO2 Governance Registry …
• into WEST Interactive’s devops effort …
• along with the other devops tools.
Systems
Development
Application
Development
Quality
Assurance
Pre-prod Production
Puppet
Chef
Perforce
SVN
WSO2 Governance Registry
{ QA }
{ Pre-prod }
{ Production }
Enhancements planned
• Extend the Identity Server installation for many new user
management tasks.
• Interested in what the new carbon core will bring to the table in
terms of performance and capability.
CONTACT US !

More Related Content

PPTX
Deploying WSO2 Middleware on Kubernetes
PDF
WSO2 Message Broker - Product Overview
PDF
How Clarifai uses NATS and Kubernetes for Machine Learning
PPTX
Pub/Sub Messaging
PDF
Implementing Microservices with NATS
PDF
Sharing is Caring: Toward Creating Self-tuning Multi-tenant Kafka (Anna Povzn...
PPTX
Kubernetes #2 monitoring
PDF
KafkaConsumer - Decoupling Consumption and Processing for Better Resource Uti...
Deploying WSO2 Middleware on Kubernetes
WSO2 Message Broker - Product Overview
How Clarifai uses NATS and Kubernetes for Machine Learning
Pub/Sub Messaging
Implementing Microservices with NATS
Sharing is Caring: Toward Creating Self-tuning Multi-tenant Kafka (Anna Povzn...
Kubernetes #2 monitoring
KafkaConsumer - Decoupling Consumption and Processing for Better Resource Uti...

What's hot (20)

PPTX
RedisConf18 - Video Experience Operational Insights in Real Time.
PDF
Kafka summit SF 2019 - the art of the event-streaming app
PDF
OpenStack Networking LBaaS
PDF
Social network with microservices
PPTX
State of the Container Ecosystem
PPTX
Building an Event-oriented Data Platform with Kafka, Eric Sammer
PDF
Microservice - Up to 500k CCU
PPTX
Comparing CoAP vs MQTT
PDF
Enhanced Developer Experience with WSO2 Enterprise Service Bus Tooling
PDF
Getting up to Speed with MirrorMaker 2 (Mickael Maison, IBM & Ryanne Dolan) K...
PPTX
GWAVACon - Exchange Sizing (English)
PPTX
Powering Microservices with Docker, Kubernetes, Kafka, and MongoDB
PDF
How THINQ runs both transactions and analytics at scale
PDF
How to create a useful my sql bug report fosdem 2019
ODP
Sdc challenges-2012
PDF
Cloud OS development
PDF
REST vs. Messaging For Microservices
PPTX
The Rise of Microservices - Containers and Orchestration
PDF
SQL, NoSQL, NewSQL? What's a developer to do?
PDF
Microservices, Monoliths, SOA and How We Got Here
RedisConf18 - Video Experience Operational Insights in Real Time.
Kafka summit SF 2019 - the art of the event-streaming app
OpenStack Networking LBaaS
Social network with microservices
State of the Container Ecosystem
Building an Event-oriented Data Platform with Kafka, Eric Sammer
Microservice - Up to 500k CCU
Comparing CoAP vs MQTT
Enhanced Developer Experience with WSO2 Enterprise Service Bus Tooling
Getting up to Speed with MirrorMaker 2 (Mickael Maison, IBM & Ryanne Dolan) K...
GWAVACon - Exchange Sizing (English)
Powering Microservices with Docker, Kubernetes, Kafka, and MongoDB
How THINQ runs both transactions and analytics at scale
How to create a useful my sql bug report fosdem 2019
Sdc challenges-2012
Cloud OS development
REST vs. Messaging For Microservices
The Rise of Microservices - Containers and Orchestration
SQL, NoSQL, NewSQL? What's a developer to do?
Microservices, Monoliths, SOA and How We Got Here
Ad

Similar to WSO2 Customer Webinar: WEST Interactive’s Deployment Approach and DevOps Practices (20)

PDF
ESB Evaluation Framework
PDF
WSO2 ESB Webinar 01 Sept 2009
PDF
WSO2Con ASIA 2016: Deployment Patterns and Capacity Planning
PDF
Introducing The WSO2 Platform
PDF
Enterprise Integration with the WSO2 ESB
PDF
WSO2 Enterprise Integrator 101
PPT
Webbinar slides
PPTX
Wso2 tutorial
PPT
WSO2 in Action
PDF
Pilot Study - WSO2 Enterprise Integrator v6.1.1
PPTX
2014 q3-platform-update-v1.06.johnmathon
PDF
WSO2Con ASIA 2016: WSO2 DevOps: How to Deploy, Manage, Administer and Monitor...
PPTX
High Volume Web API Management with the WSO2 ESB
PDF
WSO2Con USA 2015: Deployment Patterns and Capacity Planning
PDF
WSO2Con USA 2017: Implement an Effective Digital Platform Using WSO2 Integration
PDF
WSO2 Enterprise Integrator 101
PPTX
High Volume Web API Management with WSO2 ESB
PDF
Improved Business Availability and Scalability with WSO2 ESB 4.9’s New Coordi...
ESB Evaluation Framework
WSO2 ESB Webinar 01 Sept 2009
WSO2Con ASIA 2016: Deployment Patterns and Capacity Planning
Introducing The WSO2 Platform
Enterprise Integration with the WSO2 ESB
WSO2 Enterprise Integrator 101
Webbinar slides
Wso2 tutorial
WSO2 in Action
Pilot Study - WSO2 Enterprise Integrator v6.1.1
2014 q3-platform-update-v1.06.johnmathon
WSO2Con ASIA 2016: WSO2 DevOps: How to Deploy, Manage, Administer and Monitor...
High Volume Web API Management with the WSO2 ESB
WSO2Con USA 2015: Deployment Patterns and Capacity Planning
WSO2Con USA 2017: Implement an Effective Digital Platform Using WSO2 Integration
WSO2 Enterprise Integrator 101
High Volume Web API Management with WSO2 ESB
Improved Business Availability and Scalability with WSO2 ESB 4.9’s New Coordi...
Ad

More from WSO2 (20)

PDF
Demystifying CMS-0057-F - Compliance Made Seamless with WSO2
PDF
Quantum Threats Are Closer Than You Think – Act Now to Stay Secure
PDF
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
PDF
Application Modernization with Choreo - The AI-Native Internal Developer Plat...
PDF
Build Smarter, Deliver Faster with Choreo - An AI Native Internal Developer P...
PDF
Platformless Modernization with Choreo.pdf
PDF
Application Modernization with Choreo for the BFSI Sector
PDF
Choreo - The AI-Native Internal Developer Platform as a Service: Overview
PDF
[Roundtable] Choreo - The AI-Native Internal Developer Platform as a Service
PPTX
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
PPTX
WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...
PPTX
WSO2Con 2025 - Building Secure Customer Experience Apps
PPTX
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
PPTX
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
PPTX
WSO2Con 2025 - Unified Management of Ingress and Egress Across Multiple API G...
PPTX
WSO2Con 2025 - How an Internal Developer Platform Lets Developers Focus on Code
PPTX
WSO2Con 2025 - Architecting Cloud-Native Applications
PDF
Mastering Intelligent Digital Experiences with Platformless Modernization
PDF
Accelerate Enterprise Software Engineering with Platformless
PDF
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
Demystifying CMS-0057-F - Compliance Made Seamless with WSO2
Quantum Threats Are Closer Than You Think – Act Now to Stay Secure
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
Application Modernization with Choreo - The AI-Native Internal Developer Plat...
Build Smarter, Deliver Faster with Choreo - An AI Native Internal Developer P...
Platformless Modernization with Choreo.pdf
Application Modernization with Choreo for the BFSI Sector
Choreo - The AI-Native Internal Developer Platform as a Service: Overview
[Roundtable] Choreo - The AI-Native Internal Developer Platform as a Service
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
WSO2Con 2025 - Building Secure Business Customer and Partner Experience (B2B)...
WSO2Con 2025 - Building Secure Customer Experience Apps
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
WSO2Con 2025 - AI-Driven API Design, Development, and Consumption with Enhanc...
WSO2Con 2025 - Unified Management of Ingress and Egress Across Multiple API G...
WSO2Con 2025 - How an Internal Developer Platform Lets Developers Focus on Code
WSO2Con 2025 - Architecting Cloud-Native Applications
Mastering Intelligent Digital Experiences with Platformless Modernization
Accelerate Enterprise Software Engineering with Platformless
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

Recently uploaded (20)

PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Approach and Philosophy of On baking technology
PPTX
Spectroscopy.pptx food analysis technology
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Electronic commerce courselecture one. Pdf
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
Big Data Technologies - Introduction.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Chapter 3 Spatial Domain Image Processing.pdf
Unlocking AI with Model Context Protocol (MCP)
Encapsulation_ Review paper, used for researhc scholars
Advanced methodologies resolving dimensionality complications for autism neur...
Digital-Transformation-Roadmap-for-Companies.pptx
MYSQL Presentation for SQL database connectivity
Mobile App Security Testing_ A Comprehensive Guide.pdf
MIND Revenue Release Quarter 2 2025 Press Release
Network Security Unit 5.pdf for BCA BBA.
Approach and Philosophy of On baking technology
Spectroscopy.pptx food analysis technology
Diabetes mellitus diagnosis method based random forest with bat algorithm
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Programs and apps: productivity, graphics, security and other tools
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Electronic commerce courselecture one. Pdf
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Big Data Technologies - Introduction.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Chapter 3 Spatial Domain Image Processing.pdf

WSO2 Customer Webinar: WEST Interactive’s Deployment Approach and DevOps Practices

  • 1. WEST Interactive’s Deployment Approach and DevOps Practices — WSO2 Customer Webinar — Preston Gross-Rhode - Systems Engineer, West Corporation Chathura Kulasinghe - Senior Solutions Engineer, WSO2
  • 2. Agenda ● WEST corporation ● The deployment ● Production hardening ● Scalability, Availability and Disaster Recovery ● Lifecycle management, versioning and artifact distribution ● DevOps automation ● Troubleshooting and Debugging the production system ● Enhancements planned
  • 4. The need of WEST Interactive To build a, ○ Service Oriented, ○ Multi-channel and Multi-client Platform ○ which leverages common Protocols, ○ Languages and Interfaces web, mobile, sms, ivr, b2b
  • 5. The Design of the solution WSO2 API Manager 3rd Party System Units WSO2 Message Broker WEST System Units WSO2 Enterprise Service Bus WSO2 Data Services Server WSO2 Application Server WSO2 Identity Server
  • 6. Deployment : Clusters and the deployment topology LB 3rd Party System Units3rd Party System Units3rd Party System Units DataCenter-01DataCenter-02 WEST Interactive 3rd PartiesClients
  • 7. Production Hardening - Deployment Model The deployment model chosen by WEST interactive, • Was not necessarily based on WSO2. • Deployed on own VMs on-premise, • Built some system development prototyping environments on AWS. Because, WSO2 products • Are JVM based, • Support many operating systems, • and many Infrastructure
  • 8. Production Hardening - VM based Tuning - WEST Hardware specification of a particular VM • Quad Core • 16 GB of RAM • 45 GB of hard disk space With JVM Based tuning as, • -Xms8g -Xmx8g -XX:MaxPermSize=2g
  • 9. Production Hardening - VM based Tuning vs WSO2 Spec Hardware specification of a particular VM • Quad Core • 2 Cores • 16 GB of RAM • 4 GB of RAM • 45 GB of hard disk space • 10 GB of hard disk space With JVM Based tuning as, • -Xms8g -Xmx8g -XX:MaxPermSize=2g • -Xms2g -Xmx2g -XX:MaxPermSize=1g VM (Virtual Machine) CPU 2 CPU 1 CPU 1 2 GB RAM2 GB RAM OS OSFiles Space JDK WSO2Binary {ZIParchiveextracted} Carbon/JVM instance
  • 10. Production Hardening - Performance Statistics Example: Records against a Cluster of WSO2 Enterprise Service Bus with 4 instances Transactions Per Hour (TPH) Transactions Per Second (TPs) Average load 660,120 184 Historical spikes 2,520,000 700 Load tests 7,200,000 2000 WSO2 ESB η
  • 11. Scalability, Availability and Disaster Recovery - Performance vs Capacity The general equation is, n = ⌈{ η + η (30/100) } / ω⌉ In this deployment n = 4, 4 = ⌈{ η + η (30/100) } / ω⌉ If ESB capacity = 2000 TPS, 4 = ⌈{ η + η (30/100) } / 2000⌉ Therefore, η < 6154 WSO2 ESB η
  • 12. Scalability, Availability and Disaster Recovery - The real capacity η < 6154 TPS Therefore, • Occasional peak upto 6154 TPS Targeted, • 6154/2 TPS ( 3077 TPS ) • for the entire setup • which is the capacity, • of 2 ESB instances • considering HA WSO2 ESB WSO2 ESB 6154/2 TPS Data Center - 01 Data Center - 02
  • 13. Scalability, Availability and Disaster Recovery : 2 Data Centers LB 3rd Party System Units3rd Party System Units3rd Party System Units DataCenter-01DataCenter-02 WEST Interactive 3rd PartiesClients
  • 14. Scalability, Availability and Disaster Recovery Our design of the solution attempted to • drive state below the SOA framework, • as to steer heavily towards linear scaling since true clustered communication between the units is not required. This applies to • all units apart from Message Broker • those require Clustering, Monitoring • and Client-side load-balancing (as a critical requirement).
  • 15. LCM, Versioning and Artifacts distribution Systems Development Application Development Quality Assurance Pre-prod Production Puppet Chef Perforce SVN Deployment ArtifactsConfiguration Artifacts Automation Automation
  • 16. DevOps and Automation • Current puppet implementation revolves around the automated phone systems platform • In near future, WSO2 platform will be moved into this infrastructure • A bonus of the WSO2 product slate is that configuration and settings are similar across products • This simplifies this effort.
  • 17. DevOps and Automation : The Typical WSO2 Product Carbon Kernel Features Collection Carbon Kernel Identity Management Features Carbon Kernel Integration Features Carbon Kernel Application Server Features Identity Server ESB Application Server Carbon Kernel Clustering Server-framework Registry Logging Data-sources Transports User-management Multi-Tenancy Admin-console Feature-manager Dep-sync
  • 18. DevOps and Automation : Configuration Files and The Kernel Systems Development Application Development Quality Assurance Pre-prod Production Puppet Chef Perforce SVN Carbon Kernel Configuration files Configuration file templates Configuration properties of different servers (key-value)
  • 19. Troubleshoot and Debug the production system • A large percentage of services revolve around the ESB • WSO2 ESB is used to handle errors from other systems gracefully, which would otherwise create negative consequences. • This follows general Integration Error Handling patterns • Explained comprehensively at http://goo.gl/BzL8L9
  • 20. Troubleshoot and Debug the production system • Otherwise the errors are debugged using the WIRE and DEBUG logs … • and dynamic level logging within the services as well as packet captures as needed • We have employed Bamboo automated Testing suite with SOAPUI test cases … • to run every night against all known testable services, (currently around 140 services)
  • 21. Enhancements planned • Integrate WSO2 Governance Registry … • into WEST Interactive’s devops effort … • along with the other devops tools. Systems Development Application Development Quality Assurance Pre-prod Production Puppet Chef Perforce SVN WSO2 Governance Registry { QA } { Pre-prod } { Production }
  • 22. Enhancements planned • Extend the Identity Server installation for many new user management tasks. • Interested in what the new carbon core will bring to the table in terms of performance and capability.