SlideShare a Scribd company logo
Confidential │ ©2020 VMware, Inc.
Elastic Load Balancing
Powered by Intel Xeon
Scalable Processors
VMware NSX Advanced Load
Balancer (by Avi Networks)
Rahul Phadke (VMware)
Shweta Jain (Intel)
05/20/2020
Confidential │ ©2020 VMware, Inc. 22
How are applications deployed using legacy load balancers
Active
15%
Standby
0%
Confidential │ ©2020 VMware, Inc. 3
Custom built hardware
Active-Standby pairs
Independently managed
Static capacity
Very expensive
Underutilization of capacity
Wastage of power and datacenter space
Complex operations
Manually provision capacity for growth
How are applications deployed –
Hardware load balancers
Challenges with legacy approach
How are applications traditionally deployed
What are the problems with this approach
Confidential │ ©2020 VMware, Inc. 4
Advantages of Intel hardware
Intel’s powerful Xeon Scalable Processors are a key enabler for modern infrastructure
Simplify datacenter
design
High end Compute
and Network
Highly cost efficient
Confidential │ ©2020 VMware, Inc. 5
Intel Networking Portfolio for Cloud Scale
Intel® Architecture
Intel® Xeon® Scalable Processors Intel® Ethernet Network Adapters
Intel® Trusted
Execution
Technology
Intel® Advanced
Encryption
Standard New
Instructions
Intel® QuickAssist
Technology
Intel® Data Plane
Development Kit
Intel® Hyperscan
Intel®
TXT
Intel® AES-NI
All Intel® product plans and roadmaps are subject to change without notice.
Confidential │ ©2020 VMware, Inc. 6
To Modern Distributed Architecture
Centralized Policies and Full Lifecycle Management
App Services
Control Plane
Data Plane
Software Load Balancer Intelligent WAF Container Ingress
Avi Controller
Bare Metal Virtualized Containers
ON PREMISES PUBLIC CLOUD
SEPARATE CONTROL &
DATA PLANE
ELASTICITY
Application Services Fabric
MULTI-CLOUD
ANALYTICS AUTOMATION
Confidential │ ©2020 VMware, Inc. 7
Consistent L4-L7 enterprise-grade app services across multi-cloud environments
Avi Networks (now VMware NSX Advanced Load Balancer)
App Analytics / Insights
Container Ingress Services
DNS and IP Address
Management (IPAM)
Web Application Firewall
(WAF) and App Security
Global Server Load
Balancing (GSLB)
Enterprise-grade Load
Balancing
NSX
Horizon(VDI)
vSphere/vCenter
Deliver
Any App
on
Any Cloud
with
One Platform
VCF
VMC
Tanzu
vRO/vRA
Confidential │ ©2020 VMware, Inc. 8
Simplify troubleshooting, eliminate TCP Dumps
Analytics and App Insights
Eliminate finger-pointing
Troubleshoot app performance, security
and end-user issues in minutes
Bare Metal Virtualized Containers
Avi Controller
• Connection log analytics
• Security insights: DDoS
• App performance metrics
• End user experience
End-to-End Timing
Total Response Time
End User
Client
RTT
Server
RTT
App
Response
Load
Balancer Server App
Confidential │ ©2020 VMware, Inc. 9
Built-in ecosystem integration/cloud connectors
Automation / Self-Service
Bare Metal Virtualized Containers
Avi Controller
Operational Automation
vRO/vRA
Cisco
CloudCenter
Infrastructure Automation
Confidential │ ©2020 VMware, Inc. 10
Software defined - Fully orchestrated
Active-Active design
Centrally managed
Dynamic capacity management
Automated - Rapid provisioning
0 capacity wastage – Lower TCO
Ease of life cycle management
Self-healing elastic fabric
How are applications deployed – Elastic
load balancing fabric
Benefits with the modern approach
How does Intel + Avi Networks solve the problem
Confidential │ ©2020 VMware, Inc. 11
Going above and beyond - Powered by Intel
Multi-Cloud Analytics and app
insights
Automation and
self-service
Confidential │ ©2020 VMware, Inc. 12
Scale vertically with more CPUs or horizontally with more Service Engines
Elastic Autoscaling
2x 1-core SEs
Nx 1-core SEs
1 core
2,500 SSL TPS
5,000 SSL TPS
1M SSL TPS
Scale to millions of
TPS or hundreds of
GBs of throughput
Confidential │ ©2020 VMware, Inc. 13
“Application fabric
elasticity without loss
of capacity with
linear scale from Intel
2nd –Generation
Xeon scalable
processor- The
equivalent
performance on high-
end proprietary
hardware load
balancers would cost
hundreds of
thousands of
dollars”.
Amit Pandey, ex-
CEO of Avi, Head of
NSX Services,
VMware
The Avi Service Engines run a purpose-built software stack that uses high performance DPDK libraries for fast packet processing, bypasses the Linux kernel stack (Linux kernel stack
performance limitations8 are well known) and fully utilizes AES-NI and other crypto special instructions on Xeon processor to provide the highest possible performance on any commodity
server or VM instance.
Record Performance of VMware (Avi) Load Balancer on 2nd Gen Intel Xeon® Scalable Server
Fabric elasticity without loss of capacity with linear scale!
- Each Service
Engine has 9 proxy
cores.
- Detailed test
configuration is
listed in the back up
slide
Disclaimer: Performance results are based on testing as of January 2020 and may not reflect all publicly available security updates. See configuration disclosure for details. No product can be
absolutely secure. Results have been estimated or simulated using internal Intel analysis or architecture simulation or modeling,and provided to you for informational purposes. Any
differences in your system hardware, software or configuration may affect your actual performance.
Confidential │ ©2020 VMware, Inc. 14
Third-party load balancing performance benchmark
Principled Technologies White Paper
Showcased
1M+ SSL TPS
application
performance
delivered with
the power of
joint Intel + Avi
solution
15Confidential │ ©2020 VMware, Inc.
How to achieve any scale on
any app on any cloud
• Rich application insights enable automation
• Elastic autoscaling for Avi SEs and app servers
• Seamless scale out or in based on traffic
Confidential │ ©2020 VMware, Inc. 16
How to Engage
Sep 1, 2019
VMware Price List
Oct 1, 2019
Partner Price List
Nov 1, 2019
Partner Central
LEARN TRY TRAIN
avinetworks.com/ docs |
webinars
vmware.com/go/try-avi-
networks
avinetworks.com/wo
rkshops
Confidential │ ©2020 VMware, Inc.
Thank You

More Related Content

PPTX
Securing Web Applications with Deep Automation with VMware NSX Advanced Load ...
PPTX
Advanced Web Application Security with an Intelligent WAF
PPTX
Multi Cloud Load balancing 101 and Hands-on Lab
PPTX
Avi workshop-101
PDF
Working From Anywhere​ with​ Advanced Load Balancing​ and ​ VMware Horizon VDI
PPTX
Avi v20.1 — What’s New in Scalable, Multi-Cloud Load Balancing
PDF
7 Requirements for Modern Load Balancers
PPTX
Multi-Cloud Load Balancing 101 and Hands-On Lab
Securing Web Applications with Deep Automation with VMware NSX Advanced Load ...
Advanced Web Application Security with an Intelligent WAF
Multi Cloud Load balancing 101 and Hands-on Lab
Avi workshop-101
Working From Anywhere​ with​ Advanced Load Balancing​ and ​ VMware Horizon VDI
Avi v20.1 — What’s New in Scalable, Multi-Cloud Load Balancing
7 Requirements for Modern Load Balancers
Multi-Cloud Load Balancing 101 and Hands-On Lab

What's hot (20)

PPTX
Multi-Cloud Load Balancing – Separating Fact from Fiction
PPTX
Deploying Elastic, Self-Service Load Balancing for VMware NSX-T
PPTX
Multi Cloud Load Balancing 101 and Hands On Lab
PPTX
Enabling Remote Employees with Horizon VDI and Avi Networks
PPTX
Delivering Applications with Full Lifecycle Automation in a Multi-Cloud World
PPTX
Enterprise-Grade Load Balancing for VMware Cloud on AWS (VMC)
PDF
7 Virtues of a Next-gen ADC
PDF
Bringing SaaS Simplicity to Proactive Support & Live Threat Updates
PPTX
What's New VMware NSX Advanced Load Balancer (Avi Networks)
PPTX
State of Load Balancing 2020
PPTX
Industry's Best Multi Cloud Application Services from Avi Networks, Now part ...
PPTX
How Multi-Cloud Load Balancing Automates Application Delivery and Drives Oper...
PPTX
How to Eliminate Load Balancer Upgrade Disruptions
PPTX
Accelerating Public Cloud Migration with Multi-Cloud Load Balancing
PPTX
Deep Dive on GSLB with VMware NSX Advanced Load Balancer (Avi Networks)
PPTX
Prevent threats With Analytics Driven Web Application Firewall
PPTX
Multi-Cloud Load Balancing and Application Services
PDF
Inteligentní řízení WAN konektivity
PPTX
Deep Automation and ML-Driven Analytics for Application Services
PPTX
Design Best Practices for High Availability in Load Balancing
Multi-Cloud Load Balancing – Separating Fact from Fiction
Deploying Elastic, Self-Service Load Balancing for VMware NSX-T
Multi Cloud Load Balancing 101 and Hands On Lab
Enabling Remote Employees with Horizon VDI and Avi Networks
Delivering Applications with Full Lifecycle Automation in a Multi-Cloud World
Enterprise-Grade Load Balancing for VMware Cloud on AWS (VMC)
7 Virtues of a Next-gen ADC
Bringing SaaS Simplicity to Proactive Support & Live Threat Updates
What's New VMware NSX Advanced Load Balancer (Avi Networks)
State of Load Balancing 2020
Industry's Best Multi Cloud Application Services from Avi Networks, Now part ...
How Multi-Cloud Load Balancing Automates Application Delivery and Drives Oper...
How to Eliminate Load Balancer Upgrade Disruptions
Accelerating Public Cloud Migration with Multi-Cloud Load Balancing
Deep Dive on GSLB with VMware NSX Advanced Load Balancer (Avi Networks)
Prevent threats With Analytics Driven Web Application Firewall
Multi-Cloud Load Balancing and Application Services
Inteligentní řízení WAN konektivity
Deep Automation and ML-Driven Analytics for Application Services
Design Best Practices for High Availability in Load Balancing
Ad

Similar to Deliver Modern Applications with an Elastic Load Balancing Fabric Powered by Intel Xeon Scalable Processors (20)

PDF
Deploying Elastic Self-Service Load Balancing
PPT
Virtulaisation
PDF
VMware Tanzu Portfolio Guide 2023 Shouheng Ting, Solution Engineer
PDF
08 sdn system intelligence short public beijing sdn conference - 130828
PPT
IBM Software Defined Networking for Virtual Environments (IBM SDN VE)
PPTX
VMware Tanzu Kubernetes Connect
PPTX
Cloud_controllers_public_webinar_aug31_v1.pptx
PDF
VMware NSX for vSphere - Intro and use cases
PPTX
NSX_Advanced_Load_Balancer_Solution_with_Oracle.pptx
PDF
Presentation cloud orchestration
PDF
Microsoft System Center 2012 R2 Overview - Presented by Atidan
PDF
VMworld 2013: Moving Beyond Infrastructure: Meeting Demands on App Lifecycle ...
PPT
Capito Ardoe House VMWare Presentation
PDF
VMworld 2014: Virtualization 101
PPT
VMware 2009
PDF
End to End Application Visibility and Troubleshooting Across the Virtual Clou...
PDF
Data Driven Decisions in DevOps
PPTX
VMworld 2015: Introducing Application Self service with Networking and Security
PPTX
VM Farms Thrive with Dedicated IP Storage Networks
PDF
Pivotal Platform - December Release A First Look
Deploying Elastic Self-Service Load Balancing
Virtulaisation
VMware Tanzu Portfolio Guide 2023 Shouheng Ting, Solution Engineer
08 sdn system intelligence short public beijing sdn conference - 130828
IBM Software Defined Networking for Virtual Environments (IBM SDN VE)
VMware Tanzu Kubernetes Connect
Cloud_controllers_public_webinar_aug31_v1.pptx
VMware NSX for vSphere - Intro and use cases
NSX_Advanced_Load_Balancer_Solution_with_Oracle.pptx
Presentation cloud orchestration
Microsoft System Center 2012 R2 Overview - Presented by Atidan
VMworld 2013: Moving Beyond Infrastructure: Meeting Demands on App Lifecycle ...
Capito Ardoe House VMWare Presentation
VMworld 2014: Virtualization 101
VMware 2009
End to End Application Visibility and Troubleshooting Across the Virtual Clou...
Data Driven Decisions in DevOps
VMworld 2015: Introducing Application Self service with Networking and Security
VM Farms Thrive with Dedicated IP Storage Networks
Pivotal Platform - December Release A First Look
Ad

More from Avi Networks (7)

PPTX
DR On Demand At Fraction of the Cost (1).pptx
PPTX
Top 4 Reasons to Migrate From NSX Load Balancing to NSX Advanced Load Balancer
PPTX
23.06.15 NSX ALB and vCD integration deepdive_webinar0615.pptx
PPTX
Enterprises-Have-Replaced-12000-ADCs-See-Why.pptx
PPTX
One And Done Multi-Cloud Load Balancing Done Right.pptx
PPTX
Virtualize Application Security Today - Hardware is No Longer Needed.pptx
PPTX
Delivering Turnkey Load Balancing in VMware Cloud with Day 0 Automation
DR On Demand At Fraction of the Cost (1).pptx
Top 4 Reasons to Migrate From NSX Load Balancing to NSX Advanced Load Balancer
23.06.15 NSX ALB and vCD integration deepdive_webinar0615.pptx
Enterprises-Have-Replaced-12000-ADCs-See-Why.pptx
One And Done Multi-Cloud Load Balancing Done Right.pptx
Virtualize Application Security Today - Hardware is No Longer Needed.pptx
Delivering Turnkey Load Balancing in VMware Cloud with Day 0 Automation

Recently uploaded (20)

PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Machine learning based COVID-19 study performance prediction
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PPTX
MYSQL Presentation for SQL database connectivity
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPT
Teaching material agriculture food technology
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
cuic standard and advanced reporting.pdf
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
KodekX | Application Modernization Development
PPTX
sap open course for s4hana steps from ECC to s4
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Encapsulation_ Review paper, used for researhc scholars
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Chapter 3 Spatial Domain Image Processing.pdf
Machine learning based COVID-19 study performance prediction
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
MYSQL Presentation for SQL database connectivity
Digital-Transformation-Roadmap-for-Companies.pptx
Advanced methodologies resolving dimensionality complications for autism neur...
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Reach Out and Touch Someone: Haptics and Empathic Computing
Teaching material agriculture food technology
Mobile App Security Testing_ A Comprehensive Guide.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
cuic standard and advanced reporting.pdf
Per capita expenditure prediction using model stacking based on satellite ima...
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
20250228 LYD VKU AI Blended-Learning.pptx
KodekX | Application Modernization Development
sap open course for s4hana steps from ECC to s4
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx

Deliver Modern Applications with an Elastic Load Balancing Fabric Powered by Intel Xeon Scalable Processors

  • 1. Confidential │ ©2020 VMware, Inc. Elastic Load Balancing Powered by Intel Xeon Scalable Processors VMware NSX Advanced Load Balancer (by Avi Networks) Rahul Phadke (VMware) Shweta Jain (Intel) 05/20/2020
  • 2. Confidential │ ©2020 VMware, Inc. 22 How are applications deployed using legacy load balancers Active 15% Standby 0%
  • 3. Confidential │ ©2020 VMware, Inc. 3 Custom built hardware Active-Standby pairs Independently managed Static capacity Very expensive Underutilization of capacity Wastage of power and datacenter space Complex operations Manually provision capacity for growth How are applications deployed – Hardware load balancers Challenges with legacy approach How are applications traditionally deployed What are the problems with this approach
  • 4. Confidential │ ©2020 VMware, Inc. 4 Advantages of Intel hardware Intel’s powerful Xeon Scalable Processors are a key enabler for modern infrastructure Simplify datacenter design High end Compute and Network Highly cost efficient
  • 5. Confidential │ ©2020 VMware, Inc. 5 Intel Networking Portfolio for Cloud Scale Intel® Architecture Intel® Xeon® Scalable Processors Intel® Ethernet Network Adapters Intel® Trusted Execution Technology Intel® Advanced Encryption Standard New Instructions Intel® QuickAssist Technology Intel® Data Plane Development Kit Intel® Hyperscan Intel® TXT Intel® AES-NI All Intel® product plans and roadmaps are subject to change without notice.
  • 6. Confidential │ ©2020 VMware, Inc. 6 To Modern Distributed Architecture Centralized Policies and Full Lifecycle Management App Services Control Plane Data Plane Software Load Balancer Intelligent WAF Container Ingress Avi Controller Bare Metal Virtualized Containers ON PREMISES PUBLIC CLOUD SEPARATE CONTROL & DATA PLANE ELASTICITY Application Services Fabric MULTI-CLOUD ANALYTICS AUTOMATION
  • 7. Confidential │ ©2020 VMware, Inc. 7 Consistent L4-L7 enterprise-grade app services across multi-cloud environments Avi Networks (now VMware NSX Advanced Load Balancer) App Analytics / Insights Container Ingress Services DNS and IP Address Management (IPAM) Web Application Firewall (WAF) and App Security Global Server Load Balancing (GSLB) Enterprise-grade Load Balancing NSX Horizon(VDI) vSphere/vCenter Deliver Any App on Any Cloud with One Platform VCF VMC Tanzu vRO/vRA
  • 8. Confidential │ ©2020 VMware, Inc. 8 Simplify troubleshooting, eliminate TCP Dumps Analytics and App Insights Eliminate finger-pointing Troubleshoot app performance, security and end-user issues in minutes Bare Metal Virtualized Containers Avi Controller • Connection log analytics • Security insights: DDoS • App performance metrics • End user experience End-to-End Timing Total Response Time End User Client RTT Server RTT App Response Load Balancer Server App
  • 9. Confidential │ ©2020 VMware, Inc. 9 Built-in ecosystem integration/cloud connectors Automation / Self-Service Bare Metal Virtualized Containers Avi Controller Operational Automation vRO/vRA Cisco CloudCenter Infrastructure Automation
  • 10. Confidential │ ©2020 VMware, Inc. 10 Software defined - Fully orchestrated Active-Active design Centrally managed Dynamic capacity management Automated - Rapid provisioning 0 capacity wastage – Lower TCO Ease of life cycle management Self-healing elastic fabric How are applications deployed – Elastic load balancing fabric Benefits with the modern approach How does Intel + Avi Networks solve the problem
  • 11. Confidential │ ©2020 VMware, Inc. 11 Going above and beyond - Powered by Intel Multi-Cloud Analytics and app insights Automation and self-service
  • 12. Confidential │ ©2020 VMware, Inc. 12 Scale vertically with more CPUs or horizontally with more Service Engines Elastic Autoscaling 2x 1-core SEs Nx 1-core SEs 1 core 2,500 SSL TPS 5,000 SSL TPS 1M SSL TPS Scale to millions of TPS or hundreds of GBs of throughput
  • 13. Confidential │ ©2020 VMware, Inc. 13 “Application fabric elasticity without loss of capacity with linear scale from Intel 2nd –Generation Xeon scalable processor- The equivalent performance on high- end proprietary hardware load balancers would cost hundreds of thousands of dollars”. Amit Pandey, ex- CEO of Avi, Head of NSX Services, VMware The Avi Service Engines run a purpose-built software stack that uses high performance DPDK libraries for fast packet processing, bypasses the Linux kernel stack (Linux kernel stack performance limitations8 are well known) and fully utilizes AES-NI and other crypto special instructions on Xeon processor to provide the highest possible performance on any commodity server or VM instance. Record Performance of VMware (Avi) Load Balancer on 2nd Gen Intel Xeon® Scalable Server Fabric elasticity without loss of capacity with linear scale! - Each Service Engine has 9 proxy cores. - Detailed test configuration is listed in the back up slide Disclaimer: Performance results are based on testing as of January 2020 and may not reflect all publicly available security updates. See configuration disclosure for details. No product can be absolutely secure. Results have been estimated or simulated using internal Intel analysis or architecture simulation or modeling,and provided to you for informational purposes. Any differences in your system hardware, software or configuration may affect your actual performance.
  • 14. Confidential │ ©2020 VMware, Inc. 14 Third-party load balancing performance benchmark Principled Technologies White Paper Showcased 1M+ SSL TPS application performance delivered with the power of joint Intel + Avi solution
  • 15. 15Confidential │ ©2020 VMware, Inc. How to achieve any scale on any app on any cloud • Rich application insights enable automation • Elastic autoscaling for Avi SEs and app servers • Seamless scale out or in based on traffic
  • 16. Confidential │ ©2020 VMware, Inc. 16 How to Engage Sep 1, 2019 VMware Price List Oct 1, 2019 Partner Price List Nov 1, 2019 Partner Central LEARN TRY TRAIN avinetworks.com/ docs | webinars vmware.com/go/try-avi- networks avinetworks.com/wo rkshops
  • 17. Confidential │ ©2020 VMware, Inc. Thank You