SlideShare a Scribd company logo
How to ensure SDN/NFV doesn't
break your network?
United States +1 (646) 558-2111
United Kingdom +44 (0) 330 221 9914
Access Code: 674-242-804
Bryon Lowen
Vice-President Telco at
QualiTest
Alex Henthorn-Iwane
Vice-President Marketing at
QualiSystems
Webinar Presenters
Agenda
QualiTest & QualiSystems
partnership
Challenges with NFV –
what, when and why to
verify with SDN/NFV?
Summary
Creating an Automated
SDN / NFV verification as
a Service
Building SDN / NFV
assurance process
QualiTest & QualiSystems
partnership
Challenges with NFV –
what, when and why to
verify with SDN/NFV?
Summary
Creating an Automated
SDN / NFV verification as
a Service
Building SDN / NFV
assurance process
QualiTest & QualiSystems partnership
•Pure Play Testing focus
•Passion for testing
•World’s 2nd largest
•Telco expertise
•Automation software
•Cloud management
•Test & CI automation
•Carrier DevOps
QualiTest & QualiSystems
partnership
Challenges with NFV –
what, when and why to
verify with SDN/NFV?
Summary
Creating an Automated
SDN / NFV verification as
a Service
Building SDN / NFV
assurance process
• End-to-end services are already often quite complex
o Many service scenarios won’t change except for the presence of VNFs
o Consider topology below for end-to-end (E2E) network service (NS) including
IMS-core enabled voice services in Cable MSO
What is a Service?
CMTS
eDVA
PCMM
S_CSCF
I-CSCF
P-CSCF
MRFC/MRFP
HSS TAS
VM
CAS
CCF OSS
BGCF/
ESCF
MGCF STP
SRP
CMS
SBC
SIP Peer
Networks
PSTN
TNS
• Endpoints aren’t just handsets, home gateways, fixed CPE
o Clusters of VMs
o VMWare, OpenStack/KVM
• New WAN topology constructs/protocols are emerging
o Federation of controllers. OpenFlow? Network Virtualization Overlays? PCEP? Segment Routing?
What is a Service? How Cloud/NFV Changes Things
Cloud DC1 Cloud DC2
Data Center Fabric
Storage
V
M
V
M
V
M
V
M
V
M
V
M
V
M
V
M
V
M
Hypervisor Hypervisor Hypervisor
Compute
Network
Cloud Orchestration
Data Center Fabric
Storage
V
M
V
M
V
M
V
M
V
M
V
M
V
M
V
M
V
M
Hypervisor Hypervisor Hypervisor
Compute
Network
Cloud Orchestration
MPLS/SDN
Core
• Performance of VNFs must be characterized and certified on hypervisor/server hardware
• North-south and east-west dimensions to performance testing
o How does traffic perform when going just through the hypervisor?
o How about when it exits a physical port and goes to a PNF device?
What are New Performance Testing Challenges
IaaS/PaaS/SaaS IaaS/PaaS/SaaS
Data Center Fabric
Storage
V
M
V
M
V
M
V
M
V
M
V
M
V
M
V
M
V
M
Hypervisor Hypervisor Hypervisor
Compute
Network
Cloud Orchestration
Data Center Fabric
Storage
V
M
V
M
V
M
V
M
V
M
V
M
V
M
V
M
V
M
Hypervisor Hypervisor Hypervisor
Compute
Network
Cloud Orchestration
When & Why: SDN/NFV DevTest Speed & Scale Implications
Network as Utility
• Waterfall timeframes
• Long certification cycles
• Manual, little automation OTT NFV SDN OSS/BSS
Dev/Test Cycle
App Lifecycle is Agile
• Agile timeframes
• Implies automation
VS
Service chain permutations could be endless
o Design permutation of vendor solution when defining the architecture (interoperability)
o Operational permutation at the time of the service instantiation (service differentiation)
Agility = IT rate of change x 100
o Performance and scale testing
How do you qualify and certify these service in an agile fashion?
When & Why: NFV DevTest Scale Implications
Admins make 500
updates / day
peak
APIs support
10,000’s updates /
day peak
Cloud Service
no admin - dynamic & automated
Today
Operations staff are involved
QualiTest & QualiSystems
partnership
Challenges with NFV –
what, when and why to
verify with SDN/NFV?
Q&A
Creating an Automated
SDN / NFV verification as
a Service
Building SDN / NFV
assurance process
Building SDN / NFV assurance process
• Reliable Service
• Right Price
• Good SLAs
• Increasingly Complex
• Renegotiate contracts
• Not affect QOS
Build strong assurance process to capitalize SDN / NFV potential
QualiTest NFV validation process
• QualiTest aims to create a unified end-to-end approach to service
assurance and network performance
NFV
Management
Orchestration Infrastructure Migration
Assure full
compliance to ESTI
ISG Standards.
Assure full compliance
to NFV requirements
for any network
equipment provider
and streamline the
ability of vendors and
users to be able to
implement compatible
NFV solutions
Build a comprehensive Test
Environment, including
Control plane and Data plane
workload simulation tools,
network analytics, QoS and
QoE monitoring probes
Test management
and Orchestration
prior to VNF
migration,
including each
component (e.g.
Orchestrator,
Vnfm, VIM)
Test the VNF
architecture and
implementation to
assure smooth
transition
ESTI NFV ISG
Compliance
(NFV-Co)
NFV Compliance
for Vendors (NFV-
Ven)
NFV Test
Environment
(NFV-TE)
MANO
Testing
(MANO-T)
VNF Migration
(VNFM-T)
QualiTest NFV validation process
Assure full
compliance to ESTI
ISG Standards.
ESTI NFV ISG
Compliance
(NFV-Co)
NFV Compliance
for Vendors (NFV-
Ven)
NFV Test
Environment
(NFV-TE)
MANO
Testing
(MANO-T)
VNF Migration
(VNFM-T)
(NFV-Co) ETSI NFV Compliance
ETSI ISG Standards Test procedure
Assuring compliance aims to find the
deviations from standards
• MANO
• VNF/NE
• Analyse ISG current standards
• Prepare compliance requirements
• Analyse each NFV component / int
• Define gap points and analyse
• Repeat steps 1-6 for each VNF and NE
Assure full compliance
to NFV requirements
for any network
equipment provider
and streamline the
ability of vendors and
users to be able to
implement compatible
NFV solutions
ESTI NFV ISG
Compliance
(NFV-Co)
NFV Compliance
for Vendors (NFV-
Ven)
NFV Test
Environment
(NFV-TE)
MANO
Testing
(MANO-T)
VNF Migration
(VNFM-T)
(NFV-Ven) Compliance for Vendors
MANO VNF
• VNF Descriptor format
• VNF redundancy model
• VNF state transitions
• VNF Package
• Allocation of addresses
• Scaling event types and format
• Maintain records on VNF
Packages
• VNF design patterns
• VNF update and upgrade
• VNF properties
• VNF Topological Characteristics
• VNF States and Transitions
• VNF fault management
Build a comprehensive Test
Environment, including
Control plane and Data plane
workload simulation tools,
network analytics, QoS and
QoE monitoring probes
ESTI NFV ISG
Compliance
(NFV-Co)
NFV Compliance
for Vendors (NFV-
Ven)
NFV Test
Environment
(NFV-TE)
MANO
Testing
(MANO-T)
VNF Migration
(VNFM-T)
(NFV-TE) NFV Test Environment
(NFV-TE) NFV Test Environment
NFV provides great flexibility:
• Build parallel test environments
• Scale up and down compute resources
• Copy any existing environment
Environment build guidelines:
• Management and Orchestration should be
similar to the production
• NS and VNF Instantiation should be similar to
production environment
• Same level of resources should be allocated.
Test Appliances:
• Simulate workload traffic on the client / server
• Simulate both data plane & control plane traffic
• Measure key metrics data & control plane
Appliances vs. Physical Test Appliances:
• Virtual test appliances are more cost effective
• Physical test appliances are recommended for
highest levels of data-plane performance or
microsecond-level timing accuracy
Test management
and Orchestration
prior to VNF
migration,
including each
component (e.g.
Orchestrator,
Vnfm, VIM)
ESTI NFV ISG
Compliance
(NFV-Co)
NFV Compliance
for Vendors (NFV-
Ven)
NFV Test
Environment
(NFV-TE)
MANO
Testing
(MANO-T)
VNF Migration
(VNFM-T)
(MANO-T) MANO Testing
(MANO-T) MANO Testing
The first step is to test NFV Management and Orchestration
Architectural Framework
NFV Orchestrator
VNF Manager
(VIM) and NFV
Infrastructure (NFVI)
VIM– VNF Manager
(Vi-Vnfm)
Orchestrator – VIM
(Or-Vi)
The VNF is deployed as one or more Virtual
Machines; source: ETSI GS NFV 002 v1.2.1
Test the VNF
architecture and
implementation to
assure smooth
transition
ESTI NFV ISG
Compliance
(NFV-Co)
NFV Compliance
for Vendors (NFV-
Ven)
NFV Test
Environment
(NFV-TE)
MANO
Testing
(MANO-T)
VNF Migration
(VNFM-T)
(VNFM-T) VNF Migration
Static testing VNF-Mano Integration
Conformance testing VNF Internal functionality
Scalability/Performance End-to-end/system test
QualiTest & QualiSystems
partnership
Challenges with NFV –
what, when and why to
verify with SDN/NFV?
Summary
Creating an Automated
SDN / NFV verification as
a Service
Building SDN / NFV
assurance process
Goal is Continuous Processes: Continuous Integation/Delivery
Automated BuildCode Commit Automated Unit Test
Automated Sanity TestAutomated & Scaled Full Regression TestAutomated Test Results
Collection
Automated BI Report Generation
Automated Build, Deploy, Test
Auto-scaled regression tests
Applied to service & network
changes
QualiSystems Summarized
Processes Infrastructure Test
Page 25
Automation Platform
• Self-Service System
• Infrastructure Modelling
• Reservation / Scheduling
• Provisioning Automation
• Reporting / Utilization
• Test Automation
• Test Results Reporting
• CI Integration
Step 1: Automate all Infrastructure
Physical Labs
MaaS
Virtual Labs
IaaS & PaaS
• Build virtual labs for VNF-only scenarios
• Consolidate or federate virtual & physical labs into private/hybrid clouds
CloudShell Resource Management
• Any resource: virtual,
physical, logical (IP prefix,
software license)
• User-defined resource
tagging to easily find the type
of device you need
• Eliminates manual searching
• Customizable resource
abstractions enable efficient
resource pooling
All resources managed in a single repository
Ensure Orchestration can Handle Network Topologies
=
Carriers adopting infrastructure orchestration to build DevOps have found
that most cloud management platforms only support compute concepts
CloudShell orchestration is capable of handling E2E NS topologies
Replace static diagrams with a live workspace
Live Topology
• Drag & drop devices
• Draw required
connections and activate
• Powerful search
capabilities based on
device attributes
• Abstract topologies
• Power on/off devices by
controlling PDUs
Step 2: Create Lab as a Service Cloud
• CloudShell allows you to
create self-service access to
full network environments
built and provisioned on
demand
• Make available to internal and
external users:
• Including vendors,
contractors
Key goals:
• Increase efficiency utilization
of test lab resources
• Reduce ratio of setup to test
time
Select
environment
Verify
availability
Reserve
Setup
Testing
activities
Collaborate
Teardown
Reservation & Scheduling
• Plan ahead lab operations
• Automatically resolve
allocation conflicts
• Guarantees availability of
devices for tests
• Only lock up resources
when they are needed for
testing
• Promotes efficient sharing
Improved sharing through reservation &
scheduling
• “One-Click” is first step toward
continuous
• Self-service users can easily launch entire
certification from UI
• Integrate with ALM to ensure consistent
reporting
• Certification can be reused for
many stages:
• New technology and early stage service proof
of concept testing
• New service introduction
• Vendor interoperability testing
• Contractor code qualification
Step 3: Create “One-Click” Certification
Tight Integration between TestShell & CloudShell
Create an
Environment
Develop a
Test
Create the
Automation
Suite
Execute and
Monitor the
Suite
Develop test in TestShell Studio in conjunction
with a live CloudShell environment for greater accuracy,
easier debugging
Suite = reservations & associated tests
What Happened when a Cable MSO Built an “As-a-Service” Approach
Overall: Complete change in the way devtest team conducted
business
Measured:
• 15% annual operations cost savings
• 20% immediate reduction in certification cycles
• 33% immediate increased in certification coverage and improving
• 100% increase in resource utilization due to 24/7 service availability
Ongoing observations:
• Earlier certification by internal departments and vendors moves quality
to the left in the cycle—still measuring outcomes
• Eliminated need for extensive travel time and costs on part of vendors
and contractors
• Increased compliance with their methodology and standards via
automation
• Increased pace of innovation
QualiTest & QualiSystems
partnership
Challenges with NFV –
what, when and why to
verify with SDN/NFV?
Summary
Creating an Automated
SDN / NFV verification as
a Service
Building SDN / NFV
assurance process
Summary
• Combined approach, building on a methodology of test processes and
automation.
• There will also be a skills pivot as organisations transition to this
virtualised environment.
• Increased pace of innovation.
Thankyou
Webinar   how to ensure sdn-nfv doesn't break your network

More Related Content

PPTX
Testing - the gatekeeper for quality in NFV
PPTX
What is DevOps? How can it impact my Customers and my Business
PPTX
NFV Testing & DevOps | QualiTest
PPTX
Ensuring Successful OPNFV-based NFV Deployments | QualiTest Group
PPTX
Roaming Assurance | QualiTest Group
PPTX
Automating your EdI Testing in Healthcare | QualiTest Group
PPTX
Healthcare IT testing | QualiTest
PPTX
Webinar: DevOps challenges facing QA
Testing - the gatekeeper for quality in NFV
What is DevOps? How can it impact my Customers and my Business
NFV Testing & DevOps | QualiTest
Ensuring Successful OPNFV-based NFV Deployments | QualiTest Group
Roaming Assurance | QualiTest Group
Automating your EdI Testing in Healthcare | QualiTest Group
Healthcare IT testing | QualiTest
Webinar: DevOps challenges facing QA

What's hot (20)

PDF
Case Study - Implementing DevOps for a complex hardware/software-based networ...
PPTX
DevOps as-a-Service (DaaS) value
PPTX
Self-Service Secure Test and Release Pipelines
PDF
Continuous testing & devops with @petemar5hall
DOCX
jaynewresume6
PDF
Star west 2011 manoj narayanan presentation 1.0
PDF
Drive Faster Quality Insights through Customized Test Automation
PPTX
Critical steps in Determining Your Value Stream Management Solution
PDF
How to Deliver Winning Mobile Apps
PPTX
Enterprise QA and Application Testing Services
PPTX
Secrets of Value Stream Mapping for Future State
PDF
Neotys PAC 2018 - Ramya Ramalinga Moorthy
PPTX
Presentation on 3 Pillars of DevOps - Kovair DevOps
PPTX
Continuous Delivery Maturity Model
PPTX
ApexUnit: Open source test framework for apex
PPTX
How to Fit Performance Testing into a DevOps Environment
PPTX
Testing for a Great App and Web Experience | QualiTest Group
DOCX
PPT
Ian Smith - Mobile Software Testing - Facing Future Challenges
PPT
Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...
Case Study - Implementing DevOps for a complex hardware/software-based networ...
DevOps as-a-Service (DaaS) value
Self-Service Secure Test and Release Pipelines
Continuous testing & devops with @petemar5hall
jaynewresume6
Star west 2011 manoj narayanan presentation 1.0
Drive Faster Quality Insights through Customized Test Automation
Critical steps in Determining Your Value Stream Management Solution
How to Deliver Winning Mobile Apps
Enterprise QA and Application Testing Services
Secrets of Value Stream Mapping for Future State
Neotys PAC 2018 - Ramya Ramalinga Moorthy
Presentation on 3 Pillars of DevOps - Kovair DevOps
Continuous Delivery Maturity Model
ApexUnit: Open source test framework for apex
How to Fit Performance Testing into a DevOps Environment
Testing for a Great App and Web Experience | QualiTest Group
Ian Smith - Mobile Software Testing - Facing Future Challenges
Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...
Ad

Viewers also liked (20)

PPTX
Crowd Catcher: Take control of the Crowd (part 1 of 3) | QualiTest Group
PPTX
Crowd Catcher: Take control of the Crowd (part 3 of 3) | QualiTest Group
PPTX
Crowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest Group
PDF
Software Defined Future
PDF
Colt Novitas SDN World Congress 2015
PDF
Contrail Enabler for agile cloud services
PPSX
Juniper Contrail VNS A BASIC introduction
PPTX
Overture presentation on Central Office (Exchange): Home to the New Telco Clo...
PDF
Colt: The Future of Telco Cloud
PDF
2016 interop sdi_showcase_contrail
PPTX
Colt inter-provider SDN NNIs and APIs
PPTX
SDN/NFV architecture vision and reality
PPTX
OpenStack Telco Cloud Challenges, David Fick, Oracle
PPTX
Contrail Basics
PDF
Using OpenContrail with Kubernetes
PDF
Telco Cloud - An evolution approach 2016
PPSX
Contrail Deep-dive - Cloud Network Services at Scale
PDF
Cloud Network Virtualization with Juniper Contrail
PPSX
Contrail Demo
PPTX
The Modern Telco Network: Defining The Telco Cloud
Crowd Catcher: Take control of the Crowd (part 1 of 3) | QualiTest Group
Crowd Catcher: Take control of the Crowd (part 3 of 3) | QualiTest Group
Crowd Catcher: take control of the Crowd (part 2 of 3) | QualiTest Group
Software Defined Future
Colt Novitas SDN World Congress 2015
Contrail Enabler for agile cloud services
Juniper Contrail VNS A BASIC introduction
Overture presentation on Central Office (Exchange): Home to the New Telco Clo...
Colt: The Future of Telco Cloud
2016 interop sdi_showcase_contrail
Colt inter-provider SDN NNIs and APIs
SDN/NFV architecture vision and reality
OpenStack Telco Cloud Challenges, David Fick, Oracle
Contrail Basics
Using OpenContrail with Kubernetes
Telco Cloud - An evolution approach 2016
Contrail Deep-dive - Cloud Network Services at Scale
Cloud Network Virtualization with Juniper Contrail
Contrail Demo
The Modern Telco Network: Defining The Telco Cloud
Ad

Similar to Webinar how to ensure sdn-nfv doesn't break your network (20)

PPTX
Demystifying Network Function Virtualization (NFV) Service Assurance
PDF
Meaningful and Necessary Operations on Behalf of NFV
PDF
NFV Tutorial
PDF
NFV Tutorial
PPTX
Modern Networking Unit 3 Network Function virtualization
PDF
Network Function Virtualization Orchestration LI
PDF
Why Network Functions Virtualization sdn?
PDF
Network Function Virtualization - Telkomsel Perspective (SDN NFV Day ITB 2016)
PDF
TIME Journey to the SPACE
PDF
Control of Communication and Energy Networks Final Project - Service Function...
PDF
Ch 05 --- nfv basics
PDF
NFV and OpenStack
PDF
Empowering Customer Centric NFV - by Sean Chen @ Openstack Summit Paris 2014
PPTX
Software defined networking(sdn) vahid sadri
PDF
NFV Linaro Connect Keynote
PDF
Understanding NFV and the MANO stack
PPTX
PDF
Design Summit - NFV BoF - Dave Neary
PDF
PLNOG15: NFV: Lessons learned from production deployments and current observa...
Demystifying Network Function Virtualization (NFV) Service Assurance
Meaningful and Necessary Operations on Behalf of NFV
NFV Tutorial
NFV Tutorial
Modern Networking Unit 3 Network Function virtualization
Network Function Virtualization Orchestration LI
Why Network Functions Virtualization sdn?
Network Function Virtualization - Telkomsel Perspective (SDN NFV Day ITB 2016)
TIME Journey to the SPACE
Control of Communication and Energy Networks Final Project - Service Function...
Ch 05 --- nfv basics
NFV and OpenStack
Empowering Customer Centric NFV - by Sean Chen @ Openstack Summit Paris 2014
Software defined networking(sdn) vahid sadri
NFV Linaro Connect Keynote
Understanding NFV and the MANO stack
Design Summit - NFV BoF - Dave Neary
PLNOG15: NFV: Lessons learned from production deployments and current observa...

More from Qualitest (19)

PDF
10 must do’s for perfect customer experience (Cx) -Qualitest
PPTX
Don’t Let Missed Bugs Cause Mayhem in your Organization!
PPTX
DevOps and Groupthink An Oxymoron?
PPTX
Google SLS Outsourcing by Jeffrey Roth
PPTX
Successful Offshore Practices by Ofer Glanz
PPTX
Pricing Models by Michel Sharvit
PPTX
5 keys to success at MTS by Tzahi Falkovich
PPTX
The Journey of QualiTest by Ayal Zylberman
PPTX
Designing for the internet - Page Objects for the Real World
PPTX
DevSecOps - It can change your life (cycle)
PPTX
IoT Quality Challenges - Testing & Engineering
PPTX
Webinar: How to get localization and testing for medical devices done right
PPTX
Root Cause Analysis | QualiTest Group
PPTX
DevOps 101
PPTX
Killing the Myths of Outsourced Software Testing
PPTX
Why do we need a Scrum Master?
PPTX
How to Test Big Data Systems | QualiTest Group
PPTX
The changing role of a QA | QualiTest Group
PPTX
DevOps – The Evolution of Agile
10 must do’s for perfect customer experience (Cx) -Qualitest
Don’t Let Missed Bugs Cause Mayhem in your Organization!
DevOps and Groupthink An Oxymoron?
Google SLS Outsourcing by Jeffrey Roth
Successful Offshore Practices by Ofer Glanz
Pricing Models by Michel Sharvit
5 keys to success at MTS by Tzahi Falkovich
The Journey of QualiTest by Ayal Zylberman
Designing for the internet - Page Objects for the Real World
DevSecOps - It can change your life (cycle)
IoT Quality Challenges - Testing & Engineering
Webinar: How to get localization and testing for medical devices done right
Root Cause Analysis | QualiTest Group
DevOps 101
Killing the Myths of Outsourced Software Testing
Why do we need a Scrum Master?
How to Test Big Data Systems | QualiTest Group
The changing role of a QA | QualiTest Group
DevOps – The Evolution of Agile

Recently uploaded (20)

PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
Electronic commerce courselecture one. Pdf
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Modernizing your data center with Dell and AMD
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Empathic Computing: Creating Shared Understanding
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
The Rise and Fall of 3GPP – Time for a Sabbatical?
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
Electronic commerce courselecture one. Pdf
Agricultural_Statistics_at_a_Glance_2022_0.pdf
NewMind AI Monthly Chronicles - July 2025
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Dropbox Q2 2025 Financial Results & Investor Presentation
Modernizing your data center with Dell and AMD
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Empathic Computing: Creating Shared Understanding
Advanced methodologies resolving dimensionality complications for autism neur...
Encapsulation_ Review paper, used for researhc scholars
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Review of recent advances in non-invasive hemoglobin estimation
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Understanding_Digital_Forensics_Presentation.pptx
Building Integrated photovoltaic BIPV_UPV.pdf

Webinar how to ensure sdn-nfv doesn't break your network

  • 1. How to ensure SDN/NFV doesn't break your network? United States +1 (646) 558-2111 United Kingdom +44 (0) 330 221 9914 Access Code: 674-242-804
  • 2. Bryon Lowen Vice-President Telco at QualiTest Alex Henthorn-Iwane Vice-President Marketing at QualiSystems Webinar Presenters
  • 3. Agenda QualiTest & QualiSystems partnership Challenges with NFV – what, when and why to verify with SDN/NFV? Summary Creating an Automated SDN / NFV verification as a Service Building SDN / NFV assurance process
  • 4. QualiTest & QualiSystems partnership Challenges with NFV – what, when and why to verify with SDN/NFV? Summary Creating an Automated SDN / NFV verification as a Service Building SDN / NFV assurance process
  • 5. QualiTest & QualiSystems partnership •Pure Play Testing focus •Passion for testing •World’s 2nd largest •Telco expertise •Automation software •Cloud management •Test & CI automation •Carrier DevOps
  • 6. QualiTest & QualiSystems partnership Challenges with NFV – what, when and why to verify with SDN/NFV? Summary Creating an Automated SDN / NFV verification as a Service Building SDN / NFV assurance process
  • 7. • End-to-end services are already often quite complex o Many service scenarios won’t change except for the presence of VNFs o Consider topology below for end-to-end (E2E) network service (NS) including IMS-core enabled voice services in Cable MSO What is a Service? CMTS eDVA PCMM S_CSCF I-CSCF P-CSCF MRFC/MRFP HSS TAS VM CAS CCF OSS BGCF/ ESCF MGCF STP SRP CMS SBC SIP Peer Networks PSTN TNS
  • 8. • Endpoints aren’t just handsets, home gateways, fixed CPE o Clusters of VMs o VMWare, OpenStack/KVM • New WAN topology constructs/protocols are emerging o Federation of controllers. OpenFlow? Network Virtualization Overlays? PCEP? Segment Routing? What is a Service? How Cloud/NFV Changes Things Cloud DC1 Cloud DC2 Data Center Fabric Storage V M V M V M V M V M V M V M V M V M Hypervisor Hypervisor Hypervisor Compute Network Cloud Orchestration Data Center Fabric Storage V M V M V M V M V M V M V M V M V M Hypervisor Hypervisor Hypervisor Compute Network Cloud Orchestration MPLS/SDN Core
  • 9. • Performance of VNFs must be characterized and certified on hypervisor/server hardware • North-south and east-west dimensions to performance testing o How does traffic perform when going just through the hypervisor? o How about when it exits a physical port and goes to a PNF device? What are New Performance Testing Challenges IaaS/PaaS/SaaS IaaS/PaaS/SaaS Data Center Fabric Storage V M V M V M V M V M V M V M V M V M Hypervisor Hypervisor Hypervisor Compute Network Cloud Orchestration Data Center Fabric Storage V M V M V M V M V M V M V M V M V M Hypervisor Hypervisor Hypervisor Compute Network Cloud Orchestration
  • 10. When & Why: SDN/NFV DevTest Speed & Scale Implications Network as Utility • Waterfall timeframes • Long certification cycles • Manual, little automation OTT NFV SDN OSS/BSS Dev/Test Cycle App Lifecycle is Agile • Agile timeframes • Implies automation VS
  • 11. Service chain permutations could be endless o Design permutation of vendor solution when defining the architecture (interoperability) o Operational permutation at the time of the service instantiation (service differentiation) Agility = IT rate of change x 100 o Performance and scale testing How do you qualify and certify these service in an agile fashion? When & Why: NFV DevTest Scale Implications Admins make 500 updates / day peak APIs support 10,000’s updates / day peak Cloud Service no admin - dynamic & automated Today Operations staff are involved
  • 12. QualiTest & QualiSystems partnership Challenges with NFV – what, when and why to verify with SDN/NFV? Q&A Creating an Automated SDN / NFV verification as a Service Building SDN / NFV assurance process
  • 13. Building SDN / NFV assurance process • Reliable Service • Right Price • Good SLAs • Increasingly Complex • Renegotiate contracts • Not affect QOS Build strong assurance process to capitalize SDN / NFV potential
  • 14. QualiTest NFV validation process • QualiTest aims to create a unified end-to-end approach to service assurance and network performance NFV Management Orchestration Infrastructure Migration
  • 15. Assure full compliance to ESTI ISG Standards. Assure full compliance to NFV requirements for any network equipment provider and streamline the ability of vendors and users to be able to implement compatible NFV solutions Build a comprehensive Test Environment, including Control plane and Data plane workload simulation tools, network analytics, QoS and QoE monitoring probes Test management and Orchestration prior to VNF migration, including each component (e.g. Orchestrator, Vnfm, VIM) Test the VNF architecture and implementation to assure smooth transition ESTI NFV ISG Compliance (NFV-Co) NFV Compliance for Vendors (NFV- Ven) NFV Test Environment (NFV-TE) MANO Testing (MANO-T) VNF Migration (VNFM-T) QualiTest NFV validation process
  • 16. Assure full compliance to ESTI ISG Standards. ESTI NFV ISG Compliance (NFV-Co) NFV Compliance for Vendors (NFV- Ven) NFV Test Environment (NFV-TE) MANO Testing (MANO-T) VNF Migration (VNFM-T) (NFV-Co) ETSI NFV Compliance ETSI ISG Standards Test procedure Assuring compliance aims to find the deviations from standards • MANO • VNF/NE • Analyse ISG current standards • Prepare compliance requirements • Analyse each NFV component / int • Define gap points and analyse • Repeat steps 1-6 for each VNF and NE
  • 17. Assure full compliance to NFV requirements for any network equipment provider and streamline the ability of vendors and users to be able to implement compatible NFV solutions ESTI NFV ISG Compliance (NFV-Co) NFV Compliance for Vendors (NFV- Ven) NFV Test Environment (NFV-TE) MANO Testing (MANO-T) VNF Migration (VNFM-T) (NFV-Ven) Compliance for Vendors MANO VNF • VNF Descriptor format • VNF redundancy model • VNF state transitions • VNF Package • Allocation of addresses • Scaling event types and format • Maintain records on VNF Packages • VNF design patterns • VNF update and upgrade • VNF properties • VNF Topological Characteristics • VNF States and Transitions • VNF fault management
  • 18. Build a comprehensive Test Environment, including Control plane and Data plane workload simulation tools, network analytics, QoS and QoE monitoring probes ESTI NFV ISG Compliance (NFV-Co) NFV Compliance for Vendors (NFV- Ven) NFV Test Environment (NFV-TE) MANO Testing (MANO-T) VNF Migration (VNFM-T) (NFV-TE) NFV Test Environment
  • 19. (NFV-TE) NFV Test Environment NFV provides great flexibility: • Build parallel test environments • Scale up and down compute resources • Copy any existing environment Environment build guidelines: • Management and Orchestration should be similar to the production • NS and VNF Instantiation should be similar to production environment • Same level of resources should be allocated. Test Appliances: • Simulate workload traffic on the client / server • Simulate both data plane & control plane traffic • Measure key metrics data & control plane Appliances vs. Physical Test Appliances: • Virtual test appliances are more cost effective • Physical test appliances are recommended for highest levels of data-plane performance or microsecond-level timing accuracy
  • 20. Test management and Orchestration prior to VNF migration, including each component (e.g. Orchestrator, Vnfm, VIM) ESTI NFV ISG Compliance (NFV-Co) NFV Compliance for Vendors (NFV- Ven) NFV Test Environment (NFV-TE) MANO Testing (MANO-T) VNF Migration (VNFM-T) (MANO-T) MANO Testing
  • 21. (MANO-T) MANO Testing The first step is to test NFV Management and Orchestration Architectural Framework NFV Orchestrator VNF Manager (VIM) and NFV Infrastructure (NFVI) VIM– VNF Manager (Vi-Vnfm) Orchestrator – VIM (Or-Vi) The VNF is deployed as one or more Virtual Machines; source: ETSI GS NFV 002 v1.2.1
  • 22. Test the VNF architecture and implementation to assure smooth transition ESTI NFV ISG Compliance (NFV-Co) NFV Compliance for Vendors (NFV- Ven) NFV Test Environment (NFV-TE) MANO Testing (MANO-T) VNF Migration (VNFM-T) (VNFM-T) VNF Migration Static testing VNF-Mano Integration Conformance testing VNF Internal functionality Scalability/Performance End-to-end/system test
  • 23. QualiTest & QualiSystems partnership Challenges with NFV – what, when and why to verify with SDN/NFV? Summary Creating an Automated SDN / NFV verification as a Service Building SDN / NFV assurance process
  • 24. Goal is Continuous Processes: Continuous Integation/Delivery Automated BuildCode Commit Automated Unit Test Automated Sanity TestAutomated & Scaled Full Regression TestAutomated Test Results Collection Automated BI Report Generation Automated Build, Deploy, Test Auto-scaled regression tests Applied to service & network changes
  • 25. QualiSystems Summarized Processes Infrastructure Test Page 25 Automation Platform • Self-Service System • Infrastructure Modelling • Reservation / Scheduling • Provisioning Automation • Reporting / Utilization • Test Automation • Test Results Reporting • CI Integration
  • 26. Step 1: Automate all Infrastructure Physical Labs MaaS Virtual Labs IaaS & PaaS • Build virtual labs for VNF-only scenarios • Consolidate or federate virtual & physical labs into private/hybrid clouds
  • 27. CloudShell Resource Management • Any resource: virtual, physical, logical (IP prefix, software license) • User-defined resource tagging to easily find the type of device you need • Eliminates manual searching • Customizable resource abstractions enable efficient resource pooling All resources managed in a single repository
  • 28. Ensure Orchestration can Handle Network Topologies = Carriers adopting infrastructure orchestration to build DevOps have found that most cloud management platforms only support compute concepts CloudShell orchestration is capable of handling E2E NS topologies
  • 29. Replace static diagrams with a live workspace Live Topology • Drag & drop devices • Draw required connections and activate • Powerful search capabilities based on device attributes • Abstract topologies • Power on/off devices by controlling PDUs
  • 30. Step 2: Create Lab as a Service Cloud • CloudShell allows you to create self-service access to full network environments built and provisioned on demand • Make available to internal and external users: • Including vendors, contractors Key goals: • Increase efficiency utilization of test lab resources • Reduce ratio of setup to test time Select environment Verify availability Reserve Setup Testing activities Collaborate Teardown
  • 31. Reservation & Scheduling • Plan ahead lab operations • Automatically resolve allocation conflicts • Guarantees availability of devices for tests • Only lock up resources when they are needed for testing • Promotes efficient sharing Improved sharing through reservation & scheduling
  • 32. • “One-Click” is first step toward continuous • Self-service users can easily launch entire certification from UI • Integrate with ALM to ensure consistent reporting • Certification can be reused for many stages: • New technology and early stage service proof of concept testing • New service introduction • Vendor interoperability testing • Contractor code qualification Step 3: Create “One-Click” Certification
  • 33. Tight Integration between TestShell & CloudShell Create an Environment Develop a Test Create the Automation Suite Execute and Monitor the Suite Develop test in TestShell Studio in conjunction with a live CloudShell environment for greater accuracy, easier debugging Suite = reservations & associated tests
  • 34. What Happened when a Cable MSO Built an “As-a-Service” Approach Overall: Complete change in the way devtest team conducted business Measured: • 15% annual operations cost savings • 20% immediate reduction in certification cycles • 33% immediate increased in certification coverage and improving • 100% increase in resource utilization due to 24/7 service availability Ongoing observations: • Earlier certification by internal departments and vendors moves quality to the left in the cycle—still measuring outcomes • Eliminated need for extensive travel time and costs on part of vendors and contractors • Increased compliance with their methodology and standards via automation • Increased pace of innovation
  • 35. QualiTest & QualiSystems partnership Challenges with NFV – what, when and why to verify with SDN/NFV? Summary Creating an Automated SDN / NFV verification as a Service Building SDN / NFV assurance process
  • 36. Summary • Combined approach, building on a methodology of test processes and automation. • There will also be a skills pivot as organisations transition to this virtualised environment. • Increased pace of innovation. Thankyou