SlideShare a Scribd company logo
Connection points between opnfv and etsi nfv tst working group
Connection Points Between OPNFV and ETSI
NFV TST Working Group
Lynch Pierre
(TST WG Chair)
Gergely Csatari
(TST WG Contributor)
3
What is NFV TST WG?
TST is one of several working groups under the ETSI NFV Industry
Specification Group (ISG)
• A productive and collaborative team (albeit being relatively small
compared to other working groups)
• Participants include telecom operators, vendors and testing
companies
4
TST Areas of Focus
• Testing the NFV functional blocks: VNF, MANO
and NFVI
• Creating NFV Proof of Concept (PoC) and
Interoperability guidelines
• Analyzing gaps between open source projects
and the ETSI NFV architecture
TST001 – Pre-deployment Testing
• Assessing the performance of the NFVI and its ability to fulfil the performance and reliability
requirements of the VNFs executing on the NFVI.
• Data and control plane testing of VNFs and their interactions with the NFV Infrastructure and the
NFV MANO.
• Validating the performance, reliability and scaling capabilities of Network Services.
• NFVI pre-deployment validation part was developed in cooperation with OPNFV Yardstick
Published
TST002 – Report on NFV Interop. Testing Methodology
• Guidelines for NFV interoperability testing
• Generic System Under Test (SUT) architecture for NFV
• Initial SUT configurations
• Interoperability feature areas
Published
7
TST003 – Open source components
Identifying gaps between OpenStack NBI and IFA005/IFA006
Published
8
TST004 – Path implementation testing
• Guidelines for test plan on path
implementation through NFVI
• SUT options
• Function placement
• SDN application type
• SDN controller type
• Metrics
• VNFC instantiation time
• Path instantiation
• 1st packet latency
• Std pkt transfer measurements
• Procedures
• Examples
Published
• Report on use cases and recommendations for VNF Snapshot
• Use cases:
• Testing
• Troubleshooting
• Lifecycle management
• During VNF lifecycle procedure
• Quick VNF recovery
• Gap Analysis with existing solutions
• Framework, procedures and solutions
• Recommendations to IFA specifications
• Policies, Fct Reqs on MANO, Ref Points
VNF
Instance
VNF
Snapshot
Package
VNF
Snapshot
external
location
Create VNF
Snapshot
Revert VNF
Snapshot
Create VNF
Snapshot
Package
Extract VNF
Snapshot
Package
Export VNF
Snapshot
Package
Import VNF
Snapshot
Package
TST005 – VNF Snapshot report
Published
• Usage of DevOps and CI/CD in Telco
environment
• Focus on the handoff of VNF
• Background and overview
• Use cases
• Supplier
• Operator
• Validator
• Test procedures
• Recommendations for package description
enhancements
DevOps pipeline, VNF1 supplier part
VNF OperatorVNF1 Supplier
DevOps pipeline, VNF2 supplier part
VNF2 Supplier
DevOps pipeline, VNF operator part
TST006 – DevOps and CI/CD
Draft
• Interoperability Testing Guidelines for NFVI-VIM, MANO and
VNF
• Detailed collection of test descriptions for most functionality
• Based on TST002 and 1st NFV Plugtests Test Plan
TST007 – Guidelines for interop
Draft
• Compute, Networking and Memory metrics for NFVI
• Each Metric:
• Name & Background
• Parameters & Scope
• Units & Method of Measurement
• Definition
• Sources of Error, Discussion
• Will be referenced by IFA027
• Compute: Processor usage, utilization
• Network: Packet, Octet, Dropped Packet, Errored Packet Counts
• Memory: Buffered, Cached, Free, Slab
• Done in cooperation with OPNFV Barometer
TST008 – NFVI Compute and Network Metrics Specification
Published
• Vendor-agnostic definitions of performance metrics and the associated methods of measurement
for Benchmarking networks supported in the NFVI
• Intended to serve as a basis for fair comparison of different implementations of NFVI
• Possible cooperation with OPNFV vsperf
TST009 – Testing Specification of Networking Benchmarks and Measurement Methods for NFVI
Draft
ETSI NFV Plugtests
• Interoperability Test Sessions
• Among different combinations of Functions Under Test (FUTs)
• 3 types of FUTs: VNFs, MANO, NFVI&VIM
• At a functional level (conformance not enforced)
• Validate basic NFV Rel 2 capabilities:
• NSD, VNF Package and SW Image Management
• NS and VNF Life Cycle Management, VR Management
• “Early” Plugtest
• Stage 3 incomplete
• IOP through open APIs, plugins, …
• …and remote integration
ETSI NFV Plugtests
• 31 participating companies or organisations including
OPNFV
• 35 Functions Under Test (commercial and open source):
• 15 VNFs,
• 9 MANOs,
• 11 NFVI&VIM
• Several supporting open source communities:
• ETSI OSM,
• Open Baton,
• OPNFV,
• Open-O
ETSI NFV Plugtests results
Deliverables:
• A Test Plan was prepared
• Test results were reported
• An overall Report was created
ETSI NFV Plugtests program
+
+OPNFV Dovetail ETSI NFV TST
ETSI NFV TST interworking with open source
• Testing is a natural area for collaboration between ETSI NFV and open source projects
• ETSI NFV is happily doing test plans, reports and specification and let the open source
projects to do the implementations
• TST WG is looking for feedback on ETSI NFV, but there is also a bug tracker
Link to the whitepaper is here.
Connection points between opnfv and etsi nfv tst working group
Acknowledgements
This material was created using
• NFV(17)000135 by Silvia Almagia
• NFV (17)000121r1 by Pierre Lynch
and other works of the TST WG

More Related Content

PDF
Automatic Integration, Testing and Certification of NFV in China Mobile
PDF
Challenge in asia region connecting each testbed and poc of distributed nfv ...
PDF
Open Platform for NFV: Arno and Beyond
PDF
Test and perspectives on nfvi from china unicom sdn nfv lab
PPTX
Upstream Testing Collaboration
PPTX
How to Reuse OPNFV Testing Components in Telco Validation Chain
PDF
Big Data for Testing - Heading for Post Process and Analytics
PDF
Distributed VNF Management - Architecture and Use cases
Automatic Integration, Testing and Certification of NFV in China Mobile
Challenge in asia region connecting each testbed and poc of distributed nfv ...
Open Platform for NFV: Arno and Beyond
Test and perspectives on nfvi from china unicom sdn nfv lab
Upstream Testing Collaboration
How to Reuse OPNFV Testing Components in Telco Validation Chain
Big Data for Testing - Heading for Post Process and Analytics
Distributed VNF Management - Architecture and Use cases

What's hot (20)

PPTX
Opnfv vision, community and projects
PDF
Qtip benchmarking as a service for opnfv
PPTX
Challenges in testing for composite vim platforms
PDF
Software-defined migration how to migrate bunch of v-ms and volumes within a...
PDF
Operating OPNFV: Deploy it, test it, run it
PDF
OPNFV scenarios challenges and opportunities
PPTX
Hands-On Testing: How to Integrate Tests in OPNFV
PDF
Faster, Higher, Stronger – Accelerating Fault Management to the Next Level
PDF
Challenges in positioning open stack for nf-vi_ are we biting off more than w...
PPTX
Opnfv testing + opnfv pharos + opnfv xci
PDF
MEF's inter-domain orchestration delivering dynamic third networks [presente...
PDF
How OPNFV Uses OpenStack & How It's Useful
PPTX
Building OPNFV as a Platform
PDF
My network functions are virtualized, but are they cloud-ready
PDF
ONAP integration with opnfv via opera
PDF
Enabling Carrier-Grade Availability Within a Cloud Infrastructure
PDF
Run OPNFV Danube on ODCC Scorpio Multi-node Server - Open Software on Open Ha...
PPTX
Open stack gluon + opnfv netready
PPTX
Swimming upstream: OPNFV Doctor project case study
PDF
Evolution of OPNFV CI System: What already exists and what can be introduced
Opnfv vision, community and projects
Qtip benchmarking as a service for opnfv
Challenges in testing for composite vim platforms
Software-defined migration how to migrate bunch of v-ms and volumes within a...
Operating OPNFV: Deploy it, test it, run it
OPNFV scenarios challenges and opportunities
Hands-On Testing: How to Integrate Tests in OPNFV
Faster, Higher, Stronger – Accelerating Fault Management to the Next Level
Challenges in positioning open stack for nf-vi_ are we biting off more than w...
Opnfv testing + opnfv pharos + opnfv xci
MEF's inter-domain orchestration delivering dynamic third networks [presente...
How OPNFV Uses OpenStack & How It's Useful
Building OPNFV as a Platform
My network functions are virtualized, but are they cloud-ready
ONAP integration with opnfv via opera
Enabling Carrier-Grade Availability Within a Cloud Infrastructure
Run OPNFV Danube on ODCC Scorpio Multi-node Server - Open Software on Open Ha...
Open stack gluon + opnfv netready
Swimming upstream: OPNFV Doctor project case study
Evolution of OPNFV CI System: What already exists and what can be introduced
Ad

Viewers also liked (18)

PDF
Summit 16: Automated Platform for Testing VNF Performance and Interoperabili...
PDF
Summit 16: Open-O Mini-Summit - Welcome & Introduction
PDF
Summit 16: Open-O Mini-Summit - Vision and Update
PDF
Summit 16: Open-O Mini-Summit - VF Event Streaming Project Proposal
PDF
Demo how to efficiently evaluate nf-vi performance by leveraging opnfv testi...
PDF
Summit 16: Open-O Mini-Summit - OPNFV & Open-O
PDF
OPNFV Developer Tools and Release Process
PDF
OPNFV with 5G Applications
PPTX
Building the carrier grade nfv infrastructure
PDF
Securing your telco cloud
PDF
Securing your nfv and sdn integrated open stack cloud- challenges, use-cases ...
PDF
NFV interoperability, for the success of commercial deployments
PDF
Requirement analysis of vim platform reliability in a three-layer decoupling ...
PDF
Summit 16: ARM Mini-Summit - Intro & Overview
PDF
Crossing the river by feeling the stones from legacy to cloud native applica...
PDF
Openstack Tacker - Moving into Pike
ODP
Accelerated dataplanes integration and deployment
PDF
Fast datastacks - fast and flexible nfv solution stacks leveraging fd.io
Summit 16: Automated Platform for Testing VNF Performance and Interoperabili...
Summit 16: Open-O Mini-Summit - Welcome & Introduction
Summit 16: Open-O Mini-Summit - Vision and Update
Summit 16: Open-O Mini-Summit - VF Event Streaming Project Proposal
Demo how to efficiently evaluate nf-vi performance by leveraging opnfv testi...
Summit 16: Open-O Mini-Summit - OPNFV & Open-O
OPNFV Developer Tools and Release Process
OPNFV with 5G Applications
Building the carrier grade nfv infrastructure
Securing your telco cloud
Securing your nfv and sdn integrated open stack cloud- challenges, use-cases ...
NFV interoperability, for the success of commercial deployments
Requirement analysis of vim platform reliability in a three-layer decoupling ...
Summit 16: ARM Mini-Summit - Intro & Overview
Crossing the river by feeling the stones from legacy to cloud native applica...
Openstack Tacker - Moving into Pike
Accelerated dataplanes integration and deployment
Fast datastacks - fast and flexible nfv solution stacks leveraging fd.io
Ad

Similar to Connection points between opnfv and etsi nfv tst working group (20)

PDF
NFV testing landscape
PDF
The Interoperability Challenge in Telecom and NFS Environments
PDF
NFV and OpenStack
PDF
Building the New Telefónica Core with NFV
PDF
NFV Open Source projects
PDF
NFV Interoperability Evaluation Results
PPTX
Demystifying Network Function Virtualization (NFV) Service Assurance
PPTX
Modern Networking Unit 3 Network Function virtualization
PDF
NFV Linaro Connect Keynote
PDF
White Paper: OPNFV: Paving the Way to Open Source NFV
PDF
Network Function Virtualization - Telkomsel Perspective (SDN NFV Day ITB 2016)
PDF
Openstack meetup NFV
PDF
NFV & Openstack
PPTX
NFV ISG – Phase 2 Begins
PPTX
OPNFV: Open Source Carrier Networking Panel
PDF
Computer Network NFV Management and Orchestration.pdf
PDF
Introduction to Network Function Virtualization (NFV)
PDF
Network Function Virtualization Orchestration LI
PPTX
Supporting Virtualized Telco Applications with OpenStack
PDF
Summit 16: ETSI NFV Interface and Architecture Overview
NFV testing landscape
The Interoperability Challenge in Telecom and NFS Environments
NFV and OpenStack
Building the New Telefónica Core with NFV
NFV Open Source projects
NFV Interoperability Evaluation Results
Demystifying Network Function Virtualization (NFV) Service Assurance
Modern Networking Unit 3 Network Function virtualization
NFV Linaro Connect Keynote
White Paper: OPNFV: Paving the Way to Open Source NFV
Network Function Virtualization - Telkomsel Perspective (SDN NFV Day ITB 2016)
Openstack meetup NFV
NFV & Openstack
NFV ISG – Phase 2 Begins
OPNFV: Open Source Carrier Networking Panel
Computer Network NFV Management and Orchestration.pdf
Introduction to Network Function Virtualization (NFV)
Network Function Virtualization Orchestration LI
Supporting Virtualized Telco Applications with OpenStack
Summit 16: ETSI NFV Interface and Architecture Overview

More from OPNFV (10)

PPTX
Energy Audit aaS with OPNFV
PDF
Storage Performance Indicators - Powered by StorPerf and QTIP
PPTX
Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...
ODP
How Many Ohs? (An Integration Guide to Apex & Triple-o)
PPTX
Being Brave: Deploying OpenStack from Master
PDF
Learnings From the First Year of the OPNFV Internship Program
PDF
OPNFV and OCP: Perfect Together
PDF
The Return of QTIP, from Brahmaputra to Danube
PDF
Improving POD Usage in Labs, CI and Testing
PDF
Distributed vnf management architecture and use-cases
Energy Audit aaS with OPNFV
Storage Performance Indicators - Powered by StorPerf and QTIP
Testing, CI Gating & Community Fast Feedback: The Challenge of Integration Pr...
How Many Ohs? (An Integration Guide to Apex & Triple-o)
Being Brave: Deploying OpenStack from Master
Learnings From the First Year of the OPNFV Internship Program
OPNFV and OCP: Perfect Together
The Return of QTIP, from Brahmaputra to Danube
Improving POD Usage in Labs, CI and Testing
Distributed vnf management architecture and use-cases

Recently uploaded (20)

PDF
Product Update: Alluxio AI 3.7 Now with Sub-Millisecond Latency
PDF
Topaz Photo AI Crack New Download (Latest 2025)
PDF
Complete Guide to Website Development in Malaysia for SMEs
PPTX
Monitoring Stack: Grafana, Loki & Promtail
PPTX
Log360_SIEM_Solutions Overview PPT_Feb 2020.pptx
PPTX
WiFi Honeypot Detecscfddssdffsedfseztor.pptx
DOCX
Greta — No-Code AI for Building Full-Stack Web & Mobile Apps
PDF
Ableton Live Suite for MacOS Crack Full Download (Latest 2025)
PDF
Types of Token_ From Utility to Security.pdf
PPTX
AMADEUS TRAVEL AGENT SOFTWARE | AMADEUS TICKETING SYSTEM
PPTX
Patient Appointment Booking in Odoo with online payment
PPTX
"Secure File Sharing Solutions on AWS".pptx
PPTX
Tech Workshop Escape Room Tech Workshop
PPTX
Weekly report ppt - harsh dattuprasad patel.pptx
PPTX
Oracle Fusion HCM Cloud Demo for Beginners
PPTX
Advanced SystemCare Ultimate Crack + Portable (2025)
PPTX
chapter 5 systemdesign2008.pptx for cimputer science students
PDF
Salesforce Agentforce AI Implementation.pdf
PDF
Cost to Outsource Software Development in 2025
PDF
Designing Intelligence for the Shop Floor.pdf
Product Update: Alluxio AI 3.7 Now with Sub-Millisecond Latency
Topaz Photo AI Crack New Download (Latest 2025)
Complete Guide to Website Development in Malaysia for SMEs
Monitoring Stack: Grafana, Loki & Promtail
Log360_SIEM_Solutions Overview PPT_Feb 2020.pptx
WiFi Honeypot Detecscfddssdffsedfseztor.pptx
Greta — No-Code AI for Building Full-Stack Web & Mobile Apps
Ableton Live Suite for MacOS Crack Full Download (Latest 2025)
Types of Token_ From Utility to Security.pdf
AMADEUS TRAVEL AGENT SOFTWARE | AMADEUS TICKETING SYSTEM
Patient Appointment Booking in Odoo with online payment
"Secure File Sharing Solutions on AWS".pptx
Tech Workshop Escape Room Tech Workshop
Weekly report ppt - harsh dattuprasad patel.pptx
Oracle Fusion HCM Cloud Demo for Beginners
Advanced SystemCare Ultimate Crack + Portable (2025)
chapter 5 systemdesign2008.pptx for cimputer science students
Salesforce Agentforce AI Implementation.pdf
Cost to Outsource Software Development in 2025
Designing Intelligence for the Shop Floor.pdf

Connection points between opnfv and etsi nfv tst working group

  • 2. Connection Points Between OPNFV and ETSI NFV TST Working Group Lynch Pierre (TST WG Chair) Gergely Csatari (TST WG Contributor)
  • 3. 3 What is NFV TST WG? TST is one of several working groups under the ETSI NFV Industry Specification Group (ISG) • A productive and collaborative team (albeit being relatively small compared to other working groups) • Participants include telecom operators, vendors and testing companies
  • 4. 4 TST Areas of Focus • Testing the NFV functional blocks: VNF, MANO and NFVI • Creating NFV Proof of Concept (PoC) and Interoperability guidelines • Analyzing gaps between open source projects and the ETSI NFV architecture
  • 5. TST001 – Pre-deployment Testing • Assessing the performance of the NFVI and its ability to fulfil the performance and reliability requirements of the VNFs executing on the NFVI. • Data and control plane testing of VNFs and their interactions with the NFV Infrastructure and the NFV MANO. • Validating the performance, reliability and scaling capabilities of Network Services. • NFVI pre-deployment validation part was developed in cooperation with OPNFV Yardstick Published
  • 6. TST002 – Report on NFV Interop. Testing Methodology • Guidelines for NFV interoperability testing • Generic System Under Test (SUT) architecture for NFV • Initial SUT configurations • Interoperability feature areas Published
  • 7. 7 TST003 – Open source components Identifying gaps between OpenStack NBI and IFA005/IFA006 Published
  • 8. 8 TST004 – Path implementation testing • Guidelines for test plan on path implementation through NFVI • SUT options • Function placement • SDN application type • SDN controller type • Metrics • VNFC instantiation time • Path instantiation • 1st packet latency • Std pkt transfer measurements • Procedures • Examples Published
  • 9. • Report on use cases and recommendations for VNF Snapshot • Use cases: • Testing • Troubleshooting • Lifecycle management • During VNF lifecycle procedure • Quick VNF recovery • Gap Analysis with existing solutions • Framework, procedures and solutions • Recommendations to IFA specifications • Policies, Fct Reqs on MANO, Ref Points VNF Instance VNF Snapshot Package VNF Snapshot external location Create VNF Snapshot Revert VNF Snapshot Create VNF Snapshot Package Extract VNF Snapshot Package Export VNF Snapshot Package Import VNF Snapshot Package TST005 – VNF Snapshot report Published
  • 10. • Usage of DevOps and CI/CD in Telco environment • Focus on the handoff of VNF • Background and overview • Use cases • Supplier • Operator • Validator • Test procedures • Recommendations for package description enhancements DevOps pipeline, VNF1 supplier part VNF OperatorVNF1 Supplier DevOps pipeline, VNF2 supplier part VNF2 Supplier DevOps pipeline, VNF operator part TST006 – DevOps and CI/CD Draft
  • 11. • Interoperability Testing Guidelines for NFVI-VIM, MANO and VNF • Detailed collection of test descriptions for most functionality • Based on TST002 and 1st NFV Plugtests Test Plan TST007 – Guidelines for interop Draft
  • 12. • Compute, Networking and Memory metrics for NFVI • Each Metric: • Name & Background • Parameters & Scope • Units & Method of Measurement • Definition • Sources of Error, Discussion • Will be referenced by IFA027 • Compute: Processor usage, utilization • Network: Packet, Octet, Dropped Packet, Errored Packet Counts • Memory: Buffered, Cached, Free, Slab • Done in cooperation with OPNFV Barometer TST008 – NFVI Compute and Network Metrics Specification Published
  • 13. • Vendor-agnostic definitions of performance metrics and the associated methods of measurement for Benchmarking networks supported in the NFVI • Intended to serve as a basis for fair comparison of different implementations of NFVI • Possible cooperation with OPNFV vsperf TST009 – Testing Specification of Networking Benchmarks and Measurement Methods for NFVI Draft
  • 14. ETSI NFV Plugtests • Interoperability Test Sessions • Among different combinations of Functions Under Test (FUTs) • 3 types of FUTs: VNFs, MANO, NFVI&VIM • At a functional level (conformance not enforced) • Validate basic NFV Rel 2 capabilities: • NSD, VNF Package and SW Image Management • NS and VNF Life Cycle Management, VR Management • “Early” Plugtest • Stage 3 incomplete • IOP through open APIs, plugins, … • …and remote integration
  • 15. ETSI NFV Plugtests • 31 participating companies or organisations including OPNFV • 35 Functions Under Test (commercial and open source): • 15 VNFs, • 9 MANOs, • 11 NFVI&VIM • Several supporting open source communities: • ETSI OSM, • Open Baton, • OPNFV, • Open-O
  • 16. ETSI NFV Plugtests results Deliverables: • A Test Plan was prepared • Test results were reported • An overall Report was created
  • 18. +
  • 20. ETSI NFV TST interworking with open source • Testing is a natural area for collaboration between ETSI NFV and open source projects • ETSI NFV is happily doing test plans, reports and specification and let the open source projects to do the implementations • TST WG is looking for feedback on ETSI NFV, but there is also a bug tracker
  • 21. Link to the whitepaper is here.
  • 23. Acknowledgements This material was created using • NFV(17)000135 by Silvia Almagia • NFV (17)000121r1 by Pierre Lynch and other works of the TST WG