SlideShare a Scribd company logo
The Role of Inter-Controller Traffic in
SDN Controllers Placement
Tianzhu Zhang, Andrea Bianco, Paolo Giaccone
IEEE NFV-SDN: Palo Alto, CA
November 8th, 2016 1
Software Defined Networking
• programmability
• enabled by centralized view of the
network state
Advantages
• scalability for large networks
One relevant challenge
2
Distributed controllers
• fault-tolerance and resilience
• load balancing, thus higher scalability
Motivation
• how the network state is distributed across
the controllers to allow a centralized logical
view
Critical issue
3
Control-plane in distributed controllers
• in-band for large networks (e.g. SD-WAN)
• switch-controller (Sw-Ctr) traffic
– standard protocols (e.g. OpenFlow)
• controller-controller (Ctr-Ctr) traffic
4
Switch-controller
traffic
Inter-controller traffic
Inter-controller (Crt-Ctr) traffic
• needed to synchronize the controllers’ states
– shared data structures
• generated by consistency protocols
– ad-hoc protocols
– different models for consistency
5
Consistency models
• assume a shared table=(key,value)
• strong consistency
– any read(key) returns always the same value
• eventual consistency
– any read(key) returns eventually the same value
• adopted model affects heavily
– the mechanisms to distribute and update the data
– the reactivity of the SDN controllers perceived by the
network devices
– the correct behavior of the network
• e.g. inconsistent view of the network graph may lead to
routing loops
6
Consistency in SDN controllers
• eventual consistency
• anti-entropy algorithm
• network topology
• flow rules
• flow statistics
• strong consistency
• RAFT consensus algorithm
• switch-controller mapping
• distributed locks
ONOS
• strong consistency
• RAFT consensus algorithm
• all shared data structures
OpenDaylight
7
Data-ownership model
• Consistency model affects that controller owner of the
shared data
8
• Read/write operations always forwarded by the
local controller to the data-owner controller
• distributed architecture only for high availability
• e.g. strong consistent data structures
Single data-ownership (SDO) model
• Read/write operations are local and then
forwarded (asynchronously) to the other
controllers
• e.g. eventual consistent data structures
Multiple data-ownership (MDO) model
Our main contributions
• we provide formulas to estimate the reactivity
perceived at the switch due to the Sw-Ctr and
Ctr-Ctr interactions
• we show the performance tradeoffs for the
controller placement problem
9
Reactivity for Multi Data-Ownership
Switch S1
ResponseUpdate
data
Flood
update
Data owner
controller
TR
TR = Sw-Ctr RTT
Data owner
controller
Data owner
controller
Reactivity for Single Data-Ownership
Data owner
controller
Switch S1
Raft
request
Log
replicatiom
ResponseUpdate
data
Log
reply
Log commit
Controller
Controller
Hp: RAFT algorithm for
strong consistency
TR
TR = Sw-Ctr RTT+2 Ctr-Ctr RTT
Optimal controller placements
13
0
10
20
30
40
50
60
70
050100150200250300350400
Reaction time for MDO [ms]
ReactiontimeforSDO[ms]
OptimalSDOplacement
OptimalMDOplacement
3 controllers in large ISP
For Single Data-Ownership (SDO), 3 possible data owners
The role of data owner in SDO
Choosing carefully the data owner is very important for the
reactivity 14
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
0100200300400500600700800900
Reduction factor
Placementid
Maximum
Minimum
Minimum reduction factor =
Reactivity (2nd best data owner choice)
Reactivity (best data owner choice)
Maximum reduction factor =
Reactivity (worst data owner choice)
Reactivity (best data owner choice)
Conclusions
• single/multiple data-ownership models adopted
by real SDN controllers affect strongly the
performance perceived at the network devices
• reactivity formulas allow to devise the optimal
placement of the controllers
– the latencies among controllers are crucial in SDO
model
• in the SDO model the choice of the data owner is
crucial
• accurate validation of the given formulas in a
large SD-WAN controlled by OpenDaylight
– available on extended version [1] on arxiv
15

More Related Content

PPTX
Inter-controller Traffic in ONOS Clusters for SDN Networks
PPT
Wireless networks ..mac layer
PDF
Equal Cost Multipath Routing in FOKUS OpenSDNCore
PPTX
Design and Implementation of a Load Balancing Algorithm for a Clustered SDN C...
PPTX
Computer network switching
PDF
Performance Engineering Requirements
PDF
Software Defined Networking - 2
PDF
Software Defined Networking - 1
Inter-controller Traffic in ONOS Clusters for SDN Networks
Wireless networks ..mac layer
Equal Cost Multipath Routing in FOKUS OpenSDNCore
Design and Implementation of a Load Balancing Algorithm for a Clustered SDN C...
Computer network switching
Performance Engineering Requirements
Software Defined Networking - 2
Software Defined Networking - 1

What's hot (20)

PDF
Software Defined Networking - 3
PDF
Traffic Engineering in Software-Defined Networks
PPTX
Software defined network
PDF
Raft in details
PPTX
Cloud computing Module 2 First Part
PPTX
Replication in Distributed Systems
PDF
OSMC 2021 | Scaling Naemon deployments to Kubernetes with Merlin
PPT
Chapter00000000
PPTX
20210506 meeting2
PPTX
Task migration in os
PDF
Clock Synchronization in Distributed Systems
PPTX
PPT
Process Management-Process Migration
PPTX
Software defined networks and openflow protocol
PPTX
Training presentation
PPTX
Physical and Logical Clocks
PPTX
Carrier Ethernet
PPT
Synchronization in distributed systems
PPTX
Communication And Synchronization In Distributed Systems
PDF
The Challenges of SDN/OpenFlow in an Operational and Large-scale Network
Software Defined Networking - 3
Traffic Engineering in Software-Defined Networks
Software defined network
Raft in details
Cloud computing Module 2 First Part
Replication in Distributed Systems
OSMC 2021 | Scaling Naemon deployments to Kubernetes with Merlin
Chapter00000000
20210506 meeting2
Task migration in os
Clock Synchronization in Distributed Systems
Process Management-Process Migration
Software defined networks and openflow protocol
Training presentation
Physical and Logical Clocks
Carrier Ethernet
Synchronization in distributed systems
Communication And Synchronization In Distributed Systems
The Challenges of SDN/OpenFlow in an Operational and Large-scale Network
Ad

Similar to The Role of Inter-Controller Traffic in SDN Controllers Placement (20)

PPTX
ONOS Platform Architecture
PPTX
TE581-Software Defined Networking-2019aaaaaaaaaaaaaaaa.pptx
PPTX
Performance and traffic management for WSNs
PPTX
lect4_SDNbasic_openflow.pptx
PPTX
SDN Multi-Controller Domain.pptx
PDF
Cosmos DB at VLDB 2019
PPTX
Software defined network
PDF
Fast switching of threads between cores - Advanced Operating Systems
PDF
intro lect.pdfkkpkpkpkpkpjjkojkopjjojjoj
PPTX
F14_Class1.pptx
PPTX
DC Moving I migracion a otro datacenterd
PDF
NOSIX - A Lightweight Portability Layer for the SDN OS
PPTX
Real Time Operating Systems
PPT
Enabling Active Flow Manipulation (AFM) in Silicon-based Network Forwarding E...
PDF
Software-Defined Networking Changes for the Paradigm for Mission-Critical Ope...
PPTX
SDN approach.pptx
PPTX
Software Defined Networking, Concepts and Practical Implementations
PPTX
Discretized Stream - Fault-Tolerant Streaming Computation at Scale - SOSP
PPTX
Link_NwkingforDevOps
PPTX
software defined networks software defined networks.pptx
ONOS Platform Architecture
TE581-Software Defined Networking-2019aaaaaaaaaaaaaaaa.pptx
Performance and traffic management for WSNs
lect4_SDNbasic_openflow.pptx
SDN Multi-Controller Domain.pptx
Cosmos DB at VLDB 2019
Software defined network
Fast switching of threads between cores - Advanced Operating Systems
intro lect.pdfkkpkpkpkpkpjjkojkopjjojjoj
F14_Class1.pptx
DC Moving I migracion a otro datacenterd
NOSIX - A Lightweight Portability Layer for the SDN OS
Real Time Operating Systems
Enabling Active Flow Manipulation (AFM) in Silicon-based Network Forwarding E...
Software-Defined Networking Changes for the Paradigm for Mission-Critical Ope...
SDN approach.pptx
Software Defined Networking, Concepts and Practical Implementations
Discretized Stream - Fault-Tolerant Streaming Computation at Scale - SOSP
Link_NwkingforDevOps
software defined networks software defined networks.pptx
Ad

Recently uploaded (20)

PDF
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
PPTX
OOP with Java - Java Introduction (Basics)
PPT
Project quality management in manufacturing
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PPT
Mechanical Engineering MATERIALS Selection
PDF
composite construction of structures.pdf
PPTX
CH1 Production IntroductoryConcepts.pptx
PDF
Automation-in-Manufacturing-Chapter-Introduction.pdf
PPTX
UNIT 4 Total Quality Management .pptx
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PPTX
Lecture Notes Electrical Wiring System Components
PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PPTX
Recipes for Real Time Voice AI WebRTC, SLMs and Open Source Software.pptx
PDF
R24 SURVEYING LAB MANUAL for civil enggi
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
OOP with Java - Java Introduction (Basics)
Project quality management in manufacturing
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
Mechanical Engineering MATERIALS Selection
composite construction of structures.pdf
CH1 Production IntroductoryConcepts.pptx
Automation-in-Manufacturing-Chapter-Introduction.pdf
UNIT 4 Total Quality Management .pptx
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
CYBER-CRIMES AND SECURITY A guide to understanding
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
Lecture Notes Electrical Wiring System Components
Embodied AI: Ushering in the Next Era of Intelligent Systems
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
Recipes for Real Time Voice AI WebRTC, SLMs and Open Source Software.pptx
R24 SURVEYING LAB MANUAL for civil enggi

The Role of Inter-Controller Traffic in SDN Controllers Placement

  • 1. The Role of Inter-Controller Traffic in SDN Controllers Placement Tianzhu Zhang, Andrea Bianco, Paolo Giaccone IEEE NFV-SDN: Palo Alto, CA November 8th, 2016 1
  • 2. Software Defined Networking • programmability • enabled by centralized view of the network state Advantages • scalability for large networks One relevant challenge 2
  • 3. Distributed controllers • fault-tolerance and resilience • load balancing, thus higher scalability Motivation • how the network state is distributed across the controllers to allow a centralized logical view Critical issue 3
  • 4. Control-plane in distributed controllers • in-band for large networks (e.g. SD-WAN) • switch-controller (Sw-Ctr) traffic – standard protocols (e.g. OpenFlow) • controller-controller (Ctr-Ctr) traffic 4 Switch-controller traffic Inter-controller traffic
  • 5. Inter-controller (Crt-Ctr) traffic • needed to synchronize the controllers’ states – shared data structures • generated by consistency protocols – ad-hoc protocols – different models for consistency 5
  • 6. Consistency models • assume a shared table=(key,value) • strong consistency – any read(key) returns always the same value • eventual consistency – any read(key) returns eventually the same value • adopted model affects heavily – the mechanisms to distribute and update the data – the reactivity of the SDN controllers perceived by the network devices – the correct behavior of the network • e.g. inconsistent view of the network graph may lead to routing loops 6
  • 7. Consistency in SDN controllers • eventual consistency • anti-entropy algorithm • network topology • flow rules • flow statistics • strong consistency • RAFT consensus algorithm • switch-controller mapping • distributed locks ONOS • strong consistency • RAFT consensus algorithm • all shared data structures OpenDaylight 7
  • 8. Data-ownership model • Consistency model affects that controller owner of the shared data 8 • Read/write operations always forwarded by the local controller to the data-owner controller • distributed architecture only for high availability • e.g. strong consistent data structures Single data-ownership (SDO) model • Read/write operations are local and then forwarded (asynchronously) to the other controllers • e.g. eventual consistent data structures Multiple data-ownership (MDO) model
  • 9. Our main contributions • we provide formulas to estimate the reactivity perceived at the switch due to the Sw-Ctr and Ctr-Ctr interactions • we show the performance tradeoffs for the controller placement problem 9
  • 10. Reactivity for Multi Data-Ownership Switch S1 ResponseUpdate data Flood update Data owner controller TR TR = Sw-Ctr RTT Data owner controller Data owner controller
  • 11. Reactivity for Single Data-Ownership Data owner controller Switch S1 Raft request Log replicatiom ResponseUpdate data Log reply Log commit Controller Controller Hp: RAFT algorithm for strong consistency TR TR = Sw-Ctr RTT+2 Ctr-Ctr RTT
  • 12. Optimal controller placements 13 0 10 20 30 40 50 60 70 050100150200250300350400 Reaction time for MDO [ms] ReactiontimeforSDO[ms] OptimalSDOplacement OptimalMDOplacement 3 controllers in large ISP For Single Data-Ownership (SDO), 3 possible data owners
  • 13. The role of data owner in SDO Choosing carefully the data owner is very important for the reactivity 14 0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 0100200300400500600700800900 Reduction factor Placementid Maximum Minimum Minimum reduction factor = Reactivity (2nd best data owner choice) Reactivity (best data owner choice) Maximum reduction factor = Reactivity (worst data owner choice) Reactivity (best data owner choice)
  • 14. Conclusions • single/multiple data-ownership models adopted by real SDN controllers affect strongly the performance perceived at the network devices • reactivity formulas allow to devise the optimal placement of the controllers – the latencies among controllers are crucial in SDO model • in the SDO model the choice of the data owner is crucial • accurate validation of the given formulas in a large SD-WAN controlled by OpenDaylight – available on extended version [1] on arxiv 15