A City Traffic Model for Optical Circuit Switching in Data Centers

.
All in One Slide
1. Traffic has changed into a mix of extremes → the hotspot model 06
BigData, bulk transfer, migration in clouds 03, traffic blackswans...
2. Current best OBS 10 → a mix of OPS + OCS (... to mirror the traffic)
easier to separate into two separate networks
3. Bulk transfers want e2e cut-through 16 ... and will not settle for less
good solutions are likely to drastically change the technology
06 myself+1 Popularity-Based Modeling of Flash Events in Synthetic Packet Traces IEICE CQ研(2012)
03 myself+0 Optimizing Virtual Machine Migration for Energy-Efficient Clouds IEICEJ (2014)
10 Harry G. Perros Connection-Oriented Networks : SONET/SDH, ATM, MPLS, and Optical Networks Wiley (2005)
16 Cut-Through and Store-and-Forward Ethernet Switching for Low-Latency Environments Cisco (2014)
M.Zhanikeev -- maratishe@gmail.com -- A City Traffic Model for Optical Circuit Switching in Data Centers -- http://bit.do/marat141030 -- 2/24
.
2/24

.
Cut-Through
.
3/24

.
The Benefits of Cut-Through
Cut-Through mode is possible only during exclusive access to line 11 16
applies to all technologies but OCS -- assuming networks are all-IP today
in Ethernet, available even in the cheapest switches
QoS
classes
Check,
etc. Q: Queue D: Drop
C: Cut Through
11 G.Wang+5 c-Through: Part-time Optics in Data Centers ACM SIGCOMM (2010)
.
4/24

.
Cut-Through will not Work when Shared
again, in Ethernet, optical, wireless networks, you always share the
uplink
cut-through does not work when shared
... therefore, circuits have to be emulated 11
Switch Switch
Qualitatively
Identical
.
5/24

.
Cut-Through: Parallel vs Sequential
20 24 28 32 36 40
Transfer time in contention (s)
40
36
32
28
24
20
Transfer time by exclusive circuits (s)
.
6/24

.
OBS
.
7/24

.
Optical Burst Switching (OBS) Basics
10 Harry G. Perros Connection-Oriented Networks : SONET/SDH, ATM, MPLS, and Optical Networks Wiley (2005)
15 R.Jankuniene+1 The Contention Resolution in OBS Network Elektronika ir Electrotechnika (2014)
.
8/24

.
OBS: Specific Slow-Downs
1. the OEO bottleneck, which requires gaps between signaling and bulk
an intrinsically centralized design
2. fixed configuration: time gaps, burst size, backoff timeouts, etc.
when not fixed -- QoS classes are difficult to implement in a fair manner
3. no official way to communicate with NOC -- OBS is an isolated world
4. ...
.
9/24

.
The City Traffic Model
.
10/24

.
.
The Basic Idea is Simple...
.
... let's treat packet traffic the same way we treat road traffic in our
cities
.
bulk sources are unique individuals, just like drivers
3C games apply (3C: cogn., coop, coord)
the concept of highways = tall roads is applicable
there should be a cost threshold for bulk transfers
before getting on the highway, bulk sources should be able to make a decision:
go on highway or stay on free roads
.
11/24

.
TE Formulations
a non-standard TE 12
unit demand as source s,
dest d, volume v, time t,
wavelength
Ti = ⟨s; d; v; t⟩:
notation: demand →
solution
Overlaps
Traditional OSPF
Ti = ⟨s; d; v⟩ ! ⟨s; a; b; :::; d⟩
Optical without Wavelength Switchign
Ti = ⟨s; d; v⟩ ! ⟨s; ⟩
Optical with Switching
Ti = ⟨s; d; v⟩ ! ⟨s; s; a; b; :::⟩
Ti = ⟨s; d; v; t1; t2⟩ ! ⟨s; ; t⟩
12 B. Fortz+1 Internet Traffic Engineering by Optimizing OSPF Weights INFOCOM (2000)
.
12/24

.
The Model: Bulk, Tall Gates, Sensing
distributed, heterogeneous, bulk transfer circuits
one-way, so, sensing and admission on one side is enough
.
13/24

.
Sensing: More Like Wireless
OBS implements collission control, sometimes called sensing 15
real sensing exists in Wireless MAC
the same concepts are used here:
1. too much sensing is bad interference
2. pull versus push approaches, depending on environment
3. physically separate signaling from bulk domains
15 R.Jankuniene+1 The Contention Resolution in OBS Network Elektronika ir Electrotechnika (2014)
.
14/24

.
Simulation
.
15/24

.
The Hotspot Traffic Model
.
Hotspots are
.
...bulk (BigData, blackswan) sources which are very few but very
impact-y.
.
standard traffic models
do not capture hotspots
4 states: normal vs
hotspots, hotspots are
baseline vs Flash
Crowds
parameters: magnitude,
variance across hotspots,
likelihood of a Flash event, ...
.
16/24

.
Current Solutions/Technologies
very hard to convert symbolics into numbers
.
17/24

.
Numeric Models
all the above metrics are converted into numeric form (seconds, impairment
ratio, ...)
all realistic based on the literature, more in the paper or in 01
continuous versus once-per-flow metric
bulks of various levels, input based on the hotspot model
input: 100 flows, output: which model finishes first
01 myself+0 Circuit Emulation for Big Data Transfers in Clouds Networking for Big Data, Wiley (in print) (2015)
.
18/24

.
Performance Results
0 2 4 6 8
Ordered list
2.25
1.8
1.35
0.9
0.45
0
log( duration)
P2Px1N P2Px2N Tall Gate
Do Nothing Traditional Scheduler Network Virtualization
0 2 4 6 8
Ordered list
2.4
1.6
0.8
0
log( duration)
0 2 4 6 8
Ordered list
2.4
1.8
1.2
0.6
log( duration)
2.55
log( duration) 0 2 4 6 8
0 2 4 6 8
Ordered list
2.4
2.1
1.8
1.5
Ordered list
2.25
1.95
1.65
log( duration)
0 2 4 6 8
Ordered list
2.4
2
1.6
1.2
log( duration)
Size: 10M..100M Size: 100M..500M
Size: 500M..1G
Size: 10G..100G
Size: 1G..10G Size: 10G..50G
Tall Gate = City Traffic
(two codenames)
do nothing is OK for
small bulks
Tall Gate wins for all
the large bulks
.
19/24

.
Implementation
.
20/24

.
The City Traffic Model in Practice
Gate A
Gate B
shows JGN (NICT) -- in
process of getting access to
two gates now
logically a ring, physically a
trunk
gates fit perfectly as
access points in/out of JGN
.
21/24

.
OCS with Gates and Sensing
a lot more responsive NOC as part of sensing technology
dumb, cheap, e2e OCS network
.
22/24

.
Wrapup
City Traffic (aka Tall Gate) Model works for all networks -- wireless,
Ethernet, optical
search for similar solutions already ongoing in data centers 16, some with
FCoE 09
some related ideas applied to optical networks in data centers 11
but this presentation is the first to present the actual model
more details later in 01
09 S.Gai Data Center Networks and Fibre Channel over Ethernet (FCoE) Lulu.com (2008)
01 myself+0 Circuit Emulation for Big Data Transfers in Clouds Networking for Big Data, Wiley (in print) (2015)
.
23/24

.
That’s all, thank you ...
.
24/24

.
[01] myself+0 (2015)
Circuit Emulation for Big Data Transfers in Clouds
Networking for Big Data, Wiley (in print)
[02] myself+0 (2014)
Multi-Source Stream Aggregation in the Cloud
Advanced Content Delivery ... in the Cloud, Wiley
[03] myself+0 (2014)
Optimizing Virtual Machine Migration for Energy-Efficient Clouds
IEICEJ
[04] myself+0 (2014)
High Availability Cloud Storage ... Social Graph, Throughput...
IEICE NS研
[05] myself+1 (2012)
Analytical Models for L2 versus L3 QoS Provisioning
IEICE PN研
.
24/24

.
[06] myself+1 (2012)
Popularity-Based Modeling of Flash Events in Synthetic Packet Traces
IEICE CQ研
[07] myself+0 (2013)
....Measuring Per-Packet Cost of Software Defined Networking
IEICE SC研
[08] J.McDonald (1983)
Fundamentals of Digital Switching
Applications of Communications Theory, Springer
[09] S.Gai (2008)
Data Center Networks and Fibre Channel over Ethernet (FCoE)
Lulu.com
[10] Harry G. Perros (2005)
Connection-Oriented Networks : SONET/SDH, ATM, MPLS, and Optical Networks
Wiley
.
24/24

.
[11] G.Wang+5 (2010)
c-Through: Part-time Optics in Data Centers
ACM SIGCOMM
[12] B. Fortz+1 (2000)
Internet Traffic Engineering by Optimizing OSPF Weights
INFOCOM
[13] I.Houidi+2 (2008)
A Distributed Virtual Network Mapping Algorithm
ICC
[14] Hui Zang+4 (2001)
Dynamic Lightpath Establishment in Wavelength-Routed Networks
IEEE ComMag
[15] R.Jankuniene+1 (2014)
The Contention Resolution in OBS Network
Elektronika ir Electrotechnika
[16] (2014)
.
24/24

.
Cut-Through and Store-and-Forward Ethernet Switching for Low-Latency
Environments
Cisco
[17] (2003)
Definitions of Managed Objects for the Optical Interface Type
RFC3591
[18] (current)
INCITS T11 Standardization Body
www.t11.org/FCoE
.
24/24

A City Traffic Model for Optical Circuit Switching in Data Centers

More Related Content

Similar to A City Traffic Model for Optical Circuit Switching in Data Centers (20)

More from Tokyo University of Science (20)

Recently uploaded (20)

A City Traffic Model for Optical Circuit Switching in Data Centers