Saving Energy With Smart Cabling

Saving Energy With 'Smart' Cabling

Mike Cooper, RCDD
Systems Application Engineer, Netconnect Data Center Solutions
mike.cooper@tycoelectronics.com

October 31, 2007


What is “smart” cabling?

• High bandwidth cabling?

• High density cabling?

• Intelligent cabling?

• Well designed cabling?

Information is Tyco Electronics Confidential & Proprietary
Do Not Reproduce or Distribute page 2 / October 31, 2007

Impact of Power Density

• Power Density is increasing on average 15-20% per year within the
data Center
– Individual server power density
– IT Technology refresh activity
– Server footprint

• Methods of measuring efficiency within the DC are outdated
– Watts/sq meter are no longer useful in deciding server
deployment strategies

• Key to success is balancing infrastructure investments with IT goals
model


Power- Where is it Going?

Reducing Data Center power consumption is a multi-faceted challenge. All
areas need to be addressed to maximize data center compute capacity and
minimize power costs.

Netw ork Equip,
12%
Server, 25% Cooling, 50%

Pw r Loss, 10%

Lighting, 3%
Sources: EYP Mission Critical Facilities, Cisco IT, Network World, Customer Interviews, APC

NOTE: Industry rule of thumb is that approx 25% of Data Center Power goes to
networking equipment and typically includes cooling and power requirements.


Application Cabling Power Measurements

How much power use is direct from the network?

• Power consumption due to Ethernet links

• Power measurement of
– LAN switch
– 1000 Base-T NIC



• Power use measurement
– 24-port LAN switch
– No. of Active configured links

# ports 10 Mb/sec 100 Mb/sec 1000 Mb/sec

0 69.1 W 69.1 W 69.1 W

2 70.2 70.1 72.9

4 71.1 70.0 76.7

6 71.6 71.1 80.2

8 71.9 71.9 83.7

10 and 100 Mb/sec At 1000 Mb/sec it is about
are about the same 1.8 W added per active link


• Power use measurements

Idle Link (no activity)

Rate Current Voltage Power

(Mb/s) (mA) (V) (W) Measured at PCI bus (DC)
1000 770 5.08 3.91
Active Link (file transfer)
100 224 5.11 1.14
10 130 5.11 .664
Rate Current Voltage Power

(Mb/s) (mA) (V) (W)
Difference between 1000 and
10 Mb/sec is about 3.2 W 1000 768 5.08 3.90

100 224 5.11 1.14
No significant difference between
10 124 5.11 .633
idle and active link

Current application benefits

• Density, modularity & performance
on equipment and in infrastructure

• MRJ21™ provides Hi-D Green GbE
Euro
– Connector: 1/3 -1/4 RJ45 cassette
MPO
– Cable: 30% smaller, 20% lighter MRJ21™

• 1 cable vs. wrapped 6-cable bundle 1.14”x.74”
– Eco-Friendly 6 GbE ports

– All components permanent link tested,
documented and serialized
– Pwr: 7-15% less than RJ45 in 2x ports
– 10G Shielded Version in process


Network Vendors with Hi-Density GbE Equipment

• Alcatel • Shanghai Electronics
– OmniSwitch • Stratex Networks
– Lucent • Tellabs / Vivace
Foundry BigIron RX-4,8, & 16
– TiMetra • UT Starcom 48 GbE ports/card
• Barco Xenia
• EIT
• EntriSphere
• Foundry Networks
Alcatel OmniSwitch
• Force10 Networks NI48 card

• Fujitsu
• IBM IBM eServer
BladeCenter Copper Pass-
• Motorola Force10 E1200 thru module
90 GbE ports/card 15 GbE ports
• NMS Communications
• Proworks Note: The vendors listed and shown have publicly launched MRJ21
equipment into the marketplace. Vendors not listed should be
contacted directly for program status updates.


10G Base-T Application Cabling Power

• 10GB-T PHY optimized for 100m UTP Cabling
– 15-20W (in 90nm) (1000B-T: 500mW)
– Problem for High Density Line Cards, PCI Cards, MBs
– 2.5us latency (1000B-T: 250ns)
– Too high for some High Performance Applications, Fibre Channel,
InfiniBand
– Power Hungry AFE (Analog Front End)
– 50% of Power is in AFE

• Not likely to improve much over time
– Large percentage of the power is in the AFE
– Power reductions in smaller process geometries are questionable


10G Base-T Application Cabling Power

• Summary of power measurements

15
Power use (W)

10

5

0
10 100 1000 10000

10G Base-T is a power concern speed (Mb/sec)
Link

g00.xls

10G Base-T Application Shielded Cabling
Power
• Power Dissipation • Short Reach
– 3W Typical, 4W Worst Case – 30m on STP/FTP Cable (field
• Latency configurable)
– Less than 500ns – 2 Connector, 3 Links Segments
– Goal of 250ns – Goal of 45m
• Low Cost • Auto Negotiation Compatible
– Significant SNR Margin – RJ-45 Connector
(1000B-T: 10dB) – Backwards Compatible with 100B-T /
– Demonstrable Design of 1M Gates 1000B-T over UTP
(2x 1000B-T)


Characteristics of Data Center Cabling

• 90% of Links are in Server Rooms Less Than 1,524 m^2 (5,000’)
(100% <= 30m)

• 5% of Links are in S. Rooms Between 1,524 m^2 and 6,096 m^2 (5,000’~20,000’)
(80% <= 30m)

• 5% of Links are in Server Rooms Greater Than 6,096 m^2 (20,000’)
(55% <= 30m)

• => 97% Coverage with 30m

• => 99% Coverage with 45m


10G Base-T Application Shielded Cabling
Power
• Networking power consumption is a significant portion of energy use
in data Centers.

• Other elements within the data Center can modulate power
to required performance

• Installing shielded cabling can allow the reduction of Network power
requirements for 10G Base-T by up to 75%


Energy Efficient Ethernet

• Past / current practice
– Design for maximum performance and ensure maximum power
condition can be powered / cooled.

• Future practice needs
– Design for normal usage, ensuring maximum energy efficiency at
that operating point
– Lower energy use at lower utilization
– Design for minimum energy usage over operational lifetime



• 1 Gb/s
– Most NIC’s and most energy to be saved
– Substantial benefits for homes and offices
– Battery life benefit for notebooks

• 10 Gb/s (copper)
– Reduces power burden in data centers
– Reduces cooling burden in data centers
– May increase switch/router port capacity



• Imagine:

• Some means of changing PHY speed for major copper PHY’s:

– Change between 1000BASE-T & 100BASE-TX based on actual
utilization.
– Change between 10GBASE-T & 1000BASE-T based on actual
utilization.



• Potential estimated energy savings:
• Commercial (Office)
– PCs, switches, printers, etc.
– 1.47 to 2.21 TWh/year
– $283 to $522 million/year
• Data Centers
– Servers, storage, switches, routers, etc.
– 0.53 to 1.05 TWh/year
– $106 to $211 million/year


Next Generation Ethernet Networks

• In the Data Center 10 GbE has
Server
penetrated into the access layer Farms

much faster than in the traditional
network environment A B

Edge
• Adoption of 10GbE on the server
infrastructure will drive the need for
Core
100GbE uplinks from the access to
the core of the data centers.

Storage/Tape Farms



Fiber Copper

~2W Power Consumption ~8-15W

Cooling Requirements

Transceiver Size

$ Data Center Area $$$$



•New high density MPO transceivers
•For40 Gb/s, commercially available
today
•12 channels running at BER <10-12,
link length 316m using OM3 fibre
•Utilizing 12 core ribbon fibre cable
•12 channels, 9.9-11.0 Gb/s/channel
tester designed and built.



• Fibre Optic Transceiver Power estimates
– High Bandwidth
– Low Power

# Channels # Transceivers per Total Gb/s per board Total W per board
board

10 3 300 12*

6 24 2,400 60*

8 - 12 12 1,200 30*

4 - 10 12 1,200 30*

* Based on Existing 850nm lasers



What is “smart” cabling?

• Cabling Technology that allows the support of new technologies at
low power consumption.

• Cabling that is forward compatible with data center technology
trends.

• Cabling that utilises new connector technologies that will be
compatible with the next generation interconnects.

• Cabling solutions that provide a positive impact in the power vs.
bandwidth battle.


Thank You!

October 31, 2007

Saving Energy With Smart Cabling

More Related Content

What's hot (15)

Similar to Saving Energy With Smart Cabling (20)

Saving Energy With Smart Cabling