SlideShare a Scribd company logo
2017#apricot2017
Routing 2016
Geoff Huston
Chief Scientist, APNIC
Through the Routing Lens
There are very few ways to assemble a single view of the
entire Internet
The lens of routing is one of the ways in which information
relating to the entire reachable Internet is bought together
Even so, its not a perfect lens…
Through the Routing Lens
1994: Introduction of CIDR
2001: The Great Internet Boom and Bust
2005: Broadband to the Masses
2009: The GFC hits the Internet
2011: Address Exhaustion
23 Years of Routing the Internet
This is a view pulled together from each
of the routing peers of Route-Views
1994: Introduction of CIDR
2001: The Great Internet Boom and Bust
2005: Broadband to the Masses
2009: The GFC hits the Internet
2011: Address Exhaustion
23 Years of Routing the Internet
This is a view pulled together from each
of the routing peers of Route-Views
2015-2016 in detail
2015-2016 in detail
average growth trend
Route Views Peers
RIS Peers
???
October 24, 0800 UTC
8
4,500 new RIB
entries in 2 hours!
AS net + - AS-Name
AS6327 744 744 0 SHAW - Shaw Communications Inc., CA
AS9829 211 221 10 BSNL-NIB National Internet Backbone, IN
AS18881 92 92 0 TELEFONICA BRASIL S.A, BR
AS43754 80 89 9 ASIATECH, IR
AS18566 80 80 0 MEGAPATH5-US - MegaPath Corporation, US
AS9116 78 79 1 GOLDENLINES-ASN 012 Smile Communications Main Autonomous System, IL
AS4800 76 1036 960 LINTASARTA-AS-AP Network Access Provider and Internet Service Provider, ID
AS38264 70 70 0 WATEEN-IMS-PK-AS-AP National WiMAX/IMS environment, PK
AS40676 61 85 24 AS40676 - Psychz Networks, US
AS16322 60 61 1 PARSONLINE Tehran - IRAN, IR
Routing Indicators for IPv4
Routing prefixes – growing by
some 54,000 prefixes per year
AS Numbers– growing by some
3,450 prefixes per year
Routing Indicators for IPv4
More Specifics are still taking up
one half of the routing table
But the average size of a
routing advertisement is getting
smaller
Routing Indicators for IPv4
Address Exhaustion is now
visible in the extent of
advertised address space
The “shape” of inter-AS
interconnection appears to be
relatively steady, as the Average
AS Path length has been steady
through the year
What happened in 2016 in V4?
Routing Business as usual – despite IPv4 address exhaustion!
– From the look of the growth plots, its business as usual, despite the increasing pressures on
IPv4 address availability
– The number of entries in the IPv4 default-free zone is now heading to 700,000 by the end of
2017
– The pace of growth of the routing table is still relatively constant at ~54,000 new entries and
3,400 new AS’s per year
• IPv4 address exhaustion is not changing this!
• Instead, we are advertising shorter prefixes into the routing system
How can the IPv4 network continue to grow when
we are running out of IPv4 addresses?
We are now recycling old addresses back into the routing system
Some of these addresses are transferred in ways that are recorded
in the registry system, while others are being “leased” without any
clear registration entry that describes the lessee
IPv4 in 2016 – Growth is Steady
• Overall IPv4 Internet growth in terms of BGP is at a rate of
some ~54,000 entries p.a.
• But we’ve run out of the unallocated address pools
everywhere except Afrinic
• So what’s driving this post-exhaustion growth?
– Transfers?
– Last /8 policies in RIPE and APNIC?
– Leasing and address recovery?
IPv4 Advertised Address “Age”
80% of all new addresses announced in 2010
were allocated or assigned within the past 12
months
2% of all new addresses announced in 2010
were >= 20 years ‘old’ (legacy)
2010
IPv4 Advertised Address “Age”
24 % of all new addresses announced in 2016
were allocated or assigned within the past 12
months
39 % of all new addresses announced
in 2016 were >= 20 years ‘old’
(legacy)
2016
IPv4: Advertised vs Unadvertised
Addresses
IPv4: Unadvertised Addresses
IPv4:Assigned vs Recovered
Growth in Advertised Addresses
Change in the Unadvertised Address Pool
RIR Allocations
“recovery”
“draw down”
IPv4 in 2016
The equivalent of 1.8 /8s was added to the routing table
across 2016
• Approximately 1.3 /8s were assigned by RIRs in 2015
– 0.7 /8’s assigned by Afrinic
– 0.2 /8s were assigned by APNIC, RIPE NCC (Last /8 allocations)
– 0.1 /8s were assigned by ARIN, LACNIC
• And a net of 0.5 /8’s were recovered from the
Unadvertised Pool
The Route-Views view of IPv6
World IPv6 Day
IANA IPv4 Exhaustion
2015-2016 in detail
Routing Indicators for IPv6
Routing prefixes – growing by
some 6,000 prefixes per year
AS Numbers– growing by some
1,700 prefixes per year (which
is half the V4 growth)
Routing Indicators for IPv6
More Specifics now take up more
than one third of the routing
table
The average size of a routing
advertisement is getting smaller
Routing Indicators for IPv6
Advertised Address span is
growing at a linear rate
The “shape” of inter-AS
interconnection in IPv6 appears
to be steady, as the Average AS
Path length has been held steady
through the year
IPv6 in 2015
• Overall IPv6 Internet growth in terms of BGP is steady at some 6,000 route
entries p.a.
This is growth of BGP route objects is 1/9 of the growth rate of the IPv4 network – as compared
to the AS growth rate which is 1/2 of the IPv4 AS number growth rate
What to expect
BGP Size Projections
For the Internet this is a time of extreme uncertainty
• Registry IPv4 address run out
• Uncertainty over the impacts of market-mediated movements of IPv4 on the routing table
• Uncertainty over the timing of IPv6 takeup leads to a mixed response to IPv6 so far, and no clear indicator of
trigger points for change for those remaining IPv4-only networks
V4 - Daily Growth Rates
V4 - Daily Growth Rates
V4 - Relative Daily Growth Rates
V4 - Relative Daily Growth Rates
Growth in the V4 network appears to be
constant at a long term average of 120
additional routes per day, or some 45,000
additional routes per year
Given that the V4 address supply has run
out this implies further reductions in address
size in routes, which in turn implies ever
greater reliance on NATs
Its hard to see how and why this situation
will persist at its current levels over the
coming 5 year horizon
Growth in the V4 network appears to be
constant at a long term average of 150
additional routes per day, or some
54,000 additional routes per year
Given that the V4 address supply has
run out this implies further reductions in
address size in routes, which in turn
implies ever greater reliance on NATs
Its hard to see how and why this situation
can persist at its current levels over the
coming 5 year horizon
V4 - Relative Daily Growth Rates
IPv4 BGP Table Size Predictions
Jan 2013 441,000
2014 488,000
2015 530,000
2016 586,000 580,000
2017 646,000 628,000 620,000
2018 700,000 675,000 670,000
2019 754,000 722,000 710,000
2020 808,000 768,000 760,000
2021 862,000 815,000
2022 916,000
These numbers are dubious due to uncertainties introduced by IPv4 address
exhaustion pressures.
Jan 2016
PREDICTION
Jan 2015
PREDICTION
Jan 2017
PREDICTION
V6 - Daily Growth Rates
V6 - Relative Growth Rates
V6 - Relative Growth RatesGrowth in the V6 network appears to be increasing, but in
relative terms this is slowing down.
Early adopters, who have tended to be the V4 transit
providers, have already received IPv6 allocation and are
routing them. The trailing edge of IPv6 adoption are generally
composed of stub edge networks in IPv4. Many of these
networks appear not to have made any visible moves in IPv6
as yet.
If we see a change in this picture the growth trend will likely be
exponential. But its not clear when such a tipping point will
occur
IPv6 BGP Table Size predictions
Jan 2014 16,100
2015 21,200
2016 27,000
2017 35,000
2018 50,000 43,000
2019 65,000 51,000
2020 86,000 59,000
2021 113,000 67,000
2022 150,000 75,000
Exponential Model Linear Model
Range of potential outcomes
BGP Table Growth
Nothing in these figures suggests that there is cause for urgent
alarm -- at present
– The overall eBGP growth rates for IPv4 are holding at a modest level, and the
IPv6 table, although it is growing at a faster relative rate, is still small in size in
absolute terms
– As long as we are prepared to live within the technical constraints of the current
routing paradigm, the Internet’s use of BGP will continue to be viable for some
time yet
– Nothing is melting in terms of the size of the routing table as yet
BGP Updates
• What about the level of updates in BGP?
• Let’s look at the update load from a single eBGP feed in a DFZ context
IPv4 Announcements and Withdrawals
IPv4 Announcements and Withdrawals
IPv4 Convergence Performance
Updates in IPv4 BGP
Nothing in these figures is cause for any great level of concern …
– The number of updates per instability event has been relatively constant, which for a distance
vector routing protocol is weird, and completely unanticipated. Distance Vector routing
protocols should get noisier as the population of protocol speakers increases, and the
increase should be multiplicative.
– But this is not happening in the Internet
– Which is good, but why is this not happening?
Likely contributors to this outcome are the damping effect of widespread use of the MRAI
interval by eBGP speakers, and the topology factor, as seen in the relatively constant V4 AS
Path Length
V6 Announcements and Withdrawals
V6 Convergence Performance
High noise
components
in IPv6
V6 Updated prefixes per day
V6 Updates per event
Updates in IPv6
BGP Route Updates are very unequally distributed across the prefix set – they
appear to affect a very small number of prefixes which stand out well above the
average
Updates in IPv6
The busiest 50 IPv6 prefixes accounted for 1/2 of all BGP IPv6 prefix
updates
Compared to IPv4
IPv6 IPv4
Updates in IPv6 BGP
IPv6 routing behaviour is similar to IPv4 behaviour:
Most announced prefixes are stable all of the time
And as more prefixes are announced, most of these announced prefixes are
highly stable.
But for a small number of prefixes we observe highly unstable behaviours
that dominate IPv6 BGP updates which appear to be more unstable
(relatively) than IPv4
The State of Routing
“Mostly Harmless”
The levels of growth of the tables, and the levels of growth of updates in BGP
do not pose any immediate concerns
The trends are predictable and steady, so network operators can plan well in
advance for the capacity of routing equipment to meet their future needs
But:
The advanced levels of instability by a small number of networks are always
annoying! How can we prevent these highly unstable prefixes?
53
That’s it!
2017#apricot2017

More Related Content

PDF
BGP in 2014
PDF
IETF 105: BGP 2018
PDF
RIPE 78: Routing in 2018
PDF
Routing in 2016, IETF 98
PDF
From Policy to Practice: Addressing and Routing in 2014 by Geoff Huston [APRI...
PDF
Addressing and Routing in 2017
PDF
Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]
PDF
The trend stats of routing table at JPIX route servers
BGP in 2014
IETF 105: BGP 2018
RIPE 78: Routing in 2018
Routing in 2016, IETF 98
From Policy to Practice: Addressing and Routing in 2014 by Geoff Huston [APRI...
Addressing and Routing in 2017
Whats so special about 512?, by Geoff Huston [APNIC 38 / APOPS 3]
The trend stats of routing table at JPIX route servers

What's hot (20)

PDF
Obtaining IPv4 Addresses
PPTX
APNIC Update - NZNOG 2017
PDF
IPv6 Addressing Plans and Subnetting
PDF
Getting IPv6 & Securing your Routing
PDF
32 - IDNOG03 - Lia Hestina (RIPE) - ATLAS Measurement
PPTX
The case for IPv6
PDF
06 (IDNOG02) IPv4 Address Transfer by Wita Laksono
PPTX
IPv6 deployment at APNIC
PDF
Measuring the End User
PPTX
Abitcool - A vast array of small-scale service providers with gigabit access,...
PDF
Measuring the end user
PDF
DNSSEC Measurement APTLD 71
PDF
BGP: Whats so special about the number 512?
PPTX
Apnic IPv6 Deployment
PDF
VNIX-NOG 2021: IPv6 Deployment Update
PDF
mnNOG 1: Securing internet Routing
PDF
Welcome to the APNIC Member Gathering, Mongolia
PDF
Akamai - State of Internet Raporu 2014 1. Çeyrek
PDF
28th TWNIC OPM and TWNOG 2017: Security best practices for network operators
PPT
Simplified IPv6 Subnetting. Understanding What’s What.
Obtaining IPv4 Addresses
APNIC Update - NZNOG 2017
IPv6 Addressing Plans and Subnetting
Getting IPv6 & Securing your Routing
32 - IDNOG03 - Lia Hestina (RIPE) - ATLAS Measurement
The case for IPv6
06 (IDNOG02) IPv4 Address Transfer by Wita Laksono
IPv6 deployment at APNIC
Measuring the End User
Abitcool - A vast array of small-scale service providers with gigabit access,...
Measuring the end user
DNSSEC Measurement APTLD 71
BGP: Whats so special about the number 512?
Apnic IPv6 Deployment
VNIX-NOG 2021: IPv6 Deployment Update
mnNOG 1: Securing internet Routing
Welcome to the APNIC Member Gathering, Mongolia
Akamai - State of Internet Raporu 2014 1. Çeyrek
28th TWNIC OPM and TWNOG 2017: Security best practices for network operators
Simplified IPv6 Subnetting. Understanding What’s What.
Ad

Viewers also liked (20)

PPTX
Ppt of routing protocols
PPTX
Routing Protocols and Concepts - Chapter 1
PDF
IP Routing Tutorial
PPT
20088 1 ccna3 3.1-06 switch configurations
PDF
The Death of Transit and Beyond
PPTX
IP ROUTING
PDF
Using ~300 Billion DNS Queries to Analyse the TLD Name Collision Problem
PDF
CCNA Routing Protocols
PDF
Routing basics/CEF
PPT
CCNA BASIC SWITCHING AND SWITCH CONFIGURATION
PPT
Chapter07
PPT
Switch configuration
PPTX
CCNA 2 Routing and Switching v5.0 Chapter 1
PPTX
Routing Protocols in WSN
PPT
CCNA Advanced Routing Protocols
PDF
IX-F Database and Tool
PPT
Presentation on router
PDF
End User DNS Measurement at APNIC
PPTX
Routers and Routing Configuration
PPT
CCNA Routing Protocols
Ppt of routing protocols
Routing Protocols and Concepts - Chapter 1
IP Routing Tutorial
20088 1 ccna3 3.1-06 switch configurations
The Death of Transit and Beyond
IP ROUTING
Using ~300 Billion DNS Queries to Analyse the TLD Name Collision Problem
CCNA Routing Protocols
Routing basics/CEF
CCNA BASIC SWITCHING AND SWITCH CONFIGURATION
Chapter07
Switch configuration
CCNA 2 Routing and Switching v5.0 Chapter 1
Routing Protocols in WSN
CCNA Advanced Routing Protocols
IX-F Database and Tool
Presentation on router
End User DNS Measurement at APNIC
Routers and Routing Configuration
CCNA Routing Protocols
Ad

Similar to Routing 2016 (20)

PDF
Scaling BGP
PDF
NANOG 90: 'BGP in 2023' presented by Geoff Huston
PDF
BGP in 2015
PDF
Routing and Addressing in 2018
PDF
What's so special about the number 512?
PDF
What Happened to IPv6? presented by Geoff Huston
PDF
Iccns2008 Cp15
PDF
Ipv6 course
PDF
36168922-Understanding-IP-Addressing
PDF
Addressing 2015
PPSX
IPv6fundamentalspresentationforccnastudents
PDF
Conceptos ipv6, direccionamiento
PDF
Como definir un esquema de direcciones IPv6
PPTX
'Secure and Sustainable Internet Infrastructure for Emerging Technologies'
PDF
IPv6 Address Planning
PPT
Internet Protocol Version 6
PPT
Ipv4 vs Ipv6 comparison
PDF
Seizing the IPv6 Advantage: For a Bigger, Faster and Stronger Internet
DOCX
New Network ProtocolRunning Head New Network Protocol Pap.docx
PPTX
Internet protocol v6
Scaling BGP
NANOG 90: 'BGP in 2023' presented by Geoff Huston
BGP in 2015
Routing and Addressing in 2018
What's so special about the number 512?
What Happened to IPv6? presented by Geoff Huston
Iccns2008 Cp15
Ipv6 course
36168922-Understanding-IP-Addressing
Addressing 2015
IPv6fundamentalspresentationforccnastudents
Conceptos ipv6, direccionamiento
Como definir un esquema de direcciones IPv6
'Secure and Sustainable Internet Infrastructure for Emerging Technologies'
IPv6 Address Planning
Internet Protocol Version 6
Ipv4 vs Ipv6 comparison
Seizing the IPv6 Advantage: For a Bigger, Faster and Stronger Internet
New Network ProtocolRunning Head New Network Protocol Pap.docx
Internet protocol v6

More from APNIC (20)

PPTX
APNIC Report, presented at APAN 60 by Thy Boskovic
PDF
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
PDF
RPKI Status Update, presented by Makito Lay at IDNOG 10
PDF
The Internet -By the Numbers, Sri Lanka Edition
PDF
Triggering QUIC, presented by Geoff Huston at IETF 123
PDF
DNSSEC Made Easy, presented at PHNOG 2025
PDF
BGP Security Best Practices that Matter, presented at PHNOG 2025
PDF
APNIC's Role in the Pacific Islands, presented at Pacific IGF 2205
PDF
IPv6 Deployment and Best Practices, presented by Makito Lay
PDF
Cleaning up your RPKI invalids, presented at PacNOG 35
PDF
The Internet - By the numbers, presented at npNOG 11
PDF
Transmission Control Protocol (TCP) and Starlink
PDF
DDoS in India, presented at INNOG 8 by Dave Phelan
PDF
Global Networking Trends, presented at the India ISP Conclave 2025
PDF
Make DDoS expensive for the threat actors
PDF
Fast Reroute in SR-MPLS, presented at bdNOG 19
PDF
DDos Mitigation Strategie, presented at bdNOG 19
PDF
ICP -2 Review – What It Is, and How to Participate and Provide Your Feedback
PDF
APNIC Update - Global Synergy among the RIRs: Connecting the Regions
PDF
Measuring Starlink Protocol Performance, presented at LACNIC 43
APNIC Report, presented at APAN 60 by Thy Boskovic
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
RPKI Status Update, presented by Makito Lay at IDNOG 10
The Internet -By the Numbers, Sri Lanka Edition
Triggering QUIC, presented by Geoff Huston at IETF 123
DNSSEC Made Easy, presented at PHNOG 2025
BGP Security Best Practices that Matter, presented at PHNOG 2025
APNIC's Role in the Pacific Islands, presented at Pacific IGF 2205
IPv6 Deployment and Best Practices, presented by Makito Lay
Cleaning up your RPKI invalids, presented at PacNOG 35
The Internet - By the numbers, presented at npNOG 11
Transmission Control Protocol (TCP) and Starlink
DDoS in India, presented at INNOG 8 by Dave Phelan
Global Networking Trends, presented at the India ISP Conclave 2025
Make DDoS expensive for the threat actors
Fast Reroute in SR-MPLS, presented at bdNOG 19
DDos Mitigation Strategie, presented at bdNOG 19
ICP -2 Review – What It Is, and How to Participate and Provide Your Feedback
APNIC Update - Global Synergy among the RIRs: Connecting the Regions
Measuring Starlink Protocol Performance, presented at LACNIC 43

Recently uploaded (20)

PPTX
newyork.pptxirantrafgshenepalchinachinane
PDF
Understand the Gitlab_presentation_task.pdf
PPT
12 Things That Make People Trust a Website Instantly
PPTX
Introduction to cybersecurity and digital nettiquette
PPTX
module 1-Part 1.pptxdddddddddddddddddddddddddddddddddddd
PDF
Lean-Manufacturing-Tools-Techniques-and-How-To-Use-Them.pdf
PPTX
E -tech empowerment technologies PowerPoint
PDF
Session 1 (Week 1)fghjmgfdsfgthyjkhfdsadfghjkhgfdsa
PDF
Alethe Consulting Corporate Profile and Solution Aproach
PPT
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
PDF
Smart Home Technology for Health Monitoring (www.kiu.ac.ug)
PPTX
Power Point - Lesson 3_2.pptx grad school presentation
PPTX
Layers_of_the_Earth_Grade7.pptx class by
PDF
FINAL CALL-6th International Conference on Networks & IOT (NeTIOT 2025)
PDF
The Ikigai Template _ Recalibrate How You Spend Your Time.pdf
PPTX
The-Importance-of-School-Sanitation.pptx
PDF
simpleintnettestmetiaerl for the simple testint
PDF
📍 LABUAN4D EXCLUSIVE SERVER STAR GAMING ASIA NO.1 TERPOPULER DI INDONESIA ! 🌟
PDF
BIOCHEM CH2 OVERVIEW OF MICROBIOLOGY.pdf
PDF
Exploring The Internet Of Things(IOT).ppt
newyork.pptxirantrafgshenepalchinachinane
Understand the Gitlab_presentation_task.pdf
12 Things That Make People Trust a Website Instantly
Introduction to cybersecurity and digital nettiquette
module 1-Part 1.pptxdddddddddddddddddddddddddddddddddddd
Lean-Manufacturing-Tools-Techniques-and-How-To-Use-Them.pdf
E -tech empowerment technologies PowerPoint
Session 1 (Week 1)fghjmgfdsfgthyjkhfdsadfghjkhgfdsa
Alethe Consulting Corporate Profile and Solution Aproach
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
Smart Home Technology for Health Monitoring (www.kiu.ac.ug)
Power Point - Lesson 3_2.pptx grad school presentation
Layers_of_the_Earth_Grade7.pptx class by
FINAL CALL-6th International Conference on Networks & IOT (NeTIOT 2025)
The Ikigai Template _ Recalibrate How You Spend Your Time.pdf
The-Importance-of-School-Sanitation.pptx
simpleintnettestmetiaerl for the simple testint
📍 LABUAN4D EXCLUSIVE SERVER STAR GAMING ASIA NO.1 TERPOPULER DI INDONESIA ! 🌟
BIOCHEM CH2 OVERVIEW OF MICROBIOLOGY.pdf
Exploring The Internet Of Things(IOT).ppt

Routing 2016

  • 2. Through the Routing Lens There are very few ways to assemble a single view of the entire Internet The lens of routing is one of the ways in which information relating to the entire reachable Internet is bought together Even so, its not a perfect lens…
  • 4. 1994: Introduction of CIDR 2001: The Great Internet Boom and Bust 2005: Broadband to the Masses 2009: The GFC hits the Internet 2011: Address Exhaustion 23 Years of Routing the Internet This is a view pulled together from each of the routing peers of Route-Views
  • 5. 1994: Introduction of CIDR 2001: The Great Internet Boom and Bust 2005: Broadband to the Masses 2009: The GFC hits the Internet 2011: Address Exhaustion 23 Years of Routing the Internet This is a view pulled together from each of the routing peers of Route-Views
  • 7. 2015-2016 in detail average growth trend Route Views Peers RIS Peers ???
  • 8. October 24, 0800 UTC 8 4,500 new RIB entries in 2 hours! AS net + - AS-Name AS6327 744 744 0 SHAW - Shaw Communications Inc., CA AS9829 211 221 10 BSNL-NIB National Internet Backbone, IN AS18881 92 92 0 TELEFONICA BRASIL S.A, BR AS43754 80 89 9 ASIATECH, IR AS18566 80 80 0 MEGAPATH5-US - MegaPath Corporation, US AS9116 78 79 1 GOLDENLINES-ASN 012 Smile Communications Main Autonomous System, IL AS4800 76 1036 960 LINTASARTA-AS-AP Network Access Provider and Internet Service Provider, ID AS38264 70 70 0 WATEEN-IMS-PK-AS-AP National WiMAX/IMS environment, PK AS40676 61 85 24 AS40676 - Psychz Networks, US AS16322 60 61 1 PARSONLINE Tehran - IRAN, IR
  • 9. Routing Indicators for IPv4 Routing prefixes – growing by some 54,000 prefixes per year AS Numbers– growing by some 3,450 prefixes per year
  • 10. Routing Indicators for IPv4 More Specifics are still taking up one half of the routing table But the average size of a routing advertisement is getting smaller
  • 11. Routing Indicators for IPv4 Address Exhaustion is now visible in the extent of advertised address space The “shape” of inter-AS interconnection appears to be relatively steady, as the Average AS Path length has been steady through the year
  • 12. What happened in 2016 in V4? Routing Business as usual – despite IPv4 address exhaustion! – From the look of the growth plots, its business as usual, despite the increasing pressures on IPv4 address availability – The number of entries in the IPv4 default-free zone is now heading to 700,000 by the end of 2017 – The pace of growth of the routing table is still relatively constant at ~54,000 new entries and 3,400 new AS’s per year • IPv4 address exhaustion is not changing this! • Instead, we are advertising shorter prefixes into the routing system
  • 13. How can the IPv4 network continue to grow when we are running out of IPv4 addresses? We are now recycling old addresses back into the routing system Some of these addresses are transferred in ways that are recorded in the registry system, while others are being “leased” without any clear registration entry that describes the lessee
  • 14. IPv4 in 2016 – Growth is Steady • Overall IPv4 Internet growth in terms of BGP is at a rate of some ~54,000 entries p.a. • But we’ve run out of the unallocated address pools everywhere except Afrinic • So what’s driving this post-exhaustion growth? – Transfers? – Last /8 policies in RIPE and APNIC? – Leasing and address recovery?
  • 15. IPv4 Advertised Address “Age” 80% of all new addresses announced in 2010 were allocated or assigned within the past 12 months 2% of all new addresses announced in 2010 were >= 20 years ‘old’ (legacy) 2010
  • 16. IPv4 Advertised Address “Age” 24 % of all new addresses announced in 2016 were allocated or assigned within the past 12 months 39 % of all new addresses announced in 2016 were >= 20 years ‘old’ (legacy) 2016
  • 17. IPv4: Advertised vs Unadvertised Addresses
  • 19. IPv4:Assigned vs Recovered Growth in Advertised Addresses Change in the Unadvertised Address Pool RIR Allocations “recovery” “draw down”
  • 20. IPv4 in 2016 The equivalent of 1.8 /8s was added to the routing table across 2016 • Approximately 1.3 /8s were assigned by RIRs in 2015 – 0.7 /8’s assigned by Afrinic – 0.2 /8s were assigned by APNIC, RIPE NCC (Last /8 allocations) – 0.1 /8s were assigned by ARIN, LACNIC • And a net of 0.5 /8’s were recovered from the Unadvertised Pool
  • 21. The Route-Views view of IPv6 World IPv6 Day IANA IPv4 Exhaustion
  • 23. Routing Indicators for IPv6 Routing prefixes – growing by some 6,000 prefixes per year AS Numbers– growing by some 1,700 prefixes per year (which is half the V4 growth)
  • 24. Routing Indicators for IPv6 More Specifics now take up more than one third of the routing table The average size of a routing advertisement is getting smaller
  • 25. Routing Indicators for IPv6 Advertised Address span is growing at a linear rate The “shape” of inter-AS interconnection in IPv6 appears to be steady, as the Average AS Path length has been held steady through the year
  • 26. IPv6 in 2015 • Overall IPv6 Internet growth in terms of BGP is steady at some 6,000 route entries p.a. This is growth of BGP route objects is 1/9 of the growth rate of the IPv4 network – as compared to the AS growth rate which is 1/2 of the IPv4 AS number growth rate
  • 28. BGP Size Projections For the Internet this is a time of extreme uncertainty • Registry IPv4 address run out • Uncertainty over the impacts of market-mediated movements of IPv4 on the routing table • Uncertainty over the timing of IPv6 takeup leads to a mixed response to IPv6 so far, and no clear indicator of trigger points for change for those remaining IPv4-only networks
  • 29. V4 - Daily Growth Rates
  • 30. V4 - Daily Growth Rates
  • 31. V4 - Relative Daily Growth Rates
  • 32. V4 - Relative Daily Growth Rates Growth in the V4 network appears to be constant at a long term average of 120 additional routes per day, or some 45,000 additional routes per year Given that the V4 address supply has run out this implies further reductions in address size in routes, which in turn implies ever greater reliance on NATs Its hard to see how and why this situation will persist at its current levels over the coming 5 year horizon
  • 33. Growth in the V4 network appears to be constant at a long term average of 150 additional routes per day, or some 54,000 additional routes per year Given that the V4 address supply has run out this implies further reductions in address size in routes, which in turn implies ever greater reliance on NATs Its hard to see how and why this situation can persist at its current levels over the coming 5 year horizon V4 - Relative Daily Growth Rates
  • 34. IPv4 BGP Table Size Predictions Jan 2013 441,000 2014 488,000 2015 530,000 2016 586,000 580,000 2017 646,000 628,000 620,000 2018 700,000 675,000 670,000 2019 754,000 722,000 710,000 2020 808,000 768,000 760,000 2021 862,000 815,000 2022 916,000 These numbers are dubious due to uncertainties introduced by IPv4 address exhaustion pressures. Jan 2016 PREDICTION Jan 2015 PREDICTION Jan 2017 PREDICTION
  • 35. V6 - Daily Growth Rates
  • 36. V6 - Relative Growth Rates
  • 37. V6 - Relative Growth RatesGrowth in the V6 network appears to be increasing, but in relative terms this is slowing down. Early adopters, who have tended to be the V4 transit providers, have already received IPv6 allocation and are routing them. The trailing edge of IPv6 adoption are generally composed of stub edge networks in IPv4. Many of these networks appear not to have made any visible moves in IPv6 as yet. If we see a change in this picture the growth trend will likely be exponential. But its not clear when such a tipping point will occur
  • 38. IPv6 BGP Table Size predictions Jan 2014 16,100 2015 21,200 2016 27,000 2017 35,000 2018 50,000 43,000 2019 65,000 51,000 2020 86,000 59,000 2021 113,000 67,000 2022 150,000 75,000 Exponential Model Linear Model Range of potential outcomes
  • 39. BGP Table Growth Nothing in these figures suggests that there is cause for urgent alarm -- at present – The overall eBGP growth rates for IPv4 are holding at a modest level, and the IPv6 table, although it is growing at a faster relative rate, is still small in size in absolute terms – As long as we are prepared to live within the technical constraints of the current routing paradigm, the Internet’s use of BGP will continue to be viable for some time yet – Nothing is melting in terms of the size of the routing table as yet
  • 40. BGP Updates • What about the level of updates in BGP? • Let’s look at the update load from a single eBGP feed in a DFZ context
  • 41. IPv4 Announcements and Withdrawals
  • 42. IPv4 Announcements and Withdrawals
  • 44. Updates in IPv4 BGP Nothing in these figures is cause for any great level of concern … – The number of updates per instability event has been relatively constant, which for a distance vector routing protocol is weird, and completely unanticipated. Distance Vector routing protocols should get noisier as the population of protocol speakers increases, and the increase should be multiplicative. – But this is not happening in the Internet – Which is good, but why is this not happening? Likely contributors to this outcome are the damping effect of widespread use of the MRAI interval by eBGP speakers, and the topology factor, as seen in the relatively constant V4 AS Path Length
  • 45. V6 Announcements and Withdrawals
  • 46. V6 Convergence Performance High noise components in IPv6
  • 48. V6 Updates per event
  • 49. Updates in IPv6 BGP Route Updates are very unequally distributed across the prefix set – they appear to affect a very small number of prefixes which stand out well above the average
  • 50. Updates in IPv6 The busiest 50 IPv6 prefixes accounted for 1/2 of all BGP IPv6 prefix updates
  • 52. Updates in IPv6 BGP IPv6 routing behaviour is similar to IPv4 behaviour: Most announced prefixes are stable all of the time And as more prefixes are announced, most of these announced prefixes are highly stable. But for a small number of prefixes we observe highly unstable behaviours that dominate IPv6 BGP updates which appear to be more unstable (relatively) than IPv4
  • 53. The State of Routing “Mostly Harmless” The levels of growth of the tables, and the levels of growth of updates in BGP do not pose any immediate concerns The trends are predictable and steady, so network operators can plan well in advance for the capacity of routing equipment to meet their future needs But: The advanced levels of instability by a small number of networks are always annoying! How can we prevent these highly unstable prefixes? 53