SlideShare a Scribd company logo
The new Janet access infrastructure
James Blessing
What we’re deploying
Example topology
Core
1
Core
2
RNEP
A
RNEP
B
Co-Lo
1
Co-Lo
2
Co-Lo
6
Co-Lo
5
Co-Lo
3
Co-Lo
4
Site 1
Site
2a
Site
2b
Co-Lo
4a
Co-Lo
4b
Site 3
Router
A
Router
B
Equipment options
» Ciena 5170
› Layer 2
› RegionalAggregation or 100G NTE
– I.e. in the co-location PoPs and RNEPs
› 1 rack unit
› 4 x 100GE ‘grey’ (QSFP28) ports
– Scalable up to a 200G regional aggregation ring
› 40 x 10GE
– Access, or multiples of 10GE for lower-demand sub-rings
Equipment options
» Ciena 5171
› Layer 2
› RegionalAggregation
› 2 rack unit
› 2 x “Sleds”
– 2x100G coherent
– 1x 100G coherent + 1 QSFP28
– Other sleds to be launched
› 40 x 10GE
– Access, or multiples of 10GE for lower-demand sub-rings, 4 port can run at 25G
Equipment options
» Ciena 8700
› Layer 2
› 10 slot
– PSLM-680-8: 6x QSFP28, 2x QSFP+
– PSLM-400-31: 30x SFP/SFP+, 1x QSFP28
– PSLM-200-20: 20x 1GbE/10GbE SFP/SFP+
– PSLM-200-2: 2x 40GbE/100GbE CFP ports
– CSLM-200-2: 2x 100G OTU-4 wrapped 100GbE
over WaveLogic 3 Nano DWDM ports
– PSLM-200-11: 10x SFP/SFP+, 1x QSFP28 ports
– More cards in development
› RNEPs & regional aggregation
08/11/2019 The new Janet access infrastructure 6
Equipment options: NTE
» Ciena 3903 / 3926 / 3928
› 3903
– 2 network-facing 1G ports, 2 user-facing 1G ports
› 3926
– See next slide
› 3928
– 4 x 1G / 10G SFP ports
– 8 x 1G SFP ports
Equipment options: NTE
»3926m
› 6 x 1G / 10G SFP+ ports
› 2 x 100M / 1G ports
› Modular: option for embedded x86 processor
› Virtual machines for router, firewall, DPI, IDS, flow optimisation,
site-to-siteVPNs, Safe Share, performance monitoring…?
› Evaluating performance in the lab
08/11/2019 Tech 2 Tech: Future Services on Janet 8
Equipment options: Optical
» Ciena 6500
› To be used as mux/demux in
regions with dark fibre
› Other deployments possible for
high capacity or extended reach
– E.g. two slot module as a 100G
transponder
08/11/2019 The new Janet access infrastructure 9
What will this look like?
08/11/2019 The new Janet access infrastructure 10
IP service delivery
Core
1
Core
2
RNEP
A
RNEP
B
Co-Lo
1
Co-Lo
2
Co-Lo
6
Co-Lo
5
Co-Lo
3
Co-Lo
4
Site 1
Site
2a
Site
2b
G.8032 Ethernet Ring
Co-Lo
4a
Co-Lo
4b
G.8032
Sub-Ring
Site 3
Router
A
Router
B
PoP to PoP
PoP A PoP B
Site 2Site 1 Site 3
Ethernet ring protection
»G.8032/Y.1344
› Less than 50ms protection switch
–(Assuming fibre ring < 1,200km!)
› Protection at layer 2, so do not need to wait for IP to
reconverge on link failure within a region
Layer 2 reroute
Core
1
Core
2
RNEP
A
RNEP
B
Co-Lo
1
Co-Lo
2
Co-Lo
6
Co-Lo
5
Co-Lo
3
Co-Lo
4
Site 1
Site
2a
Site
2b
G.8032 Ethernet Ring
Co-Lo
4a
Co-Lo
4b
G.8032
Sub-Ring
Site 3
Router
A
Router
B
IP protection
»If an RNEP fails, still need to switch to the other RNEP at
layer 3
»Bidirectional Forwarding Detection (BFD)
› Rapidly detect failures that might be hidden at layer 2
–IP access may just be aVLAN on an interface that stays up
› NOC will configure on MRS routers
› Member to configure on non-MRS L3 devices
› Static routes tied to BFD, or BGP session tied to BFD.
Ethernet Diagnostics
»Check circuit before being brought into service
› RFC2544 /Y.1564
– Loss
– Delay
– Throughput
»Performance monitoring
› CFM /Y.1731
– Delay
– Jitter
– Loss
»Improved visibility of Netpaths through the aggregation
infrastructure
Presentation
»Services delimited byVLANs
› Or additional ports on the NTE
»Services might be
› IP
› ExpressRoute
› Netpath
Scalability
»If using OSA FC, upgrades will be down to engineer time.
› New port on the 5170, re-use the NTE if it’s a 3926/3928.
› No involvement from Openreach
»Upgrades to regional aggregation rings
› Insert SFPs, connect to the OSA FC filters.
Questions and discussion?
08/11/2019 The new Janet access infrastructure 19

More Related Content

PPTX
Future services on Janet
PPTX
Birds of a feather - network engineering
PPTX
Experiments in 100G networking for data-intensive research
PDF
Scaling the Web to Billions of Nodes: Towards the IPv6 “Internet of Things” b...
PPTX
LAN, WAN, SAN upgrades: hyperconverged vs traditional vs cloud
PPT
EAP TLS, the Rolls-Royce of extensible authentication protocol (EAP) methods ...
PDF
BIND 9 - making a modern DNS server
PPT
flowspec @ APF 2013
Future services on Janet
Birds of a feather - network engineering
Experiments in 100G networking for data-intensive research
Scaling the Web to Billions of Nodes: Towards the IPv6 “Internet of Things” b...
LAN, WAN, SAN upgrades: hyperconverged vs traditional vs cloud
EAP TLS, the Rolls-Royce of extensible authentication protocol (EAP) methods ...
BIND 9 - making a modern DNS server
flowspec @ APF 2013

What's hot (20)

PPTX
44 - IDNOG03 - LT - Rommy Kuntoro - G.Fast 1Gbps over Copper Cable, Are we r...
PPTX
Ipv6 deployment at the university of warwick - networkshop44
PPTX
Software Stacks to enable SDN and NFV
PDF
OIF 2015 FOE Architecture Presentation
PPTX
IPv6 at Mythic Beasts - Networkshop44
PDF
TLD Anycast DNS servers to ISPs
PDF
AVB intro
PDF
Running a Local Copy of the DNS Root Zone
PDF
OIF 112G Panel at DesignCon 2017
PPTX
Evolution of network automation at Imperial College London
PDF
Minimum Viable FIB
PPTX
Multicast in OpenStack
PPTX
Opensample: A Low-latency, Sampling-based Measurement Platform for Software D...
PPTX
6TiSCH + RPL @ Telecom Bretagne 2014
PDF
Cloud Traffic Engineer – Google Espresso Project by Shaowen Ma
PDF
Taking Security Groups to Ludicrous Speed with OVS (OpenStack Summit 2015)
PDF
PLNOG 13: Alexis Dacquay: Handling high-bandwidth-consumption applications in...
PPTX
IPv6 and IP Multicast… better together?
PDF
02 - IDNOG04 - Sheryl Hermoso (APNIC) - IPv6 Deployment at APNIC
PDF
ENRZ Advanced Modulation for Low Latency Applications
44 - IDNOG03 - LT - Rommy Kuntoro - G.Fast 1Gbps over Copper Cable, Are we r...
Ipv6 deployment at the university of warwick - networkshop44
Software Stacks to enable SDN and NFV
OIF 2015 FOE Architecture Presentation
IPv6 at Mythic Beasts - Networkshop44
TLD Anycast DNS servers to ISPs
AVB intro
Running a Local Copy of the DNS Root Zone
OIF 112G Panel at DesignCon 2017
Evolution of network automation at Imperial College London
Minimum Viable FIB
Multicast in OpenStack
Opensample: A Low-latency, Sampling-based Measurement Platform for Software D...
6TiSCH + RPL @ Telecom Bretagne 2014
Cloud Traffic Engineer – Google Espresso Project by Shaowen Ma
Taking Security Groups to Ludicrous Speed with OVS (OpenStack Summit 2015)
PLNOG 13: Alexis Dacquay: Handling high-bandwidth-consumption applications in...
IPv6 and IP Multicast… better together?
02 - IDNOG04 - Sheryl Hermoso (APNIC) - IPv6 Deployment at APNIC
ENRZ Advanced Modulation for Low Latency Applications
Ad

Similar to The new Janet access architecture (20)

PPTX
The new Janet access infrastructure
PDF
The new Janet access infrastructure
PPTX
The technical details of presenting 100GbE networking to sites
PPTX
Janet access solutions
PPTX
Janet Network update and futures - by James Blessing
PDF
Building Janet6 online briefing 6 March 2013
PPTX
Janet Futures
PPTX
Janet Network update
PPTX
Introduction and background
PPTX
Building the Janet Access infrastructure
PPTX
Future services on Janet
PDF
Janet6 online briefing 4 October 2012
PPTX
Future services on Janet
PDF
Janet6 online briefing 5 July 2012
PPTX
Tech 2 tech low latency networking on Janet presentation
PPTX
HPC Midlands - JANET(UK) Enabling the UK's e-Infrastructure
PDF
Strategy briefing: network technologies 7 March 2013
PDF
Tech 2 Tech: Network performance
PDF
Data Networks: Next-Generation Optical Access toward 10 Gb/s Everywhere
PPTX
Tech 2 Tech welcome
The new Janet access infrastructure
The new Janet access infrastructure
The technical details of presenting 100GbE networking to sites
Janet access solutions
Janet Network update and futures - by James Blessing
Building Janet6 online briefing 6 March 2013
Janet Futures
Janet Network update
Introduction and background
Building the Janet Access infrastructure
Future services on Janet
Janet6 online briefing 4 October 2012
Future services on Janet
Janet6 online briefing 5 July 2012
Tech 2 tech low latency networking on Janet presentation
HPC Midlands - JANET(UK) Enabling the UK's e-Infrastructure
Strategy briefing: network technologies 7 March 2013
Tech 2 Tech: Network performance
Data Networks: Next-Generation Optical Access toward 10 Gb/s Everywhere
Tech 2 Tech welcome
Ad

More from Jisc (20)

PPTX
Strengthening open access through collaboration: building connections with OP...
PPTX
Andrew-Brown-JUSP-showcase-20240730.pptx
PPTX
JUSP Showcase - Rebuilding Data presentation
PPTX
Adobe Express Engagement Webinar (Delegate).pptx
PPTX
FE Accessibility training matrix partnership - information session
PPTX
Procuring a research management system: why is it so hard?
PPTX
Adobe Express Engagement Webinar (Delegate).pptx
PPTX
How libraries can support authors with open access requirements for UKRI fund...
PPTX
Supporting (UKRI) OA monographs at Salford.pptx
PPTX
The approach at University of Liverpool.pptx
PPTX
Jisc's value to HE: the University of Sheffield
PPTX
Towards a code of practice for AI in AT.pptx
PPTX
Jamworks pilot and AI at Jisc (20/03/2024)
PPTX
Wellbeing inclusion and digital dystopias.pptx
PPTX
Accessible Digital Futures project (20/03/2024)
PPTX
Procuring digital preservation CAN be quick and painless with our new dynamic...
PPTX
International students’ digital experience: understanding and mitigating the ...
PPTX
Digital Storytelling Community Launch!.pptx
PPTX
Open Access book publishing understanding your options (1).pptx
PPTX
Scottish Universities Press supporting authors with requirements for open acc...
Strengthening open access through collaboration: building connections with OP...
Andrew-Brown-JUSP-showcase-20240730.pptx
JUSP Showcase - Rebuilding Data presentation
Adobe Express Engagement Webinar (Delegate).pptx
FE Accessibility training matrix partnership - information session
Procuring a research management system: why is it so hard?
Adobe Express Engagement Webinar (Delegate).pptx
How libraries can support authors with open access requirements for UKRI fund...
Supporting (UKRI) OA monographs at Salford.pptx
The approach at University of Liverpool.pptx
Jisc's value to HE: the University of Sheffield
Towards a code of practice for AI in AT.pptx
Jamworks pilot and AI at Jisc (20/03/2024)
Wellbeing inclusion and digital dystopias.pptx
Accessible Digital Futures project (20/03/2024)
Procuring digital preservation CAN be quick and painless with our new dynamic...
International students’ digital experience: understanding and mitigating the ...
Digital Storytelling Community Launch!.pptx
Open Access book publishing understanding your options (1).pptx
Scottish Universities Press supporting authors with requirements for open acc...

Recently uploaded (20)

PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
KodekX | Application Modernization Development
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Electronic commerce courselecture one. Pdf
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PPT
Teaching material agriculture food technology
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
sap open course for s4hana steps from ECC to s4
PDF
Approach and Philosophy of On baking technology
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Network Security Unit 5.pdf for BCA BBA.
Programs and apps: productivity, graphics, security and other tools
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
KodekX | Application Modernization Development
Mobile App Security Testing_ A Comprehensive Guide.pdf
Electronic commerce courselecture one. Pdf
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Advanced methodologies resolving dimensionality complications for autism neur...
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Teaching material agriculture food technology
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
MIND Revenue Release Quarter 2 2025 Press Release
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
sap open course for s4hana steps from ECC to s4
Approach and Philosophy of On baking technology
Per capita expenditure prediction using model stacking based on satellite ima...
Review of recent advances in non-invasive hemoglobin estimation
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Network Security Unit 5.pdf for BCA BBA.

The new Janet access architecture

  • 1. The new Janet access infrastructure James Blessing
  • 4. Equipment options » Ciena 5170 › Layer 2 › RegionalAggregation or 100G NTE – I.e. in the co-location PoPs and RNEPs › 1 rack unit › 4 x 100GE ‘grey’ (QSFP28) ports – Scalable up to a 200G regional aggregation ring › 40 x 10GE – Access, or multiples of 10GE for lower-demand sub-rings
  • 5. Equipment options » Ciena 5171 › Layer 2 › RegionalAggregation › 2 rack unit › 2 x “Sleds” – 2x100G coherent – 1x 100G coherent + 1 QSFP28 – Other sleds to be launched › 40 x 10GE – Access, or multiples of 10GE for lower-demand sub-rings, 4 port can run at 25G
  • 6. Equipment options » Ciena 8700 › Layer 2 › 10 slot – PSLM-680-8: 6x QSFP28, 2x QSFP+ – PSLM-400-31: 30x SFP/SFP+, 1x QSFP28 – PSLM-200-20: 20x 1GbE/10GbE SFP/SFP+ – PSLM-200-2: 2x 40GbE/100GbE CFP ports – CSLM-200-2: 2x 100G OTU-4 wrapped 100GbE over WaveLogic 3 Nano DWDM ports – PSLM-200-11: 10x SFP/SFP+, 1x QSFP28 ports – More cards in development › RNEPs & regional aggregation 08/11/2019 The new Janet access infrastructure 6
  • 7. Equipment options: NTE » Ciena 3903 / 3926 / 3928 › 3903 – 2 network-facing 1G ports, 2 user-facing 1G ports › 3926 – See next slide › 3928 – 4 x 1G / 10G SFP ports – 8 x 1G SFP ports
  • 8. Equipment options: NTE »3926m › 6 x 1G / 10G SFP+ ports › 2 x 100M / 1G ports › Modular: option for embedded x86 processor › Virtual machines for router, firewall, DPI, IDS, flow optimisation, site-to-siteVPNs, Safe Share, performance monitoring…? › Evaluating performance in the lab 08/11/2019 Tech 2 Tech: Future Services on Janet 8
  • 9. Equipment options: Optical » Ciena 6500 › To be used as mux/demux in regions with dark fibre › Other deployments possible for high capacity or extended reach – E.g. two slot module as a 100G transponder 08/11/2019 The new Janet access infrastructure 9
  • 10. What will this look like? 08/11/2019 The new Janet access infrastructure 10
  • 11. IP service delivery Core 1 Core 2 RNEP A RNEP B Co-Lo 1 Co-Lo 2 Co-Lo 6 Co-Lo 5 Co-Lo 3 Co-Lo 4 Site 1 Site 2a Site 2b G.8032 Ethernet Ring Co-Lo 4a Co-Lo 4b G.8032 Sub-Ring Site 3 Router A Router B
  • 12. PoP to PoP PoP A PoP B Site 2Site 1 Site 3
  • 13. Ethernet ring protection »G.8032/Y.1344 › Less than 50ms protection switch –(Assuming fibre ring < 1,200km!) › Protection at layer 2, so do not need to wait for IP to reconverge on link failure within a region
  • 14. Layer 2 reroute Core 1 Core 2 RNEP A RNEP B Co-Lo 1 Co-Lo 2 Co-Lo 6 Co-Lo 5 Co-Lo 3 Co-Lo 4 Site 1 Site 2a Site 2b G.8032 Ethernet Ring Co-Lo 4a Co-Lo 4b G.8032 Sub-Ring Site 3 Router A Router B
  • 15. IP protection »If an RNEP fails, still need to switch to the other RNEP at layer 3 »Bidirectional Forwarding Detection (BFD) › Rapidly detect failures that might be hidden at layer 2 –IP access may just be aVLAN on an interface that stays up › NOC will configure on MRS routers › Member to configure on non-MRS L3 devices › Static routes tied to BFD, or BGP session tied to BFD.
  • 16. Ethernet Diagnostics »Check circuit before being brought into service › RFC2544 /Y.1564 – Loss – Delay – Throughput »Performance monitoring › CFM /Y.1731 – Delay – Jitter – Loss »Improved visibility of Netpaths through the aggregation infrastructure
  • 17. Presentation »Services delimited byVLANs › Or additional ports on the NTE »Services might be › IP › ExpressRoute › Netpath
  • 18. Scalability »If using OSA FC, upgrades will be down to engineer time. › New port on the 5170, re-use the NTE if it’s a 3926/3928. › No involvement from Openreach »Upgrades to regional aggregation rings › Insert SFPs, connect to the OSA FC filters.
  • 19. Questions and discussion? 08/11/2019 The new Janet access infrastructure 19

Editor's Notes

  • #4: I’ll come back to this later in the presentation High level toplogy. Co-location in carrier neutral points of presence, mainly Openreach exchanges. Ethernet equipment in each PoP Layer 3 equipment only in the RNEPs. Three example sites, one single-homed, another with resilient access, and a third connected to a sub-ring.
  • #5: This is the equipment that’s going to be in each PoP. Or at least for the first few regions we’re deploying. Performs layer 2 aggregation.
  • #6: This is the equipment that’s going to be in each PoP. Or at least for the first few regions we’re deploying. Performs layer 2 aggregation.
  • #8: We will be installing an NTE at the end of every line in the new access architecture. Visibility of the access line Possible use for service demarcation. In itself this is *not* intended to replace the MRS.
  • #12: Layer 2 services back to the routers for IP. Ditto for other services such as ExpressRoute. More to come on G.8032 in a bit.
  • #13: Shows how two neighbouring PoPs might be built. 4x10G backbone. Site 1 has 1G access. Site 3 has 10G access over OSA Filter Connect, so we can upgrade to 20G or more easily. Site 2 already has 20G resilient from two locations.