SlideShare a Scribd company logo
Building a Router
Hannes Gredler
hannes@rtbrick.com
Pravin S Bhandarkar
pravin@rtbrick.com
RtBrick positioning
Hyper Scale
Routing
Protocols
Bare Metal
hardware
Full API
programmability
Mission & Vision: Interwork Applications & Network
Southbound API
Forwarding State, Policy
Northbound API
Telemetry, Topology Data
Our view of the network: HYBRID
Controller:
Southbound API
Routing Protocols:
IGP, BGP, SR
• Our Toolkits (=Bricks) are enabler for DevOps models
• Accelerated Adoption, rather than building software from scratch
• Our Toolkits (=Bricks) are purpose-build for:
• Flexibility
• Speed of deployment
• Eliminate the “old” Network paradigm
• No closed-systems, no curated release model
• Fast Forward IETF Network Apps (BGP, IS-IS, Segment-
Routing …)
• Create your own Network Apps by your needs
• Or let us customize the Applications for you
• Open Source Network Test environment
• Leverage our work for acceptance testing
RtBrick = acceleration for building network devices
What Problem does RtBrick solve ?
Time to Revenue (TTR) O(months)
Development SQA-Test Acceptance-
Test
Deploy
Vendor Service Provider
Dev Test Deploy
Time to Revenue (TTR) O(days)
Vendor & Service Provider
How ?
Database
centric
Modular
Code
Open
Test
Open
Hardware
1. Database centric / Distributed Data Store
bds://local/bgp.neighbor
bds://local/isis.a
dj
bds://local/isis.lsdb.l2
bds://217.160.181.216/bgp.rib-in
PUBSUB
2. Modular Code
IS-IS
BGP
RSVP
LDP
Netflow
Sflow
OSPF
Trill
STP
PIM
L3VPN
L2VPN
Core infra (BDS, IPC, DPKG)
IS-IS NetflowSRBGP
SR
Statically Compiled
Monolithic NOS
Dynamic Loaded Library
Modular NOS
3. Open Test, Pull
3. Open Test, Push
4. Open Hardware / White Boxes
• Economy of scale will ultimately render custom-ASICs obsolete
• Cost/Bit favorable on Merchant Silicon
• FY2016 systems shipping:
• 3TBit/s, > 128K FIB entries
• 800 Gbit/s, > Full Tables, Large Buffers, MPLS, indirection
• Feature Gap gets closed
• Cannibalizing Edge Router Business …
• RtBrick “Full Stack” makes no Hardware assumptions
• Unbounded Configuration Possibilities:
• Single Switch, Cluster of Switches, Co-located x86 Rack Servers ….
• Large FIBs, Small FIBs, SW-based forwarders & Combos thereof
System Architecture
Route Reflector
• Control plane server
• 24 Core Dual Socket Intel XEON 3.3 Ghz
• 256 GB RAM
• 512 GB SSD for Snapshots for “antifragile” daemon restart
• 2 Port 10 GBit/s (Intel XL710) DPDK compatible NIC card
SYSTEM LAYOUT
1RU Server
LXC
M
N2N1
etc isis
bgp
isis
bgp.
ipv4
bgp.
ipv6
fwd
conf
policy
System Architecture
Peering router
PEERING ROUTER
FWDD PLUGIN ARCHITECTURE
Brick daemon "fwdd" on NPU
VPP
REST APIbackstore CLI
Tomahawk Jericho Netlink
Brick daemon "fwdd" on Server
VPP
REST APIbackstore CLI
Tomahawk Jericho Netlink
FORWARDING CAPABILITIES
• Forward transit traffic from the NPU
• Import / Export ACLs
• Punt host path traffic using GRE/MPLS from NPU to server
• Dynamic Control Plane Protection on NPU for host traffic
• Data plane policies installed on the NPU for transit traffic via
firewall filters
• Fwdd on NPU-CPU to have:
• VPP based software forwarder to interface with backstore
• Chipset specific plug-in that programs the ASIC
• Bypass NPU-CPU processor for packet processing
System Architecture
Spine router
• Three Levels of Routing
• BGP (eBGP, iBGP)
• IGP (IS-IS)
• Fabric Discovery Protocol
(=Multi Instance IS-IS,
Instance-ID 0xfabd)
• Use multi-level route
resolution to tie it all together
• Three Levels of Forwarding
• Inter-domain: IPv4 / IPV6 /
MPLS
• Intra-domain: MPLS (Segment
Routing)
• Intra-Fabric: MPLS Segment
Routing
RECURSIVE ARCHITECTURE
DISCRETE SPINE ROUTER
System Architecture
Super Spine router
LXC
Control Board
LXC
fwd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M
M
N2N1
etc
etc isis
bgp
isis
bgp.
ipv4
bgp.
ipv6
sample
fwd
conf
policy
LXC
fwd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M
etc sample
LXC
fwd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M
etc sample
LXC
fwd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M
etc sample
LXC
fwd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M
etc sample
LXC
fwd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M
etc sample
LXC
fwd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M
etc sample
LXC
fwd
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M
etc sample
• Embedded Control Board
• Control Plane hosting control
plane, user interface & Policy
• Multi linecard switch
• OCP 800 (26 Tbit/s)
• OCP 1600 (52 Tbits/s)
• Linux container (LXC)
containing etc, sample, fwd
• Fwd: chipset specific adaptation
Tomahawk
SPINE ROUTER
Licencing Options
• Consumer / Developer License
• Consumer: Access to package binaries
• Developer: Access to Protocol (BGP, OSPF) code
• Full-Stack Developer: Access to Protocol and Infrastructure code
• Annual / Perpetual License
• Per Node / Enterprise (All you can eat) license
• Pay as you grow, vs. one off
• Maintenance & Support
PROPOSED LICENCING OPTIONS
WE’LL BE ANSWERING QUESTIONS NOW
Q A&
THANK YOU FOR YOUR TIME
Q & A SESSION

More Related Content

PPTX
Hannes end-of-the-router-tnc17
PDF
Advanced Traffic Engineering (TE++)
PDF
Tungsten Fabric Overview
PPTX
The Need for Complex Analytics from Forwarding Pipelines
PDF
OCP Summit 2016 - Transforming Networks to All-IT Network with OCP and Open N...
PDF
DPDK Summit 2015 - Sprint - Arun Rajagopal
PDF
Hyperscan - Mohammad Abdul Awal
PDF
Install FD.IO VPP On Intel(r) Architecture & Test with Trex*
Hannes end-of-the-router-tnc17
Advanced Traffic Engineering (TE++)
Tungsten Fabric Overview
The Need for Complex Analytics from Forwarding Pipelines
OCP Summit 2016 - Transforming Networks to All-IT Network with OCP and Open N...
DPDK Summit 2015 - Sprint - Arun Rajagopal
Hyperscan - Mohammad Abdul Awal
Install FD.IO VPP On Intel(r) Architecture & Test with Trex*

What's hot (20)

PDF
ONS Summit 2017 SKT TINA
PPTX
Layer-3 BFD Optimization Proposals for Enterprise and Campus Networks
PDF
Generic Resource Manager - László Vadkerti, András Kovács
PDF
Open Network OS Overview as of 2015/10/16
PPTX
Design, Verification and Emulation of an Island-Based Network Flow Processor
PPTX
High Availability in Neutron
PDF
OpenDataPlane - Bill Fischofer
PDF
Inside Microsoft's FPGA-Based Configurable Cloud
PPTX
Netsft2017 day in_life_of_nfv
PPT
Cumulus networks - Overcoming traditional network limitations with open source
PDF
Hotplug and Virtio - Tetsuya Mukawa
PPTX
Cumulus Linux 2.5.3
PDF
Cloud Networking Trends
PDF
Service Function Chaining in Openstack Neutron
PPTX
Barak Perlman, ConteXtream - SFC (Service Function Chaining) Using Openstack ...
PDF
Use EPA for NFV & Test with OPNVF* Yardstick*
PDF
LF_OVS_17_OVN and Kelda
PDF
DPDK Architecture Musings - Andy Harvey
PDF
DPDK Integration: A Product's Journey - Roger B. Melton
PDF
LF_OVS_17_IPSEC and OVS DPDK
ONS Summit 2017 SKT TINA
Layer-3 BFD Optimization Proposals for Enterprise and Campus Networks
Generic Resource Manager - László Vadkerti, András Kovács
Open Network OS Overview as of 2015/10/16
Design, Verification and Emulation of an Island-Based Network Flow Processor
High Availability in Neutron
OpenDataPlane - Bill Fischofer
Inside Microsoft's FPGA-Based Configurable Cloud
Netsft2017 day in_life_of_nfv
Cumulus networks - Overcoming traditional network limitations with open source
Hotplug and Virtio - Tetsuya Mukawa
Cumulus Linux 2.5.3
Cloud Networking Trends
Service Function Chaining in Openstack Neutron
Barak Perlman, ConteXtream - SFC (Service Function Chaining) Using Openstack ...
Use EPA for NFV & Test with OPNVF* Yardstick*
LF_OVS_17_OVN and Kelda
DPDK Architecture Musings - Andy Harvey
DPDK Integration: A Product's Journey - Roger B. Melton
LF_OVS_17_IPSEC and OVS DPDK
Ad

Similar to Building a Router (20)

PDF
Osnug meetup-tungsten fabric - overview.pptx
PPTX
HiPEAC-Keynote.pptx
PDF
Accelerated SDN in Azure
PDF
Software Defined Network (SDN) using ASR9000 :: BRKSPG-2722 | San Diego 2015
PDF
LinkedIn OpenFabric Project - Interop 2017
PDF
[발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community)
PDF
Tech Tutorial by Vikram Dham: Let's build MPLS router using SDN
PDF
Fastsocket Linxiaofeng
PDF
Security defined routing_cybergamut_v1_1
PDF
Platforms for Accelerating the Software Defined and Virtual Infrastructure
PDF
ONUG Tutorial: Bridges and Tunnels Drive Through OpenStack Networking
PDF
Summit 16: How to Compose a New OPNFV Solution Stack?
PPTX
Support of containerized workloads in ONAP
PDF
RouteFlow & IXPs
PDF
NSX: La Virtualizzazione di Rete e il Futuro della Sicurezza
PPTX
Software Defined Networking: Primer
PDF
Dataplane networking acceleration with OpenDataplane / Максим Уваров (Linaro)
PPTX
SD-WAN Catalyst a brief Presentation of solution
PDF
Open vSwitch Introduction
Osnug meetup-tungsten fabric - overview.pptx
HiPEAC-Keynote.pptx
Accelerated SDN in Azure
Software Defined Network (SDN) using ASR9000 :: BRKSPG-2722 | San Diego 2015
LinkedIn OpenFabric Project - Interop 2017
[발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community)
Tech Tutorial by Vikram Dham: Let's build MPLS router using SDN
Fastsocket Linxiaofeng
Security defined routing_cybergamut_v1_1
Platforms for Accelerating the Software Defined and Virtual Infrastructure
ONUG Tutorial: Bridges and Tunnels Drive Through OpenStack Networking
Summit 16: How to Compose a New OPNFV Solution Stack?
Support of containerized workloads in ONAP
RouteFlow & IXPs
NSX: La Virtualizzazione di Rete e il Futuro della Sicurezza
Software Defined Networking: Primer
Dataplane networking acceleration with OpenDataplane / Максим Уваров (Linaro)
SD-WAN Catalyst a brief Presentation of solution
Open vSwitch Introduction
Ad

Recently uploaded (20)

PDF
Unit-1 introduction to cyber security discuss about how to secure a system
PDF
Automated vs Manual WooCommerce to Shopify Migration_ Pros & Cons.pdf
PPTX
Slides PPTX World Game (s) Eco Economic Epochs.pptx
PPTX
SAP Ariba Sourcing PPT for learning material
PDF
The New Creative Director: How AI Tools for Social Media Content Creation Are...
PDF
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
PDF
Decoding a Decade: 10 Years of Applied CTI Discipline
PPT
Design_with_Watersergyerge45hrbgre4top (1).ppt
PPTX
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
PDF
An introduction to the IFRS (ISSB) Stndards.pdf
PDF
RPKI Status Update, presented by Makito Lay at IDNOG 10
PDF
Testing WebRTC applications at scale.pdf
PPT
tcp ip networks nd ip layering assotred slides
PPTX
presentation_pfe-universite-molay-seltan.pptx
PDF
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
DOCX
Unit-3 cyber security network security of internet system
PPTX
Introduction to Information and Communication Technology
PPTX
Power Point - Lesson 3_2.pptx grad school presentation
PDF
Tenda Login Guide: Access Your Router in 5 Easy Steps
PPTX
artificial intelligence overview of it and more
Unit-1 introduction to cyber security discuss about how to secure a system
Automated vs Manual WooCommerce to Shopify Migration_ Pros & Cons.pdf
Slides PPTX World Game (s) Eco Economic Epochs.pptx
SAP Ariba Sourcing PPT for learning material
The New Creative Director: How AI Tools for Social Media Content Creation Are...
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
Decoding a Decade: 10 Years of Applied CTI Discipline
Design_with_Watersergyerge45hrbgre4top (1).ppt
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
An introduction to the IFRS (ISSB) Stndards.pdf
RPKI Status Update, presented by Makito Lay at IDNOG 10
Testing WebRTC applications at scale.pdf
tcp ip networks nd ip layering assotred slides
presentation_pfe-universite-molay-seltan.pptx
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
Unit-3 cyber security network security of internet system
Introduction to Information and Communication Technology
Power Point - Lesson 3_2.pptx grad school presentation
Tenda Login Guide: Access Your Router in 5 Easy Steps
artificial intelligence overview of it and more

Building a Router

  • 1. Building a Router Hannes Gredler hannes@rtbrick.com Pravin S Bhandarkar pravin@rtbrick.com
  • 2. RtBrick positioning Hyper Scale Routing Protocols Bare Metal hardware Full API programmability
  • 3. Mission & Vision: Interwork Applications & Network Southbound API Forwarding State, Policy Northbound API Telemetry, Topology Data
  • 4. Our view of the network: HYBRID Controller: Southbound API Routing Protocols: IGP, BGP, SR
  • 5. • Our Toolkits (=Bricks) are enabler for DevOps models • Accelerated Adoption, rather than building software from scratch • Our Toolkits (=Bricks) are purpose-build for: • Flexibility • Speed of deployment • Eliminate the “old” Network paradigm • No closed-systems, no curated release model • Fast Forward IETF Network Apps (BGP, IS-IS, Segment- Routing …) • Create your own Network Apps by your needs • Or let us customize the Applications for you • Open Source Network Test environment • Leverage our work for acceptance testing RtBrick = acceleration for building network devices
  • 6. What Problem does RtBrick solve ? Time to Revenue (TTR) O(months) Development SQA-Test Acceptance- Test Deploy Vendor Service Provider Dev Test Deploy Time to Revenue (TTR) O(days) Vendor & Service Provider
  • 8. 1. Database centric / Distributed Data Store bds://local/bgp.neighbor bds://local/isis.a dj bds://local/isis.lsdb.l2 bds://217.160.181.216/bgp.rib-in PUBSUB
  • 9. 2. Modular Code IS-IS BGP RSVP LDP Netflow Sflow OSPF Trill STP PIM L3VPN L2VPN Core infra (BDS, IPC, DPKG) IS-IS NetflowSRBGP SR Statically Compiled Monolithic NOS Dynamic Loaded Library Modular NOS
  • 12. 4. Open Hardware / White Boxes • Economy of scale will ultimately render custom-ASICs obsolete • Cost/Bit favorable on Merchant Silicon • FY2016 systems shipping: • 3TBit/s, > 128K FIB entries • 800 Gbit/s, > Full Tables, Large Buffers, MPLS, indirection • Feature Gap gets closed • Cannibalizing Edge Router Business … • RtBrick “Full Stack” makes no Hardware assumptions • Unbounded Configuration Possibilities: • Single Switch, Cluster of Switches, Co-located x86 Rack Servers …. • Large FIBs, Small FIBs, SW-based forwarders & Combos thereof
  • 14. • Control plane server • 24 Core Dual Socket Intel XEON 3.3 Ghz • 256 GB RAM • 512 GB SSD for Snapshots for “antifragile” daemon restart • 2 Port 10 GBit/s (Intel XL710) DPDK compatible NIC card SYSTEM LAYOUT 1RU Server LXC M N2N1 etc isis bgp isis bgp. ipv4 bgp. ipv6 fwd conf policy
  • 17. FWDD PLUGIN ARCHITECTURE Brick daemon "fwdd" on NPU VPP REST APIbackstore CLI Tomahawk Jericho Netlink Brick daemon "fwdd" on Server VPP REST APIbackstore CLI Tomahawk Jericho Netlink
  • 18. FORWARDING CAPABILITIES • Forward transit traffic from the NPU • Import / Export ACLs • Punt host path traffic using GRE/MPLS from NPU to server • Dynamic Control Plane Protection on NPU for host traffic • Data plane policies installed on the NPU for transit traffic via firewall filters • Fwdd on NPU-CPU to have: • VPP based software forwarder to interface with backstore • Chipset specific plug-in that programs the ASIC • Bypass NPU-CPU processor for packet processing
  • 20. • Three Levels of Routing • BGP (eBGP, iBGP) • IGP (IS-IS) • Fabric Discovery Protocol (=Multi Instance IS-IS, Instance-ID 0xfabd) • Use multi-level route resolution to tie it all together • Three Levels of Forwarding • Inter-domain: IPv4 / IPV6 / MPLS • Intra-domain: MPLS (Segment Routing) • Intra-Fabric: MPLS Segment Routing RECURSIVE ARCHITECTURE
  • 23. LXC Control Board LXC fwd 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M M N2N1 etc etc isis bgp isis bgp. ipv4 bgp. ipv6 sample fwd conf policy LXC fwd 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M etc sample LXC fwd 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M etc sample LXC fwd 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M etc sample LXC fwd 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M etc sample LXC fwd 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M etc sample LXC fwd 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M etc sample LXC fwd 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 M etc sample • Embedded Control Board • Control Plane hosting control plane, user interface & Policy • Multi linecard switch • OCP 800 (26 Tbit/s) • OCP 1600 (52 Tbits/s) • Linux container (LXC) containing etc, sample, fwd • Fwd: chipset specific adaptation Tomahawk SPINE ROUTER
  • 25. • Consumer / Developer License • Consumer: Access to package binaries • Developer: Access to Protocol (BGP, OSPF) code • Full-Stack Developer: Access to Protocol and Infrastructure code • Annual / Perpetual License • Per Node / Enterprise (All you can eat) license • Pay as you grow, vs. one off • Maintenance & Support PROPOSED LICENCING OPTIONS
  • 26. WE’LL BE ANSWERING QUESTIONS NOW Q A& THANK YOU FOR YOUR TIME Q & A SESSION

Editor's Notes

  • #2: Dear <name>, thanks for giving me the opportunity to present my my upcoming venture called ‘rtbrick’. As the name ‘brick’ implies we want to build a modular, scalable routing software targeted to a disintegrated network market.
  • #4: Our mission & vision is to make Application and Networking integration seamless. Up to today it is hardly possible to set a massive amount of networking state from an application. If an Application wants to influence forwarding state or a routing policy one has to go through detours of vendor proprietary command line and scripting interfaces. Too often those proprietary interfaces have upper boundaries on the amount of transactions they can process. – Depending on the vendor and OS being used this can vary from one transaction every 10 seconds to a few 10s of transactions per second. The bottleneck also applies to export of telemetry data like link utilization, delay measurements - using the SNMP and netconf vehicles only a few 10s to 100s of state information may get extracted. This clearly does not work if you want to implement fast feedback loops between applications and the network.
  • #5: Our view of the network is that it has to be a hybrid across all layers (overlay and underlay). It is the combination of dynamic routing-protocols and Controller information which make networks manageable and resilient. Dynamic Routing Protocols are a good tool for discovering the topology and bootstrapping the internal network. For the time being, Internet Routing will rely on BGP4 and extensions.
  • #6: Companies like Google, FB, Netflix have demonstrated the clear value of DevOps as an organizational model. It improves time-to-revenue in every possible angle. However, many SPs are yet undecided if they want to build up software development expertise due to the perceived high entry cost Hence our core offering is to reduce the cost of running a DEVOPS model - the toolkits that we provide allows rapid feature introduction from development down to an integrated test environment.
  • #7: The inherent promise of DEVOPS is to reduce the Time-to-revenue of new network functionality which is today order of months Using our system new network functionality can be developed, tested and rolled-out in a a few days
  • #8: Our Offering is build around 4 Principles
  • #9: The core of the system is a distributed data store which holds every state in the system. Irrespective if it is interface information, IS-IS adjacencies, BGP RIBs or forwarding tables – every state is stored in the back store. Brick Data Store (BDS) it is a model-driven indexing and data replication vehicle. BDS has been designed for speed and consistency – data insertion can progress as fast as 1M updates per second per CPU core. The back store is configured by defining tables, objects and its attributes akin to a SQL server using a json config file. The back store also allows to quickly locate who is the originator of a an object and generate local replicas of that data for local (in-situ) processing. BDS is fully horizontal scalable, so if there are large tables (like for example RIB-ins) then it can shard the workload across a set of worker processes) all of the shard-ing can happen without changing a single-line of code The database centric design allows us to do all the cool-HA things, like doing live-software upgrades, restart of components without loss of service, etc. – Furthermore this design paradigm greatly minimizes the amount of boiler-plate code that one has to do to develop new networking code.
  • #10: Before coming to conclusions about what is broken in the Industries’ prevailing software delivery model, one first has to analyze how software is built, extended, and maintained over time. Assume Vendor A has a working, scalable implementation of a piece of networking software; let’s say a routing protocol. Over time, Service Provider customers, come up with all sorts of enhancement requests; some more useful than others. Usually, the enhancement request gets prototyped first, validated, and then merged back into the main line code. The fundamental problem here, is that it is not possible to de-feature certain functionality once merged. It is not possible to custom-tailor what the customer wants. There is no package manager that allows you to mix and match packages. There is no component that allows you to uninstall certain packages that you do not need. Just ask your networking vendor for the following tailor-made software release: IS-IS, BGP for IPv4 and IPv6, no OSPF. no LDP, no RSVP Not possible? - Reason it is not possible is because things have been constructed as a monolithic system, mostly by just compiling a new feature. Most often, a given feature is intimately linked to the underlying infrastructure (like an in-memory database, or some event queue processor), and, removing it out of the code base, may get to an effort as large as originally developing the feature. In most cases there is no dedication on how to clean things up later. Every added feature will make future feature additions harder. If you just make the number of supported software features large enough, you can extrapolate, that at some point, this will become unmaintainable. At RtBrick we have a small core and all functionality is added using the Debian package manager, All of our App source code get published on GitHub such that App developers can have a look at it.
  • #11: An old saying in the SW industry is: show me your testing and integration code and I’ll show you the quality of your code. As such any open-source effort that comes without the accompanying test-environment is futile. At RtBrick we’ll share the test and integration framework together with our devops customers. They way it works is at follows – first a real world network topology, configuration and interface names gets pulled from the live network into a model. Based on that synthesized network model the to-be-rolled-out code gets unit and integrations tested.
  • #12: If there is no nuclear blowout, then the code finally gets deployed using the fleet manager. Our Devops customers are encouraged to publish their test-cases on Github, such that we can leverage the network effect in testing and rapidly harden the quality of the shared code.