Design Driven Network Assurance

Copyright © 2023 - Jeremy Schulman
Design Driven
Network Assurance
Jeremy Schulman
Senior Director, Major League Baseball

Agenda
● Motivation
● Demos from Deployments
● Some Theory
● Practitioners Details
● Q & A
2
My hope for your takeaway:
Consider different approach
towards network automation
and Infrastructure as Code
Spark ideas how you
approach your next project
For even more ….

Background
and
Motivation
● Multi-site enterprise network
● Multiple network vendors
● Multiple networking domains
● Complex network edge
requirements
● Quickly adapt to "in field"
project changes
● Challenging timelines due to
external factors
- Any network design
- Any vendors
- Greenfield projects
- Brownfield projects
- "Snowflakes"
- Agile
3

Network Quality Assurance
Ensure the network is operating as expected and
report any anomalies with as much context as
possible maximizing situational awareness.
For any given network we define a design from
which we automatically derive checks. We use
these design checks to validate the current state
of the network.
4
Design
Design
Checks
Validate
Network
Network
change
The checks are automatically recomputed when
we make changes to the design!

Design "Compiler"
● Builds the design and
identifies design errors
● Generates the checks for
each device, executed later
by a validation engine
● Generates design reports
● Optionally generates device
configurations
5
Design
Design
Compiler
Checks
Configs
Design
Errors
Reports
netcad

Network Validation
Quick Demo
6
Executing the design checks against the live
network and reporting network assurance
results
netcam

Four Critical Questions …
7
1. How do we know we are
building the right network?
2. How do ensure the network is
configured correctly?
3. How do we ensure the network
is operationally correct?
netcam
netcad
netcad
netcam
process
netcad

The Fourth Critical Question
4. How do we advance the
transformation of culture,
process, and automation? leadership
resources
"care"
process products
8

Demo Time!

NetCad + NetBox Integration
Use netcad to design a site network
Use netcad-netbox plugin to push the site design into
NetBox
● Sites
● Devices
● Interfaces
● IP Addresses
● Link-Aggregation Groups
● Cabling
10

Check Network Pre-Hardware Swap
Use netcad to build network checks
Use netcam to perform network checks
Observe work that needs to be completed
● Swap network hardware
● Transceiver to be swapped
● Interfaces to be cabled
12

Check Config Deployment
Use netcad to build device configurations
Use netcam to config-check for differences on the live
network device
● See exactly what changes will be made before they are made
● Fully automated with rollback
● Captures diff-files
14

Check Network Status after Deploy
On-site technician has swapped hardware
Need to validate operational state
Need to identify any anomalies to resolve
● Found missing cabling
● Power systems not online yet
16

What is Design Driven
Network Assurance?

What is a Design?
19
The set of devices
networked together
The composition of
design services that each
device uses to validate
the state of the network

Network Quality Assurance Matrix
20
Topology VLANs PTP BGP-Peer Multicast
dev1
dev2
dev3
dev4
dev5
dev6
dev7

Network Check Results … Pass/Fail
21
dev1
dev2
dev3
dev4
dev5
dev6
dev7

dev3 is Operating as Expected
22
dev1
dev2
dev3
dev4
dev5
dev6
dev7

Multicast is Operating as Expected
23
dev1
dev2
dev3
dev4
dev5
dev6
dev7

The Network is
Operating as Expected
24
dev1
dev2
dev3
dev4
dev5
dev6
dev7

Case Study:
Precision Time Protocol

Case Study: PTP w/primary+backup GM
26
(G) - Grand Master - Clock origin
(M) - Master - transmits clock
(S) - Slave - receives clock

PTP - Design Report
27
The design describes the expected PTP state(s) for each device and interface
What is the actual state of PTP in this network ?
netcad

PTP Network Check Report
28
Site where PTP service is NOT working as expected.
Report shows informational and potential corrective actions.
netcam

PTP Network Check Report
29
Site where PTP service is working as expected
netcam

Design Driven Network
Assurance - Python "SDK"

Python First Approach
● Each design consists of Python
files that use the netcad-cam
SDK toolkit
● Plugins to utilize specific NOS
and design-services
● Multiple python packages /
repositories
● Approach designed for plugin /
extensibility

Benefits of Python Approach
● Leverage Python ecosystem
○ packages, IDEs, debuggers, and best practices
● Async I/O for concurrency and fast execution !!!
● "NoYAML"
● Benefits Junior network automation engineers
○ environment to learn and develop skills
● Flexible - Handle network design business logic / "snowflakes"
32

Software Engineering Best Practices
○ Requirement gathering
○ Focus on documentation
○ Code versioning
○ Peer reviews
○ Learn collaborative development
○ Using a debugger
○ Writing test cases
○ Other systems integration
○ Large project composition
○ Not constrained by DSL
33

Challenges of Python Approach
● Python learning curve
● Software tooling learning curve
● Having dedicated "off project" time to practice
a new skill
● Expectation setting with stakeholders
○ developing solutions vs. going Cowboy on the
CLI
● Working collaborative vs. Cowboy | Hero
● Focusing on non-coding aspects that take time
○ documentation, testing, and software
maintenance 34
Any change is hard
Affects people,
process, and culture
Be patient

Summary ● Design is code - version
controlled, reviewed, lifecycle
● Design checks are quality
assurance tests that provide
operational coverage
● Encourages practice to keep
Designs "up to date" by the
nature of running the
network by Design
● Builds skill sets to manage
IaC based systems
Design Driven Network
Assurance
35

Thank you!
Jeremy Schulman
Senior Director, Major League Baseball

Q&A
Meet Up

Backup Slides

Design Services - Reusable Building Blocks
● Network Vendor/System agnostic
● Defines design validation rules so that we
cannot build "invalid" designs
● Provides service specific build automations
● Defines collections of checks that will be
generated for each device using the design
service
● Can be general purpose such as "topology"
and "vlans"
● Can be bespoke to enterprise specific needs
39
Validation
rules
Build
automations
Check
collections
Design-Service XYZ

Design Automation - VLAN Port Assignments
40
Acc Switch 1 Acc Switch 3
Agg Switch
Vlans A, B, C Vlans A, D, E, F
ALL ALL
Acc Switch 2
Vlans A, B, D, E
ALL
PEER
PEER PEER
ALL
Indicates this port
should be configured
will all VLANs defined
in the design for this
device
PEER
Indicates this port
should be configured
with the same VLANs
used by the connected
interface (peer)
Router
ALL
PEER

Design Service Validation Abstraction Example
41
Vlans
Design Service
Switchports Vlans
EOS
vlans-ds
IOS-XE
vlans-ds
NX-OS
vlans-ds
<OS …>
vlans-ds
Each OS driver will implement the vlans design-service "switchports" and
"vlans" checks, specific to their capabilities and access (API vs. SSH, etc)

Design Driven Network Assurance

More Related Content

Similar to Design Driven Network Assurance (20)

More from Network Automation Forum (13)

Recently uploaded (20)

Design Driven Network Assurance