SlideShare a Scribd company logo
v
Big Data with Cumulus
David Sinn
April 22, 2015
Cumulus Networks: Making Networks Accessible
§ Vision
§  Bringing the Linux Revolution to Networking
§ Mission
§  To enable high capacity networks that are easy to deploy
and affordable helping customers realize the full promise of
the software-defined data center.
cumulusnetworks.com 2
Big Data in the Data Center
§ Super-compute
§  Clusters of x86 servers.
§  Ultra-low latency
§  Large scale east/west traffic
§ Distributed Storage/MapReduce
§  Dynamic workloads, so locality is difficult
§ Costly Legacy Deployments
cumulusnetworks.com 3
Traditional BigData Deployments
§ Layer-2 based
§  Constrained east/west
§  High port costs
§  Variable Latency
§  Host resiliency demands
§  Closed protocols
cumulusnetworks.com 4
L3: A better design
§ ECMP based Fat Tree
§  East/west bandwidth
§ Better Failure Handling
§ Scalable: No
Bottlenecks
§ Simple Feature Set
§ Open Protocols!
cumulusnetworks.com 5
LEAF
SPINE
Big Data Improvements
§ Stop worrying about locality
§  Full bandwidth is available between any pair of servers
§  Location becomes irrelevant for performance
§  Keep replicas as far away from each other as possible
§ Faster recovery
§  Plenty of core bandwidth to re-replicate after failure
§  Host HA becomes a lower level concern
cumulusnetworks.com 6
Unified Management
§ Converged administration
§  Same automation tools for managing servers now
available for the network
cumulusnetworks.com
Layer 3 Fabric
Servers
Switches
7
Cumulus Innovation Focus – Apps for the networking infrastructure
Don’t re-invent the wheel, but smoothen the ride
§  ONIE – Unmanned Install
§  ZTP – Zero Touch Provisioning
§  PTMd – Cable fault detection
§  Unnumbered Interfaces – IP management
§  Network Virtualization – Minimize physical changes
§  Dual Home hosts – Simplified Networks
8
NETWORK OS
HARDWARE
APP APP APP
hardware
Cumulus Linux
routing gangliabridging
hardware
operating system
app app app
CumulusNetworks.com
Automation Workflow
§ Installation Framework
§  PXE & ONIE to install the OS’s
§  Anisble to install the applications and configure the
nodes
Cumulus Networks and Partner Confidential 9
bare metal server
Server OS
app app app
BIOS and PXE
bare metal switch
Network OS
app app app
Boot Loader and ONIE
Similar to installing a server OS using PXE
Network OS
Boot Loader and ONIE
boot into
Boot Loader and ONIE
boot into
ONIE looks for and installs network OS image
Demo
§ Cumulus Customer Workbench
§  2-Spine + 2 Leaf
•  OSPF Unnumbered with PTM
§  2-Ubuntu Servers
•  Hortonworks Hadoop
•  HDFS & YARN
•  Server 1: master + worker
•  Server 2: worker
cumulusnetworks.com 10
Ansible
§ Example Automation Process
§ Network
§  Define topology
§  Install license
§  Configure OSPF Unnumbered & PTM
§  Start networking
cumulusnetworks.com 11
Ansible Continued
§ Server Setup
§  Create users, setup networking
§  Install packages and dependencies
§  Deploy site specific Hadoop Config
§  Start HDFS & YARN
§ Enjoy Your BigData Cluster
cumulusnetworks.com 12
Demo
§ Let’s switch to the demo
cumulusnetworks.com 13
The Data Center Network with Cumulus Linux
CumulusNetworks.com 14
Open AffordableResponsive
Unlock Your Choices.
§  Disaggregation of hardware and software
§  Choice of best-in-class platforms and tools
§  Inherently flexible – with no vendor lock-in
§  Vast resources in the Linux community
Serve the Business Better.
§  Rapid, accurate services with automation –
provisioning in minutes instead of days
§  Orchestration via server tools
§  Accelerated innovation via DevOps, open
source, and broad solution ecosystem
Save as You Grow.
§  Scalable, affordable capacity in layer 2,
layer 3 or layer 3 overlay networks
§  >50% CapEx savings with industry-standard
hardware running Cumulus Linux
§  Opex savings through automation, use of
server tools and simpler expansion
© 2015 Cumulus Networks. Cumulus Networks, the Cumulus Networks Logo, and Cumulus Linux are trademarks or registered trademarks of Cumulus Networks, Inc. or its
affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. The registered trademark Linux® is used pursuant to a sublicense from LMI,
the exclusive licensee of Linus Torvalds, owner of the mark on a world-wide basis.
§ Thank You!
cumulusnetworks.com 15
Unleashing the Power of Open Networking

More Related Content

PDF
Cumulus Linux 2.5 Overview
PPTX
Big Data, Better Networks
PDF
Using linux to manage the entire rack
PDF
NFD9 - David Sinn, Real World Examples
PDF
Nick Fisk - low latency Ceph
ODP
Using CloudStack With Clustered LVM
PPTX
DevOps Fest 2019. Stanislav Kolenkin. Сonnecting pool Kubernetes clusters: Fe...
PDF
1 sysadmin vs 250 clusters de stockage
Cumulus Linux 2.5 Overview
Big Data, Better Networks
Using linux to manage the entire rack
NFD9 - David Sinn, Real World Examples
Nick Fisk - low latency Ceph
Using CloudStack With Clustered LVM
DevOps Fest 2019. Stanislav Kolenkin. Сonnecting pool Kubernetes clusters: Fe...
1 sysadmin vs 250 clusters de stockage

What's hot (14)

PDF
[OpenStack Days Korea 2016] Track1 - Mellanox CloudX - Acceleration for Cloud...
PDF
Monitoring of OpenNebula installations
PDF
Open Hardware for All - Webinar March 25, 2015
PPTX
XenServer HA Improvements
PDF
OVHcloud Hosted Private Cloud Platform Network use cases with VMware NSX
PDF
Ceph with CloudStack
PPTX
Cloud stack overview
PDF
TechDay - Cambridge 2016 - OpenNebula Corona
PDF
[OpenStack Days Korea 2016] Track3 - OpenStack on 64-bit ARM with X-Gene
PDF
Nova net-or-neutron-atlanta2014.pptx
PDF
Ceph and Apache CloudStack
PPT
PDF
XCP-ng - past, present and future
PDF
Networking is the barrier to Cloud
[OpenStack Days Korea 2016] Track1 - Mellanox CloudX - Acceleration for Cloud...
Monitoring of OpenNebula installations
Open Hardware for All - Webinar March 25, 2015
XenServer HA Improvements
OVHcloud Hosted Private Cloud Platform Network use cases with VMware NSX
Ceph with CloudStack
Cloud stack overview
TechDay - Cambridge 2016 - OpenNebula Corona
[OpenStack Days Korea 2016] Track3 - OpenStack on 64-bit ARM with X-Gene
Nova net-or-neutron-atlanta2014.pptx
Ceph and Apache CloudStack
XCP-ng - past, present and future
Networking is the barrier to Cloud
Ad

Viewers also liked (20)

PDF
NFD9 - JR Rivers, Cumulus Networks Overview
PDF
Manage your switches like servers
PDF
Webinar- Tea for the Tillerman
PDF
Open Networking for Your OpenStack
PPTX
Cumulus Linux 2.5.3
PDF
Unlock Your Cloud Potential with Mirantis OpenStack & Cumulus Linux
PDF
Mlag invisibile layer 2 redundancy
PPTX
Linux networking is Awesome!
PDF
How deep is your buffer – Demystifying buffers and application performance
PDF
Cumulus Linux 2.5.4
PPTX
July NYC Open Networking Meeup
PDF
Dreamhost deploying dreamcompute at scale
PDF
Cumulus Linux 2.5.5 What's New
PDF
The Software-Defined Data Center - Dell and Cumulus Networks
PDF
NFD9 - Dinesh Dutt, Data Center Architectures
PDF
NFD9 - Matt Peterson, Data Center Operations
PPTX
Webinar-Linux Networking is Awesome
PDF
Ifupdown2: Network Interface Manager
PDF
Operationalizing BGP in the SDDC
PPTX
Webinar: Network Automation [Tips & Tricks]
NFD9 - JR Rivers, Cumulus Networks Overview
Manage your switches like servers
Webinar- Tea for the Tillerman
Open Networking for Your OpenStack
Cumulus Linux 2.5.3
Unlock Your Cloud Potential with Mirantis OpenStack & Cumulus Linux
Mlag invisibile layer 2 redundancy
Linux networking is Awesome!
How deep is your buffer – Demystifying buffers and application performance
Cumulus Linux 2.5.4
July NYC Open Networking Meeup
Dreamhost deploying dreamcompute at scale
Cumulus Linux 2.5.5 What's New
The Software-Defined Data Center - Dell and Cumulus Networks
NFD9 - Dinesh Dutt, Data Center Architectures
NFD9 - Matt Peterson, Data Center Operations
Webinar-Linux Networking is Awesome
Ifupdown2: Network Interface Manager
Operationalizing BGP in the SDDC
Webinar: Network Automation [Tips & Tricks]
Ad

Similar to Big data, better networks (20)

PDF
Unleash the Power of Open Networking
PDF
Simplifying OpenStack Networks with Routing on the Host: Gerard Chami + Scott...
PDF
Making the Switch to Bare Metal and Open Networking
PDF
Modern Data Center Network Architecture - The house that Clos built
PDF
Cloud Bursting 101: What to do When Cloud Computing Demand Exceeds Capacity
PDF
Boyan Krosnov - Building a software-defined cloud - our experience
PPTX
HPC and cloud distributed computing, as a journey
PPTX
Cumulus Networks Overview
PDF
3 Ways to Connect to the Oracle Cloud
PDF
Introduction to Apache Mesos and DC/OS
PPTX
Understanding and deploying Network Virtualization
PDF
ONIE / Cumulus Networks Webinar
PDF
Deploying flash storage for Ceph without compromising performance
PPTX
Mellanox Market Leading Solutions
PPTX
Ceph Day New York 2014: Best Practices for Ceph-Powered Implementations of St...
PDF
Ansible & Cumulus Networks - Simplify Network Automation
PPTX
DOE Magellan OpenStack user story
PDF
Enterprise-Grade Networking in OpenStack
PDF
Accelerated SDN in Azure
PDF
Cloud Stack with Bare Metal, presented in Apache Con Europe 2016
Unleash the Power of Open Networking
Simplifying OpenStack Networks with Routing on the Host: Gerard Chami + Scott...
Making the Switch to Bare Metal and Open Networking
Modern Data Center Network Architecture - The house that Clos built
Cloud Bursting 101: What to do When Cloud Computing Demand Exceeds Capacity
Boyan Krosnov - Building a software-defined cloud - our experience
HPC and cloud distributed computing, as a journey
Cumulus Networks Overview
3 Ways to Connect to the Oracle Cloud
Introduction to Apache Mesos and DC/OS
Understanding and deploying Network Virtualization
ONIE / Cumulus Networks Webinar
Deploying flash storage for Ceph without compromising performance
Mellanox Market Leading Solutions
Ceph Day New York 2014: Best Practices for Ceph-Powered Implementations of St...
Ansible & Cumulus Networks - Simplify Network Automation
DOE Magellan OpenStack user story
Enterprise-Grade Networking in OpenStack
Accelerated SDN in Azure
Cloud Stack with Bare Metal, presented in Apache Con Europe 2016

More from Cumulus Networks (12)

PPTX
Building a Layer 3 network with Cumulus Linux
PDF
Operationalizing EVPN in the Data Center: Part 2
PDF
Demystifying EVPN in the data center: Part 1 in 2 episode series
PPTX
Best practices for network troubleshooting
PDF
NetDevOps 202: Life After Configuration
PPTX
Cumulus Networks: Automating Network Configuration
PPTX
Demystifying Networking: Data Center Networking Trends 2017
PPTX
Building Scalable Data Center Networks
PPTX
Network Architecture for Containers
PPTX
Demystifying Networking Webinar Series- Routing on the Host
PPTX
Operationalizing VRF in the Data Center
PPTX
Microservices Network Architecture 101
Building a Layer 3 network with Cumulus Linux
Operationalizing EVPN in the Data Center: Part 2
Demystifying EVPN in the data center: Part 1 in 2 episode series
Best practices for network troubleshooting
NetDevOps 202: Life After Configuration
Cumulus Networks: Automating Network Configuration
Demystifying Networking: Data Center Networking Trends 2017
Building Scalable Data Center Networks
Network Architecture for Containers
Demystifying Networking Webinar Series- Routing on the Host
Operationalizing VRF in the Data Center
Microservices Network Architecture 101

Recently uploaded (20)

PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PPTX
Tartificialntelligence_presentation.pptx
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
A Presentation on Artificial Intelligence
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Encapsulation theory and applications.pdf
PDF
A comparative analysis of optical character recognition models for extracting...
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
cuic standard and advanced reporting.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Electronic commerce courselecture one. Pdf
PDF
Machine learning based COVID-19 study performance prediction
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Empathic Computing: Creating Shared Understanding
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Tartificialntelligence_presentation.pptx
Group 1 Presentation -Planning and Decision Making .pptx
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
A Presentation on Artificial Intelligence
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Dropbox Q2 2025 Financial Results & Investor Presentation
Encapsulation theory and applications.pdf
A comparative analysis of optical character recognition models for extracting...
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
cuic standard and advanced reporting.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Reach Out and Touch Someone: Haptics and Empathic Computing
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Electronic commerce courselecture one. Pdf
Machine learning based COVID-19 study performance prediction
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Empathic Computing: Creating Shared Understanding
Diabetes mellitus diagnosis method based random forest with bat algorithm

Big data, better networks

  • 1. v Big Data with Cumulus David Sinn April 22, 2015
  • 2. Cumulus Networks: Making Networks Accessible § Vision §  Bringing the Linux Revolution to Networking § Mission §  To enable high capacity networks that are easy to deploy and affordable helping customers realize the full promise of the software-defined data center. cumulusnetworks.com 2
  • 3. Big Data in the Data Center § Super-compute §  Clusters of x86 servers. §  Ultra-low latency §  Large scale east/west traffic § Distributed Storage/MapReduce §  Dynamic workloads, so locality is difficult § Costly Legacy Deployments cumulusnetworks.com 3
  • 4. Traditional BigData Deployments § Layer-2 based §  Constrained east/west §  High port costs §  Variable Latency §  Host resiliency demands §  Closed protocols cumulusnetworks.com 4
  • 5. L3: A better design § ECMP based Fat Tree §  East/west bandwidth § Better Failure Handling § Scalable: No Bottlenecks § Simple Feature Set § Open Protocols! cumulusnetworks.com 5 LEAF SPINE
  • 6. Big Data Improvements § Stop worrying about locality §  Full bandwidth is available between any pair of servers §  Location becomes irrelevant for performance §  Keep replicas as far away from each other as possible § Faster recovery §  Plenty of core bandwidth to re-replicate after failure §  Host HA becomes a lower level concern cumulusnetworks.com 6
  • 7. Unified Management § Converged administration §  Same automation tools for managing servers now available for the network cumulusnetworks.com Layer 3 Fabric Servers Switches 7
  • 8. Cumulus Innovation Focus – Apps for the networking infrastructure Don’t re-invent the wheel, but smoothen the ride §  ONIE – Unmanned Install §  ZTP – Zero Touch Provisioning §  PTMd – Cable fault detection §  Unnumbered Interfaces – IP management §  Network Virtualization – Minimize physical changes §  Dual Home hosts – Simplified Networks 8 NETWORK OS HARDWARE APP APP APP hardware Cumulus Linux routing gangliabridging hardware operating system app app app CumulusNetworks.com
  • 9. Automation Workflow § Installation Framework §  PXE & ONIE to install the OS’s §  Anisble to install the applications and configure the nodes Cumulus Networks and Partner Confidential 9 bare metal server Server OS app app app BIOS and PXE bare metal switch Network OS app app app Boot Loader and ONIE Similar to installing a server OS using PXE Network OS Boot Loader and ONIE boot into Boot Loader and ONIE boot into ONIE looks for and installs network OS image
  • 10. Demo § Cumulus Customer Workbench §  2-Spine + 2 Leaf •  OSPF Unnumbered with PTM §  2-Ubuntu Servers •  Hortonworks Hadoop •  HDFS & YARN •  Server 1: master + worker •  Server 2: worker cumulusnetworks.com 10
  • 11. Ansible § Example Automation Process § Network §  Define topology §  Install license §  Configure OSPF Unnumbered & PTM §  Start networking cumulusnetworks.com 11
  • 12. Ansible Continued § Server Setup §  Create users, setup networking §  Install packages and dependencies §  Deploy site specific Hadoop Config §  Start HDFS & YARN § Enjoy Your BigData Cluster cumulusnetworks.com 12
  • 13. Demo § Let’s switch to the demo cumulusnetworks.com 13
  • 14. The Data Center Network with Cumulus Linux CumulusNetworks.com 14 Open AffordableResponsive Unlock Your Choices. §  Disaggregation of hardware and software §  Choice of best-in-class platforms and tools §  Inherently flexible – with no vendor lock-in §  Vast resources in the Linux community Serve the Business Better. §  Rapid, accurate services with automation – provisioning in minutes instead of days §  Orchestration via server tools §  Accelerated innovation via DevOps, open source, and broad solution ecosystem Save as You Grow. §  Scalable, affordable capacity in layer 2, layer 3 or layer 3 overlay networks §  >50% CapEx savings with industry-standard hardware running Cumulus Linux §  Opex savings through automation, use of server tools and simpler expansion
  • 15. © 2015 Cumulus Networks. Cumulus Networks, the Cumulus Networks Logo, and Cumulus Linux are trademarks or registered trademarks of Cumulus Networks, Inc. or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. The registered trademark Linux® is used pursuant to a sublicense from LMI, the exclusive licensee of Linus Torvalds, owner of the mark on a world-wide basis. § Thank You! cumulusnetworks.com 15 Unleashing the Power of Open Networking