SlideShare a Scribd company logo

Cisco Live! :: Content Delivery Networks (CDN)

Bruno Teixeira, profile picture
Bruno Teixeira

The document outlines the principles and architecture of Content Delivery Networks (CDNs), focusing on caching techniques, resource optimization, and system design for content distribution. It covers various caching models, performance metrics, and the impact of different service delivery frameworks on media services. Emphasis is placed on understanding the dynamics of caching efficiency, cost considerations, and the implementation of CDN architecture for enhanced content delivery.

Internet
1 of 85
Downloaded 252 times
1
2
3
4
Most read
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
Most read
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
Most read
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
Cisco Live! :: Content Delivery Networks (CDN)
Content Delivery Networks (CDN): Caching Principles, Architecture, and Resource Optimization Scott Wainner, Distinguished Systems Engineer BRKSPV-2160
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Cisco Spark Questions? Use Cisco Spark to chat with the speaker after the session 1. Find this session in the Cisco Live Mobile App 2. Click “Join the Discussion” 3. Install Spark or go directly to the space 4. Enter messages/questions in the space How cs.co/ciscolivebot#BRKSPV-2160Cisco Spark spaces will be available until July 3, 2017.
Objectives • Understand Principles of Caching • Understand System Architecture and Role of CDN • Distinguish Impact of Service Delivery Models • Assess Characteristics of Resource Optimization
AGENDA • Caching Principles • Caching Value Proposition Models • Content Delivery Functions • Content Delivery of Media Services • Platform Optimization and Management • Enabling Cloud Content Delivery
Content Caching Principles
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 7BRKSPV-2160 Relevance • Commercial Video • Imagery • Production Training / Education Systems • Marketing / Mass Communication Systems • Notification Information Distribution • Telemetry Distribution to Subscribers • Software Distribution Many Media Types and Purposes
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 8BRKSPV-2160 Content Distribution Principles PerformanceEfficiency Resiliency
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 9BRKSPV-2160 Content Distribution Architectural Models • Hierarchical • Distribution Tree from Origin • Often associated with an Authoritative Source • Tightly controlled distribution policies • Peer to peer • Distributed Hash Table model • Content can be cached anywhere • Appropriate in fully meshed topologies • Multiple sources C C C C C C C C C
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 10BRKSPV-2160 System Architecture Content Management Origin Servers Live EPG Clients Offer Management Personalization Billing Offers Subscriptions Content Distribution Live Origin ServersLive On Demand VOD Origin Servers Storage Mid-Tier Cache CacheCache Our Focus Today Authentication And Navigation Asset Management Live Media VOD Media Product Bundles Workflows Catalog Creation Entitlement Policy Digital Rights Metadata Video Control Session Management Policy Management Edge Cache Entitlement & Session ControlPolicy Catalog Content Delivery Content Acquisition Transcoding Streams Video VoD IMDb Video Control Plane Data Plane Authorization & Assignment Credentials Image Tags Images Software Live ABR traffic VOD ABR traffic
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Entertainment Services Content Library (Origin) Traffic Servers Traffic Servers Off-Net Traffic Routing Internet Content Programming Published Content Centralized Content, Command and Control, and Analytics Hierarchy of Origination, Mid-Tier and Edge Caching Management Plane, Content Routing Plane, Content Delivery Plane Resiliency Defined at each Tier Cost Optimized Platform Selection Entertainment Services On-Net Ingest, Routing, & Management (Optional) Caching Layer Optimized Edge Cache Traffic Ops 11BRKSPV-2160 CDN Systems Architecture
Content Caching Techniques
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 13BRKSPV-2160 CDN - Introduction to Dynamic Caching • Concepts • CDN is a “Proxy” for Origin Servers • Redirecting clients to CDN • CDN Functional Cache Elements • “Traffic Routing” Redirection • “Origin Server” Library • “Traffic Server” Caching • “Traffic Server” Edge Cache Content Delivery Network Streams Ingest Cache-Fill Origin Servers Mid-Tier Cache Edge Cache Content Library Cache Storage Cache Storage Traffic Routing Location Requests Content Requests Content Requests Content Requests Location Redirects
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 14BRKSPV-2160 CDN – Implementation Considerations • Storage Considerations • Live Media (Finite Window) • VoD Media (Natural Expiration) • Cloud DVR (No Caching) • Content Affinity • Localization • Mobile • Pre-positioned • Mapping Methodology • File Handle in URL • Byte Offset in URL • Retention / Eviction Algorithms • Least Recently Used • First In / First Out • Metadata (Algorithmic Expiration) Input Main memory Solid state disk Spinning disk Caching Characterization Cache-Fill or Edge Cache Cache-Fill or Ingest Output
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public HTTP Caching • RFC2616 HTTP/1.1 • RFC 6585 Status Codes • RFC 2817 TLS • RFC 5785 Well-Known URI • RFC 6266 Content-Disposition • Cache Types • Transparent Caches • Proxy Caches 15BRKSPV-2160 Transparent Cache Internet Transparent Caching x  x get (file@fqdn-a.com) get (file@fqdn-a.com) Origin Server Intercept
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Transparent Caching • Unauthorized Intercept • Non Monetized • Dynamic Interpretation of Request • HTTP GET Analysis • Authentication or Encryption Interference • Authentication • Token or HASH Validation Corrupted • Payload Encryption • (e.g. Media Headers, Opaque Objects) • Transport Encryption • (e.g. TLS, SPDR) 16BRKSPV-2160 Transparent Cache Internet Catalog DNS Origin Server Item (x, Location (fqdn-y)) Location (fqdn-y.com) Item: x Location (fqdn-y) x  x get (x@fqdn-y.com) 1 2 3 4 6 Intercept 5 STOP7 9 GET (x@fqdn-y.com) STOP8
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public HTTP Caching • RFC2616 HTTP/1.1 • RFC 6585 Status Codes • RFC 2817 TLS • RFC 5785 Well-Known URI • RFC 6266 Content-Disposition • Cache Types • Transparent Caches • Proxy Caches 17BRKSPV-2160 Proxy Caching Proxy Cache get (file@fqdn-a.com) get (file@fqdn-b.com) z  y Origin Server Rewrite
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Proxy Caching • Authorized Delegation • Explicit Interpretation Provided to Cache • Optimized Payload is Known a priori • Authentication or Encryption Viable • Authenticators Validated and Recalculated • Tokens, HASH • Private Keys Shared • Payload Remains Encrypted • Substitution of Opaque Payload • Transport Encryption • Public Certificates Exchanged 18BRKSPV-2160 Origin Server Catalog DNS Item (z@fqdn-a.com) Item (z@fqdn-b.com) FQDN (fqdn-a) Location: (fqdn-a.com fqdn-b.com) get (z@fqdn-a.com) get (z@fqdn-b.com) 1 2 3 4 5 6 Proxy Cache fqdn-a  fqdn-b
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 19BRKSPV-2160 CDN Caching Basics • Authorized Delegation • Explicit Interpretation Provided to Cache • Authentication or Encryption Viable • Redirection to Optimal Location • Cache Hit Ratio • Distributed Edge • Edge Cache • Intermediate Layer • Reverse Proxy Cache Item (file@cdn.com) Origin Server CDN Traffic Server (Caching) Catalog DNS Traffic Server (Cache) Item (file@media.com) cdn.com Asset Mapping ( file@cdn.com file@media.com) get (file@se.cdn.com) get (file@media.com) get (file@media.com) GET (file@cdn.com) Redirect (file@se.cdn.com) 1 2 3 4 6 7 5 Traffic Router 8 9
CDN Value Proposition
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 21BRKSPV-2160 Content Caching Principles Content Popularity Cost Inflection Point Caching Sites Bandwidth Costs Cache Costs Optimized Costs Cost Cache Hit Rates
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 22BRKSPV-2160 Content Popularity Content Popularity Often Characterized by Zipf’s Law Library Described by Alpha (α) Cache Each Library is Unique • Old Movies • Current Hits • Music Videos • Sports Highlights • TV Series Views Titles ranked by Demand Top 100 Bottom 100
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 23BRKSPV-2160 Contributing Factors • CHR of Content Types • ABR more difficult to predict than for PDL • Cache Fill Traffic • Temporary content renewal • Triggered by revalidation • First Fill Request • Eviction • Popularity Profile • Least Recently Used • Topology Considerations • Hierarchical Caching gains • Geographical Content Affinity Different Nodal Cache Hit Rates !!!
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public • Probability of a Cache Hit PCHR • Probability of a Nodal Cache Miss PCM = 1- PCHR (b) Cache 13 8/13 = 61.6% 24BRKSPV-2160 Nodal Cache Hit Rates Cache Origin 2 5 Content Requests 3/5 = 60% 2/2 = 100% (a) • Node A Cache Miss PCHRa = 3/5 = 0.60 or 60% PCMa = 1 – 0.60 = 0. 4 • Node B Cache Miss PCHRb = 8/13 = 0.616 or 61.6% PCMb= 1 – 0.616 = 0.384 Very Popular Content New Content / Unpopular Content Some Popular Content
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public • Probability of System Cache Miss PSCM = PCMa * PCMb (b) Cache 13 8/13 = 62% 25BRKSPV-2160 System Cache Hit Rates Cache Origin 2 5 Content Requests 3/5 = 60% 2/2 = 100% (a) • System Cache Miss Example PCHRa = 3/5 = 0.60 or 60% PCMa = 1 – 0.60 = 0. 4 PCHRb = 8/13 = 0.616 or 61.6% PCMb= 1 – 0.616 = 0.384 PSCM = 0.4 * 0.384 = 0.154 = 15.4% • System Cache Hit Rate = 1- 15.4% = 84.6%
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 26BRKSPV-2160 Caching Cost : Bandwidth Cost Bandwidth Costs Demand Contributions / Cache-fill Source Data Center Network Core Network Edge Access Network Home Network
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 27BRKSPV-2160 Caching Cost : Cache Storage Cost Source Data Center Network Core Network Edge Access Network Storage Home Network
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 28BRKSPV-2160 Caching Cost Inflection Point: Optimized Costs Cost Source Data Center Network Core Network Edge Access Network Optimal Costs !!! Latency? Jitter? Congestion? Throughput? DemandContributions / Cache-fill Home Network Optimal Performance??? Storage + Bandwidth = Total Cost
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 29BRKSPV-2160 Caching Architecture Distribute ‘Enough’ Cache Storage at the ‘Right’ Locations Contributions Content Producer Data Center Origination sync Distribution Cache-Tier CDN Data Center CDN Data Center Co-Lo Cage cache-fill Enterprise Cache circuit circuit internet circuit peer ISP Co-Lo cache-fill Edge Cache Edge CacheWAN VPN internet Edge-Stream sources sources
Content Delivery Functions
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Time <- 2011 2012 2013 2014 *Road Mapped 31BRKSPV-2160 Cisco CDN Architecture Evolution 2015 2016 2017 2018 ➤ Encoders ➤ OMD Cache-Nodes ➤ vDCM ➤ cDVR MOS ➤ Infinite Video ➤ Cloud Native
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Hypervisor HypervisorHypervisor Traffic Vault Unified Compute System 32BRKSPV-2160 Elastic Platform Traffic Router OMD Analytics Traffic Operations Traffic Router Traffic Server Origin Server Traffic Monitor Traffic Server Unified Compute System Unified Compute System Traffic Sever Influx DB OpenStack – Compute, Storage, and Network Orchestration Traffic Stats Network Infrastructure Video Services Workflow Orchestration
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 33BRKSPV-2160 CDN Functional Architecture Server Function Summary Traffic Server HTTP/S proxy-cache based on open source Traffic Router Cache Selection, redirects clients to best cache Traffic Ops Configure and Monitor Traffic Server Caches Traffic Vault Protects keys and certificates Traffic Monitor Monitors cache health and load Traffic Stats Aggregates and visualizes real-time and historical performance data Influx DB Time series database to retain all Traffic Server statistics OMD Analytics Splunk based CDN Insights with 300+ Dashboards MaxMind Geo Database Open Media Distribution Edge-Tier Mid-Tier DNS Traffic Router Traffic- Monitor Traffic- Stats Traffic OPS Traffic Vault Influx DB Traffic Server Traffic Server Origin Server Client DNS Resolver OMD Insights
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Router • Delivery Service Properties • Localization using Coverage Zone Map (CZM) • DNS Content Routing • Authoritative DNS for Origin • List of Edge Cache IP • HTTP Content Routing • DNS Resolves to Self • HTTP Redirect 34BRKSPV-2160 Edge-Tier Traffic Router Traffic Server Client Edge-Tier Traffic Server
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Server • Reverse Proxies • URL Re-mapping Logic to Specific Sources (Mid-Tier Cache or Origin) • Cache Groups • Mid-Tier Cluster (single geographical coordinate) • Edge Cluster (single geographical coordinate) • HTTP Content Routing • DNS Resolves to Self • HTTP Proxy 35BRKSPV-2160 Traffic Server Traffic Server Origin Server Client Edge-Tier Mid-Tier
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Delivery Service • Cache in RAM, cache on disk, or do not cache at all • Use DNS or HTTP Content routing • Limits on transactions per second and bandwidth • Protocol (http or https) • Token based authentication settings • Header rewrite rules 36BRKSPV-2160
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Monitor • Throughput (e.g. bytes in, bytes out, etc). • Transactions (e.g. number of 2xx, 3xx, 4xx responses, etc). • Connections (e.g. from clients, to parents, origins, etc). • Cache performance (e.g.: hits, misses, refreshes, etc). • Storage performance (e.g.: writes, reads, frags, directories, etc). • System performance (e.g: load average, network throughput, etc). 37BRKSPV-2160
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Stats • Cache Stats • Bandwidth, Max Kbps, Client Connections • Delivery Service Stats • Service rates Kbps, Status (4xx/5xx), TPS (2xx, 3xx, 4xx, 5xx, total) • By Cache-Group, CDN, Delivery Service • Daily Stats • Max Bandwidth, Bytes Served, by CDN 38BRKSPV-2160
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Vault • SSL Certificates • Private Key, Certificate (CRT), Certificate Signing Request (CSR) • DNSSec Keys • Key Signing Key (private key, public key) • Zone Signing Key (private key, public key) • URL Signing Keys • Query Strings • Tokens 39BRKSPV-2160
Content Delivery System Design
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Origin Servers and the CDN • Content Management System (CMS) • Combine Content + Publishing Metadata • Origin Servers (OS) • Organized Media on Storage • Authorize Mid-Tier Cache • Package Content 41BRKSPV-2160 Origin Server Caching Traffic Servers OMD Traffic Router 1. POST CDN DELIVERY SERVICE 3. Request 2. CONFIG 6. GET Content 7. OK (media) CMS 1. POST OMD Traffic Ops 4. Location 5. Request 8. Ok (Media)
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 42BRKSPV-2160 Origin Server • Ingest must be flexible, resilient and secure • CDN can ingest from multiple Origin Servers • Local or Remote locations • Origins can be replicated • Locally (load balancing) • Remotely (disaster recovery) • Origins can have structure • Security • Capture/Recording/Playout separation for better scalability Content Mid-Tier Cache Ad Objects Origin Server Web Objects Origin Server Media Objects DELIVERY SERVICE (Web Objects) DELIVERY SERVICE (Media) DELIVERY SERVICE (Ads) Origin Servers Capture Play
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 43BRKSPV-2160 Delivery Service Content Routing • Request Redirection model • Traffic Router is the Authoritative DNS for “Delivery Service” FQDN • HTTP-based 30x redirection • Traffic Router resolves domain name to its own IP address • Traffic Router then uses 302/307 redirection to an Edge Cache • DNS-based redirection • Traffic Router resolves domain to IP address of Edge Cache • Traffic Router Criteria • Based on Client IP Address CDN Origin Server Policy Services: • Geo-Location • Network Proximity • Policy • Quota DNS Request Redirection Traffic Routing (HTTP, DNS) Traffic Server (Edge Cache) Traffic Server (Mid-tier Cache)
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Net Z 44BRKSPV-2160 Traffic Server Assignment • Assessing Location (Latency) • Per Delivery Service • Per Location • Assessing Status (Availability) • Analytics from Edge Caches • Resources Available • Assessing Content Affinity (Performance) • Assign Request to Previously Assigned Edge Cache • Assessing Content Controls • Quotas • Thresholds S1 IP S2 IP Traffic Monitor S3 IP Net X S1 Status S3 Status S2 Status Client Request Net Y Traffic Router Status
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Net Z 45BRKSPV-2160 Static Location-based Routing • Separate Content Routing Plane • Implemented at Traffic Router • Reference Location Information (MaxMind) • Traffic Server’s inform Traffic Monitor about status and load using keep-alive messages • Server Redundancy • Variety of Traffic Server Selection criteria available • Load • Content • Service availability S1 IP S2 IP Traffic Router CIP1S3 IP CIP LOC CIP1 == net Y CIP2 == net Z CIP2 Net X Net Y NODE LOC S1 IP == net X S2 IP == net Y S3 IP == net Z Lookup MaxMind DB Coverage Zone Load
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 46BRKSPV-2160 Content Delivery • Content Affinity Traffic Routing • Hash Calculated on URL (HTTP Only) • Common URL requests have affinity to same Traffic Server • Traffic Server Selection • Hash Calculated on Origin URL • Common Cache-fill requests have affinity to same Traffic Server • Origin Selection • Same as above CA 1 S2 IP S3b IP Client CA 2 S3a IP OS 1 OS 2 Client Client Client
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 47BRKSPV-2160 Content Delivery Optimization • Origin Server Sizing depends on CDN Cache Hit Rate (CHR) efficiency • Define CDN topology and apply Hierarchical Caching to achieve efficiency goal • Example • CDN Efficiency goal: 90% • Two-tier CDN (edge + mid-tier-cache) • Edge CHR (eCHR): 80% • Mid-tier Cache CHR (mCHR): 50% • Efficiency = • 1 – (1 – eCHR)*(1 – mCHR) = System CHR • 1 – (1 – 0.80)*(1 – 0.50) = 90% CA 1 S2 IP Client S3a IP OS 1 OS 2 Client Client Edge Cache Hit Rate Mid-Tier Cache Hit Rate
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 48BRKSPV-2160 Edge Throughput: Peak Busy Hour (PBH) NAS OS 20 Gbps 10 Gbps 30 Gbps 15 Gbps 0.5 Gbps 0.5 Gbps 4 Gbps 2 Gbps Live Load VoD Load Criteria 50 live channels; all profiles Bitrate per Channel = 10 Mbps Site Demand 30 Gbps Edge Live Cache-Fill 50 live * 10 Mbps/live = 0.5 Gbps Criteria Site Demand 20 Gbps Edge PoP CHR = 80% Edge VoD Cache-fill Load * (1- CHR) 20 Gbps * (0.2) = 4 Gbps Criteria Site Demand 10 Gbps Edge PoP CHR = 80% Edge VoD Cache-fill Load * (1- CHR) 10 Gbps * (0.2) = 2 Gbps VoD Load Live Load Criteria 50 live channels; all profiles Bitrate per Channel = 10 Mbps Site Demand 15 Gbps Edge Live Cache-Fill 50 live * 10 Mbps/live = 0.5 Gbps
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 20 Gbps 10 Gbps 30 Gbps 15 Gbps 0.5 Gbps 0.5 Gbps 4 Gbps 2 Gbps 49BRKSPV-2160 Origination Throughput: Peak Busy Hour (PBH) NAS OS Live VoD Criteria 50 live channels Bitrate per Channel = 10 Mbps Edge Live Cache-Fill 50 live * 10 Mbps/live = 0.5 Gbps Criteria Cache Demand 2+4 = 6 Gbps Cache CHR = 50% Edge VoD Cache-fill Load * (1- CHR) 6 Gbps * (0.5) = 3 Gbps 0.5 Gbps3 Gbps
CDN Characterization: Adaptive Bit Rate
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 51BRKSPV-2160 Common Adaptive Bit Rate (ABR) Methods • Apple • HTTP Live Streaming (HLS) • Segmented H.264 (MPEG2TS) • Manifest (.m3u8) • Microsoft • HTTP Smooth Streaming (HSS) • Fragmented H.264 (MP4) • Server Manifest, Client Manifest (.ims, .imsc ) • MPEG-DASH • Dynamic Adaptive Streaming over HTTP (DASH) • Fragmented H.264 (ISO-BMFF) • Media Presentation Description (.mpd)
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 52BRKSPV-2160 The Challenges with Distributing ABR Objects  Short fragment / segment sizes  High HTTP Request Rate  URL’s can be Absolute or Relative  DNS Resolutions  TCP connections should not be short-lived (client code)  Pipeline HTTP Requests  CDS object handling configured on a per Delivery Service basis Progressive Download ABR Delivery Movie.mp4 Frag1-1 Frag1-2 Frag2-1 . 2hr movie, 2 sec segments . 3600 fragments x 7 profiles . 25,000 objects/movie Frag1-3 Frag1-4 Frag2-2 Frag2-3 Frag2-4 Frag3-1 Frag3-2 Frag3-3 Frag3-4 Frag4-1 Frag4-2 Frag4-3 Frag4-4 Time Start + 2 sec + 4 sec + 6 sec 512 kbps 768 kbps 1.0 mbps 1.5 mbps GET GET GET GET
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Live / Linear TV: HLS • Caching the Sliding Window • Time-to-Live (TTL) access to Manifest / Profiles (10s) • Time-to-Live access to Segments (30s) 53BRKSPV-2160 MPEG2TS Transcode / Package TNOW T-10T-20 T+10 T+20 T+30 T+40 T+50 SOURCE Client 1 Client 2 Segment TTL Remaining in CDN Segment TTL Expired in CDN Manifest TTL Remaining in CDN Manifest TTL Expired in CDN No Segment in CDN HLS Profile 5 HLS Profile 1 HLS Profile 2 HLS Profile 3 HLS Profile 4
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Live / Linear TV: DASH and HSS • Caching the Time-shift Window • Time-to-Live (TTL) access to .imsc Manifest (2s) • Repackaged .mpd (1-10sec) 54BRKSPV-2160 MPEG2TS Transcode / Package T-2T-4 T+2 T+4 T+6 T+8 T+10 SOURCE Segment TTL Remaining in CDN Segment TTL Expired in CDN Current Manifest Available Manifest TTL Expired in CDN .imsc, .mpd No Segment in CDN TNOW Client 1 Client 2HSS Profile 5 HSS Profile 1 HSS Profile 2 HSS Profile 3 HSS Profile 4 TTL remaining TTL Expired
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public VoD: HLS • Complete Mapping of Manifest to Segments • Time-to-Live of Manifest / Profiles (as specified) • Time-to-Live access to Segments (as specified) 55BRKSPV-2160 MPEG2TS Transcode / Package T+10 T+20 T+30 T+40 T+50 manifest.m3u8segment.ts Segment TTL Remaining in CDN Segment TTL Expired in CDN Manifest TTL Remaining in CDN Manifest TTL Expired in CDN No Segment in CDN TNOW Complete Manifest Cached until TTL Expired Client 1 Client 2HLS Profile 5 HLS Profile 1 HLS Profile 2 HLS Profile 3 HLS Profile 4
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public VoD: HSS and DASH • Caching the ‘DVR Duration’ Window • Time-to-Live (TTL) access to .imsc Manifest (2s) • Time-to-Live access to Fragments (6s – IIS default 2hr) 56BRKSPV-2160 T+2 T+4 T+6 T+8 T+10 .imsc Segment TTL Remaining in CDN Segment TTL Expired in CDN Manifest TTL Remaining in CDN Manifest TTL Expired in CDN No Segment in CDN MPEG2TS Transcode / Package .ismv Client 1 Client 2HSS Profile 5 HSS Profile 1 HSS Profile 2 HSS Profile 3 HSS Profile 4 TNOW TTL remaining TTL Expired
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 57BRKSPV-2160 The Challenges with Distributing ABR Objects Behavior  Object Length (sec) Client Request (TPS) 2000 clients (TPS) Asset Requests (Objects/Hour) 200 channels (Objects / Hour) Smooth 2 0.5000 1,000 1800 360,000 HLS 10 0.1000 200 360 72,000 PDL 3600 0.0003 0.56 1 200 Bit Rate  3000 kbps 1500 kbps 500 kbps Smooth 0.75 0.38 0.13 HLS 3.8 1.9 0.6 PDL 1,350 675 225 Transaction Rates: Transactions Per Second for 1HR asset Cache Object Size (MB) Bit Rate  3000 kbps 1500 kbps 500 kbps Smooth 1 1 1 HLS 360 360 360 PDL 1 1 1 Origin File Count (One Hour Asset) High Transaction Rate File Object Count Small Object Write/Read Performance
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public HSS vs. HLS: Vastly Different Methods 58BRKSPV-2160 HSS (Microsoft) HLS (Apple) Transport Protocol HTTP HTTP Fragment Size (default) 2 seconds 10 seconds #TCP connections 2 1-2 # Content Files on Origin Server #profiles #profiles x 360/Hr. of content Codec Support VC-1, H.264, WMA H.264 Wire Format MP4 fragments MPEG2TS video segments, audio ID3, webVTT File Format on Origin Server .ismv, Fragmented mp4 .ts, Segmented TS Standard HTTP Origin Server No Yes Encryption/DRM PlayReady; AES-128 in Counter Mode AES-128 in Cipher Block Chaining Client Silverlight, OSMF (OpenSource) iPhone OS +, QuickTime X Client Manifest file .ismc (.ism/manifest or .isml/manifest) .m3u8 Origin server Helper integrated with IIS server HTTP server
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public HSS vs. DASH: DASH is a super-set of HSS 59BRKSPV-2160 HSS (Microsoft) DASH (MPEG DASH Guidelines v3) Transport Protocol HTTP HTTP Fragment Size (typical) 2 seconds 1-10 seconds #TCP connections 2 1 , 2 # Content Files on Origin Server #profiles #programs Codec Support VC-1, H.264, WMA H.264, H.265 Wire Format MP4 fragments MP4 fragments File Format on Origin Server .ismv, Fragmented mp4 ISO-BMFF Standard HTTP Origin Server No Yes Encryption/DRM PlayReady; AES-128 in Counter Mode Common Encryption, AES-128, CTR+ CBC Client Silverlight, OSMF (OpenSource) DASH Client Client Manifest file .ismc (.ism/manifest or .isml/manifest) .mpd (media presentation description) Origin server Helper integrated with IIS server Packager (MPD), Server (Segments)
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 60BRKSPV-2160 CDN Optimizations for ABR • Optimized TCP connection handling • Scaling to support the large # of connections for ABR • Optimized HTTP request handling • Scaling to support the large # of GET requests for ABR • Request Bundling • For live streaming, aggregates multiple cache-fill requests for the same content into a single request • Small Object Cache Throughput Optimizations • Small objects written to memory, delayed write to disk (SSD or HDD) • Large objects continue to be cached on disk • Client/Cache Stickiness (Content Affinity) • Service Visibility • Reporting and Analytics optimizations for ABR Aggregation of common requests into single request (e.g. manifest update) Origin Server Mid-Tier Cache Streamer
New Approaches Caching
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Mobility Overlay Storage Caching Overlay Integrated Network Fabric supporting mobility, security, and caching Security Overlay New Communication Model  Security – Implicit object security  Storage – Dynamic caching of objects in the forwarding fabric  Mobility – Eliminate mobility anchors Information Centric Networking Providing a New Foundation Integratetosinglelayer BRKSPV-2160 62
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKSPV-2160 Information Centric Networking A new paradigm in communications • Definitions: • NAMED-DATA • uniquely identified chunk of data, state, or results of a process • {e.g. sensor reading, calculation, or .. a media fragment} • PRODUCER • Produces named-data • CONSUMER • Creates “Interest” requests for named-data • FORWARDER • Forwards named-data object along ”Interest” path 63
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Properties of Hybrid ICN Named Data Connection-less Transport Pending State for Interest Requests Low latency networking Convergence of Unicast / Multicast Distribution Multi-Path Load-Balancing Anchorless Mobility Reactive In-network Caching & Recovery Stateless Connection In-Network Content-Awareness Multi-service Support Intrinsically Secure Dynamic Forwarding BRKSPV-2160 64
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public IP Content-networking Hybrid ICN ICN • Names into IPv6 addresses • L4-7 request routing based on names (e.g. with SR) • Connection-based sender-driven transport • Tunnel-based security • Anchor-based mobility • Application-layer (CDN) proactive caching • Names into IPv6 addresses • L3 Name-based routing and h2h dynamic forwarding • Partially symmetric routing • Connectionless receiver- driven multipath transport • Object-based security • Anchorless mobility • In-path reactive caching • Variable length routable names • L3 Name-based routing and h2h dynamic forwarding • Symmetric routing • Connectionless receiver- driven multipath transport • Object-based security • Anchorless mobility • In-path reactive caching BRKSPV-2160 65 Hybrid ICN is ICN
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public o Name-Space : IPv6 packets, no options o IP Transparent Interconnection with hICN enabled routers o ICN layer 3 - 4 features: anchorless mobility, unified unicast/multicast, in-path caching, security Hybrid ICN with IPv6 ICN IP router hICN Forwarder ICN hICN ProducerhICN Consumer ICN IP routerhICN Consumer ICNIP Packet IP routerIP router hICN IP Interest Origin MPEG-DASH | HLS HTTP GET hICN IP Interest 1 2 3 45 67 8 9 BRKSPV-2160 66
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 67BRKSPV-2160 Anatomy of a URL IPv4 ➤ IPv6 • Scale by 30 orders of magnitude • IPv6 object representations
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 68BRKSPV-2160 hICN Encoding of a Media Object IPv6: Service Prefix IPv6: Media Object
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public hICN: Network-Native Video Distribution See the Demonstration in DevNet Booth D27 Acquire/ Create hICN DistributionhICN Packaging Net-Native Direct (not redirect) IP Content routing ④ hICN Network Analytics become Content Aware⑤ Remote Production Studio & Post Production Content Push + Linear/Live “Channels” Video Streaming Content Pull Consumer Experience Contribution Content Preparation & Playout In-Network Caching from SP to Subscriber ③Named-Data Objects Ingested ②Named-Data Content Packaging ① IP IP IP IP IP IP BRKSPV-2160 69
Platform Optimization and Orchestration
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Platform Requirements • Three Dimensions of Analysis • Compute • Computation Complexity • Transactions Per Second • Storage • Volume of Data • Read / Write Capabilities of Storage • Bandwidth • Throughput • Packets Per Second 71BRKSPV-2160 Compute Storage Bandwidth • Live Streaming • VoD Origin • VoD Streaming • cDVR Origin • Encryption • Encapsulation • Live Origin • Encoding
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 72BRKSPV-2160 System Load Requirements: Linear Unicast Compute (CPU) Storage (TB) Bandwidth (Gbps)0 300 600 900 1200 1500 Compute (CPU) Storage (TB) Bandwidth (Gbps) Assumptions: Stream Demand:1500 Gbps Channels: 500 Size: 10Mbps per channel Caching: In-memory
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 73BRKSPV-2160 System Load Requirements: Video On Demand Compute (CPU) Storage (TB) Bandwidth (Gbps)0 300 600 900 1200 1500 Compute (CPU) Storage (TB) Bandwidth (Gbps) Assumptions: Stream Demand: 500 Gbps Titles: 200,000 Size: 3.2 GB per Title (avg 43min) Caching: 97% CHR
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 74BRKSPV-2160 System Load Requirements: Cloud DVR Compute (CPU) Storage (TB) Bandwidth (Gbps)0 300 600 900 1200 1500 Compute (CPU) Storage (TB) Bandwidth (Gbps) Assumptions: Stream Demand: 1320Gbps Titles: Unique Copy Size: 3.2 GB per Title (avg 43 min) Caching: 0% CHR
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 75BRKSPV-2160 System Load Requirements: Combined Services Compute (CPU) Storage (TB) Bandwidth (Gbps)0 500 1000 1500 2000 2500 Compute (CPU) Storage (TB) Bandwidth (Gbps) Data Center Services
Example: Cloud-Enabled Media Origination Services
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 77BRKSPV-2160 MOS Controller – High Level Modules Control Plane Data Plane Management functionality Service Manager, GUI Manager, Document Services Media Control Plane Application Instance Controller (AIC) Content Object Store Controller (COS AIC) Centralized Logging (ELK) Service Orchestration Service Instance Controller (SIC) Asset Workflow Manager(AWM) Media Data Plane MCE, MPE (MPE-C, MPE-TC) App Engines (State Cache HA-Proxy, IPVS)
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 78BRKSPV-2160 Unified Media Components Communication MCE MCE MCE MPE- TCMPE – C LB LB Key Mgmt Key Mgmt HA Proxy HA Proxy COS COS COS MPE MPE MPE Ingest OpenStack SWIFT Storage Redistribution Key Lookup Playback Request Redirect to MPE Playback Request (HLS, HSS, HDS) Playback Request (DASH) Playback Request (DASH) Playback Request (HLS, HSS, HDS) Playback Response (DASH) LinuxCisco 3rd Party
Key Points
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 80BRKSPV-2160 Key Takeaways: Caching • CDN Value Proposition • Efficient Distribution of Content (Audio, Media, Software) • Improved Performance / Scale • Resiliency Caching Sites Optimized Costs Cost • Content Caching Methods • Emphasis on Proxy Caching (Authorized) vs Transparent • Leveraging Two Referral Methods: DNS-based or HTTP Redirect • CDN Architectural Choices • Strategic Hierarchical Caching • Cost Optimization: Bandwidth Versus Storage Proxy Cache HTTP | DNS
Q & A
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public • Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 gift card. • Complete your session surveys through the Cisco Live mobile app or on www.CiscoLive.com/us. Complete Your Online Session Evaluation Don’t forget: Cisco Live sessions will be available for viewing on demand after the event at www.CiscoLive.com/Online.
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Continue Your Education • Demos in the Cisco campus • Walk-in Self-Paced Labs • Lunch & Learn • Meet the Engineer 1:1 meetings • Related sessions 83BRKSPV-2160
Thank you
Cisco Live! :: Content Delivery Networks (CDN)

More Related Content

PDF
RTI DDS Intro with DDS Secure
John Breitenbach
 
PPTX
Firewall in Network Security
lalithambiga kamaraj
 
PPTX
Redes de Computadores
Fábio Eliseu
 
PDF
Network Security Fundamentals
Rahmat Suhatman
 
PPT
Redes wireless
Carla Jesus
 
PPTX
Reseaux-sansfil.pptx
israchatta
 
PPTX
CCNA ppt Day 1
VISHNU N
 
PPTX
Understanding the Windows Server Administration Fundamentals (Part-2)
Tuan Yang
 
RTI DDS Intro with DDS Secure
John Breitenbach
 
Firewall in Network Security
lalithambiga kamaraj
 
Redes de Computadores
Fábio Eliseu
 
Network Security Fundamentals
Rahmat Suhatman
 
Redes wireless
Carla Jesus
 
Reseaux-sansfil.pptx
israchatta
 
CCNA ppt Day 1
VISHNU N
 
Understanding the Windows Server Administration Fundamentals (Part-2)
Tuan Yang
 

What's hot (20)

PDF
Network Monitoring System
Rofiq Fauzi
 
PPTX
Understanding the Windows Server Administration Fundamentals (Part-1)
Tuan Yang
 
PDF
Network Security-Module_1.pdf
Dr. Shivashankar
 
PPTX
TCP/IP Introduction
Dineesha Suraweera
 
PDF
Cisco Live Brksec 3032 - NGFW Clustering
ib_cims
 
PPT
Log Analysis
n|u - The Open Security Community
 
PPT
Network cable
Online
 
PDF
TechWiseTV Workshop: Software-Defined Access
Robb Boyd
 
PPTX
SCSI(small computer system interface)
Niraj Lamichhane
 
PDF
Understanding Cisco’ Next Generation SD-WAN Technology
Cisco Canada
 
PPTX
Operation of Ping - (Computer Networking)
Jubayer Al Mahmud
 
PPTX
Datacenter overview
Heather Brotherton
 
PPTX
Networking Standards And Protocols
Steven Cahill
 
PPT
03 backup-and-recovery
hunny garg
 
PPTX
Wireshark Basic Presentation
MD. SHORIFUL ISLAM
 
PPTX
Smtp, pop3, imapv 4
Shwetanshu Gupta
 
PPTX
Windows server
Hideo Amezawa
 
PPTX
Sistemas operacionais de redes particionamento de discos ii
Carlos Melo
 
PPTX
VPN Virtual Private Network
Rama Krishna Nakka
 
PPT
CCNA presentation.
Ajaigururaj R
 
Network Monitoring System
Rofiq Fauzi
 
Understanding the Windows Server Administration Fundamentals (Part-1)
Tuan Yang
 
Network Security-Module_1.pdf
Dr. Shivashankar
 
TCP/IP Introduction
Dineesha Suraweera
 
Cisco Live Brksec 3032 - NGFW Clustering
ib_cims
 
Log Analysis
n|u - The Open Security Community
 
Network cable
Online
 
TechWiseTV Workshop: Software-Defined Access
Robb Boyd
 
SCSI(small computer system interface)
Niraj Lamichhane
 
Understanding Cisco’ Next Generation SD-WAN Technology
Cisco Canada
 
Operation of Ping - (Computer Networking)
Jubayer Al Mahmud
 
Datacenter overview
Heather Brotherton
 
Networking Standards And Protocols
Steven Cahill
 
03 backup-and-recovery
hunny garg
 
Wireshark Basic Presentation
MD. SHORIFUL ISLAM
 
Smtp, pop3, imapv 4
Shwetanshu Gupta
 
Windows server
Hideo Amezawa
 
Sistemas operacionais de redes particionamento de discos ii
Carlos Melo
 
VPN Virtual Private Network
Rama Krishna Nakka
 
CCNA presentation.
Ajaigururaj R
 
Ad

Similar to Cisco Live! :: Content Delivery Networks (CDN) (20)

PDF
Oracle E-Business Suite On Oracle Cloud
pasalapudi
 
PDF
enterprise_campus_qos_0 (1234567890).pdf
AntonioIsipJr1
 
PPTX
Cisco's Open Device Programmability Strategy: Open Discussion
Cisco DevNet
 
PDF
Building DataCenter networks with VXLAN BGP-EVPN
Cisco Canada
 
PDF
Cisco Software Defined Access - новая архитектура для корпоративных кампусных...
Cisco Russia
 
PDF
PLNOG 9: Marcin Strzyżewski, Marcin Wawrzyński - Videoscape Distribution Suite
PROIDEA
 
PDF
RPKI Tutorial
Bangladesh Network Operators Group
 
PPTX
Tale of a New Bangladeshi NIX
Bangladesh Network Operators Group
 
PPTX
Applying Hyper-scale Design Patterns to Routing
Hannes Gredler
 
PDF
Cisco Connect Toronto 2017 - Model-driven Telemetry
Cisco Canada
 
PDF
Introduction to Hybrid Information-Centric Networking
Luca Muscariello
 
PDF
[非公開]Oracle Cloud Infrastructure Classic ネットワーク機能詳細
オラクルエンジニア通信
 
PPTX
Using PerfDHCP tool to scale DHCP in OpenStack Neutron
Vikram G Hosakote
 
PPTX
Mcas log collector deck
Matt Soseman
 
PDF
Introducing XRd Lightweight, Programmable and Containerized
happyagan
 
PDF
Next-gen Network Telemetry is Within Your Packets: In-band OAM
Open Networking Summit
 
PDF
Gain Insight and Programmability with Cisco DC Networking
Cisco Canada
 
PDF
Gain Insight and Programmability with Cisco DC Networking
Cisco Canada
 
PDF
Cisco DC Networking: Gain Insight and Programmability with
Cisco Canada
 
PDF
BRKSEC-3771 - WSA with wccp.pdf
MenakaDevi14
 
Oracle E-Business Suite On Oracle Cloud
pasalapudi
 
enterprise_campus_qos_0 (1234567890).pdf
AntonioIsipJr1
 
Cisco's Open Device Programmability Strategy: Open Discussion
Cisco DevNet
 
Building DataCenter networks with VXLAN BGP-EVPN
Cisco Canada
 
Cisco Software Defined Access - новая архитектура для корпоративных кампусных...
Cisco Russia
 
PLNOG 9: Marcin Strzyżewski, Marcin Wawrzyński - Videoscape Distribution Suite
PROIDEA
 
RPKI Tutorial
Bangladesh Network Operators Group
 
Tale of a New Bangladeshi NIX
Bangladesh Network Operators Group
 
Applying Hyper-scale Design Patterns to Routing
Hannes Gredler
 
Cisco Connect Toronto 2017 - Model-driven Telemetry
Cisco Canada
 
Introduction to Hybrid Information-Centric Networking
Luca Muscariello
 
[非公開]Oracle Cloud Infrastructure Classic ネットワーク機能詳細
オラクルエンジニア通信
 
Using PerfDHCP tool to scale DHCP in OpenStack Neutron
Vikram G Hosakote
 
Mcas log collector deck
Matt Soseman
 
Introducing XRd Lightweight, Programmable and Containerized
happyagan
 
Next-gen Network Telemetry is Within Your Packets: In-band OAM
Open Networking Summit
 
Gain Insight and Programmability with Cisco DC Networking
Cisco Canada
 
Gain Insight and Programmability with Cisco DC Networking
Cisco Canada
 
Cisco DC Networking: Gain Insight and Programmability with
Cisco Canada
 
BRKSEC-3771 - WSA with wccp.pdf
MenakaDevi14
 
Ad

More from Bruno Teixeira (12)

PDF
RIPE Database Expert Certificate
Bruno Teixeira
 
PDF
Introduction to SDN and Network Programmability - BRKRST-1014 | 2017/Las Vegas
Bruno Teixeira
 
PDF
Software Defined Network (SDN) using ASR9000 :: BRKSPG-2722 | San Diego 2015
Bruno Teixeira
 
PDF
Passive Optical Networks - PON: Customer Case Study, Design, Implementation a...
Bruno Teixeira
 
PDF
DWDM 101 - BRKOPT-2016
Bruno Teixeira
 
PDF
Cisco Live! :: Deploying SIP Trunks with Cisco Unified Border Element (CUBE/v...
Bruno Teixeira
 
PDF
Cisco Live! :: Introduction to Segment Routing :: BRKRST-2124 | Las Vegas 2017
Bruno Teixeira
 
PDF
Cisco Live! :: Introduction to IOS XR for Enterprises and Service Providers
Bruno Teixeira
 
PDF
Cisco Live! :: Cisco ASR 9000 Architecture :: BRKARC-2003 | Las Vegas 2017
Bruno Teixeira
 
PDF
Cisco Live! :: Cisco ASR 9000 Architecture :: BRKARC-2003 | Milan Jan/2014
Bruno Teixeira
 
PDF
Cisco Live! :: Carrier Ethernet 2.0 :: BRKSPG-2720 | Las Vegas July/2016
Bruno Teixeira
 
PDF
Cisco Live! :: Carrier Ethernet 2.0 :: BRKSPG-2720 | Las Vegas July/2016
Bruno Teixeira
 
RIPE Database Expert Certificate
Bruno Teixeira
 
Introduction to SDN and Network Programmability - BRKRST-1014 | 2017/Las Vegas
Bruno Teixeira
 
Software Defined Network (SDN) using ASR9000 :: BRKSPG-2722 | San Diego 2015
Bruno Teixeira
 
Passive Optical Networks - PON: Customer Case Study, Design, Implementation a...
Bruno Teixeira
 
DWDM 101 - BRKOPT-2016
Bruno Teixeira
 
Cisco Live! :: Deploying SIP Trunks with Cisco Unified Border Element (CUBE/v...
Bruno Teixeira
 
Cisco Live! :: Introduction to Segment Routing :: BRKRST-2124 | Las Vegas 2017
Bruno Teixeira
 
Cisco Live! :: Introduction to IOS XR for Enterprises and Service Providers
Bruno Teixeira
 
Cisco Live! :: Cisco ASR 9000 Architecture :: BRKARC-2003 | Las Vegas 2017
Bruno Teixeira
 
Cisco Live! :: Cisco ASR 9000 Architecture :: BRKARC-2003 | Milan Jan/2014
Bruno Teixeira
 
Cisco Live! :: Carrier Ethernet 2.0 :: BRKSPG-2720 | Las Vegas July/2016
Bruno Teixeira
 
Cisco Live! :: Carrier Ethernet 2.0 :: BRKSPG-2720 | Las Vegas July/2016
Bruno Teixeira
 

Recently uploaded (20)

PPT
250152213-Excitation-SystemWERRT (1).ppt
woldemariamworku2
 
PDF
Alethe Consulting Corporate Profile and Solution Aproach
debashisrakshit2025
 
PDF
si manuel quezon at mga nagawa sa bansang pilipinas
LizaDeVeraFloresLaya
 
PPT
415456121-Jiwratrwecdtwfdsfwgdwedvwe dbwsdjsadca-EVN.ppt
woldemariamworku2
 
PPTX
newyork.pptxirantrafgshenepalchinachinane
PrashantKoirala12
 
PPTX
module 1-Part 1.pptxdddddddddddddddddddddddddddddddddddd
KevinSeelu
 
PPTX
Layers_of_the_Earth_Grade7.pptx class by
varadhanvara05
 
PDF
Exploring VPS Hosting Trends for SMBs in 2025
Liquid Web
 
PPTX
E -tech empowerment technologies PowerPoint
kylebalatero12
 
PPTX
Reading as a good Form of Recreation
Raj Kumble
 
PPT
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
MelwinPaul6
 
PPTX
artificialintelligenceai1-copy-210604123353.pptx
b45r14
 
PPT
isotopes_sddsadsaadasdasdasdasdsa1213.ppt
Kenneth James Alamillo
 
PDF
Understand the Gitlab_presentation_task.pdf
ruhinisiyara
 
PDF
Alethe Consulting Corporate Profile and Solution Aproach
debashisrakshit2025
 
PPTX
Cyber Hygine IN organizations in MSME or
paramkiet
 
PDF
The Evolution of Traditional to New Media .pdf
NIKKODENSMIRO
 
PPTX
IPCNA VIRTUAL CLASSES INTERMEDIATE 6 PROJECT.pptx
AldoCharaRojas
 
PPTX
1402_iCSC_-_RESTful_Web_APIs_--_Josef_Hammer.pptx
mwnorman1
 
PPTX
Database Information System - Management Information System
faizhossain3
 
250152213-Excitation-SystemWERRT (1).ppt
woldemariamworku2
 
Alethe Consulting Corporate Profile and Solution Aproach
debashisrakshit2025
 
si manuel quezon at mga nagawa sa bansang pilipinas
LizaDeVeraFloresLaya
 
415456121-Jiwratrwecdtwfdsfwgdwedvwe dbwsdjsadca-EVN.ppt
woldemariamworku2
 
newyork.pptxirantrafgshenepalchinachinane
PrashantKoirala12
 
module 1-Part 1.pptxdddddddddddddddddddddddddddddddddddd
KevinSeelu
 
Layers_of_the_Earth_Grade7.pptx class by
varadhanvara05
 
Exploring VPS Hosting Trends for SMBs in 2025
Liquid Web
 
E -tech empowerment technologies PowerPoint
kylebalatero12
 
Reading as a good Form of Recreation
Raj Kumble
 
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
MelwinPaul6
 
artificialintelligenceai1-copy-210604123353.pptx
b45r14
 
isotopes_sddsadsaadasdasdasdasdsa1213.ppt
Kenneth James Alamillo
 
Understand the Gitlab_presentation_task.pdf
ruhinisiyara
 
Alethe Consulting Corporate Profile and Solution Aproach
debashisrakshit2025
 
Cyber Hygine IN organizations in MSME or
paramkiet
 
The Evolution of Traditional to New Media .pdf
NIKKODENSMIRO
 
IPCNA VIRTUAL CLASSES INTERMEDIATE 6 PROJECT.pptx
AldoCharaRojas
 
1402_iCSC_-_RESTful_Web_APIs_--_Josef_Hammer.pptx
mwnorman1
 
Database Information System - Management Information System
faizhossain3
 

Cisco Live! :: Content Delivery Networks (CDN)

  • 2. Content Delivery Networks (CDN): Caching Principles, Architecture, and Resource Optimization Scott Wainner, Distinguished Systems Engineer BRKSPV-2160
  • 3. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Cisco Spark Questions? Use Cisco Spark to chat with the speaker after the session 1. Find this session in the Cisco Live Mobile App 2. Click “Join the Discussion” 3. Install Spark or go directly to the space 4. Enter messages/questions in the space How cs.co/ciscolivebot#BRKSPV-2160Cisco Spark spaces will be available until July 3, 2017.
  • 4. Objectives • Understand Principles of Caching • Understand System Architecture and Role of CDN • Distinguish Impact of Service Delivery Models • Assess Characteristics of Resource Optimization
  • 5. AGENDA • Caching Principles • Caching Value Proposition Models • Content Delivery Functions • Content Delivery of Media Services • Platform Optimization and Management • Enabling Cloud Content Delivery
  • 7. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 7BRKSPV-2160 Relevance • Commercial Video • Imagery • Production Training / Education Systems • Marketing / Mass Communication Systems • Notification Information Distribution • Telemetry Distribution to Subscribers • Software Distribution Many Media Types and Purposes
  • 8. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 8BRKSPV-2160 Content Distribution Principles PerformanceEfficiency Resiliency
  • 9. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 9BRKSPV-2160 Content Distribution Architectural Models • Hierarchical • Distribution Tree from Origin • Often associated with an Authoritative Source • Tightly controlled distribution policies • Peer to peer • Distributed Hash Table model • Content can be cached anywhere • Appropriate in fully meshed topologies • Multiple sources C C C C C C C C C
  • 10. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 10BRKSPV-2160 System Architecture Content Management Origin Servers Live EPG Clients Offer Management Personalization Billing Offers Subscriptions Content Distribution Live Origin ServersLive On Demand VOD Origin Servers Storage Mid-Tier Cache CacheCache Our Focus Today Authentication And Navigation Asset Management Live Media VOD Media Product Bundles Workflows Catalog Creation Entitlement Policy Digital Rights Metadata Video Control Session Management Policy Management Edge Cache Entitlement & Session ControlPolicy Catalog Content Delivery Content Acquisition Transcoding Streams Video VoD IMDb Video Control Plane Data Plane Authorization & Assignment Credentials Image Tags Images Software Live ABR traffic VOD ABR traffic
  • 11. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Entertainment Services Content Library (Origin) Traffic Servers Traffic Servers Off-Net Traffic Routing Internet Content Programming Published Content Centralized Content, Command and Control, and Analytics Hierarchy of Origination, Mid-Tier and Edge Caching Management Plane, Content Routing Plane, Content Delivery Plane Resiliency Defined at each Tier Cost Optimized Platform Selection Entertainment Services On-Net Ingest, Routing, & Management (Optional) Caching Layer Optimized Edge Cache Traffic Ops 11BRKSPV-2160 CDN Systems Architecture
  • 13. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 13BRKSPV-2160 CDN - Introduction to Dynamic Caching • Concepts • CDN is a “Proxy” for Origin Servers • Redirecting clients to CDN • CDN Functional Cache Elements • “Traffic Routing” Redirection • “Origin Server” Library • “Traffic Server” Caching • “Traffic Server” Edge Cache Content Delivery Network Streams Ingest Cache-Fill Origin Servers Mid-Tier Cache Edge Cache Content Library Cache Storage Cache Storage Traffic Routing Location Requests Content Requests Content Requests Content Requests Location Redirects
  • 14. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 14BRKSPV-2160 CDN – Implementation Considerations • Storage Considerations • Live Media (Finite Window) • VoD Media (Natural Expiration) • Cloud DVR (No Caching) • Content Affinity • Localization • Mobile • Pre-positioned • Mapping Methodology • File Handle in URL • Byte Offset in URL • Retention / Eviction Algorithms • Least Recently Used • First In / First Out • Metadata (Algorithmic Expiration) Input Main memory Solid state disk Spinning disk Caching Characterization Cache-Fill or Edge Cache Cache-Fill or Ingest Output
  • 15. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public HTTP Caching • RFC2616 HTTP/1.1 • RFC 6585 Status Codes • RFC 2817 TLS • RFC 5785 Well-Known URI • RFC 6266 Content-Disposition • Cache Types • Transparent Caches • Proxy Caches 15BRKSPV-2160 Transparent Cache Internet Transparent Caching x  x get (file@fqdn-a.com) get (file@fqdn-a.com) Origin Server Intercept
  • 16. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Transparent Caching • Unauthorized Intercept • Non Monetized • Dynamic Interpretation of Request • HTTP GET Analysis • Authentication or Encryption Interference • Authentication • Token or HASH Validation Corrupted • Payload Encryption • (e.g. Media Headers, Opaque Objects) • Transport Encryption • (e.g. TLS, SPDR) 16BRKSPV-2160 Transparent Cache Internet Catalog DNS Origin Server Item (x, Location (fqdn-y)) Location (fqdn-y.com) Item: x Location (fqdn-y) x  x get (x@fqdn-y.com) 1 2 3 4 6 Intercept 5 STOP7 9 GET (x@fqdn-y.com) STOP8
  • 17. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public HTTP Caching • RFC2616 HTTP/1.1 • RFC 6585 Status Codes • RFC 2817 TLS • RFC 5785 Well-Known URI • RFC 6266 Content-Disposition • Cache Types • Transparent Caches • Proxy Caches 17BRKSPV-2160 Proxy Caching Proxy Cache get (file@fqdn-a.com) get (file@fqdn-b.com) z  y Origin Server Rewrite
  • 18. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Proxy Caching • Authorized Delegation • Explicit Interpretation Provided to Cache • Optimized Payload is Known a priori • Authentication or Encryption Viable • Authenticators Validated and Recalculated • Tokens, HASH • Private Keys Shared • Payload Remains Encrypted • Substitution of Opaque Payload • Transport Encryption • Public Certificates Exchanged 18BRKSPV-2160 Origin Server Catalog DNS Item (z@fqdn-a.com) Item (z@fqdn-b.com) FQDN (fqdn-a) Location: (fqdn-a.com fqdn-b.com) get (z@fqdn-a.com) get (z@fqdn-b.com) 1 2 3 4 5 6 Proxy Cache fqdn-a  fqdn-b
  • 19. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 19BRKSPV-2160 CDN Caching Basics • Authorized Delegation • Explicit Interpretation Provided to Cache • Authentication or Encryption Viable • Redirection to Optimal Location • Cache Hit Ratio • Distributed Edge • Edge Cache • Intermediate Layer • Reverse Proxy Cache Item (file@cdn.com) Origin Server CDN Traffic Server (Caching) Catalog DNS Traffic Server (Cache) Item (file@media.com) cdn.com Asset Mapping ( file@cdn.com file@media.com) get (file@se.cdn.com) get (file@media.com) get (file@media.com) GET (file@cdn.com) Redirect (file@se.cdn.com) 1 2 3 4 6 7 5 Traffic Router 8 9
  • 21. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 21BRKSPV-2160 Content Caching Principles Content Popularity Cost Inflection Point Caching Sites Bandwidth Costs Cache Costs Optimized Costs Cost Cache Hit Rates
  • 22. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 22BRKSPV-2160 Content Popularity Content Popularity Often Characterized by Zipf’s Law Library Described by Alpha (α) Cache Each Library is Unique • Old Movies • Current Hits • Music Videos • Sports Highlights • TV Series Views Titles ranked by Demand Top 100 Bottom 100
  • 23. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 23BRKSPV-2160 Contributing Factors • CHR of Content Types • ABR more difficult to predict than for PDL • Cache Fill Traffic • Temporary content renewal • Triggered by revalidation • First Fill Request • Eviction • Popularity Profile • Least Recently Used • Topology Considerations • Hierarchical Caching gains • Geographical Content Affinity Different Nodal Cache Hit Rates !!!
  • 24. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public • Probability of a Cache Hit PCHR • Probability of a Nodal Cache Miss PCM = 1- PCHR (b) Cache 13 8/13 = 61.6% 24BRKSPV-2160 Nodal Cache Hit Rates Cache Origin 2 5 Content Requests 3/5 = 60% 2/2 = 100% (a) • Node A Cache Miss PCHRa = 3/5 = 0.60 or 60% PCMa = 1 – 0.60 = 0. 4 • Node B Cache Miss PCHRb = 8/13 = 0.616 or 61.6% PCMb= 1 – 0.616 = 0.384 Very Popular Content New Content / Unpopular Content Some Popular Content
  • 25. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public • Probability of System Cache Miss PSCM = PCMa * PCMb (b) Cache 13 8/13 = 62% 25BRKSPV-2160 System Cache Hit Rates Cache Origin 2 5 Content Requests 3/5 = 60% 2/2 = 100% (a) • System Cache Miss Example PCHRa = 3/5 = 0.60 or 60% PCMa = 1 – 0.60 = 0. 4 PCHRb = 8/13 = 0.616 or 61.6% PCMb= 1 – 0.616 = 0.384 PSCM = 0.4 * 0.384 = 0.154 = 15.4% • System Cache Hit Rate = 1- 15.4% = 84.6%
  • 26. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 26BRKSPV-2160 Caching Cost : Bandwidth Cost Bandwidth Costs Demand Contributions / Cache-fill Source Data Center Network Core Network Edge Access Network Home Network
  • 27. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 27BRKSPV-2160 Caching Cost : Cache Storage Cost Source Data Center Network Core Network Edge Access Network Storage Home Network
  • 28. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 28BRKSPV-2160 Caching Cost Inflection Point: Optimized Costs Cost Source Data Center Network Core Network Edge Access Network Optimal Costs !!! Latency? Jitter? Congestion? Throughput? DemandContributions / Cache-fill Home Network Optimal Performance??? Storage + Bandwidth = Total Cost
  • 29. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 29BRKSPV-2160 Caching Architecture Distribute ‘Enough’ Cache Storage at the ‘Right’ Locations Contributions Content Producer Data Center Origination sync Distribution Cache-Tier CDN Data Center CDN Data Center Co-Lo Cage cache-fill Enterprise Cache circuit circuit internet circuit peer ISP Co-Lo cache-fill Edge Cache Edge CacheWAN VPN internet Edge-Stream sources sources
  • 31. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Time <- 2011 2012 2013 2014 *Road Mapped 31BRKSPV-2160 Cisco CDN Architecture Evolution 2015 2016 2017 2018 ➤ Encoders ➤ OMD Cache-Nodes ➤ vDCM ➤ cDVR MOS ➤ Infinite Video ➤ Cloud Native
  • 32. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Hypervisor HypervisorHypervisor Traffic Vault Unified Compute System 32BRKSPV-2160 Elastic Platform Traffic Router OMD Analytics Traffic Operations Traffic Router Traffic Server Origin Server Traffic Monitor Traffic Server Unified Compute System Unified Compute System Traffic Sever Influx DB OpenStack – Compute, Storage, and Network Orchestration Traffic Stats Network Infrastructure Video Services Workflow Orchestration
  • 33. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 33BRKSPV-2160 CDN Functional Architecture Server Function Summary Traffic Server HTTP/S proxy-cache based on open source Traffic Router Cache Selection, redirects clients to best cache Traffic Ops Configure and Monitor Traffic Server Caches Traffic Vault Protects keys and certificates Traffic Monitor Monitors cache health and load Traffic Stats Aggregates and visualizes real-time and historical performance data Influx DB Time series database to retain all Traffic Server statistics OMD Analytics Splunk based CDN Insights with 300+ Dashboards MaxMind Geo Database Open Media Distribution Edge-Tier Mid-Tier DNS Traffic Router Traffic- Monitor Traffic- Stats Traffic OPS Traffic Vault Influx DB Traffic Server Traffic Server Origin Server Client DNS Resolver OMD Insights
  • 34. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Router • Delivery Service Properties • Localization using Coverage Zone Map (CZM) • DNS Content Routing • Authoritative DNS for Origin • List of Edge Cache IP • HTTP Content Routing • DNS Resolves to Self • HTTP Redirect 34BRKSPV-2160 Edge-Tier Traffic Router Traffic Server Client Edge-Tier Traffic Server
  • 35. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Server • Reverse Proxies • URL Re-mapping Logic to Specific Sources (Mid-Tier Cache or Origin) • Cache Groups • Mid-Tier Cluster (single geographical coordinate) • Edge Cluster (single geographical coordinate) • HTTP Content Routing • DNS Resolves to Self • HTTP Proxy 35BRKSPV-2160 Traffic Server Traffic Server Origin Server Client Edge-Tier Mid-Tier
  • 36. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Delivery Service • Cache in RAM, cache on disk, or do not cache at all • Use DNS or HTTP Content routing • Limits on transactions per second and bandwidth • Protocol (http or https) • Token based authentication settings • Header rewrite rules 36BRKSPV-2160
  • 37. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Monitor • Throughput (e.g. bytes in, bytes out, etc). • Transactions (e.g. number of 2xx, 3xx, 4xx responses, etc). • Connections (e.g. from clients, to parents, origins, etc). • Cache performance (e.g.: hits, misses, refreshes, etc). • Storage performance (e.g.: writes, reads, frags, directories, etc). • System performance (e.g: load average, network throughput, etc). 37BRKSPV-2160
  • 38. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Stats • Cache Stats • Bandwidth, Max Kbps, Client Connections • Delivery Service Stats • Service rates Kbps, Status (4xx/5xx), TPS (2xx, 3xx, 4xx, 5xx, total) • By Cache-Group, CDN, Delivery Service • Daily Stats • Max Bandwidth, Bytes Served, by CDN 38BRKSPV-2160
  • 39. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Traffic Vault • SSL Certificates • Private Key, Certificate (CRT), Certificate Signing Request (CSR) • DNSSec Keys • Key Signing Key (private key, public key) • Zone Signing Key (private key, public key) • URL Signing Keys • Query Strings • Tokens 39BRKSPV-2160
  • 41. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Origin Servers and the CDN • Content Management System (CMS) • Combine Content + Publishing Metadata • Origin Servers (OS) • Organized Media on Storage • Authorize Mid-Tier Cache • Package Content 41BRKSPV-2160 Origin Server Caching Traffic Servers OMD Traffic Router 1. POST CDN DELIVERY SERVICE 3. Request 2. CONFIG 6. GET Content 7. OK (media) CMS 1. POST OMD Traffic Ops 4. Location 5. Request 8. Ok (Media)
  • 42. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 42BRKSPV-2160 Origin Server • Ingest must be flexible, resilient and secure • CDN can ingest from multiple Origin Servers • Local or Remote locations • Origins can be replicated • Locally (load balancing) • Remotely (disaster recovery) • Origins can have structure • Security • Capture/Recording/Playout separation for better scalability Content Mid-Tier Cache Ad Objects Origin Server Web Objects Origin Server Media Objects DELIVERY SERVICE (Web Objects) DELIVERY SERVICE (Media) DELIVERY SERVICE (Ads) Origin Servers Capture Play
  • 43. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 43BRKSPV-2160 Delivery Service Content Routing • Request Redirection model • Traffic Router is the Authoritative DNS for “Delivery Service” FQDN • HTTP-based 30x redirection • Traffic Router resolves domain name to its own IP address • Traffic Router then uses 302/307 redirection to an Edge Cache • DNS-based redirection • Traffic Router resolves domain to IP address of Edge Cache • Traffic Router Criteria • Based on Client IP Address CDN Origin Server Policy Services: • Geo-Location • Network Proximity • Policy • Quota DNS Request Redirection Traffic Routing (HTTP, DNS) Traffic Server (Edge Cache) Traffic Server (Mid-tier Cache)
  • 44. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Net Z 44BRKSPV-2160 Traffic Server Assignment • Assessing Location (Latency) • Per Delivery Service • Per Location • Assessing Status (Availability) • Analytics from Edge Caches • Resources Available • Assessing Content Affinity (Performance) • Assign Request to Previously Assigned Edge Cache • Assessing Content Controls • Quotas • Thresholds S1 IP S2 IP Traffic Monitor S3 IP Net X S1 Status S3 Status S2 Status Client Request Net Y Traffic Router Status
  • 45. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Net Z 45BRKSPV-2160 Static Location-based Routing • Separate Content Routing Plane • Implemented at Traffic Router • Reference Location Information (MaxMind) • Traffic Server’s inform Traffic Monitor about status and load using keep-alive messages • Server Redundancy • Variety of Traffic Server Selection criteria available • Load • Content • Service availability S1 IP S2 IP Traffic Router CIP1S3 IP CIP LOC CIP1 == net Y CIP2 == net Z CIP2 Net X Net Y NODE LOC S1 IP == net X S2 IP == net Y S3 IP == net Z Lookup MaxMind DB Coverage Zone Load
  • 46. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 46BRKSPV-2160 Content Delivery • Content Affinity Traffic Routing • Hash Calculated on URL (HTTP Only) • Common URL requests have affinity to same Traffic Server • Traffic Server Selection • Hash Calculated on Origin URL • Common Cache-fill requests have affinity to same Traffic Server • Origin Selection • Same as above CA 1 S2 IP S3b IP Client CA 2 S3a IP OS 1 OS 2 Client Client Client
  • 47. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 47BRKSPV-2160 Content Delivery Optimization • Origin Server Sizing depends on CDN Cache Hit Rate (CHR) efficiency • Define CDN topology and apply Hierarchical Caching to achieve efficiency goal • Example • CDN Efficiency goal: 90% • Two-tier CDN (edge + mid-tier-cache) • Edge CHR (eCHR): 80% • Mid-tier Cache CHR (mCHR): 50% • Efficiency = • 1 – (1 – eCHR)*(1 – mCHR) = System CHR • 1 – (1 – 0.80)*(1 – 0.50) = 90% CA 1 S2 IP Client S3a IP OS 1 OS 2 Client Client Edge Cache Hit Rate Mid-Tier Cache Hit Rate
  • 48. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 48BRKSPV-2160 Edge Throughput: Peak Busy Hour (PBH) NAS OS 20 Gbps 10 Gbps 30 Gbps 15 Gbps 0.5 Gbps 0.5 Gbps 4 Gbps 2 Gbps Live Load VoD Load Criteria 50 live channels; all profiles Bitrate per Channel = 10 Mbps Site Demand 30 Gbps Edge Live Cache-Fill 50 live * 10 Mbps/live = 0.5 Gbps Criteria Site Demand 20 Gbps Edge PoP CHR = 80% Edge VoD Cache-fill Load * (1- CHR) 20 Gbps * (0.2) = 4 Gbps Criteria Site Demand 10 Gbps Edge PoP CHR = 80% Edge VoD Cache-fill Load * (1- CHR) 10 Gbps * (0.2) = 2 Gbps VoD Load Live Load Criteria 50 live channels; all profiles Bitrate per Channel = 10 Mbps Site Demand 15 Gbps Edge Live Cache-Fill 50 live * 10 Mbps/live = 0.5 Gbps
  • 49. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 20 Gbps 10 Gbps 30 Gbps 15 Gbps 0.5 Gbps 0.5 Gbps 4 Gbps 2 Gbps 49BRKSPV-2160 Origination Throughput: Peak Busy Hour (PBH) NAS OS Live VoD Criteria 50 live channels Bitrate per Channel = 10 Mbps Edge Live Cache-Fill 50 live * 10 Mbps/live = 0.5 Gbps Criteria Cache Demand 2+4 = 6 Gbps Cache CHR = 50% Edge VoD Cache-fill Load * (1- CHR) 6 Gbps * (0.5) = 3 Gbps 0.5 Gbps3 Gbps
  • 51. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 51BRKSPV-2160 Common Adaptive Bit Rate (ABR) Methods • Apple • HTTP Live Streaming (HLS) • Segmented H.264 (MPEG2TS) • Manifest (.m3u8) • Microsoft • HTTP Smooth Streaming (HSS) • Fragmented H.264 (MP4) • Server Manifest, Client Manifest (.ims, .imsc ) • MPEG-DASH • Dynamic Adaptive Streaming over HTTP (DASH) • Fragmented H.264 (ISO-BMFF) • Media Presentation Description (.mpd)
  • 52. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 52BRKSPV-2160 The Challenges with Distributing ABR Objects  Short fragment / segment sizes  High HTTP Request Rate  URL’s can be Absolute or Relative  DNS Resolutions  TCP connections should not be short-lived (client code)  Pipeline HTTP Requests  CDS object handling configured on a per Delivery Service basis Progressive Download ABR Delivery Movie.mp4 Frag1-1 Frag1-2 Frag2-1 . 2hr movie, 2 sec segments . 3600 fragments x 7 profiles . 25,000 objects/movie Frag1-3 Frag1-4 Frag2-2 Frag2-3 Frag2-4 Frag3-1 Frag3-2 Frag3-3 Frag3-4 Frag4-1 Frag4-2 Frag4-3 Frag4-4 Time Start + 2 sec + 4 sec + 6 sec 512 kbps 768 kbps 1.0 mbps 1.5 mbps GET GET GET GET
  • 53. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Live / Linear TV: HLS • Caching the Sliding Window • Time-to-Live (TTL) access to Manifest / Profiles (10s) • Time-to-Live access to Segments (30s) 53BRKSPV-2160 MPEG2TS Transcode / Package TNOW T-10T-20 T+10 T+20 T+30 T+40 T+50 SOURCE Client 1 Client 2 Segment TTL Remaining in CDN Segment TTL Expired in CDN Manifest TTL Remaining in CDN Manifest TTL Expired in CDN No Segment in CDN HLS Profile 5 HLS Profile 1 HLS Profile 2 HLS Profile 3 HLS Profile 4
  • 54. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Live / Linear TV: DASH and HSS • Caching the Time-shift Window • Time-to-Live (TTL) access to .imsc Manifest (2s) • Repackaged .mpd (1-10sec) 54BRKSPV-2160 MPEG2TS Transcode / Package T-2T-4 T+2 T+4 T+6 T+8 T+10 SOURCE Segment TTL Remaining in CDN Segment TTL Expired in CDN Current Manifest Available Manifest TTL Expired in CDN .imsc, .mpd No Segment in CDN TNOW Client 1 Client 2HSS Profile 5 HSS Profile 1 HSS Profile 2 HSS Profile 3 HSS Profile 4 TTL remaining TTL Expired
  • 55. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public VoD: HLS • Complete Mapping of Manifest to Segments • Time-to-Live of Manifest / Profiles (as specified) • Time-to-Live access to Segments (as specified) 55BRKSPV-2160 MPEG2TS Transcode / Package T+10 T+20 T+30 T+40 T+50 manifest.m3u8segment.ts Segment TTL Remaining in CDN Segment TTL Expired in CDN Manifest TTL Remaining in CDN Manifest TTL Expired in CDN No Segment in CDN TNOW Complete Manifest Cached until TTL Expired Client 1 Client 2HLS Profile 5 HLS Profile 1 HLS Profile 2 HLS Profile 3 HLS Profile 4
  • 56. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public VoD: HSS and DASH • Caching the ‘DVR Duration’ Window • Time-to-Live (TTL) access to .imsc Manifest (2s) • Time-to-Live access to Fragments (6s – IIS default 2hr) 56BRKSPV-2160 T+2 T+4 T+6 T+8 T+10 .imsc Segment TTL Remaining in CDN Segment TTL Expired in CDN Manifest TTL Remaining in CDN Manifest TTL Expired in CDN No Segment in CDN MPEG2TS Transcode / Package .ismv Client 1 Client 2HSS Profile 5 HSS Profile 1 HSS Profile 2 HSS Profile 3 HSS Profile 4 TNOW TTL remaining TTL Expired
  • 57. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 57BRKSPV-2160 The Challenges with Distributing ABR Objects Behavior  Object Length (sec) Client Request (TPS) 2000 clients (TPS) Asset Requests (Objects/Hour) 200 channels (Objects / Hour) Smooth 2 0.5000 1,000 1800 360,000 HLS 10 0.1000 200 360 72,000 PDL 3600 0.0003 0.56 1 200 Bit Rate  3000 kbps 1500 kbps 500 kbps Smooth 0.75 0.38 0.13 HLS 3.8 1.9 0.6 PDL 1,350 675 225 Transaction Rates: Transactions Per Second for 1HR asset Cache Object Size (MB) Bit Rate  3000 kbps 1500 kbps 500 kbps Smooth 1 1 1 HLS 360 360 360 PDL 1 1 1 Origin File Count (One Hour Asset) High Transaction Rate File Object Count Small Object Write/Read Performance
  • 58. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public HSS vs. HLS: Vastly Different Methods 58BRKSPV-2160 HSS (Microsoft) HLS (Apple) Transport Protocol HTTP HTTP Fragment Size (default) 2 seconds 10 seconds #TCP connections 2 1-2 # Content Files on Origin Server #profiles #profiles x 360/Hr. of content Codec Support VC-1, H.264, WMA H.264 Wire Format MP4 fragments MPEG2TS video segments, audio ID3, webVTT File Format on Origin Server .ismv, Fragmented mp4 .ts, Segmented TS Standard HTTP Origin Server No Yes Encryption/DRM PlayReady; AES-128 in Counter Mode AES-128 in Cipher Block Chaining Client Silverlight, OSMF (OpenSource) iPhone OS +, QuickTime X Client Manifest file .ismc (.ism/manifest or .isml/manifest) .m3u8 Origin server Helper integrated with IIS server HTTP server
  • 59. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public HSS vs. DASH: DASH is a super-set of HSS 59BRKSPV-2160 HSS (Microsoft) DASH (MPEG DASH Guidelines v3) Transport Protocol HTTP HTTP Fragment Size (typical) 2 seconds 1-10 seconds #TCP connections 2 1 , 2 # Content Files on Origin Server #profiles #programs Codec Support VC-1, H.264, WMA H.264, H.265 Wire Format MP4 fragments MP4 fragments File Format on Origin Server .ismv, Fragmented mp4 ISO-BMFF Standard HTTP Origin Server No Yes Encryption/DRM PlayReady; AES-128 in Counter Mode Common Encryption, AES-128, CTR+ CBC Client Silverlight, OSMF (OpenSource) DASH Client Client Manifest file .ismc (.ism/manifest or .isml/manifest) .mpd (media presentation description) Origin server Helper integrated with IIS server Packager (MPD), Server (Segments)
  • 60. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 60BRKSPV-2160 CDN Optimizations for ABR • Optimized TCP connection handling • Scaling to support the large # of connections for ABR • Optimized HTTP request handling • Scaling to support the large # of GET requests for ABR • Request Bundling • For live streaming, aggregates multiple cache-fill requests for the same content into a single request • Small Object Cache Throughput Optimizations • Small objects written to memory, delayed write to disk (SSD or HDD) • Large objects continue to be cached on disk • Client/Cache Stickiness (Content Affinity) • Service Visibility • Reporting and Analytics optimizations for ABR Aggregation of common requests into single request (e.g. manifest update) Origin Server Mid-Tier Cache Streamer
  • 62. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Mobility Overlay Storage Caching Overlay Integrated Network Fabric supporting mobility, security, and caching Security Overlay New Communication Model  Security – Implicit object security  Storage – Dynamic caching of objects in the forwarding fabric  Mobility – Eliminate mobility anchors Information Centric Networking Providing a New Foundation Integratetosinglelayer BRKSPV-2160 62
  • 63. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKSPV-2160 Information Centric Networking A new paradigm in communications • Definitions: • NAMED-DATA • uniquely identified chunk of data, state, or results of a process • {e.g. sensor reading, calculation, or .. a media fragment} • PRODUCER • Produces named-data • CONSUMER • Creates “Interest” requests for named-data • FORWARDER • Forwards named-data object along ”Interest” path 63
  • 64. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Properties of Hybrid ICN Named Data Connection-less Transport Pending State for Interest Requests Low latency networking Convergence of Unicast / Multicast Distribution Multi-Path Load-Balancing Anchorless Mobility Reactive In-network Caching & Recovery Stateless Connection In-Network Content-Awareness Multi-service Support Intrinsically Secure Dynamic Forwarding BRKSPV-2160 64
  • 65. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public IP Content-networking Hybrid ICN ICN • Names into IPv6 addresses • L4-7 request routing based on names (e.g. with SR) • Connection-based sender-driven transport • Tunnel-based security • Anchor-based mobility • Application-layer (CDN) proactive caching • Names into IPv6 addresses • L3 Name-based routing and h2h dynamic forwarding • Partially symmetric routing • Connectionless receiver- driven multipath transport • Object-based security • Anchorless mobility • In-path reactive caching • Variable length routable names • L3 Name-based routing and h2h dynamic forwarding • Symmetric routing • Connectionless receiver- driven multipath transport • Object-based security • Anchorless mobility • In-path reactive caching BRKSPV-2160 65 Hybrid ICN is ICN
  • 66. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public o Name-Space : IPv6 packets, no options o IP Transparent Interconnection with hICN enabled routers o ICN layer 3 - 4 features: anchorless mobility, unified unicast/multicast, in-path caching, security Hybrid ICN with IPv6 ICN IP router hICN Forwarder ICN hICN ProducerhICN Consumer ICN IP routerhICN Consumer ICNIP Packet IP routerIP router hICN IP Interest Origin MPEG-DASH | HLS HTTP GET hICN IP Interest 1 2 3 45 67 8 9 BRKSPV-2160 66
  • 67. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 67BRKSPV-2160 Anatomy of a URL IPv4 ➤ IPv6 • Scale by 30 orders of magnitude • IPv6 object representations
  • 68. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 68BRKSPV-2160 hICN Encoding of a Media Object IPv6: Service Prefix IPv6: Media Object
  • 69. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public hICN: Network-Native Video Distribution See the Demonstration in DevNet Booth D27 Acquire/ Create hICN DistributionhICN Packaging Net-Native Direct (not redirect) IP Content routing ④ hICN Network Analytics become Content Aware⑤ Remote Production Studio & Post Production Content Push + Linear/Live “Channels” Video Streaming Content Pull Consumer Experience Contribution Content Preparation & Playout In-Network Caching from SP to Subscriber ③Named-Data Objects Ingested ②Named-Data Content Packaging ① IP IP IP IP IP IP BRKSPV-2160 69
  • 71. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Platform Requirements • Three Dimensions of Analysis • Compute • Computation Complexity • Transactions Per Second • Storage • Volume of Data • Read / Write Capabilities of Storage • Bandwidth • Throughput • Packets Per Second 71BRKSPV-2160 Compute Storage Bandwidth • Live Streaming • VoD Origin • VoD Streaming • cDVR Origin • Encryption • Encapsulation • Live Origin • Encoding
  • 72. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 72BRKSPV-2160 System Load Requirements: Linear Unicast Compute (CPU) Storage (TB) Bandwidth (Gbps)0 300 600 900 1200 1500 Compute (CPU) Storage (TB) Bandwidth (Gbps) Assumptions: Stream Demand:1500 Gbps Channels: 500 Size: 10Mbps per channel Caching: In-memory
  • 73. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 73BRKSPV-2160 System Load Requirements: Video On Demand Compute (CPU) Storage (TB) Bandwidth (Gbps)0 300 600 900 1200 1500 Compute (CPU) Storage (TB) Bandwidth (Gbps) Assumptions: Stream Demand: 500 Gbps Titles: 200,000 Size: 3.2 GB per Title (avg 43min) Caching: 97% CHR
  • 74. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 74BRKSPV-2160 System Load Requirements: Cloud DVR Compute (CPU) Storage (TB) Bandwidth (Gbps)0 300 600 900 1200 1500 Compute (CPU) Storage (TB) Bandwidth (Gbps) Assumptions: Stream Demand: 1320Gbps Titles: Unique Copy Size: 3.2 GB per Title (avg 43 min) Caching: 0% CHR
  • 75. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 75BRKSPV-2160 System Load Requirements: Combined Services Compute (CPU) Storage (TB) Bandwidth (Gbps)0 500 1000 1500 2000 2500 Compute (CPU) Storage (TB) Bandwidth (Gbps) Data Center Services
  • 77. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 77BRKSPV-2160 MOS Controller – High Level Modules Control Plane Data Plane Management functionality Service Manager, GUI Manager, Document Services Media Control Plane Application Instance Controller (AIC) Content Object Store Controller (COS AIC) Centralized Logging (ELK) Service Orchestration Service Instance Controller (SIC) Asset Workflow Manager(AWM) Media Data Plane MCE, MPE (MPE-C, MPE-TC) App Engines (State Cache HA-Proxy, IPVS)
  • 78. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 78BRKSPV-2160 Unified Media Components Communication MCE MCE MCE MPE- TCMPE – C LB LB Key Mgmt Key Mgmt HA Proxy HA Proxy COS COS COS MPE MPE MPE Ingest OpenStack SWIFT Storage Redistribution Key Lookup Playback Request Redirect to MPE Playback Request (HLS, HSS, HDS) Playback Request (DASH) Playback Request (DASH) Playback Request (HLS, HSS, HDS) Playback Response (DASH) LinuxCisco 3rd Party
  • 80. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 80BRKSPV-2160 Key Takeaways: Caching • CDN Value Proposition • Efficient Distribution of Content (Audio, Media, Software) • Improved Performance / Scale • Resiliency Caching Sites Optimized Costs Cost • Content Caching Methods • Emphasis on Proxy Caching (Authorized) vs Transparent • Leveraging Two Referral Methods: DNS-based or HTTP Redirect • CDN Architectural Choices • Strategic Hierarchical Caching • Cost Optimization: Bandwidth Versus Storage Proxy Cache HTTP | DNS
  • 81. Q & A
  • 82. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public • Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 gift card. • Complete your session surveys through the Cisco Live mobile app or on www.CiscoLive.com/us. Complete Your Online Session Evaluation Don’t forget: Cisco Live sessions will be available for viewing on demand after the event at www.CiscoLive.com/Online.
  • 83. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public Continue Your Education • Demos in the Cisco campus • Walk-in Self-Paced Labs • Lunch & Learn • Meet the Engineer 1:1 meetings • Related sessions 83BRKSPV-2160