Sm west 2010-microsoft-workshop
- 1. Live Streaming with Microsoft Silverlight and Windows Server Chris Knowlton Senior Product Manager Microsoft
- 2. Objectives • Better understand live streaming options with Windows Media and IIS Smooth Streaming • Get started with Microsoft Silverlight • Use Expression Encoder to create, protect, and seamlessly publish content • Target common live broadcast scenarios • Deliver to a wide range of end user conditions and clients 2
- 3. Agenda • Overview – WMS & IISMS • IIS Smooth Streaming • Media Delivery Workflow • Next Steps 3
- 4. OVERVIEW – WMS & IISMS 4
- 5. Microsoft Media Platform Content Protection - Microsoft PlayReady Capture Encode DeliveDr e&li vMera nage Receive 5
- 6. Windows Server • Complete server operating system • Available at different price points, starting at Free • Includes media server capabilities via Free downloads from Microsoft.com: – Windows Media Services – Internet Information Services (IIS) Media Services 6
- 7. Core Media Server Scenarios • Enterprise – On-demand training – Live executive broadcast • Internet – News & entertainment – Music & movie services – Internet-based Radio/TV stations – Radio & television rebroadcasts – Live event broadcasts 7
- 8. Delivering Media with Windows Server IIS Media Services • Unicast Streaming • WMS RTSP • WMS HTTP • MBR Streaming • Intelligent Streaming • Multicast Streaming • WMS Multicast • Progressive Download • Bit Rate Throttling • Web Playlists • Adaptive Streaming • Smooth Streaming • Multicast Streaming • Smooth Multicast 8
- 9. Key Media Server Features • Live & on-demand streaming • Access control via authentication / authorization • Rich logging & advertising support • Multiple-bit-rate streaming • Fast Streaming & Advanced FF/RW • Archiving & Play While Archiving • Extensible platform • Server Core installation… • Caching & Proxying… • Scalability… 9
- 10. Server Core Option • Design – Minimal-footprint headless installation option – For running fixed-function server roles – Good option for Windows Embedded appliances – Supports all WMS plug-ins • Benefits – Eliminates GUI and client features – Reduces hardware requirements – Reduces overall attack surface – Reduces servicing costs 10
- 11. Caching & Proxying • WMS and IIS provide caching & proxying – WMS Cache/Proxy plug-in – part of WMS – IIS Application Request Routing (ARR) – download • Benefits – Improved end user experience – Reduced load on the origin server – Reduced load on the network 11
- 12. Caching & Proxying • Usage Options – Proxy – allows broadcast stream splitting – Caching • Opportunistic caching • Pre-caching (e.g., using DFSR) • Adheres to Expiry Date on content – Reverse Proxy • Provides a gateway server to users • Redirects content requests to a specified origin server 12
- 13. Windows Media Services 2003 Scalability • WMS example on standard rack-mount server +400 connections +1,500 connections +1,200 connections 3,000 concurrent 300kbps connections Optimizations TCP Offload x64 Support WMS 9.0 scalability 6,100 connections + 10-25% more on Server Core • IIS is typically much more scalable than WMS 13
- 14. Affordable Media Delivery Options • Costs for Windows Server 2008 R2: Edition Cost Features Notes Web Server $ 469 / server 99%, Web-facing 1, 2 Standard $ 999 / server 99% of features 2, 3 Enterprise $3,999 / server All features 3 Datacenter $2,999 / proc. All features 3 Notes: 1. WebSiteSpark provides free Web Server licenses for up to 3 years 2. WMS Multicast requires Enterprise or Datacenter edition 3. Standard, Datacenter, and Enterprise are available via Service Provider Licensing Agreement (SPLA), which charges for actual monthly usage 14
- 15. Live Streaming – WMS vs. IIS Live Streaming Features WMS 2008 IISMS 4.x Unicast HTTP streaming from live encoders Broadcast streaming from files Server- and client-side logging High Availability content sourcing (encoder failover) Archiving of live streams Multiple-bit-rate streaming (Intelligent vs. Smooth) HTTP Streaming RTSP/TCP & RTSP/UDP Streaming Multicast streaming * Play While Archiving (late joiner feature) Windows Media Services proxying and caching Standard HTTP proxying and caching Full Network DVR Low-Latency Streaming Built-in PlayReady DRM * * Targeting availability in IIS Media Services 4.5 15
- 16. Silverlight and Windows Media Live Streaming DEMO 16
- 17. IIS SMOOTH STREAMING 17
- 18. Traditional Streaming Pros & Cons • Benefits of Traditional Streaming – Responsive User Experience • Users can pause, seek, fast-forward, rewind with ease – Effective use of bandwidth • Send only the content your users watch – Rich Logging and Monitoring • Know what your users are watching at all times • Challenge of Traditional Streaming: Higher TCO – Packets do not make use of HTTP caching networks – Must deploy streaming edge servers to scale out 18
- 19. Progressive Download Pros & Cons • Benefits of traditional progressive download – Broad reach • No need for streaming code in the player • Gets through all firewalls – Optimized, cost-effective global delivery • Cacheable by existing HTTP caches • Distributed worldwide by CDN HTTP infrastructures • Challenges – Limited user experience – no… live streaming, instant start, instant seeking, or interactivity – Wasted bandwidth (user downloads 100%, watches 20%) – No visibility into viewer behavior & experience 19
- 20. The "Last Mile" Challenge Edge Server Low Bandwidth Fast CPU High Bandwidth Slow CPU The “Last Mile” from Server to Client “Best quality I can download” High Bandwidth Fast CPU “Best quality I can render” “Best quality, period ” Conditions change every second 20
- 21. Basic IIS Smooth Streaming 2.4M … 300K Bit Rate Heuristics 300K @ 00:00? 700K @ 00:02? 2.4M @ 00:04? 1.5M @ 00:06? 2.4M @ 00:08? 00:00 00:02 00:04 00:06 00:08 300K (start quickly) 700K (good network) 2.4M (great network) 1.5M (glitch) 2.4M (play on…) 21
- 22. IIS.net Graphing Player NextSmooth.com Demo Site DEMO 22
- 23. Smooth Streaming - A New Approach • Makes use of globally available HTTP caches: – Stateless – no persistent connections required – No dedicated servers or overlay networks required – No provisioning required • Adapts to constantly changing conditions • Rich, interactive user experience • Customizable, real-time client reporting • Delivers only the bits needed for that moment 23
- 24. Live Smooth Streaming • Builds on Smooth Streaming – Cacheable HTTP delivery for Live events – Network Digital Video Recorder (DVR) • Pause, Instant Replay, Go to Start, Go to Live… • Synchronized in-stream text & metadata – Captioning and subtitling – Sparse data (e.g., chapter markers) – Control events (e.g., ad insertion points) • Trick Play: FF, Rewind, Slow Motion 24
- 25. Smooth Streaming Results • Internet video is as good or better than TV – Users with only SD TVs can see Internet HD on their computers • Users experience content in new ways – Contextual linking, Live DVR, multiple camera angles… • Advertising can be very targeted – Ads that interest you, in HD – Could be embedded, interactive ads • Longer engagement times – Users who watch HD content via the Internet stay engaged longer 25
- 26. IIS Smooth Streaming Multi-Camera Player DEMO 26
- 27. MEDIA DELIVERY WORKFLOW 27
- 28. IIS Smooth Streaming Workflow From simple on-demand training… 28
- 29. IIS Smooth Streaming Workflow …with straightforward workflows… Acquire Encode Deliver Consume 29
- 30. IIS Smooth Streaming Workflow …to highly enhanced experiences… Alternate Camera Angles Key Plays Markers Instant Replay Slow Motion FFWD / REW Quality Meter HD quality Video Live Ad Insertions Highlights, Stats, and Chat “Go Live” Button 30
- 31. IIS Smooth Streaming Workflow …that are a bit more complex. 31
- 32. IIS Smooth Streaming Workflow Media Assets Origin Server Client CDN Encoder Source Acquire Encode Deliver Consume 32
- 33. IIS Smooth Streaming Workflow Origin Server Client Media Assets CDN Encoder Video Asset Live Video Audio Asset Live Audio Acquire Encode Deliver Consume 33
- 34. Acquire – Getting Content • The higher the quality, the better • Include your advertising – make it HD & interactive • Not just video: IIS Smooth Streaming can also deliver… – Synchronized in-stream text & metadata • Captioning and subtitling • Sparse data (e.g., chapter markers) • Control events (e.g., ad insertion points) – Audio tracks • Additional languages • Commentary • Audio-only broadcasts (coming soon!) 34
- 35. IIS Smooth Streaming Workflow Media Assets Server Manifest .ism file Client Manifest .ismc file MP4 file(s) Origin Server Client CDN Encoder Video Asset Live Video Audio Asset Live Audio Acquire Encode Deliver Consume 35
- 36. Encode • IIS Smooth Streaming encoders create: – Fragmented MP4 files • Contiguous MP4 files on disk – Easier file management – Can have separate files per bit rate, or one large MBR file • IIS fragments MP4 files into smaller cacheable objects – Highly scalable stateless delivery via HTTP caching – Users only receive the fragments they need, saving bandwidth – Two manifests • Server (.ism) – lists available tracks and bit rates • Client (.ismc) – lists codecs, resolutions, fragment index 36
- 37. Encoding Partners • Professional Encoder Partner Ecosystem – Live – Inlet, Envivio, Digital Rapids – VOD – Live partners, plus Elemental, Grab Networks, Rhozet, Telestream, TwoFour Digital, Viewcast • Each is finding ways to add value, e.g.… – Carrier-class reliability – Enterprise-class pricing – Education-class ease of use • See http://www.iis.net/media/showcase for a longer list of partners, with more on the way 37
- 38. Microsoft Expression Encoder 4 • Video encoder, editor, and SDK • Replaces Windows Media Encoder • New features in version 4 – Live Smooth Streaming support – OD, Live Smooth Streaming Presets (VC-1, H.264) – Publish directly to IIS & WMS origin servers – PlayReady DRM encryption for Smooth Streaming – High quality screen capture encoding – High perf: GPU acceleration and multi-core usage 38
- 39. IIS Encoding Options • Smooth Streaming Format SDK – Enables encoder and workflow products • IIS Transform Manager – On-Demand transcoding, transmuxing, encryption – User-specified Watch Folders for content ingest • Expression Encoder integration for transcoding – Work queue and job management framework • Local scheduler for simple scenarios • HPC integration for scale-out – Task API on MSDN for ISV-supplied tasks and jobs 39
- 40. Time to stretch! 10-MINUTE BREAK 40
- 41. IIS Smooth Streaming Workflow Rough Cut Editing Server Manifest .ism file Client Manifest .ismc file MP4 file(s) IIS Media Services Internet Information Services Windows Server Origin Server Client CDN Encoder Video Asset Live Video Audio Asset Live Audio Acquire Encode Deliver Consume 41
- 42. Rough Cut Editing • Provides instant highlights during live events • Faster time to market with highlights – Repurpose existing assets – No transcoding, so publish in seconds • Reduction in costs – Free tool – No expensive video workstations – No additional storage costs • Web based video editing – Location independent – Platform independent • Fits in with encoders and other workflow tools 42
- 43. Silverlight Rough Cut Editor • Free tool • Used for Olympics • Built in Silverlight • Source code is provided • Download from http://code.msdn.microsoft.com/RCE 43
- 44. IIS Smooth Streaming Workflow Media Assets Server Manifest .ism file Client Manifest .ismc file MP4 file(s) IIS Media Services Internet Information Services Windows Server Origin Server Client CDN Encoder Video Asset Live Video Audio Asset Live Audio Acquire Encode Deliver Consume 44
- 45. Blow up of IIS MS Internet Information Services Smooth Streaming Live Smooth Streaming Smooth Multicast Bit Rate Throttling Web Playlists Advanced Logging Content Protection/DRM Transform Manager Application Request Routing Acquire Encode Deliver Consume IIS Smooth Streaming Workflow 45
- 46. Acquire Encode Deliver Consume Internet Information Services IIS Media Services Blow up of IIS MS Smooth Streaming Live Smooth Streaming Smooth Multicast Bit Rate Throttling Web Playlists Advanced Logging Content Protection/DRM Transform Manager Application Request Routing IIS Smooth Streaming Workflow 46
- 47. IIS Media Services Platform Goals • Extend Media Engagement – Scale using Web servers and HTTP caching – Deliver True HD (720p+) live & OD video • Measure and Monetize Media – Real-time server- and client-side logging – Reduce Web server bandwidth usage • Create One Web Platform – Consolidate multiple media formats – Manage Web and media content together 47
- 48. IIS Smooth Streaming • Smooth Streaming (on-demand) • Live Smooth Streaming • Low-Latency Live Smooth Streaming – Less that 2 seconds from source to client screen – HTTP cacheable media delivery – Enables financial, gam(bl)ing, and surveillance verticals 48
- 49. IIS Smooth Streaming • iPhone, iPod, and iPad support – Server delivers in devices’ native formats – Single set of Smooth files – easy to manage • Smooth Multicast (coming soon!) – Combines best of multicast and Smooth Streaming – Reliable, scalable delivery on multicast networks – Rollover to standard Smooth Streaming – Full DVR support 49
- 50. IIS Live Smooth Streaming DEMO 50
- 51. Intelligent Progressive Download • Bit Rate Throttling – Automatic format and encoding buffer detection – 11 pre-defined A/V formats (FLV, MP4, MOV, etc.) – Can be extended to almost any format – Also works with data files • Web Playlists – Hybrid of client- and server-side playlists – Tokenizes URLs and prevents third-party playback – ASX by default; easily adapted to other formats 51
- 52. IIS Advanced Logging • Rich user engagement data – Perform deep analysis – Improve ROI • Real-time integration for near-live monitoring • Real-time filtering keeps client data separated • Compatible with WMS and other W3C logging • Centralized client logging for large networks 52
- 53. Content Protection/DRM • Supported in Smooth Streaming via… – PIFF (Protected Interoperable File Format) – Smooth Streaming Format SDK – Smooth Streaming Player SDK – One-click PlayReady in IIS (coming soon!) • Netflix and the Digital Entertainment Content Ecosystem (DECE – now branded as Ultraviolet) are using PIFF as the basis of their file format 53
- 54. Application Request Routing (ARR) • Makes IIS a full-featured HTTP cache proxy • Works better together with Smooth Streaming • Provides control and extensibility for scaling 54
- 55. IIS Smooth Streaming Workflow Media Assets Server Manifest .ism file Client Manifest .ismc file MP4 file(s) IIS Media Services Internet Information Services Windows Server Origin Server Origin Server Client Optional Web Cache, e.g., IIS ARR Encoder CDN Video Asset Live Video Audio Asset Live Audio Acquire Encode Deliver Consume 55
- 56. Scaling Out IIS Smooth Streaming • Use a Content Delivery Network (CDN) • Use an Online Video Platform (OVP) • Purchase caching appliances • Build out a set of IIS caching servers • Ensure a high-availability architecture 56
- 57. Using a CDN • Content Delivery Networks (CDNs): – Have 1000s of geographically dispersed servers – Most provide value-added media delivery services – Provide fast scalability to reach a global audience • Many CDNs support IIS Smooth Streaming, including Limelight Networks, Level 3, Internap, CDNetworks, and Akamai • More CDNs are beginning to offer media player templates and transcoding services 57
- 58. Using an Online Video Platform • An Online Video Platform (OVP) typically provides: – Transcoding – Global delivery – Media player design – Monitoring and analytics – Monetization through targeted advertising • Ooyala and Kaltura are two OVPs that support IIS Smooth Streaming 58
- 59. IIS Smooth Streaming Workflow Computer Phone Set top box Media Assets Server Manifest .ism file Client Manifest .ismc file MP4 file(s) OnlineB Vlowi dupe oof II SP MlSa tform IIS Media Services Internet Information Services Windows Server Origin Server Origin Server Optional Web Cache, e.g., IIS ARR Video Asset Live Video Audio Asset Live Audio Encoder Acquire Encode Deliver Consume 59
- 60. Purchase Caching Appliances • Caching appliances are often: – Priced based on features and capacity – Designed to provide high reliability and up-time – Running a custom OS or management platform • May be very useful: – For mission-critical private or managed networks – Where high volumes of redundant network traffic would result in congestion or high bandwidth bills • Examples: Cisco, Bluecoat, Riverbed 60
- 61. Scaling Out Your Deployment on IIS • ARR and Smooth Streaming can use new or existing servers to scale out your delivery and get content closer to end users • Build out in tiers; each adds unique value – Ingest – acquire, aggregate, manage sources – Origin – maintain authoritative archives – Distribution – control load on the Origin – Edge Servers – cache data close to viewers 61
- 62. Private Network Deployment Streaming on Primary LAN Remote Users on WAN Remote Users not on WAN Origin Server Edge Server DMZ or CDN Edge Servers 500-750-1100 kbps Multicast 500-750 kbps Multicast & Unicast 500-750 kbps Unicast 62
- 63. High Availability Architecture • Failover at each point in the critical path – Encoder – redundant or hot-spare model – Ingest – active/passive recommended – Origin – active/active recommended IIS7 Ingest Server Encoder 1 Encoder 2 Encoder 3 IIS7 Ingest Server IIS7 Origin Server IIS7 Origin Server push push 63
- 64. Live DVR and Archive Settings • For Live broadcasts, use these features: – Temporary DVR archive • Delete DVR archive after live broadcast is done – Sliding window DVR archive • Only archive the most recent NN minutes • Ideal for 24/7 live broadcasts – Archive segmentation • Create a new archive file for every NN minutes 64
- 65. IIS Smooth Streaming Workflow Media Assets Server Manifest .ism file Client Manifest .ismc file MP4 file(s) IIS Media Services Internet Information Services Windows Server Origin Server Origin Server Silverlight Application Silverlight Media Framework Client Optional Web Cache, e.g., IIS ARR Encoder CDN Silverlight Web Browser Operating System Client Video Asset Live Video Audio Asset Live Audio Acquire Encode Deliver Consume 65
- 66. IIS Smooth Streaming Workflow Computer Phone Set top box Media Assets Server Manifest .ism file Client Manifest .ismc file MP4 file(s) IIS Media Services Internet Information Services Windows Server Origin Server Origin Server Optional Web Cache, e.g., IIS ARR Video Asset Live Video Audio Asset Live Audio Encoder Acquire Encode Deliver Consume 66
- 67. Silverlight Across Screens • Cross-platform computer support (now approaching 65% of desktops worldwide) • Available now on Nokia & Windows phones • Coming to set-top boxes, connected TVs, Blu-ray players, etc. via Intel & Broadcom SOC • Consistent quality and experience across all endpoints 67
- 68. IIS Smooth Streaming Client • .NET APIs for Smooth Streaming in Silverlight – Enable basic and advanced playback, DRM, multiple camera angles, advertising functions, analytics, etc. – Part of the Silverlight Media Framework • Windows Phone 7 Smooth Streaming • IIS Smooth Streaming Client Porting Kit – Reaches clients that cannot run Silverlight – Coming soon to STBs and mobile devices 68
- 69. IIS Smooth Streaming Player Architecture Vertical Extensions (Multiple components) Smooth Streaming Client Silverlight Runtime Playback Interface Ad Interface Track Selection Trick Play Diagnostics Analytics Interface Heuristics Configuration UI Control (Vertigo) Ads (DoubleClick) Analytics (Conviva / Omniture) Multiple Cameras (Vertigo) Diagnostic Extension (Microsoft) Configuration Settings (Microsoft) Final UI Layer 69
- 70. Silverlight Media Framework • Open source media player framework • Builds on the core functionality of the PDK • Enables developers to quickly deploy a robust, scalable, customizable media player for IIS Smooth Streaming delivery • Built on the player code base used to deliver many Smooth Streaming deployments, such as Sunday Night Football, the Olympics, etc. 70
- 71. Reporting, Analytics, Monitoring • IIS Advanced Logging • Third-party integration – Conviva (real-time content delivery analytics) – Omniture (Web analytics) – DoubleClick (advertising) • Silverlight Analytics Framework integration – Logs video experiences built on the Silverlight Media Framework 71
- 72. IIS Smooth Streaming Workflow Computer Phone Set top box Media Assets Server Manifest .ism file Client Manifest .ismc file MP4 file(s) IIS Media Services Internet Information Services Windows Server Origin Server Origin Server Optional Web Cache, e.g., IIS ARR Video Asset Live Video Audio Asset Live Audio Encoder Acquire Encode Deliver Consume 72
- 73. IIS Smooth Streaming Workflow Computer Phone Set top box Media Assets Server Manifest .ism file Client Manifest .ismc file MP4 file(s) ABdlowv eupr otf iIsISi MnSg IIS Media Services Internet Information Services Windows Server Origin Server Origin Server Optional Web Cache, e.g., IIS ARR Video Asset Live Video Audio Asset Live Audio Encoder Acquire Encode Deliver Consume 73
- 74. Advertising with Smooth Streaming • Pre-roll or pre-timed interstitial videos • Live stream ad insertion • Synchronized banner ads • Interactive overlay advertising • HD advertising using bit rate history • Targeted advertising based on analytics – Using third-party Smooth Client extensions – Using IIS Advanced Logging 74
- 75. Next Steps – Acquire & Encode • Acquisition – switch to HD source if possible • Encoding – Expression Encoder • Download the free trial of EE4 from http://www.microsoft.com/expression/products/Encod er_Overview.aspx • Upgrade the free trial version on-line for just $199 – Third-party encoders • See the list at http://www.iis.net/media/partners • Visit encoder companies here on the show floor 75
- 76. Next Steps - Deliver • Visit http://ww.iis.net/media to learn more IIS Media Services and edge caching with ARR • See the list of CDN partners at http://www.iis.net/media/partners • Follow up with OVPs Kaltura and Ooyala: – http://corp.kaltura.com/about/silverlight_signup – http://www.ooyala.com/go/microsoft-silverlight 76
- 77. Next Steps – Consume • Learn about the broader Silverlight Media Framework at http://smf.codeplex.com • Learn more about the IIS Smooth Streaming PDK, see http://www.iis.net/smoothplayer • Get the details on the Microsoft Silverlight Analytics Framework at http://msaf.codeplex.com 77
- 78. Resources - Demos www.IIS.net/media/demo Images (c) copyright Blender Foundation / www.bigbuckbunny.org, Universal Pictures, SanDisk, iStreamPlanet, and Microsoft 78
- 79. Resources – Customer Examples www.IIS.net/media/showcase 79
- 80. Resources – Partners www.IIS.net/media/partners 80
- 81. Please… FILL OUT YOUR EVALUATION FORM 81
- 82. Q & A 82
- 83. Chris.Knowlton@microsoft.com SEND E-MAIL WITH ANY FOLLOW-UP QUESTIONS… 83
- 84. 84