SlideShare a Scribd company logo
Developing Applications with Host Media Processing David Asher
Host Media Processing: What We’re Talking About Using a general-purpose computing platform To create a telephony application
Market Trend: Host Media Processing Lower acquisition costs,  sometimes Lower provisioning and maintenance costs Eliminate special hardware associated costs  More failure recovery options
HMP Reliability Economics 1 DSP platform  with 480 ports 4 HMP platforms  with 480 ports 1 Failure = 480 ports 1 Failure = 120 ports
HMP Application Economics ~ $4k for 1U Dual Xeon 120 application sessions rated capacity   ~ $33 per session HW cost Reduction in total cost of ownership no platform integration and test no special hardware inventory, tracking, failures, replacements, repairs, tech support
Distributed Media Processing Single large DSP media server Small media servers “built-in” to each application App Servers Media Server App Servers HMP HMP HMP HMP HMP
Primary Features IVR Operations Play prompt, record and play messages, detect DTMF tones, ASR & TTS interface Audio processing operations Automatic gain control, voice activity detector, acoustic DTMF detector Enhanced media services Transcoding (audio and video), conferencing VoIP call connections RTP packetization, SIP signaling, encryption
Application Control Options Application  Server Application  Server Application  Server Application  Server Application  Server Application  Server API VoiceXML & CCXML Control  Protocol (SIP) Markup Languages API Control Protocol IP Media Server IP Media Server HMP Media Server “ Native” VOIP  Application “ Native” VOIP  Application “ Native” VOIP  Application IP Media Server IP Media Server HMP Media Server IP Media Server IP Media Server HMP Media Server
Inside the HMP Media Server:  Protocol Stacks Host Ethernet Ports Host IP Protocol Stack (QoS, Firewall) UDP / SCTP TCP RTP Host Media Processing HTTP Scripting Engines Media Control Protocols SIP MRCP Speech Automation Application Interface Media Services
HMP Stack Example Configuration for IVR IP (QoS) UDP IP (Firewall) UDP RTP Egress Ingress RTP Packet Scheduler Jitter Buffer Auto Gain Control Voice Decoder Voice Activity Det. Tone Detector RTP Stream Switching Media Processing Record Play Application Interface Packet Processing Voice Activity Det. Tone Generator Voice Encoder Gain Control Operating System API / IVR
Quality of Service – Why? Data Applications Reliable delivery without error; timing is not critical Bursty, unpredictable bandwidth consumption Nonlinear performance degradation near bandwidth saturation Voice Applications Timely delivery is critical; errors can be tolerated Predictable bandwidth consumption Linear, well distributed performance degradation near bandwidth saturation time bandwidth bandwidth time
Quality of Service – What? time Jitter Increase or Packet Loss Events Available Bandwidth Voice Class Data Class
Voice Coder Performance 20 ms 30 ms 10 ms 1.0 ms 0.75 ms Delay Time 4.2 4.0 4.2 4.2 4.4 Mean Opinion Score (1-5) 6.3 kbps G.723.1 Transmission Bandwidth Coder 15 kbps iLBC 8 kbps G.729a 16-32 kpbs G.726 64 kbps G.711
Voice Coder Resiliency
Native RTP File Recording Improve the quality of recordings Reduce the cost of transcoding Content Store File Stream with Encapsulated RTP VoIP Callers G.711  G.726 G.723  G.729 HMP Application
Types of Attack or Misuse Source: IDC,  2003 CSI/FBI Computer Crime and Security Survey
SECURITY IS YOUR RESPONSIBILITY !!! An HMP platform is a computer like any other It is vulnerable to many Internet security threats The application developer is responsible for building secure applications!
Kernel vs. User-Space Implementation Kernel User-space HMP exists in the same process space as the applications A critical failure in the HMP stack can crash the server Hard to isolate HMP problems from application problems HMP exists in it’s own process space; the service can be stopped A critical failure in the HMP stack won’t destabilize the server HMP problems are isolated from application problems
HMP Density Roadmap Montecito  (4-Way) Tanglewood (16-Way) Dual 2.4 GHz Dual 64-Bit Based on Intel CPU Roadmap
DSP vs. HMP ?? DSP Very high density High transcoding requirement Low power requirement PSTN interfaces and signaling HMP Lower density Need to deploy on generalized servers VOIP-only
Is HMP Inevitable ?? New processing requirements that favor DSP economics Security – encryption Wideband audio (conferencing) Video transcoding, transrating, resizing, and conferencing …

More Related Content

PPT
Surf Communication Solutions - Packet To Packet Apps
PPT
Packet-to-Packet Applications
PDF
VoIP Monitoring and Troubleshooting
PPT
Audio And Video Over Internet
PPT
Surf Communication Solutions - Voice Video Gw
PPT
Designing Triple-Play Apps Using DSP Resource Boards
PPT
Building Voice
PDF
Introduction to VoIP, RTP and SIP
Surf Communication Solutions - Packet To Packet Apps
Packet-to-Packet Applications
VoIP Monitoring and Troubleshooting
Audio And Video Over Internet
Surf Communication Solutions - Voice Video Gw
Designing Triple-Play Apps Using DSP Resource Boards
Building Voice
Introduction to VoIP, RTP and SIP

What's hot (20)

PPT
Video Streaming - 4.ppt
PPT
MM_Conferencing.ppt
PPT
Slides for Week 4 - Lec 2
PPTX
Voice Quality Metrics in VoIP
PPT
Protocol For Streaming Media
PPT
Practical Fundamentals of Voice over IP (VoIP) for Engineers and Technicians
PPTX
Prosody s telephony software
PPTX
Streaming Video Techniques
PPT
VoLTE video telephony – a communication evolution
PPT
Vo Ip Rajibdeka
PPT
Introduction To SIP
PPT
PPT
Voip
PPT
Audio and Video streaming.ppt
PPS
A glance-at-voip
PPT
Introduction to VoIP
PDF
Core Stor Ip Recording V1
PPT
Introduction to VoIP using SIP
PDF
Polycom soundpoint ip450 data sheet
Video Streaming - 4.ppt
MM_Conferencing.ppt
Slides for Week 4 - Lec 2
Voice Quality Metrics in VoIP
Protocol For Streaming Media
Practical Fundamentals of Voice over IP (VoIP) for Engineers and Technicians
Prosody s telephony software
Streaming Video Techniques
VoLTE video telephony – a communication evolution
Vo Ip Rajibdeka
Introduction To SIP
Voip
Audio and Video streaming.ppt
A glance-at-voip
Introduction to VoIP
Core Stor Ip Recording V1
Introduction to VoIP using SIP
Polycom soundpoint ip450 data sheet
Ad

Similar to Developing Applications Using Host Processing Instead of DSPs (20)

PPT
Surf Communication Solutions - Surf General
PPT
Sinnreich Henry Johnston Alan Pt 2
PDF
TeamSpirit
PPT
Video Conferencing : Fundamentals and Application
PDF
Understanding VoIP - 1
PPTX
VoIP (Voice over Internet Protocol)
PPT
Voice over IP: Issues and Protocols
PPTX
Voice Over IP (VoIP) and STREAMING
PDF
Video Streaming
PPTX
PPT
Streaming Overview Final.ppt
PPT
Streaming Overview Final.ppt
PPT
Streaming Overview Final.ppt
PPT
Streaming Overview Final.ppt
PDF
Simmortel Open Communications
PPT
Audio and video streaming
PPT
Surf Communication Solutions - Surf Rider Amc
PPT
Video "Transcoding" Solutions for Mobile TV
PPT
“What Every Digital TV Executive Needs to Know About Adaptive Rate Streaming...
POT
SIP servers on embedded systems: Powering SoHo communications
Surf Communication Solutions - Surf General
Sinnreich Henry Johnston Alan Pt 2
TeamSpirit
Video Conferencing : Fundamentals and Application
Understanding VoIP - 1
VoIP (Voice over Internet Protocol)
Voice over IP: Issues and Protocols
Voice Over IP (VoIP) and STREAMING
Video Streaming
Streaming Overview Final.ppt
Streaming Overview Final.ppt
Streaming Overview Final.ppt
Streaming Overview Final.ppt
Simmortel Open Communications
Audio and video streaming
Surf Communication Solutions - Surf Rider Amc
Video "Transcoding" Solutions for Mobile TV
“What Every Digital TV Executive Needs to Know About Adaptive Rate Streaming...
SIP servers on embedded systems: Powering SoHo communications
Ad

More from Videoguy (20)

PDF
Energy-Aware Wireless Video Streaming
PDF
Microsoft PowerPoint - WirelessCluster_Pres
PDF
Proxy Cache Management for Fine-Grained Scalable Video Streaming
PDF
Adobe
PDF
Free-riding Resilient Video Streaming in Peer-to-Peer Networks
PDF
Instant video streaming
PDF
Video Streaming over Bluetooth: A Survey
PDF
Reaching a Broader Audience
PDF
Considerations for Creating Streamed Video Content over 3G ...
PDF
ADVANCES IN CHANNEL-ADAPTIVE VIDEO STREAMING
PDF
Impact of FEC Overhead on Scalable Video Streaming
PDF
Application Brief
PDF
Video Streaming Services – Stage 1
PDF
Streaming Video into Second Life
PDF
Flash Live Video Streaming Software
PDF
Videoconference Streaming Solutions Cookbook
PDF
Streaming Video Formaten
PDF
iPhone Live Video Streaming Software
PDF
Glow: Video streaming training guide - Firefox
PDF
Video and Streaming in Nokia Phones v1.0
Energy-Aware Wireless Video Streaming
Microsoft PowerPoint - WirelessCluster_Pres
Proxy Cache Management for Fine-Grained Scalable Video Streaming
Adobe
Free-riding Resilient Video Streaming in Peer-to-Peer Networks
Instant video streaming
Video Streaming over Bluetooth: A Survey
Reaching a Broader Audience
Considerations for Creating Streamed Video Content over 3G ...
ADVANCES IN CHANNEL-ADAPTIVE VIDEO STREAMING
Impact of FEC Overhead on Scalable Video Streaming
Application Brief
Video Streaming Services – Stage 1
Streaming Video into Second Life
Flash Live Video Streaming Software
Videoconference Streaming Solutions Cookbook
Streaming Video Formaten
iPhone Live Video Streaming Software
Glow: Video streaming training guide - Firefox
Video and Streaming in Nokia Phones v1.0

Developing Applications Using Host Processing Instead of DSPs

  • 1. Developing Applications with Host Media Processing David Asher
  • 2. Host Media Processing: What We’re Talking About Using a general-purpose computing platform To create a telephony application
  • 3. Market Trend: Host Media Processing Lower acquisition costs, sometimes Lower provisioning and maintenance costs Eliminate special hardware associated costs More failure recovery options
  • 4. HMP Reliability Economics 1 DSP platform with 480 ports 4 HMP platforms with 480 ports 1 Failure = 480 ports 1 Failure = 120 ports
  • 5. HMP Application Economics ~ $4k for 1U Dual Xeon 120 application sessions rated capacity  ~ $33 per session HW cost Reduction in total cost of ownership no platform integration and test no special hardware inventory, tracking, failures, replacements, repairs, tech support
  • 6. Distributed Media Processing Single large DSP media server Small media servers “built-in” to each application App Servers Media Server App Servers HMP HMP HMP HMP HMP
  • 7. Primary Features IVR Operations Play prompt, record and play messages, detect DTMF tones, ASR & TTS interface Audio processing operations Automatic gain control, voice activity detector, acoustic DTMF detector Enhanced media services Transcoding (audio and video), conferencing VoIP call connections RTP packetization, SIP signaling, encryption
  • 8. Application Control Options Application Server Application Server Application Server Application Server Application Server Application Server API VoiceXML & CCXML Control Protocol (SIP) Markup Languages API Control Protocol IP Media Server IP Media Server HMP Media Server “ Native” VOIP Application “ Native” VOIP Application “ Native” VOIP Application IP Media Server IP Media Server HMP Media Server IP Media Server IP Media Server HMP Media Server
  • 9. Inside the HMP Media Server: Protocol Stacks Host Ethernet Ports Host IP Protocol Stack (QoS, Firewall) UDP / SCTP TCP RTP Host Media Processing HTTP Scripting Engines Media Control Protocols SIP MRCP Speech Automation Application Interface Media Services
  • 10. HMP Stack Example Configuration for IVR IP (QoS) UDP IP (Firewall) UDP RTP Egress Ingress RTP Packet Scheduler Jitter Buffer Auto Gain Control Voice Decoder Voice Activity Det. Tone Detector RTP Stream Switching Media Processing Record Play Application Interface Packet Processing Voice Activity Det. Tone Generator Voice Encoder Gain Control Operating System API / IVR
  • 11. Quality of Service – Why? Data Applications Reliable delivery without error; timing is not critical Bursty, unpredictable bandwidth consumption Nonlinear performance degradation near bandwidth saturation Voice Applications Timely delivery is critical; errors can be tolerated Predictable bandwidth consumption Linear, well distributed performance degradation near bandwidth saturation time bandwidth bandwidth time
  • 12. Quality of Service – What? time Jitter Increase or Packet Loss Events Available Bandwidth Voice Class Data Class
  • 13. Voice Coder Performance 20 ms 30 ms 10 ms 1.0 ms 0.75 ms Delay Time 4.2 4.0 4.2 4.2 4.4 Mean Opinion Score (1-5) 6.3 kbps G.723.1 Transmission Bandwidth Coder 15 kbps iLBC 8 kbps G.729a 16-32 kpbs G.726 64 kbps G.711
  • 15. Native RTP File Recording Improve the quality of recordings Reduce the cost of transcoding Content Store File Stream with Encapsulated RTP VoIP Callers G.711 G.726 G.723 G.729 HMP Application
  • 16. Types of Attack or Misuse Source: IDC, 2003 CSI/FBI Computer Crime and Security Survey
  • 17. SECURITY IS YOUR RESPONSIBILITY !!! An HMP platform is a computer like any other It is vulnerable to many Internet security threats The application developer is responsible for building secure applications!
  • 18. Kernel vs. User-Space Implementation Kernel User-space HMP exists in the same process space as the applications A critical failure in the HMP stack can crash the server Hard to isolate HMP problems from application problems HMP exists in it’s own process space; the service can be stopped A critical failure in the HMP stack won’t destabilize the server HMP problems are isolated from application problems
  • 19. HMP Density Roadmap Montecito (4-Way) Tanglewood (16-Way) Dual 2.4 GHz Dual 64-Bit Based on Intel CPU Roadmap
  • 20. DSP vs. HMP ?? DSP Very high density High transcoding requirement Low power requirement PSTN interfaces and signaling HMP Lower density Need to deploy on generalized servers VOIP-only
  • 21. Is HMP Inevitable ?? New processing requirements that favor DSP economics Security – encryption Wideband audio (conferencing) Video transcoding, transrating, resizing, and conferencing …