Automated Voice And Audio Quality Test Measurement
- 1. Making your voice quality testing easy Sevana Oy Endre Domiczi Mobile: +358 9 23164165 E-mail: ceo@sevana.fi
- 2. This Presentation … is you to meet Sevana, it’s team, management, technology and services … is to discuss what one demands from a voice quality software in different systems devoted to test networks, codecs, QoS, QoE … is to present Sevana Voice Quality Testing approach and software … is to describe who is ideal partner or/and customer for Sevana Voice Quality Testing software … is to clearly show the benefits our customers obtain working with us … is to tell you why we think that Sevana is your trusted partner
- 3. Company Presentation Sevana Oy (Ltd) is a privately owned Helsinki based Finnish company established in 2003 as a software development company with the emphasis to emerging software technologies in telecom and industrial solutions. Sevana Oy Agrikolankatu 11 00530 Helsinki email: info@sevana.fi Finland tel. : +358 9 23164165
- 4. Company management and shareholders Sevana Oy (Ltd.) is currently owned by its founders and employees. The company has three different international software research and development teams organized by product lines. Sevana Oy (Ltd.) is lead by Mr. Endre Domiczi company CEO who is one of the main shareholders and co-founders. He is currently responsible for company operations and managing activities in Finland and European markets.
- 5. What do we want from a voice quality system? Let’s consider voice quality from a user point of view: We want to know when audio sounds good and when it sounds bad We want to be sure that if our customer uses our system to approach somebody the one at the destination will be able to communicate with the one at the origin We want to have a possibility to predict how our system will work when brought live We want to speak, hear and be heard We do not want to know HOW this is done, but we want to hear and be heard! Sound’s good!
- 6. What do we want you to get from a voice quality system? Let’s consider voice quality from a user point of view: We want you to be able to automatically detect when audio sounds good and when it does not – and thereby be able to easily predict user satisfaction in your oraganization (and among your product and services users) We want to be sure that when your customer uses voice quality concept and software system and approaches somebody, the one at the destination will be able to communicate with the one at the origin with 100% satisfaction. We want you to predict how our system will work when going live We want your customers to speak, hear, be heard and satisfied with the quality We want you to be able to demand clarifications from your voice carrier provider (fixed, mobile, VoIP) referring to quantitative reasons for quality loss We want you to hear and be heard with a 100% satisfaction! Sound’s good!
- 7. Cost-Effective Automated Testing Avoid expensive, imprecise, time and effort consuming manual tests Surveillance Continuous and precise monitoring of voice/audio service availability, quality and performance (KQI, KPI) Service Quality Management Precise measurement of voice/audio service availability, performance and quality Reporting flexible, dynamic, automated reporting and alarming environment Scalability Starting from a small stand-alone or/and desktop to network distributed systems What does one typically demand from a voice quality system?
- 8. Flexible User Interface User-friendly and user-specific modern GUI Flexible User Access Accessibility from Internet, Intranet, LAN, etc Open Interface Seamless and easy integration and combination of existing and new tools Flexible Customer Environment Availability for various customer environments and adaptation to specific customer needs What does one typically demand from a voice quality system?
- 9. Cost-Effective Automated Testing Quick ROI when automating voice quality testing: when automating IVR systems testing ROI period maybe less than 1 month! Surveillance Integrating voice quality testing (VQT) module into your existing environment allows easy, continuous and precise monitoring of service availability, quality and performance. Service Quality Management Precise measurement of service availability, performance and quality is achieved by ability to tune voice quality testing software utilizing a large variety of software parameters Reporting Automated reporting utilizing existing or introducing highly customized reporting systems. Scalability Starting from a PDA or desktop to network distributed systems Sevana product & service offerings (1/2) Features and benefits
- 10. Flexible User Interface Customized user-friendly GUI based on multiplatform or ribbon technologies Flexible User Access Accessibility from Internet, Intranet, LAN based on any Windows/Linux solution Open Interface Seamless and easy integration into Windows/Linux systems Flexible Customer Environment Availability for various customer environments and low cost customization to specific customer needs (down to offshore rates!) Sevana product & service offerings (2/2) Features and benefits
- 11. Preface Simple but powerful tool to provide perceptual voice quality testing and audio file comparison in terms of audio quality. This is the easiest way to compare two audio files and test voice quality loss between original and degraded files. Besides this a most demanded functionality of the software can also test audio codecs and generate audio signals for voice quality testing. Requirements Hardware: starting from a modern PDA OS: Windows/Linux/Other (when Java based) Audio: 8kHz, 16 bit, Mono 16kHz, 16bit, Mono, Stereo 22kHz-44kHz, 16bit, Mono, Stereo Features Generate test signals Test voice codecs Compare audio files (.pcm or .wav) Sevana Voice Quality Testing Technology
- 12. Our Customers Fixed line telecom operators Land lines voice quality ADSL/SIP voice quality Voice services (e.g. IVR) Mobile operators Call quality check and monitoring Voice services (e.g. IVR) Voice/audio streaming VoIP operators Call quality monitoring Network monitoring for VoIP calls VoIP IVR Automated voice quality feedback
- 13. Companies providing voice quality testing solutions Fixed lines Mobile VoIP Companies providing QoS monitoring solutions Fixed lines (ADSL/SIP) Mobile VoIP Network monitoring Companies providing IT solutions for health care Companies providing industrial solutions Companies providing audio/speech/music equipment consulting Voice related products manufacturers Companies providing environmental consulting Our Business Partners
- 14. Implementation Approach Available: Windows/Linux command line Windows DLL library Customizable: Windows Mobile Java Desktop
- 15. Business Solutions (1): Automated IVR systems testing Check IVR System for: Voice services availability Announcements correctness Recognized prompt and prompt parts Entire architecture of your IVR system Define and create KPIs
- 16. Business Solutions (2): Automated IVR systems testing IVR System Under Test IVR system available Telecom equipment for making calls and DTMF input available Test scenarios known Audio recordings available Testing process Make call Create interaction (send DTMF tone) Receive voice response Compare received voice response with the correct (original) one Still doing this manually? Using expensive SR?
- 17. Automate IVR systems testing Testing process Make call Create interaction (send DTMF tone) Receive voice response Compare received voice response with the correct one (original recording) by using Sevana Voice Quality Testing module: Original vs. Response = 80%-99% of similarity – correct! Original vs. Response < 60% of similarity – wrong! Otherwise – repeat test. Value: 1 test call takes 1 minute, 1 man hour costs 10 euros, amount of test calls 1000 (we know the numbers are really small!) Savings: over 166 euros, over 16 hours of work ROI: in reality after making 2001 test, this maybe less than 1 month!
- 18. Business Solutions(4): VQT in Mobile Networks Mobile device with a stored voice/audio of original quality initiating a call to “answering machine” Mobile network of any standard providing carrier to the “answering machine” and being reason for audio degradation “ Answering machine” when receiving a call plays back the same original audio to the mobile device Test network quality for voice transmission from a Windows Mobile enabled device in seconds! Mobile Network Originating a phone call Answering to phone call Playing recorded audio Receiving degraded sound
- 19. Business Solutions(5): VQ Monitoring Computer generating and storing “speech model” – a set of sounds typical for human speech – delivering to the reception side through carrier channel/trunk Network carrier: PSTN/GSM/3G/CDMA/IP Computer receiving degraded “speech model” and calculating voice quality value in % plus reasons for voice quality loss Test channels/trunks for voice quality continuously. No other equipment required than what you already have! Carrier Network Speech Model Signal Degraded Speech Model Signal
- 20. Business Solutions(6): VoIP: QoE Feedback Avoid asking VoIP users for voice quality feedback, automate receiving perceptual quality of experience values – make your system more customer friendly! On one end of VoIP conversation outgoing (original) and incoming (degraded) are recorded On the other end of VoIP conversation outgoing (original) and incoming (degraded) are recorded as well VoIP Network VQ Server tests original1 to degraded2 and degraded1 to original1 providing 2 values for voice quality of the conversation
- 21. Business Solutions(7): VoIP: QoS Monitor your VoIP provider by doing sudden tests and be aware that your provider maintains appropriate network and voice quality (especially if you signed SLA) Initiating a call would requite just the same client device/application and 1 license of Sevana Voice Quality Software Test voice quality in your VoIP environment and get back to your VoIP provider with questions on SLA and reasons for voice quality loss – you will be prepared with estimations and actual reasons what degrades voice quality in your network. VoIP network conditions as well as voice quality conditions may vary, but when you are paying for your VoIP provider you should have means to check the actual situation of voice quality in your VoIP VoIP Network Test HD Voice easily!
- 22. How to make it happen – the Procedure Consulting Study Analysis Solution Deployment Customization Implementation Testing Deployment Deployment Audit Support Benefits of the specially designed standardized procedure Fully fits into customer environment requirements Utilizes available hardware, software, resources and business processes Provides the best routes to optimize customer satisfaction
- 23. How to make it happen – Sevana Consulting Study Study existing customer goals and create wish-lists Inform customer about unknown options/possibilities/challenges Finalize customer’s wish-list Analysis Analyze available solutions, vendors, architectures, technologies Analyze HW/SW required and available, work out the best option Analyze costs involved, create POC (proof-of-concept) plan Solution Work out customer requirements specification Work out technical requirements specification Work out project deployment and implementation plan Value Ease and speed up deployment and implementation Increase ROI Tailored user satisfaction measurement Highly customized solution
- 24. Innovative approach The most competitive technology and pricing on the market We don’t sell expensive HW/SW testing equipment – we are making your own resources perform required tasks (turn your recording server into VQT server at the cost of 1 license !) Lowest software customization prices Most advanced multiplatform support Great potential for further feature expansion within the same support/maintenance contract Value Proposition: Why Sevana?
- 25. THANK YOU!