automated voice and audio quality test measurement

25
Making your voice quality testing easy Sevana Oy Endre Domiczi Mobile: +358 9 23164165 E-mail: [email protected]

Upload: sevana-oy

Post on 04-Dec-2014

1.358 views

Category:

Technology


1 download

DESCRIPTION

AQuA is a simple but powerful tool to provide perceptual voice quality testing and audio file comparison. This is the easiest way to compare two audio files and test sound signals quality between original and degraded files.

TRANSCRIPT

Page 1: Automated Voice And Audio Quality Test Measurement

Making your voice quality testing easy

Sevana Oy

Endre DomicziMobile: +358 9 23164165E-mail: [email protected]

Page 2: Automated Voice And Audio Quality Test Measurement

This Presentation• …is you to meet Sevana, it’s team, management, technology and services

• …is to discuss what one demands from a voice quality software in different systems devoted to test networks, codecs, QoS, QoE

• …is to present Sevana Voice Quality Testing approach and software

• …is to describe who is ideal partner or/and customer for Sevana Voice Quality Testing software

• …is to clearly show the benefits our customers obtain working with us

• …is to tell you why we think that Sevana is your trusted partner

Page 3: Automated Voice And Audio Quality Test Measurement

Company Presentation

Sevana Oy (Ltd) is a privately owned Helsinki based Finnish company established in 2003 as a software development company with the emphasis to emerging software technologies in telecom and industrial solutions.

Sevana Oy

Agrikolankatu 11

00530 Helsinki email: [email protected]

Finland tel. : +358 9 23164165

Page 4: Automated Voice And Audio Quality Test Measurement

Company management and shareholders

Sevana Oy (Ltd.) is currently owned by its founders and employees.

The company has three different international software research and development teams organized by product lines.

Sevana Oy (Ltd.) is lead by Mr. Endre Domiczi company CEO who is one of the main shareholders and co-founders. He is currently responsible for company operations and managing activities in Finland and European markets.

Page 5: Automated Voice And Audio Quality Test Measurement

What do we want from a voice quality system?

• Let’s consider voice quality from a user point of view:o We want to know when audio sounds good and when it sounds bado We want to be sure that if our customer uses our system to approach somebody the

one at the destination will be able to communicate with the one at the origino We want to have a possibility to predict how our system will work when brought liveo We want to speak, hear and be heard

We do not want to know HOW this is done, but we want to hear and be heard!

Sound’s good!

Page 6: Automated Voice And Audio Quality Test Measurement

What do we want you to get from a voice quality system?

• Let’s consider voice quality from a user point of view:o We want you to be able to automatically detect when audio sounds good and when it does not –

and thereby be able to easily predict user satisfaction in your oraganization (and among your product and services users)

o We want to be sure that when your customer uses voice quality concept and software system and approaches somebody, the one at the destination will be able to communicate with the one at the origin with 100% satisfaction.

o We want you to predict how our system will work when going liveo We want your customers to speak, hear, be heard and satisfied with the qualityo We want you to be able to demand clarifications from your voice carrier provider (fixed, mobile,

VoIP) referring to quantitative reasons for quality loss

We want you to hear and be heard with a 100% satisfaction!

Sound’s good!

Page 7: Automated Voice And Audio Quality Test Measurement

Cost-Effective Automated Testingo Avoid expensive, imprecise, time and effort consuming manual tests

Surveillanceo Continuous and precise monitoring of voice/audio service availability,

quality and performance (KQI, KPI)

Service Quality Managemento Precise measurement of voice/audio service availability, performance

and quality

Reportingo flexible, dynamic, automated reporting and alarming environment

Scalabilityo Starting from a small stand-alone or/and desktop to network distributed

systems

What does one typically demand from a voice quality system?

Page 8: Automated Voice And Audio Quality Test Measurement

Flexible User Interfaceo User-friendly and user-specific modern GUI

Flexible User Accesso Accessibility from Internet, Intranet, LAN, etc

Open Interfaceo Seamless and easy integration and combination of existing and new

tools

Flexible Customer Environmento Availability for various customer environments and adaptation to specific

customer needs

What does one typically demand from a voice quality system?

Page 9: Automated Voice And Audio Quality Test Measurement

Cost-Effective Automated Testingo Quick ROI when automating voice quality testing: when automating IVR systems

testing ROI period maybe less than 1 month!

Surveillanceo Integrating voice quality testing (VQT) module into your existing environment allows

easy, continuous and precise monitoring of service availability, quality and performance.

Service Quality Managemento Precise measurement of service availability, performance and quality is achieved by

ability to tune voice quality testing software utilizing a large variety of software parameters

Reportingo Automated reporting utilizing existing or introducing highly customized reporting

systems.

Scalabilityo Starting from a PDA or desktop to network distributed systems

Sevana product & service offerings (1/2)Features and benefits

Page 10: Automated Voice And Audio Quality Test Measurement

Flexible User Interfaceo Customized user-friendly GUI based on multiplatform or ribbon

technologies

Flexible User Accesso Accessibility from Internet, Intranet, LAN based on any Windows/Linux

solution

Open Interfaceo Seamless and easy integration into Windows/Linux systems

Flexible Customer Environmento Availability for various customer environments and low cost

customization to specific customer needs (down to offshore rates!)

Sevana product & service offerings (2/2)Features and benefits

Page 11: Automated Voice And Audio Quality Test Measurement

Prefaceo Simple but powerful tool to provide perceptual voice quality testing and audio file comparison

in terms of audio quality. This is the easiest way to compare two audio files and test voice quality loss between original and degraded files. Besides this a most demanded functionality of the software can also test audio codecs and generate audio signals for voice quality testing.

Requirementso Hardware: starting from a modern PDAo OS: Windows/Linux/Other (when Java based)o Audio:

o 8kHz, 16 bit, Monoo 16kHz, 16bit, Mono, Stereoo 22kHz-44kHz, 16bit, Mono, Stereo

Featureso Generate test signalso Test voice codecso Compare audio files (.pcm or .wav)

Sevana Voice Quality Testing Technology

Page 12: Automated Voice And Audio Quality Test Measurement

Our Customers

• Fixed line telecom operatorso Land lines voice qualityo ADSL/SIP voice qualityo Voice services (e.g. IVR)

• Mobile operatorso Call quality check and monitoringo Voice services (e.g. IVR)o Voice/audio streaming

• VoIP operatorso Call quality monitoringo Network monitoring for VoIP callso VoIP IVRo Automated voice quality feedback

Page 13: Automated Voice And Audio Quality Test Measurement

• Companies providing voice quality testing solutionso Fixed lineso Mobileo VoIP

• Companies providing QoS monitoring solutionso Fixed lines (ADSL/SIP)o Mobileo VoIPo Network monitoring

• Companies providing IT solutions for health care

• Companies providing industrial solutions

• Companies providing audio/speech/music equipment consulting

• Voice related products manufacturers

• Companies providing environmental consulting

Our Business Partners

Page 14: Automated Voice And Audio Quality Test Measurement

Implementation Approach

Block of signals

Estimation blockTest signalgenerator

Bank ofsignals

Deviceunder test

Syn

chro

nize

r

Analyticalmodule re

sult

Available:Windows/Linux command lineWindows DLL library

Customizable:Windows MobileJavaDesktop

Page 15: Automated Voice And Audio Quality Test Measurement

Business Solutions (1): Automated IVR systems testing

Check IVR System for:• Voice services availability• Announcements correctness• Recognized prompt and prompt parts• Entire architecture of your IVR system• Define and create KPIs

Page 16: Automated Voice And Audio Quality Test Measurement

Business Solutions (2): Automated IVR systems testing

IVR System Under Testo IVR system availableo Telecom equipment for making calls and DTMF input availableo Test scenarios knowno Audio recordings available

Testing processo Make callo Create interaction (send DTMF tone)o Receive voice responseo Compare received voice response with the correct (original) one

Still doing this

manually?

Using expensive

SR?

Page 17: Automated Voice And Audio Quality Test Measurement

Automate IVR systems testingTesting process

o Make callo Create interaction (send DTMF tone)o Receive voice responseo Compare received voice response with the correct one (original

recording) by using Sevana Voice Quality Testing module: Original vs. Response = 80%-99% of similarity – correct! Original vs. Response < 60% of similarity – wrong! Otherwise – repeat test.

Value: 1 test call takes 1 minute, 1 man hour costs 10 euros, amount of test calls 1000 (we know the numbers are really small!)Savings: over 166 euros, over 16 hours of work

ROI: in reality after making 2001 test, this maybe less than 1 month!

Page 18: Automated Voice And Audio Quality Test Measurement

Business Solutions(4): VQT in Mobile Networks

Mobile device with a stored voice/audio of original quality initiating a call to “answering machine”

Mobile network of any standard providing carrier to the “answering machine” and being reason for audio degradation

“Answering machine” when receiving a call plays back the same original audio to the mobile device

Test network quality for voice transmission from a Windows Mobile enabled device in seconds!

Mobile Network

Originating a phone callAnswering to phone call

Playing recorded audioReceiving degraded sound

Page 19: Automated Voice And Audio Quality Test Measurement

Business Solutions(5): VQ Monitoring

Computer generating and storing “speech model” – a set of sounds typical for human speech – delivering to the reception side through carrier channel/trunk

Network carrier: PSTN/GSM/3G/CDMA/IP

Computer receiving degraded “speech model” and calculating voice quality value in % plus reasons for voice quality loss

Test channels/trunks for voice quality continuously. No other equipment required than what you already have!

Carrier Network

Speech Model Signal

Degraded Speech Model Signal

Page 20: Automated Voice And Audio Quality Test Measurement

Business Solutions(6): VoIP: QoE Feedback

Avoid asking VoIP users for voice quality feedback, automate receiving perceptual quality of experience values – make your system more customer friendly!

On one end of VoIP conversation outgoing (original) and incoming (degraded) are recorded

On the other end of VoIP conversation outgoing (original) and incoming (degraded) are recorded as well

VoIP Network

VQ Server tests original1 to degraded2 and degraded1 to original1 providing 2 values for voice quality of the conversation

Page 21: Automated Voice And Audio Quality Test Measurement

Business Solutions(7): VoIP: QoS

Monitor your VoIP provider by doing sudden tests and be aware that your provider maintains appropriate network and voice quality (especially if you signed SLA)

Initiating a call would requite just the same client device/application and 1 license of Sevana Voice Quality Software

Test voice quality in your VoIP environment and get back to your VoIP provider with questions on SLA and reasons for voice quality loss – you will be prepared with estimations and actual reasons what degrades voice quality in your network.

VoIP network conditions as well as voice quality conditions may vary, but when you are paying for your VoIP provider you should have means to check the actual situation of voice quality in your VoIP

VoIP Network

Test HD Voice easily!

Page 22: Automated Voice And Audio Quality Test Measurement

How to make it happen – the Procedure• Consulting

o Studyo Analysiso Solution

• Deploymento Customizationo Implementationo Testing

• Deploymento Deploymento Audito Support

• Benefits of the specially designed standardized procedureo Fully fits into customer environment requirementso Utilizes available hardware, software, resources and business processeso Provides the best routes to optimize customer satisfaction

Page 23: Automated Voice And Audio Quality Test Measurement

How to make it happen – Sevana Consulting• Study

o Study existing customer goals and create wish-listso Inform customer about unknown options/possibilities/challengeso Finalize customer’s wish-list

• Analysiso Analyze available solutions, vendors, architectures, technologieso Analyze HW/SW required and available, work out the best optiono Analyze costs involved, create POC (proof-of-concept) plan

• Solutiono Work out customer requirements specificationo Work out technical requirements specificationo Work out project deployment and implementation plan

• Valueo Ease and speed up deployment and implementationo Increase ROIo Tailored user satisfaction measuremento Highly customized solution

Page 24: Automated Voice And Audio Quality Test Measurement

• Innovative approach

• The most competitive technology and pricing on the market

• We don’t sell expensive HW/SW testing equipment – we are making your own resources perform required tasks (turn your recording server into VQT server at the cost of 1 license!)

• Lowest software customization prices

• Most advanced multiplatform support

• Great potential for further feature expansion within the same support/maintenance contract

Value Proposition: Why Sevana?

Page 25: Automated Voice And Audio Quality Test Measurement

THANK YOU!