clearsight video and audio quality evaluation seminar
TRANSCRIPT
![Page 1: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/1.jpg)
ClearSight Video and Audio Quality Evaluation Seminar
--Triple Play Analysis--
ClearSight Networks, Inc.
ClearSight Networks, Inc.
![Page 2: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/2.jpg)
Sehedule
10:00 - 10:20 ClearSight Analyzer ・ ClearSight Networks Overview・ Product Overview
10:20 – 10:45 Audio and Video quality measurement ・ Audio quality measurement ・ Video quality measurement ・ MDI and VQFactor
10:45 - 11:30 Audio/Video in actual environment
ClearSight Analyzer measures audio/video quality when connection fault (delay, packet loss) occurs.
11:30 - 11:45 IPTV analysis method11:45 - 12:00 Question and Answer
![Page 3: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/3.jpg)
At the Seminar Start (background)
You have not established the method to evaluate video quality
Video service has begun IPTV, VOD and TV meeting, [sekiyuriitei] supervisory camera
......
It is necessary to analyze audio and video simultaneously. Video data record needs large storage HDD Long time monitor is needed when there is intermittent fault.
It is difficult to troubleshooting
![Page 4: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/4.jpg)
ClearSight Networks and Analyzer
![Page 5: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/5.jpg)
ClearSight Introduction
ClearSight Networks, Inc.
Start 2002Location Fremont, CA, US
![Page 6: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/6.jpg)
Media and Awards
![Page 7: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/7.jpg)
Customer (in US)
![Page 8: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/8.jpg)
Top to down Analysis Process ofClearSight Analyzer
![Page 9: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/9.jpg)
STEP1. Classify Application
・ Top to down analysis process of ClearSight Analyzer
The number of servers, flows, problems, issues and throughput in each application
![Page 10: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/10.jpg)
STEP2. Ladder View
・ It shows application flow ladder view between server and client.
It will show fault in red or yellow when communication error occurs.
![Page 11: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/11.jpg)
STEP3. Decode Screen
Only the packet in ladder view will be filtered to show in Decode screen
Protocol Decode Details
![Page 12: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/12.jpg)
STEP4. Application Content Placyback
HTTP reassemble
Audio/Video Playback
User activity and content of FTP, Telnet, E-mail, Database, VoIP application etc. can be played back.
![Page 13: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/13.jpg)
・ Triple-Play Distribution
Step5. Report
Ration of application data, audio and video is shown in this graph. When troubleshooting, you can grasp the change of respective application distribution at a glance.
・ HTTP Report
![Page 14: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/14.jpg)
ClearSight Product Line
![Page 15: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/15.jpg)
ClearSight Analyzer Product Line with Triple-play
ClearSightClearSight Analyzer SeriesAnalyzer Series 10/100M10/100M Software AnalyzerSoftware Analyzer 10/100M10/100M Full Duplex Laptop AnalyzerFull Duplex Laptop Analyzer 10/100/Gigabit10/100/Gigabit Portable PC AnalyzerPortable PC Analyzer 10G10G Portable PC AnalyzerPortable PC Analyzer
ClearSight Network Time MachineClearSight Network Time Machine Ser Seriesies Rack-mountedRack-mounted PortablePortable
![Page 16: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/16.jpg)
ClearSightClearSight Analyzer SeriesAnalyzer Series 10/100M10/100M Software VersionSoftware Version
Application Drill-down Analysis
Ladder view
Real time application flow analysis
Japanese support!!
The user interface is intuitive and easy to know
Playback
Playing back application content from packet
Sniffer, Ethereal trace file compatibility
![Page 17: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/17.jpg)
10/100/Gigabit10/100/Gigabit Portable PC versionPortable PC version
The traffic on duplex gigabit ethernet will be separated into ChA/ChB to analyze.
Real time application flow analysis (Ladder view) can be used
10 nsec time stamp resolution
![Page 18: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/18.jpg)
10/100M10/100M Full Duplex Laptop VersionFull Duplex Laptop Version
Bidirectional traffic on 10/100M full duplex ethernet will be separated when flowing over TAP with 2 NIC monitoring simultaneously.
The bidirectional application traffic which is taken from 2 NICs dividing into ChA/ChB can be integrated to display and analyze.
ClearSight individual real time application flow analysis (ladder view) can be used
![Page 19: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/19.jpg)
ClearSightClearSight Analyzer SeriesAnalyzer Series10Gb Analyzer10Gb Analyzer
■Full wire-rate capture 2GB capture capacity is available at full wire rate by using analyzer exclusive onboard memory for NIC.
■Filter Trigger The onboard filter trigger can be used in wire-rate environment. The trigger can be defined as Mac address, IP address or Pattern match.
■Statistic Number of frames, number of bytes, various environment error data, VLAN and other statistics are offered.
■The powerful ClearSight analysis function You can analyze captured data with ClearSight Analyzer. ClearSight individual Ladder view, Application playback and Triple-play analysis functions can be used.
New
![Page 20: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/20.jpg)
ClearSight Network Time MachineClearSight Network Time Machine SeriesSeriesRack-mounted VersionRack-mounted Version
Product Name Economy(CSR-4420) Standard(CSR-4430) Premium(CSR-4431)
CPU Single 3.0 GHz Xeon Dual 3.0 GHz Xeon Dual 3.0 GHz Xeon
Memory 4 GB RAM 4 GB RAM 4 GB RAM
OS Windows Server 2003 Windows Server 2003 Windows Server 2003
Capture Filter × ○ ○
Slicing × ○ ○
Analysis Function
Post analysisPost analysis/Real-time an
alysisPost analysis/Real-time an
alysis
HDD Capacity0.7 TB ( OS and packet sto
rage 、 meta data * storage )1.5 TB ( OS and packet stor
age 、 meta data * storage )
3.3 TB ( packet storage )
300 GB ( meta data * storage )
HDD Sstructure RAID 0 RAID 0 RAID 50
Expandability - - Up to 9.9 TB
Image
![Page 21: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/21.jpg)
ClearSight Network Time MachineClearSight Network Time Machine Series SeriesPortable VersionPortable Version
Product Name Network Time Machine Portable (CSR-4530HR)
CPU Dual-Core AMD Opteron™ Processor 2.2GHz
Memory 4 GB RAM
OS Microsoft Windows XP Professional SP2
Capture Filter ○
Slicing ○
Analysis Function Post analysis / Real time analysis
HDD Capacity・ Capture capacity: 370GB
・ OS/Statistic capacity: 100GB
HDD Structure RAID 0
Monitor port ・ 10/100/1000Base-T ×2
・ SFP connector (multi mode/single mode) ×2
Size/Weight42.7cm(W) x 29.1cm(H) x 11.2cm(D) 、 8.8Kg
(with tote case)
New
![Page 22: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/22.jpg)
VoIP Audio Quality Evaluation
![Page 23: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/23.jpg)
VoIP Ladder View
・ Ladder View Screen
![Page 24: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/24.jpg)
Major cause audio quality decreased・ Packet loss・ Out of sequence・ Jitter・ Delay and so on
Audio quality evaluation method・ R-Value ( Max : 93.2 )・ MOS ( Max : 5 )
Audio Quality Measurement
![Page 25: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/25.jpg)
Statistics・ RTP Statistic Screen
![Page 26: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/26.jpg)
Alert
・ RTP related threshold
・ Alarm Indication
![Page 27: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/27.jpg)
Call Log Browser
Report ItemCall Status
Number of Calls
Call Duration
MOS Summary
MOS Distribution
R-Value Distribution
・ Call Information
![Page 28: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/28.jpg)
Report (Quality Report)・ Audio Quality Report for each
Call
![Page 29: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/29.jpg)
Report (History Report)・ History Report
・ MOS Summary History Report
![Page 30: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/30.jpg)
Audio Playback
・ ClearSight support Codecs
![Page 31: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/31.jpg)
Video Quality Evaluation
![Page 32: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/32.jpg)
Video Data
・ TV Meeting・ IPTV - IP Broadcast Service - VOD Service
・ Internet TV and so on
![Page 33: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/33.jpg)
・ Packet loss-RTP-IPv6 fragment packet
・ Out of sequence・ Jitter・ Delay
Video Quality Measurement
![Page 34: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/34.jpg)
Video Quality Measurement Statistics
・ Statisitics
![Page 35: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/35.jpg)
Video Quality Measurement Methods
R-value and MOS are for Audio, what is for Video…?
• MDI ( Media Delivery Index ) - Stipulated by RFC4445
• VQFactor - ClearSight specific factor
![Page 36: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/36.jpg)
MDI ( Media Delivery Index )
• DF ( Delay Factor ) buffer estimationDF ( per unit time )=( max ( X ) -
min ( X )) /Media rate X=byte media rate=byte/second
• MLR ( Media Loss Rate )MLR ( per unit time ) = ( packet loss + out
of sequence ) /elapse time
![Page 37: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/37.jpg)
VQFactor
The VQFactor, whose highest value is 5, considers the following causes of quality deterioration.
・ Bandwidth ( Depend on Codec )
E.g. H.263 Low : 20kbps High : 192kbpsH.264 Low : 20kbps High :
768kbpsMPEG4 Low : 28kbps High :
1024kbpsMPEG2 Low : 1Mbps High :
12Mbps
・ Packet loss・ Network delay・ Jitter
![Page 38: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/38.jpg)
Technology Comparison
VQ-Factor MDI
Passive Video Quality Y Y
Packet loss reference Y Y
Codec reference Y N
Video MOS Value Y N
Accuracy ( consideration )
High Low
![Page 39: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/39.jpg)
Video Quality MeasurementVQFactor and MDI Statistics
・ Statistics
![Page 40: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/40.jpg)
MPEG Statistics
• MPEG Statistics– 3 -type frames
• I-frame –Image the whole screen is included • P–frame – It is estimated from the last I frame or th
e P frame • B–frame – It is estimated from the last and the nex
t I frame or the P frame
![Page 41: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/41.jpg)
MPEG Stats
I-Frame Stat
P-Frame Stat
B-Frame Stat
![Page 42: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/42.jpg)
Video Codec
• Codecs
– To encode and decode video steam– Individual stream bandwidth is decided by th
e using codec – Sensitivity of Jitter and Packet loss is decide
d by the codec
![Page 43: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/43.jpg)
Video Codec
• ClearSight playback supports codecs :– H.264 (Baseline, Main, Extend)– MPEG2-TS – MPEG2 layer II – MPEG4– iLBC (internet Low Bit Rate Codec)– JPEG (411, 422, 111)– H.263 (Mode A Mode B)– ASF (Windows Media Advanced System format)
![Page 44: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/44.jpg)
Video Quality Alarm
• Alarm– Several deterioration
causes can be set• RTP packet loss
• IPv6 fragment loss
• Out of sequence
• Jitter
• VQFactor
• MDI and so on
・ Alarm threshold setting
・ Alarm Screen
![Page 45: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/45.jpg)
Video Quality Report• Video Quality Report
– IPTV video steam report can be editted just like VoIP quality report.
– The report is useful although faults classification is specified
・ Jitter Report・ VQFactor Report
![Page 46: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/46.jpg)
Move connecting point
![Page 47: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/47.jpg)
Demo Environment
![Page 48: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/48.jpg)
Delay Generating Device Summary
■ Features * Even in the emulate environment (64byte 100%), it can en
sure full wire rate capture. * Delay can be set by 1 bit ( 0.1ns @ 10Gbps ) * Usually we support delay from 250ms to 1s, and additional
delay can be optional. * Support various error types (Bit Error, Packet Loss, Fluctu
ation (Jitter), Order Replacement, Data Rewriting, LOS, Link Down and so on)
■ Application * Network device efficiency and function evaluation * Video transport quality verification (IPTV and streaming) * Quality verification for VoIP delay, fluctuation and packet lo
ss.
![Page 49: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/49.jpg)
ANUE circuit fault device(Packet loss, Delay )
SIP Server192.168.6.1
Demo Environment
Client192.168.7.2Telephone
111
Client192.168.7.3
Telephone222ClearSight Analyzer
HUB HUB
ClearSight Measurement
![Page 50: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/50.jpg)
Video quality problem solving steps
1. The normal standard VQFactor measured such as measuring result in lab environment
2. Measuring VQFactor at user’s place
3. Jitter, Packet loss, Delay verification• It can separate network data other than above
4. Problem Reason Investigation• Network• Video • Receive device
ClearSight Best Solution
![Page 51: ClearSight Video and Audio Quality Evaluation Seminar](https://reader037.vdocuments.mx/reader037/viewer/2022102815/556d0c42d8b42ad34f8b4d25/html5/thumbnails/51.jpg)
Thank You!