recovery of missing speech packets using the short-time energy and zero crossing measurements nurgun...

22
Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian, Senior Member, IEEE Hung, Kuo-En NTHU/CS, Visual Communication Lab.

Post on 21-Dec-2015

217 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing

Measurements

Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchia

n, Senior Member, IEEE

Hung, Kuo-En NTHU/CS, Visual Communication Lab.

Page 2: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Outline

• Introduction

• Waveform Substitution Based on the STE and the Zero-Crossing Information

• Experimental Results

• Analysis and Evaluation of the Reconstruction methods

• Conclusions

Page 3: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Introduction

• Short-time energy (STE)

• Zero-crossing Rate (STZR)

• Zero-crossing Locations (STZL)

Page 4: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Introduction (cont’d)

Page 5: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Waveform Substitution

2/)1(,...,,2/,0,11

isn Segment

1,...,1,0,by k packet in samplesSpeech

1

0

2 MnMMnnxM

n

Pllx

M

tkk

k

Page 6: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Waveform Substitution (Method A)

Page 7: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Method A (cont’d)

packet previous theof samplelast on the basedsign initial thesets:sgn[]

sin()factor adjacent on the changessign impose:)1(

1),(in support unit with r windowrectangula a is:

)()(

)()()(

10 ,)(

)sin(

)1()1(sgn)(

kpacket in STZL therepresent :,...,1 ,

1

01

i

iii

k

cr

ii

ii

i

Z

i

ikc

i

nnw

nne

nxnenx

Pnknnw

nn

nn

Pxnx

Zin

Page 8: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Waveform Substitution (Method B)

Page 9: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Method B (cont’d)

)()(

)()()(

))(sin()( 0

nne

nxnenx

nnZnx

k

cr

c

Page 10: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Waveform Substitution (cont’d)

zz

kkr

zzz

zZkr

kkr

kr

nPnnn

xPexPx

Pnnnn

nnPxnenx

PxePxx

nnnn

nnPxnenx

2;2

)0()( and )0()(

1),sin()1)](1(sgn[)()(

)1()1( and )1()1(

0),sin()]1(sgn[)()(

110

11

11

11

101

01

Page 11: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results

• Parameters(a) Packet loss rate

(b) Packet length

(c) STE window length

(d) Interpolation technique

Page 12: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

Page 13: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

Page 14: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

Page 15: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

Page 16: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

Page 17: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

Page 18: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

dBeYeXeXMSNR

dBinyinxinxI

nSNR

N

i

jwjwN

i

jw

I

i

l

i

iii

22/

0

22/

0

1

2

1

2

])()([)(log10

)]()([)(1

log10)(

Page 19: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

:Method A

: Method B

: Zero-stuffing

Page 20: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

Page 21: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Experimental Results (cont’d)

Page 22: Recovery of Missing Speech Packets Using the Short-Time Energy and Zero Crossing Measurements Nurgun Erdol, IEEE, Claude Castelluccia, and Ali Zilouchian,

Conclusions

• STE and STZL’s of a speech segment in a packet are sufficient parameters for reconstruction.

• Method A can be used until the packet loss rate get up to 40%

• Provide a smooth transition in energy