sentence unit detection in conversational dialogue
DESCRIPTION
Speaker B. Sentence Unit Detection in Conversational Dialogue. Speaker A. Prosodic features. Elizabeth Lingg , Tejaswi Tennetti , Anand Madhavan. it has a lot of garlic in it too does n't it. i it does . Sentence Units. . . LDC2009T01 - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/1.jpg)
Sentence Unit Detection in Conversational Dialogue
Elizabeth Lingg, Tejaswi Tennetti, Anand Madhavan
it has a lot of garlic in it too does n't it i it does
Speaker B
Speaker A
Prosodic features
<question> <statement> Sentence Units
![Page 2: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/2.jpg)
Dataset used
LDC2009T01English CTS Treebank with Structural metadata
Highlights• Fisher and Switchboard audio clips• Words annotated with POS tags• Sentence units labeled: • Question• Statement• Backchannel• Incomplete
![Page 3: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/3.jpg)
Prediction resultsFinal results of predictions with the best features chosen
![Page 4: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/4.jpg)
Effect of POS tags
![Page 5: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/5.jpg)
Effect of special words for backchannel identificationClub words like ‘mhm’, ‘oh yeah’ etc into a separate class and see if it helps in predicting backchannel better
Effects on other sentence units
![Page 6: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/6.jpg)
Miscellaneous features Previous sentence class prediction (faked as well as true)
Length of sentence so far or number of words so far (that have not been classified yet)
![Page 7: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/7.jpg)
Prosodic featuresF0F0 normalizedPause duration for speakerEnergyLength of wordPause length before wordWord pitch rangeEnergyEnergy normalized
![Page 8: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/8.jpg)
Prosodic featuresF0F0 normalizedPause duration for speakerEnergyLength of wordPause length before wordWord pitch rangeEnergyEnergy normalized
![Page 9: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/9.jpg)
Prosodic featuresn-gram prosodic features
![Page 10: Sentence Unit Detection in Conversational Dialogue](https://reader036.vdocuments.mx/reader036/viewer/2022062410/5681619a550346895dd14fc3/html5/thumbnails/10.jpg)
ReferencesEnriching Speech Recognition With Automatic Detection of Sentence Boundaries and Disfluencies, Yang Liu, Elizabeth Shriberg, Andreas Stolcke, Dustin Hillard, Mari Ostendorf and Mary Harper...