geneva, switzerland, 25 october 2013

18
Geneva, Switzerland, 25 October 2013 Access Services for TV Quality Metrics and Challenges in the Provision of Live Closed Captioning in Brazil Gabriela Campedelli Cidade do Conhecimento USP, Brazil <[email protected]> ITU Workshop on “Making Media Accessible to all: The options and the economics” (Geneva, Switzerland, 24 (p.m.) – 25 October 2013)

Upload: glora

Post on 14-Jan-2016

41 views

Category:

Documents


2 download

DESCRIPTION

ITU Workshop on “ Making Media Accessible to all: The options and the economics ” (Geneva, Switzerland, 24 (p.m.) – 25 October 2013). Access Services for TV Quality Metrics and Challenges in the Provision of Live Closed Captioning in Brazil. Gabriela Campedelli - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013

Access Services for TVQuality Metrics and Challenges in the Provision

of Live Closed Captioning in Brazil

Gabriela Campedelli Cidade do Conhecimento USP, Brazil

<[email protected]>

ITU Workshop on “Making Media Accessible to all:The options and the economics”

(Geneva, Switzerland, 24 (p.m.) – 25 October 2013)

Page 2: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 2

Background data

Population 201 millionArea 8.5 million km2

An estimated 16 million Brazilians (8%) have special needsFree-to-air TV still important Internet surfing approaching same numbers as TV.

Page 3: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 3

TV in Brazil

Analogue terrestrial broadcastingFederative broadcasting model:

All local stationsNetwork composed by local content affiliates

Digital terrestrial TV ISDB-T started in 2007Analog swicth-off planned for 2016 (option to extend deadline)

Page 4: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 4

TV genres in Brazil

The programming provider station and affiliates all offer pre-recorded and live programming:

News and current affairsGeneral entertainmentTelenovelasPre-recorded soaps and seriesMoviesReality showsMusic shows

Page 5: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 5

TV access services in Brazil

Demand5+ million individuals (2.5%) who are deaf or have recognized, serious hearing impairments

Supply14 hours daily (from 6 am to 2 am) – regulator only counts 2 hours from 2 am to 6 am 6 hours (6-14) and 6 hours (17 – 02)Regulatory framework applies to all free-to-air TV in cities with 500,000+ inhabitants

Page 6: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 6

TV captioning - metrics

NORMA BRASILEIRA ABNT NBR 15290 Primeira edição 31.10.2005 Acessibilidade em

comunicação na televisão [Accessibility in TV captions]

Predates legislation and audience research on deafness and accessibility!Based on ’old’ US and Canadian standardsSpecifications for captioning, video description and sign language

Page 7: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 7

TV captioning - metrics

Closed captioningCaptioning delay max. 4 seconds (live) or frame-accurate (pre-recorded content) [c.f. 4.1.9 Sincronia]

Minimum/maximum display times depending on whether there are one, two or three lines of captioning [c.f. 4.2.8 Tempo de exposição]

Verbatim captioning for live closed captioning98% accuracy threshold for live captioning

Page 8: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 8

TV captioning - metrics

No specification of how this is to be measured (c.f. NER model – Spain – AENOR 15390)NCRA in USA uses as parameter for quality of transcriptions for live stenotype but these are not mandatory thereNo mention of the research on which these metrics were based

Page 9: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 9

TV captioning - evidence

Users in Brazil report inobservancy in ABNT metricsSynchronicity in ABNT metrics are impossible to achieveBBC’s recent paper by Mike Armstrong

demonstrated the link between syncronicity and perceived quality by viewers.

Source: Mike Amstrong (2013). THE DEVELOPMENT OF A METHODOLOGY TO EVALUATE THE PERCEIVED QUALITY OF LIVE TV SUBTITLES. BBC R&D, UK, IBC 2013.

Page 10: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 10

TV captioning - evidence

Page 11: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 11

TV captioning - evidence

"The clearest trend for timing was for people watching with sound where there was a strong and statistically significant increase in the quality score with improved timing (reduced delay).For the range of timings tested, each 1 second reduction in the subtitle delay gave just over 5 points improvement in the quality score."

Page 12: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 12

TV captioning - evidence

The presentation time of each caption also depends on: Presentation form (Pop-up or Roll-on)Liguistic issues (verbatim or linguistic condensation to reduce the required reading speed). Are we using the research that has already be done in this field?

Page 13: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 13

TV captioning – other issues affecting quality

Analog TVAtmospheric interference (heavy rain etc)Strange characters due to problems in signal transmission over countryTelecommunications problems

Digital TVBlocking and other artifacts.

Page 14: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 14

TV captioning – options to improve quality

Reducing the delay in live CCReviewing the service end-to-end to identify ways of reducing the delayIssues with Emergency AlertsImprovements in Re-speaking (speech recognition)Stenography (adjustments in brazilian portuguese vocabulary)

Page 15: Geneva, Switzerland, 25 October 2013

Other Technologies in Accessibility

LIBRAS APP – signing language Prize WSA-MobilePossible use in secondScreen

Geneva, Switzerland, 24 October 2013 15

Page 16: Geneva, Switzerland, 25 October 2013

Other uses of closed captioning

BOX Fish (TV API) search engine (USA)

Commercial app in second screen market http://www.niemanlab.org/2012/12/opened-captions-turning-the-spoken-words-on-tv-screens-into-streams-of-hackable-data/

Could accessibility services in communication be called metadata in order to include technology in market?

Geneva, Switzerland, 24 October 2013 16

Page 17: Geneva, Switzerland, 25 October 2013

Geneva, Switzerland, 25 October 2013 17

TV captioning – conclusions

Setting tough mandatory quality metrics is no guarantee of captioning quality if the targets are impossible to achieveQuality metrics can vary from language to languageCultural factors are involvedTechnology & methodology crucialNeed for more research with audience to deliver closed captioning to promote understandingUnderstanding is the best metric

Page 18: Geneva, Switzerland, 25 October 2013

Thank you!

Gabriela Campedelli +55 11 97637 9099

[email protected]://www.cidade.usp.br

LinkedIn: http://www.linkedin.com/profile/view?id=203273681&trk=wvmp-profile

Lattes: http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4228482E6Geneva, Switzerland, 25 October 2013 18