interactive content for subjective studies on web … · 2012-11-28 · lack of control...

16
- 1 - © FTW 2012 INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB BROWSING QOE: A KEPLER DERIVATIVE Sebastian Egger, Raimund Schatz, Bruno Gardlo

Upload: others

Post on 02-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 1 - © FTW 2012

INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB BROWSING QOE: A KEPLER DERIVATIVE

Sebastian Egger, Raimund Schatz, Bruno Gardlo

Page 2: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 2 - © FTW 2012 !

Web QoE Assessment 1/2

Goal is to quantify impact of: -  QoS parameters -  Usability -  Design -  Device Performance

on subjective quality perception of web browsing under realistic conditions

Page 3: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 3 - © FTW 2012

Web QoE Assessment 2/2

Content Related Problems: §  Lack of control (Advertisments, interactive elements)

§  External sites permanently changing

§  Server and internet performance fluctuations

§  Comparability between Labs

Page 4: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 4 - © FTW 2012

Reliable Subjective Testing for

Web QoE enabled by

Realistic, Standardized

Reference Content

Motivation and Goal

Page 5: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 5 - © FTW 2012

Content Framework Requirements

§  Locally stored §  Representative for different Content Categories

-  e.g.: News, Photo Album, Webshop, Map Services

§  Interactive Content -  Updated daily -  User interaction possible

§  Available in different languages §  Customizable design in order to mimic certain

webpages §  Customizable page weight §  Mobile derivate of the framework §  (somehow) coherent with existing Standards (Kepler)

Page 6: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 6 - © FTW 2012

Content Categories

§  News

§  Photo Albums

Page 7: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 7 - © FTW 2012

Content Categories ctd.

§  Webshops

§  Map Services

Page 8: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 8 - © FTW 2012

Interactive Content and Language

§  Requirement 1: Allow for realistic tasks! §  Requirement 2: Avoid user fatigue and boredom!

§  Sufficient amount of information for several Web QoE test conditions (each 2 – 3 minutes)

§  Interaction pattern must be realistic §  Up to date information is important, especially for

news pages §  Page content must be available locally §  Language should be adaptable to target audience

Page 9: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 9 - © FTW 2012

Design and Page Weight

§  New web test content framework must be able to mimic different web page designs.

§  Ideally different sites could be recreated by the same framework

§  Customizable page weight. -  Emulate technical properties of existing sites àFuture proof

Page 10: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 10 - © FTW 2012

Coherence with KEPLER

§  The new framework should be technically coherent with the existing Kepler page in terms of defined

-  Object count and size -  Object types -  Object size distribution -  Compressible / Incompressible objects

§  Additional feature(s) -  Customizable page weight

Page 11: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 11 - © FTW 2012

PROPOSED SOLUTION

Page 12: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 12 - © FTW 2012

FTW’s solution 1/2

§  Automatically created web pages suitable for subjective testing

-  Interactivity is ensured as pages have the same depth as the prototype page / RSS feed selected

-  Several successive web QoE sessions can be conducted as the content is ‘deep’ enough.

§  Content Framework creates web page from harvested content in the database automatically

-  Page appearance is defined via style sheets -  Page style can be easily customized -  Mobile version defined via style sheets

Page 13: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 13 - © FTW 2012

FTW’s solution 2/2

§  Content: harvest information from selected prototype page through python script or RSS feeds

-  Content fed into a local database -  Freshness of content enabled by e.g. harvesting news every

day in an automated fashion -  Language selection achieved via prototype page / RSS

feeds

§  Web page categories being implemented currently -  News Page -  Photopage

Page 14: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 14 - © FTW 2012

Conclusion

§  Content for subjective Web QoE Tests on its way §  Following requirements are met

-  Local storage -  Decent interactivity and content ‘depth’ -  Configurable Language -  Two content categories

§  Requirements not met (yet) -  More content categories -  Mobile derivate

§  Roadmap -  Publication as part of Standardization Process within ETSI -  Release Date: 12.12.2012

Page 15: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 15 - © FTW 2012

Preview of the pages

News Page §  http://dataworkers.eu/spiegel_new/www/

Photopage §  http://dataworkers.eu/spiegel_new/www/fakebook/

Login data: Username: etsi PWD: testcontent12

Page 16: INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB … · 2012-11-28 · Lack of control (Advertisments, interactive elements) ! External sites permanently changing ! Server and internet

- 16 - © FTW 2012

Thank you for your attention!

Questions / Suggestions ?