interactive content for subjective studies on web … · 2012-11-28 · lack of control...
TRANSCRIPT
- 1 - © FTW 2012
INTERACTIVE CONTENT FOR SUBJECTIVE STUDIES ON WEB BROWSING QOE: A KEPLER DERIVATIVE
Sebastian Egger, Raimund Schatz, Bruno Gardlo
- 2 - © FTW 2012 !
Web QoE Assessment 1/2
Goal is to quantify impact of: - QoS parameters - Usability - Design - Device Performance
on subjective quality perception of web browsing under realistic conditions
- 3 - © FTW 2012
Web QoE Assessment 2/2
Content Related Problems: § Lack of control (Advertisments, interactive elements)
§ External sites permanently changing
§ Server and internet performance fluctuations
§ Comparability between Labs
- 4 - © FTW 2012
Reliable Subjective Testing for
Web QoE enabled by
Realistic, Standardized
Reference Content
Motivation and Goal
- 5 - © FTW 2012
Content Framework Requirements
§ Locally stored § Representative for different Content Categories
- e.g.: News, Photo Album, Webshop, Map Services
§ Interactive Content - Updated daily - User interaction possible
§ Available in different languages § Customizable design in order to mimic certain
webpages § Customizable page weight § Mobile derivate of the framework § (somehow) coherent with existing Standards (Kepler)
- 6 - © FTW 2012
Content Categories
§ News
§ Photo Albums
- 7 - © FTW 2012
Content Categories ctd.
§ Webshops
§ Map Services
- 8 - © FTW 2012
Interactive Content and Language
§ Requirement 1: Allow for realistic tasks! § Requirement 2: Avoid user fatigue and boredom!
§ Sufficient amount of information for several Web QoE test conditions (each 2 – 3 minutes)
§ Interaction pattern must be realistic § Up to date information is important, especially for
news pages § Page content must be available locally § Language should be adaptable to target audience
- 9 - © FTW 2012
Design and Page Weight
§ New web test content framework must be able to mimic different web page designs.
§ Ideally different sites could be recreated by the same framework
§ Customizable page weight. - Emulate technical properties of existing sites àFuture proof
- 10 - © FTW 2012
Coherence with KEPLER
§ The new framework should be technically coherent with the existing Kepler page in terms of defined
- Object count and size - Object types - Object size distribution - Compressible / Incompressible objects
§ Additional feature(s) - Customizable page weight
- 11 - © FTW 2012
PROPOSED SOLUTION
- 12 - © FTW 2012
FTW’s solution 1/2
§ Automatically created web pages suitable for subjective testing
- Interactivity is ensured as pages have the same depth as the prototype page / RSS feed selected
- Several successive web QoE sessions can be conducted as the content is ‘deep’ enough.
§ Content Framework creates web page from harvested content in the database automatically
- Page appearance is defined via style sheets - Page style can be easily customized - Mobile version defined via style sheets
- 13 - © FTW 2012
FTW’s solution 2/2
§ Content: harvest information from selected prototype page through python script or RSS feeds
- Content fed into a local database - Freshness of content enabled by e.g. harvesting news every
day in an automated fashion - Language selection achieved via prototype page / RSS
feeds
§ Web page categories being implemented currently - News Page - Photopage
- 14 - © FTW 2012
Conclusion
§ Content for subjective Web QoE Tests on its way § Following requirements are met
- Local storage - Decent interactivity and content ‘depth’ - Configurable Language - Two content categories
§ Requirements not met (yet) - More content categories - Mobile derivate
§ Roadmap - Publication as part of Standardization Process within ETSI - Release Date: 12.12.2012
- 15 - © FTW 2012
Preview of the pages
News Page § http://dataworkers.eu/spiegel_new/www/
Photopage § http://dataworkers.eu/spiegel_new/www/fakebook/
Login data: Username: etsi PWD: testcontent12
- 16 - © FTW 2012
Thank you for your attention!
Questions / Suggestions ?