PISTE – Progress Report

Thanos M. Demiris, PhDINTRACOM S.A.

dema@intracom.gr

A short project overview

• Provision of:– Tools to broadcasters for creating

augmented reality views of sports events– Tools for encoding and viewing rich

interactive multimedia content in MPEG-4 on consumer electronics

– Assessment of DVB infrastructure in supporting large scale virtual environments

Application Mock-ups – Part I

Application Mock-ups – Part II

Work-Packages

1. User Requirements 35 PMs2. System Design 42 PMs3. Implementation of the server platform

251 PMs4. Implementation of the receiver platform

70 PMs5. System integration and testing 30 PMs6. Trials 48 PMs7. Market acceptance and exploitation

32 PMs8. Project management 35 PMs

Active Work-Tasks

WP 11.1 User requirements definition1.2 Survey of related systems and

applications1.3 Identification and specification of

application scenariosWP 22.1 Design of the overall architecture2.2 Design of the server platform2.3 Design of the receiver platform

Requirements collection procedure

Collect & Classify Criteria

Requirements Collection

End-Users

Internal Actor 1

Internal Actor N

…

Homogenization&

GeneralizationRequirements

Requirements

Requirements

Appli-cation

Require-ments

QuestionnaireInternal UsersExternal Users

quest

feedback

UML Use Cases

Work-Task 1.1: Excerpt from TA

Workpackage

Responsible

ICOM UoC TMMRDF

CNET

TELTEC

PUE FhG/IGD

PHL ERT IMT EPFL Total

1.1 ERT 2 1 1 1 1 1 1 2 2 1 1 14

1.2 IMT 2 1 0 0 1 1 0 1 1 1 0 8

1.3 ICOM

2 1 1 1 1 1 1 1 2 1 1 13

The users of the consortium will participate in the identification of PISTE’s actors and the provision of these actor’s requirements. These requirements will be analysed and organised by the Technology providers in a requirements

specification document.

For the specification of the user requirements the UML (Unified Modelling Language) Use Case Model will be utilised.

User questionnaires

• Interviews with involved broadcasters

• Previous experience of partners previously involved in the domain

• Web questionnaires for:– Broadcasters– Athletes– Viewers (spectators)

• Publication of links to questionnaires within related sites

http://piste.intranet.gr/public

Status of the user survey

• Most representative sample: viewers

• Further contact with broadcasters postponed until after the Olympics– Collection of organizational experience– Camera positioning– Data collection

• The inclusion of mock-ups in the questionnaires attracts more participants

Current results

• Valuable information about the possible deployment environment

• Information about the role of the people involved in a live sports transmission

• Concrete information flow• Data dictionary

Overall conclusions:• Results corresponding in their majority to

the expectations of the consortium• Statistical evaluation due end of October

Work-Task 1.2: Excerpt from TA

Workpackage

Responsible

ICOM UoC TMMRDF

CNET

TELTEC

PUE FhG/IGD

PHL ERT IMT EPFL Total

1.1 ERT 2 1 1 1 1 1 1 2 2 1 1 14

1.2 IMT 2 1 0 0 1 1 0 1 1 1 0 8

1.3 ICOM

2 1 1 1 1 1 1 1 2 1 1 13

In addition this WP will provide a survey of PISTE related applications which will help in gaining an overall idea of the field, and identifying suitable

market domains. The results of this task will will assist the work of WP7 relative to market survey and positioning of the PISTE system. Moreover, it

will define the technical aspects to be accomplished by the technical activities. Special attention will be given to the Games Industry.

Domains investigated I

• Broadcasting software – SONY– ORAD

• Related authoring tools– REALVIZ MatchMover– Pinnacle PCTV

• Products and white papers in the realm of interactive TV– Oracle– PHILIPS Set top box– Nokia integrated MM device

Domains investigated II

• Related projects and forums– MPEG– MHP– TV Anytime– Web 3D

• Games industry: software and hardware achievements – Sydney 2000 (official Olympics Game)– FIFA 2000, NHL 2000– Microsoft X-Box

Work-Task 1.3: Excerpt from TA

Workpackage

Responsible

ICOM UoC TMMRDF

CNET

TELTEC

PUE FhG/IGD

PHL ERT IMT EPFL Total

1.1 ERT 2 1 1 1 1 1 1 2 2 1 1 14

1.2 IMT 2 1 0 0 1 1 0 1 1 1 0 8

1.3 ICOM

2 1 1 1 1 1 1 1 2 1 1 13

The requirements specification document together with the market survey will be used for the definition of realistic Application Scenarios that in turn will form

the basis for the definition of Trials in WP6.

Finalization of specifications

Task 1.1:

User Require-

ments

Task 1.2:

Related Applications

Trade-off

feedback

Task 1.3:ApplicationScenario

UML Use Cases

+ CollaborationDiagrams

End-userrequirements

Performancerequirements

Interfacerequirements

Resourcerequirements

Internal Actorrequirements

Users

Application Scenarios - Categories

• Olympic sports (28 sports/296 events) categorization:– Number of athletes involved– Equipment necessary– Cameras necessary for full coverage– Background settings

• Broadcaster tasks

• Viewer interaction

Work-Task 2.1: Excerpt from TAWorkpackage

Responsible

ICOM UoC TMMRDF

CNET

TELTEC

PUE FhG/IGD

PHL ERT IMT EPFL Total

2.1 ICOM

3 1 2 2 1 2 1 0 0 1 1 14

Technology and research members of the consortium will design the PISTE system in terms of: a) The system components definition, together with their associated functions;b) Identification of the interfaces among the components; c) Data model of the PISTE database; and d) Standards evaluation and rational.

The specification and design of the PISTE system and its components will be carried out through the use of Object Oriented Techniques, and a unified design approach will be achieved through the use of UML as a Modelling Language.

At the end of Workpackage's first month, a concise deliverable (i.e. D2) will be distributed providing the framework of the subsequent PISTE developments in terms of platform specification and software tools organisation.

Planning of the design

• Mock-ups prepared– Static mock-ups

• Authoring tool for the broadcasters• Examples of the outcome reaching the

viewer

– Dynamic mock-ups• Communication APIs implementation

• Design of sender and receiver platforms proceeding in sub-groups

Sketch of the deployment architecture

Authoring StationWindows NT/2000>= 256MB MM75GB HDDPowerful 3D Graphics Card(e.g. Riva TNT, G-Force, ASUS V7700DDR etc.)

Oracle DatabaseWindows NT/2000 or Solaris>= 256MB MM> 75GB HDD

High-speed local connection

Demonstration PlatformWindows NT/2000

DVB / Back-link

Clustering

• Seeking co-operation with VIRTUE in the realm of algorithms for image analysis and mosaicking

• Further possibilities in the areas of:– MPEG-4 encoding/players– Next generation set-top-boxes