Resource Annotation and Delivery for Mobile Augmented Reality Services

Martin MemmelKnowledge Management Group

German Research Center for Artificial Intelligence (DFKI GmbH)martin.memmel@dfki.de

© 2010 Martin Memmel

Aachen, 2010/02/26

Outline

● Augmented Reality Services & Key Problems● The RADAR Project● Sample Use Cases

© 2010 Martin Memmel

The Mobile Web is Growing

© 2010 Martin Memmel

http://www.morganstanley.com/institutional/techresearch/internet_ad_trends102009.html

http://www.opera.com/media/smw/2009/pdf/smw092009.pdf

Augmented Reality Services

© 2010 Martin Memmel

http://layar.com

http://www.wikitude.org

http://www.aloqa.com

http://www.flickr.com/photos/bradybd/2818154005/

Key Questions

© 2010 Martin Memmel

Key Questions

● What kinds of contents can be used?● Who can contribute contents?● Which applications can use these contents?● Must it be a one-size-fits-all!?

© 2010 Martin Memmel

The RADAR Project

© 2010 Martin Memmel

RADAR – Project Aims

● Making the abundance of location-dependent digital resources available in AR Services– Social Web, Semantic Web, Repositories (e.g., public

inventories)● Allow contributions of end users

– Crowdsourcing, Collective Intelligence● Adapters for existing services● Development of a prototypical, personalized and

location-based Augmented Reality Service

© 2010 Martin Memmel

Our Approach:An Open Ecosystem

© 2010 Martin Memmel

RADAR – Approach

● Development of an infrastructure to contribute, organize and annotate multimedia resources that can be used within Augmented Reality Services– free of charge wherever possible– focus on design and usability– use of open standards, formats for the integration of all

established types of multimedia content– reusability of contents– integrability of services in other contexts

(interoperability)© 2010 Martin Memmel

Adaptation of ALOE as a Backbone

© 2010 Martin Memmel

http://aloe-project.de

What is ALOE?

● ALOE is a system for collaborative sharing and annotation of arbitrary multimedia resources – users can upload resources

(ALOE as a repository)– existing resources can be referenced as bookmarks

(ALOE as a referatory)● Resources can be found by using various filter

criteria and search modes● Users can tag, rate and comment resources,

initiate and join groups, etc. © 2010 Martin Memmel

ALOE Use Cases

© 2010 Martin Memmel

http://aloe-project.de/AloeView © 2010 Martin Memmel

http://openeer.dfki.de © 2010 Martin Memmel

https://mindpool.dfki.de © 2010 Martin Memmel

http://www.mace-project.eu

ALOE is a White Label Platform

● ALOE has two main components– The ALOE WebService offers almost all ALOE

functionalities via a SOAP/REST API– The ALOE View offers GUI access for all common web

browsers (Firefox, Safari, Opera, IE, Chrome)

● The ALOE View can be adapted easily to allow for a different look & feel or internationalization (full UTF-8 support and usage of Labels)

© 2010 Martin Memmel

ALOE System Architecture

© 2010 Martin Memmel

© 2010 Martin Memmel

The RADAR Architecture (our plan)

© 2010 Martin Memmel

LinkedDataSocial Web Data

Backend for resource contribution and annotation

● Generic metadata format● User profiles● GUI

Mobile clientLocation based IR

● Retrieval of data from ALOE● Access to selected social web services● Access to LinkedData

Ex. services

Adapter

© 2010 Martin Memmel

Use Case “Augmented City Kaiserslautern”

© 2010 Martin Memmel

Cultural Heritage & Crowdsourcing

● Possible contents:– Stories (text, audio, video)– Pictures– Movies

● Stakeholders:– Public institutions– End users (senior citizens!)

© 2010 Martin Memmel

“Talking Places”

© 2010 Martin Memmel

“Talking places”

● Offer information about the history of places– Multimedia contents– Timeline concepts

© 2010 Martin Memmel

http://www.newgadgets.de/wp-content/uploads/2009/02/mobile-augmented-reality-auf-dem-iphone.jpg

http://layar.com/layar-30-launched-5-cases-to-show-the-power-of-the-platform

Timelines

© 2010 Martin Memmel

http://www.flickr.com/photos/biilder/255896817/sizes/o/

© 2010 Martin Memmel

http://www.wochenmarkt-kaiserslautern.de/Geschichte_des_Wochenmarktes/geschichte_des_wochenmarktes.html

http://www.lautringer.de/Stadtansichten/Alte_Stadtansichten_Album_02/alte_stadtansichten_album_02.html

http://www.lautringer.de/Stadtansichten/Alte_Stadtansichten_Album_09/alte_stadtansichten_album_09.html

© 2010 Martin Memmel

http://www.flickr.com/photos/leobard/3492127854/sizes/l/in/set-72157617561339220/

http://www.m-e-s-s.de

Emotional Maps

© 2010 Martin Memmel

Lehr- und Forschungsgebiet Computergestützte Planungs- und Entwurfsmethoden in Raumplanung und ArchitekturProf. Dr.-Ing. Bernd Streich

http://cpe.arubi.uni-kl.de

“Emotional maps”

● Collecting personal information and feelings (stress, fear, etc.) about places, architectural structures and situations

● Web 2.0: new data which reveals individual reactions to the environment

● Advanced scenarios: collecting information with additional sensors– Biosensors collect conscious and unconscious data

© 2010 Benjamin Allbach, Martin Memmel

© 2009 Stephan Baumannhttp://bodymonitor.de/

http://urbansync.wordpress.com/

© 2010 Benjamin Allbach

http://bodymonitor.de/

© 2010 Benjamin Allbach

Emomaps – application areas

● Hints for designing of public squares ● Emotional city guide (city marketing) ● Influence  of the built environment ● Safety aspects (stressful areas on streets)● ...

© 2010 Benjamin Allbach

Thank you for your attention!

http://www.dfki.de/~memmelhttp://dfki.uni-kl.de/radar

http://aloe-project.dehttp://www.stiftung-innovation.rlp.de

© 2010 Martin Memmel

Acknowledgements

This work is supported by the Stiftung Rheinland-Pfalz für Innovation

http://www.stiftung-innovation.rlp.de

© 2010 Martin Memmel