mobile augmented reality - 123seminarsonly.com · 2012-02-14 · mobile augmented reality virtual...

20
Technische Universität Berlin Open Communication Systems 1 Mobile Augmented Reality Hai To

Upload: others

Post on 20-May-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

Technische Universität Berlin Open Communication Systems 1

Mobile Augmented Reality

Hai To

Page 2: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

2Technische Universität Berlin Open Communication Systems

Agenda

What is mAR?➔A brief history of AR➔Definition & Taxonomy

Where to find mAR?➔Former approaches➔Current use cases➔Future Scenarios

How to make mAR?➔Software & Hardware➔Android for the win➔Technology is the key

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 3: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

3Technische Universität Berlin Open Communication Systems

What is mAR?

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 4: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

4Technische Universität Berlin Open Communication Systems

Background

●AR derived from Virtual Reality➔term was coined by engineers at Boeing(1990, Thomas Caudell & David Mizell)

➔VR already used in aircraft manufacturing(Boeing 777 completely designed through 3D CAD)

➔AR developed to aid assembling wiring harness

➔prototype has been realised with support of DARPA & Honeywell Military Avionics Division

➔AR-system proved to be 25% to 50% faster than conventional methods

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 5: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

5Technische Universität Berlin Open Communication Systems

Definition

“to augment” = to increase, make larger or supplement “reality” = (subjective perception of) the real world ↳“AR” = extended perception of one's surrounding through ancillary information

●Augmented Reality is a computing system:

➔combining reality with virtual objects➔interacting in real-time➔registered in 3D(Ronald T. Azuma)

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 6: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

6Technische Universität Berlin Open Communication Systems

Taxonomy

●Augmented Reality or Virtual Reality

utilising real vs generating artificialsurrounding environment

➔compartmentation depends on the referenced world model

➔independent from the perceived images(Paul Milgram)

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 7: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

7Technische Universität Berlin Open Communication Systems

Where to find mAR?

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 8: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

8Technische Universität Berlin Open Communication Systems

Former Approaches

●MARS – at Columbia University:➔mobile computing system combining HMD, handheld and wireless communication technology

➔developed to help navigate and receive information about points of interest

➔motivation: create an advanced, context-aware, mobile experience; define reusable interface components

➔challenges: ergonomics (miniaturisation, power supply, thermal dissipation); robustness & outdoor usability; commercialisation

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 9: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

9Technische Universität Berlin Open Communication Systems

Current Use Cases

●Location based mAR:➔e.g. Wikitude, Layar, TwittARound➔utilizes build in GPS and electronic compass system for tracking

➔ancillary information for POIs shown on display

●mAR Gaming:➔e.g. Arhrr, Ghostwire, Treasure Hunting➔uses tag recognition for tracking➔window to another world

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 10: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

10Technische Universität Berlin Open Communication Systems

• The Astonishing Tribe in Malmö, Sweden

• Android based

• uses the Flickr facial recognition technologyprovided by Polar Rose

Smartphone Apps

TAT Augmented ID

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 11: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

11Technische Universität Berlin Open Communication Systems

Future Scenarios

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

U-Cities

* total inter-connectedness

* largest integrated

technology testbeds

* 297 Mio RFID research

centers

* personal smartcard for purchases &

access

Page 12: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

12Technische Universität Berlin Open Communication Systems

How to make mAR?

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 13: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

13Technische Universität Berlin Open Communication Systems

Mobile Platforms

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

●Software libraries:

➔ARToolKit (C/C++)

➔Studierstube ES (C/C++)

●OS-market-share:

➔D’Fusion (TI)➔AndAR, mixare➔DRAFT (TUM)➔ARML (Mobilizy)

Worldwide: Smartphone Sales to End Users by Operating System, 2008 (Gartner)

52%

17%

12%

8%8%2%1%

SymbianRIMWindows MMac OS XLinuxPalm OSOther

Page 14: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

14Technische Universität Berlin Open Communication Systems

Android

●“Softwarestack”➔Mobile OS + Middleware + Key Applications

➔creation + emulation + debugging tools

➔APIs, APIs, APIs➔free documentation

➔online market place

➔open source

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

●mAR relevant:➔Sensor Manager➔Location Manager

➔Surface Manager

➔OpenGL + SGL API

➔Camera + Geomagnetic Field API

Linux Kernel

Libraries RT

ApplicationsFramework

Applications

Page 15: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

15Technische Universität Berlin Open Communication Systems

Android

●benefits: ➔licensing➔developer freedom

➔hardware options

➔standardisation

➔multi tasking➔component reuse

➔easy customizability

➔big community➔momentum

●concerns:➔limited commercial distribution on marketplace

➔internationalisation and localisation

➔premature

➔security➔privacy➔fragmentation

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 16: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

16Technische Universität Berlin Open Communication Systems

Technologies

●Key technologies:

➔GPS localization(indoor, precision)

➔Head tracking(realtime, fluent)

➔Display(glare, contrast)

➔Computer(processing, miniaturization)

➔Network(QoS, speed)

●Add-ons: ➔haptic Displays➔RFID Readers➔3D Display➔acoustic/ aromatic augmentations

➔Projector...

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 17: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

17Technische Universität Berlin Open Communication Systems

Conclusion

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 18: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

18Technische Universität Berlin Open Communication Systems

Prospect

●mAR present state: in its infancy➔comprehensive research environment➔advanced development status➔early commercialisation stage

●barriers: content, critical mass, technology

●mAR promises: host of everyday uses

➔endless virtual information in evanescent real objects

➔seamless mergence of reality and virtuality

➔personalised information management & filteringIntroduction

What is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 19: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

19Technische Universität Berlin Open Communication Systems

Challenges

●social issues:➔technological discrepancy → informational discrimination

➔privacy, autonomy, liability

●systematic issues:➔lot of challenging systems → difficult to unify information access

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Page 20: Mobile Augmented Reality - 123seminarsonly.com · 2012-02-14 · Mobile Augmented Reality Virtual Reality, Azuma & Milgram RV-Continuum, MARS, Wikitude, Arhhr, TAT AID, U-Cities wearble

20Technische Universität Berlin Open Communication Systems

IntroductionWhat is mAR?

Where to find mAR?

How to make mAR?

Conclusion

Q&A

Mobile Augmented RealityVirtual Reality, Azuma & Milgram

RV-Continuum,MARS, Wikitude, Arhhr, TAT AID, U-Cities

wearble vs mobileARToolKit, ARML, Studiestube

Symbian, Apple, Androidkey technologies, add-ons

barriers, promiseschallenges