Mobile Augmented Reality:Technology Advances and UX Challenges Kevin Arthur

@karthur

Source: https://flic.kr/p/8ERBCd

2015. Source: Microsoft Hololens

AR: Blending the Physical and Digital

2015. Source: Microsoft Hololens

Head-worn AR

Sources: https://en.wikipedia.org/wiki/Augmented_reality, Minecraft Reality by 13th Lab/Mojang.

Handheld (Mobile) AR

Yelp. Source: https://flic.kr/p/7vHnb5

Mobile AR Phase 1: Location Overlays

Layar app. Junaio app.

Phase 2: QR Codes, Markers, Overlays

Phase 2: QR Codes, Markers, Overlays

(when it works)

Phase 3: No Markers, Scene Awareness & Reconstruction, Tracking, Occlusion

Occipital. Source: http://structure.io

Phase 3: No Markers, Scene Awareness & Reconstruction, Tracking, Occlusion

Paracosm. Source: https://paracosm.io/

Phase 3: No Markers, Scene Awareness & Reconstruction, Tracking, Occlusion

Source: Intel® RealSense™ Technology

Demos vs. Products

Successful Product

😎

😀

✨

💭

We Have Better Demos but not Better Products

Successful Product

😎

😀

✨

💭

Different Paths to Success for AR (and other Emerging Tech)?

Successful Product

Acknowledge Bad First Impressions

Source: http://www.amazon.com/Codes-Kill-Kittens-Customers-Dishearten/dp/1118732758

Mobile AR is Tiring, Let People Relax

Balance live/active mode with offline/inactive mode

Source: Intel® RealSense™ Technology, Rachel Kennison

Apply in Small Chunks, for Carefully Selected Tasks

IKEA app, Autodesk Homestyler app

Quick view (AR)

Relaxed editing (not AR)

Design for the Physical Reality

Don’t depend on artificial environments, props, and perfect conditions

Source: Intel® RealSense™ Technology, Rachel Kennison

Don’t do Everything

Don’t forget the task, context, user skills, user preferences, ergonomics, etc…

Multiple Products and Interaction Styles

Successful Product

IKEA app, Autodesk Homestyler app

Keep Exploring. Depth > Breadth Kevin Arthur @karthur JPL Spacecraft 3D. Source: https://www.flickr.com/photos/brownpau/8017859672/