Mixed Reality and Product ManagementVikas BatraFeb 2017

2 Product Management Role

Define Product...

Viable

Valuable

UsableFeasible

3 The Objective

Augmented Reality and Virtual Reality Examine

Competitive Advantage ? Address New Market/Customer Segment ?

Process of Assessment

4 Spatial User Interface

New Compute Interface Redefines human interaction with Physical Objects and Physical Space

1. 3-Dimensional, Computer-generated, Graphical Spatial View 1. augments actual physical view (Augmented Reality), or 2. eliminates actual physical view (Virtual Reality)

2. Hands Free. Controlled by hands gestures, head/body movements

5 Spatial User Interface

Source Microsoft

6 Compute Interface Evolution

Command Line Interface

Graphical User Interface

Touch Screen Voice Interface

Spatial User Interface

2D Screen – Text 2D Screen – Graphical

2D Screen – Graphical

Speakers 3D Spatial Projection

Keyboard KeyboardMouce

Touch Screen Mic Camera. InfraRed Sensors

Key press Mouse move, clicks Swipe, Pinch Speak Hand gesturesHead/Body movement

MS–DOS Windows, Mac Smartphones, Tablets, etc.

Echo, Siri, Google Assistant

Head Mounted Display, Smart Glasses

7 Virtual Reality(VR)

8 Virtual Reality - Phone Based

9 Virtual Reality – Head Mounted Display

10 Virtual Reality – Gaming Console

Source: Sony

Sony PlayStation VR

11 Virtual Reality – PC Based

Source: Facebook/Oculus/Endgadet

Facebook Oculus Development Platform

Facebook Oculus Rift and Touch

12 Creating Virtual Reality Content

Capture Store Edit Transmit Playback

Nokia Ozo 360Camera

Source: Nokia

13 Augmented Reality(AR)

14 On TV

15 On Mobile Phone

Lets see it in action

16 On Mobile Phone - Tango

Depth Sensing Motion Tracking

Google Tango Application Development Platform

Lenovo Pahb2 Pro

17 On Mobile Phone – Tango

See Before you Buy Wayfair View App on Tango

18 Visualization in 3D Space

Visualize Wi-Fi Signal Coverage

Signal Mapper App on Tango By Signal Garden

19 On Smart Glasses

Microsoft HoloLens ODG R-8 Smart Glasses

20 Optics

Holographic Waveguide

Curved CombinerFlat Combiner

Display

Lens

Computer Graphics

Actual Physical View

21 Smart Glasses

40+ Smart Glasses AugmentedReality.org ww.arglassesbuyersguide.com

Source: AugmentedReality.org

22 Software

Recognize and Track Environment Define AR Experiences Execute AR Experiences Integration with Existing Systems

50+ AR Authoring Platforms/SDKs Comparison at Social Comparehttp://socialcompare.com/en/comparison/augmented-reality-sdks

23 End-User Interface

Source Microsoft

24 The Big PictureInternet of Things

Artificial Intelligence/ Analytics

Humans

Data

Automated Control

Data Manual Control

‘Pull’

‘ Contextually Relevant Push’

25 The Promise

Augmented Reality 3-Dimensional, Augmented Views (Audio-Video) Hands Free Operation - Input/output from hand gestures, voice,

camera, sensors … Larger, adjustable display area Greater Comfort, Always with you. ‘Contextually Relevant Push’

Virtual Reality Immersive Experiences

Significantly better end-user experience compared to Smartphone/PC/Tablets

26 The Challenges

Technical Optics Weight Battery Life Bandwidth/Delay

Business Price

Content Application Platforms and Eco-system

27 Trends

~4B VC funding since 2014 Big Players

Miniaturization Optics Lower Prices

5G Wireless Networks WiGig/802.11ad

28 Example Uses Cases

29 Use Cases Areas

Physical Objects

Physical Space

Immersive Experiences

30 Use Cases – Physical Objects

Design Assemble Warehouse/Logistics Operate/Use Maintain

Support. I See What You See

Survey Education/Training

Execute a Procedure

31 Use Cases – Physical Spaces

Architecture/Interior Design Navigation Venue Experiences e.g. Museums See Before You Buy 3-D Visualization in Space Language Translation …

32 Uses Cases – Immersive Experiences

Gaming Social Virtual Experience Movies Theme Parks Live Events – Every Viewer on Prime Seat Virtual Tours

Before to travel Real Estate

… Holoportation

33

What will you define?

34 The Process

35 Assessment Process

Define Concept

Identify and Capture Value •End Customers, Organization, PartnersUsability Viability• Customer ROI/Time • Impact to organization (e.g. CBA, Users, Usage Time)

• Partners (CBA) RisksConcept Assessment •Objective•Cost/Effort • Time/Schedule

Assess Concept

Refine Value, Usability, Viability, and Risks Prototype • Objective• Deliverable• Cost/Effort• Time/Schedule

Develop Prototype

Refine Value, Usability, Viability and RisksProduct Development• Scope • Cost/Effort• Time/Schedule

Go To Market, Support etc.

Perform Assessment

? Develop

Prototype? Develop Product?

36 Questions ?

37 Back Up

38 Example Use Cases

3D Virtual Design Design prior to development Visualize prior to purchase

Execute Procedure. Hands-free, 3D AR, Audio assisted

Physical Object: Install, Operate, MaintainExample ; Boeing Example ;

Nokia Small Cell Surgical/Medical Procedure Pick and Pack Surveys, Navigation

Always On Self/Environment Monitoring, Compliance Non intrusive Alerting, Audio output

Contextual Situation Awareness Push Contextually Relevant Information IOT Enabled Machine Visibility and Control Multi party conference

I see what you see Remote Expert, Customer Support, etc.

3D Non-real time Video for Training Example

Contextual Marketing Larger Viewing Area, Non intrusive Contextually relevant

Holo-portation. Real Time Communication 3D Virtual Travel 3D Immersive Entertainment ….

39 See before you buy

Wayfair View App on Tango

40 Design

SketchUp Viewer Trimble Inc.

Meta 2 GlassesMeta

41 Execute a Procedure

AR Car Repair Solution Continental Corporation

Hands Free Instructions in the FieldEpson/Atheer

42 Medical

VeinViewer ChristieMed

43 Interior Design

InContext Solutions

44 Education

HoloAnatomy by Case Western Reserve University

HoloHeart by Made In Point GmbH

45 Navigation

Aircraft NavigationAero Glass

Indoor Navigation to the shelf/aisle Aisle 411 -

46 Navigation

Car Navigation.Navdy

47 Support

Skype. Microsoft

48 Venue Experience

Source EPSON

49 Virtual Keyboard/Key pad

Augumenta Interaction PlatformHoloLens 3D3 Keyboard

50 Live Events

Live Events – US Open Golf NextVR

51

Spectacles SnapChat

52 Technology Components

Optics (Waveguide, Curved Surface Combiner) Gesture Recognition and Control Voice Recognition and Control Depth Sensing Inertial Measurement Unit (IMU) Context Aware – Computing 3D Video/Audio, Capture, Editing, and Transmission Augmented Reality Authoring Software Platform

Enterprise AR Value Chain

Nokia Internal Use. Confidential.

Components

• Qualcomm• TI• Intel

• Nvidia • AMD•…

• Samsung• Lumus• Rochester Optical •….

Smart Glasses

• ODG • Intel/Recon • Epson• Vuzix• Daqri (Helmet) • Google

• Microsoft • Meta• Lenovo

• MagicLeap

Connectivity

• Nokia, Ericsson, Huawei

• Cisco, Brocade/Ruckus, HPE/Aruba..

Applications Development

• APX Labs/UpSkill• PTC • Atheer• Wikitude• Augumenta

• Daqri,• Pristine • UBIMax • Incontext Solutions• Surgical Theater• …

SystemIntegration

• IBM• Accenture• HP•…• Nokia Services ?

Operations & Management

• AirWatch by vmware

• Augmate •Nokia Impact (MDM)?

54 End User Experience

At Home Source Microsoft

55 End User Experience

Source: Microsoft HoloLens

56 End User Experience

Source: Microsoft HoloLens Everywhere ElseSource ODG,

57 Questions to Ask

Can it enable meeting existing customer needs better ? Can it enable meeting an unmet customer need? Are there new customer segments that can now become attractive? Can it improve monetization ? E.g. moving subscriber from free to premium

offering?

Can it enable higher Productivity? Can it enable higher Quality? Can it enable greater Safety? Can it help with Compliance requirements?Directly from VR HMD/AR Smart Glasses and Technology building blocks

58 Resources

www.arglassesbuyersguide.com/ www.augmentedworldexpo.com/ Augmented Reality for Enterprise Alliance (AREA)

www.thearea.org/ Karl Guttag on Technology www.kguttag.com Depth Sensing Technologies Comparison

http://www.ti.com/lsds/ti/sensing-products/optical-sensors/3d-time-of-flight-sensors-technology-comparison.page