xr: vr, ar, mr, and extended realitiesdefinitions •mixed reality (mr), or hybrid reality, is the...
TRANSCRIPT
![Page 1: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/1.jpg)
1www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
XR: VR, AR, MR, and Extended Realities
Engineering Application workshop
![Page 2: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/2.jpg)
2www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
XR: VR, AR, MR, and Extended RealitiesEric KamManufacturing Market Development and StrategistESI Group
![Page 3: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/3.jpg)
Agenda • Introduction• Definitions and Capabilities• Compare/Contrast• Consumer xR• Enterprise xR
• Product Lifecycles• * Workshop Exercise: Where do we each fit?• Product Development• Manufacturing Value Stream• Service and Maintenance• xR capabilities alignment• * Which xR technologies are relevant to me?
• Value to Manufacturing Enterprises• Job-to-be-done• Practical applications• * Workshop Exercise: What’s in it for me?• What should we look into
• Summary and conclusions
![Page 4: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/4.jpg)
Definitions • Virtual Reality (VR) is an interactive computer-generated experience taking place within a simulated environment• First Person Simulations/Games
• Driving and Flight Simulators
• Immersive Stereoscopic Visualization
• Head Mounted Displays
![Page 5: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/5.jpg)
5www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
![Page 6: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/6.jpg)
Definitions • Augmented reality (AR) is an interactive experience of a real-world environment where the objects that reside in the real-world are "augmented" by computer-generated perceptual information• Types
• Annotative (labels, pop-ups, etc)
• Spatial
• Mode of delivery• Projected
• Handheld
• Wearable
![Page 7: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/7.jpg)
7www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
![Page 8: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/8.jpg)
Definitions • Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations where physical and digital objects co-exist and interact in real time
![Page 9: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/9.jpg)
9www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
![Page 10: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/10.jpg)
xR definitions
• xR = Extended Reality
• VR = Virtual Reality
• MR = Mixed Reality
• AR = Augmented reality
Virtuality Reality
Exclusion
Immersion
![Page 11: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/11.jpg)
Consumer use and marketingLet’s agree that we are
not talking about media, entertainment,
or consumer uses
![Page 12: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/12.jpg)
12www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Training and Education
• Valid downstream use-cases
• Do not influence manufacturing or engineering decision, represent the outcome of engineering or planning activities
![Page 13: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/13.jpg)
13www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
The “bad-old-days”
ConceptProduct
EngineeringManufacturing-
Process planningTooling Design &
DevelopmentPrototyping/Pilot Production
Sales and After sales
Physical mock-ups
Clay models and mock-ups
T – 72 months (or more) SOP
Pre-production parts available
Drawings
Production intent parts
available
Craft proof or prototype parts
Production learning
Service learning
![Page 14: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/14.jpg)
14www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
ConceptProduct
engineeringProcess engineering
Tooling Development
Prototyping/Pilot ProductionSales and
After sales
Product Life Cycle
Exercise and Discussion: Where do you fit?
• Using the index card / sticky-notes
• Indicate the start and end of your workflow
• Using different card indicate the source of your input or supplier of you data/geometry/parts
• Using a third card indicate your customer or outputs of your work
![Page 15: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/15.jpg)
15www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Product still being designedProcesses pending
ConceptProduct
engineering
Product Design “FrozenProcess Planning
Process engineeringTooling
DevelopmentPrototyping/Pilot
Product LaunchedProcesses is fixed
ProductionSales and
After sales
Product Life Cycle
![Page 16: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/16.jpg)
16www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
The Challenge of Integration Engineering
Product Development
Pre Production Production Post Sales
Ability to influence the design
Impact / Cost of Unresolved Issues
![Page 17: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/17.jpg)
17www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
ConceptProduct
engineeringProcess engineering
Tooling Development
Prototyping/Pilot ProductionSales and
After sales
Product Life Cycle
![Page 18: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/18.jpg)
18www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
From Physical to Virtual Prototyping
• Toyota Motor Corporation Global website• http://www.toyota-global.com/company/history_of_toyota
• Engineering.com• http://www.engineering.com/ElectronicsDesign/ElectronicsDesignArticles/ArticleID/13292/ESI-Kicks-Out-Virtual-Reality-Software-ICIDO-102.aspx
![Page 19: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/19.jpg)
19www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Physical Models for Design
![Page 20: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/20.jpg)
20www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Virtual Reality applied in Design and Engineering
![Page 21: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/21.jpg)
21www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
![Page 22: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/22.jpg)
22www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Integration: Operator Requirements Engineering
![Page 23: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/23.jpg)
23www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Practical Build Milestone Reviews
Copyright © 2017 ESI and Colabra LLC. All rights reserved. 23
Product Development Pre Production Production Post Sales
Ability to influence the
design
Impact / Cost of Unresolved
Issues
Construction Gateway
(Physical Pre-production Vehicle)
Industry Initiatives
• ’Drive to the Left’ (find more issues up-front)
• Reduction of physical prototypes (new)
Increased Product Line Complexity & Shorter Development Cycles
=>Tendency for ’Green Washing’
(checking off topics without validation)
Pilot Assembly Gateway
(Production Intent Vehicle)
SOP Gateway
(Production Vehicle)
![Page 24: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/24.jpg)
Using Virtual Prototypes –Delivery modes
• On screen reviews
• Projected VR• Powerwall• CAVE
• Handheld Devices• Tablets• Phones
• Head-mounted displays• Tethered• Stand-alone• Virtual Reality• “Mixed reality”• Augmented reality
![Page 25: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/25.jpg)
25www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Wide Immersion or Projected Virtual Reality
![Page 26: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/26.jpg)
26www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Head Mounted Displays
![Page 27: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/27.jpg)
27www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Prototyping/Pilot ProductionProduct
engineeringProcess engineering
xR Solution RadarProduct Geometry
Process DefinitionPeople
• Fluctuating
• Fixed
ConceptTooling
DevelopmentSales and
After sales
• Consider where you are in the value stream from product concept to post-launch and whether the following aspects are fixed or in flux regarding decisions to be made
• Product Design, Product Geometry
• Process (operation, manufacturing, or service)
• People (demographics, population)
![Page 28: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/28.jpg)
Virtual Reality –Geometry and Spatial Computing Solutions
• CAD/DMU Embedded Visualization
• CAD/DMU Plug-in or Accelerated Visualization
• Engineering Virtual Integration
• Stand-alone Professional Visualization
• Game-engine Developed Application
![Page 29: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/29.jpg)
29www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Time to immersive experience: Visual Fidelity & Interaction
Game Engines
Pro-visualization
CAD/DMU (Plug-in)
Virtual Engineering
Vis
ual
izat
ion
Time
Photoreal
CGI
Textured CAD
Inte
ract
ion
Time
Real-time interaction
Predefined behaviors
Animations
Time sensitive decisions
Time sensitive decisions
Persistent deliverables
Persistent Deliverables
Static ViewsCAD
![Page 30: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/30.jpg)
30www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Manufacturing and time to market
![Page 31: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/31.jpg)
31www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Cost
Profits
Design for Performance
Design for Manufacturing
Design for Assembly
Design for Service
Time & Cost toStart of
Production (SoP)
Key Production KPIs
Safety, Quality, Delivery, Cost
EngineeringManufacturing
Engineering In-Service
Ramp-up Time &Cost to Volume
& Handover
Operate
Maintain
Decomission
Production Operations
Process-ResourcesProduct
Time
Manufacturing Engineering and impact on Value Stream
Time to Product RoI
![Page 32: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/32.jpg)
32www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
Addressable Manufacturing Engineering and Service Planning
Product
Packaging &
Clearances
Wiring & Cabling
Integration &
Clearances
Component
Installation &
Removal
Operator & Tooling
Clearances,
Reachability &
Visibility
Process
Validation &
Optimization
Tooling &
Equipment
Validation
Operator
Ergonomics &
Safety Validation
Workspace
Validation &
Optimization
Process
Familiarization &
Communication
![Page 33: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/33.jpg)
33www.esi-group.com
Copyright © ESI Group, 2018. All rights reserved.
![Page 34: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/34.jpg)
xR Spectrum for Collaboration
Individual
Group On-site
Part/Component Environment
Remote Multi-site
![Page 35: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/35.jpg)
Launch and Post-launch
• Once all (most) of the decisions have been fixed for product design and manufacturing launch…
![Page 36: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/36.jpg)
![Page 37: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/37.jpg)
Digital Guidance in Assembly and Maintenance
![Page 38: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/38.jpg)
Augmented reality • Where is the material coming from?
• How is this different than printed manuals or PDF?
• How has the information been validated?
• Is access to the information consistently required?
![Page 39: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/39.jpg)
Summary and Conclusions
• xR is valuable for the manufacturing enterprise, but all xR is not created equal
• xR technology should be implemented based on the availability/volatility of necessary information
• xR technology applies to a wide array of display and interaction formats that all aim to facilitate information transfer using digital data
• xR applied without considering the above will be technology for its own sake, consider what decisions or information transfer requires facilitation before narrowing down technology applications
![Page 40: XR: VR, AR, MR, and Extended RealitiesDefinitions •Mixed reality (MR), or hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations](https://reader033.vdocuments.mx/reader033/viewer/2022042914/5f4f96379e756226b25de6f6/html5/thumbnails/40.jpg)
Thank You
For more informat ion p lease v i s i t :
Vir tualReal i ty.ES I -Group.com