dsc europe 2020 - dsc 2020 europe vr
TRANSCRIPT
DSC 2020 Europe VR
DSC 2020 EUROPE VR
Driving Simulation & Virtual Reality Conference & Exhibition
Palais des Congrès - Antibes September 9, 2020
Title
Presenter
Accelerate automotive simulation development
Seb Loze | Simulation Industry Manager
T : @SLFeeding #DSC2020 | [email protected]
#UE4 | @UNREALENGINE
Remember last year ?
Key takeaways from 2019 DSC speech :
1. Epic Games is strongly investing in some core non-game industries including Simulation
2. Unreal Engine is free (source code is available for free on GitHub as well)
3. Eager to aggregate insights coming from the simulation experts
#UE4 | @UNREALENGINE
Remember yesterday ?
If you missed James Butcher Unreal Engine tutorial :
https://learn.unrealengine.com/
#UE4 | @UNREALENGINE
Driving Simulations | Smart and beautiful (and vice versa)
Depending on their goals, priorities in the development process of driving simulators is focussing on 8 criterias impacting the way images are displayed (or not) :
● Image accuracy ● Photorealism ● Dynamics Engine Integration ● HIL Integration● AI Integration● Open Architecture ● Support of standards● Pipeline Optimization
“One thing that we're not necessarily doing is we're not doing a fancy 3D world like this because we are simulating perception.” - Uber, Matt Ranney
“UE4 allowed us to achieve an impressive graphics quality, allowing top quality lighting effects, and rain/wet terrain simulation” - Kunos Assetto Corsa, Marco Massarutto
#UE4 | @UNREALENGINE
Driving Simulations | Smart and beautiful (and vice versa)
(Attributed values are projections based on typical use cases observations)
Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game
#UE4 | @UNREALENGINE
Unreal Engine | Driving Simulation use cases examples
https://www.infoq.com/presentations/uber-self-driving-software/
Inside a self-driving Uber
https://venturebeat.com/2019/04/20/gms-cruise-is-preparing-for-a-self-
driving-future-in-the-cloud/
GM’s Cruise is preparing for a self-drivingfuture in the cloud
https://www.extremetech.com/extreme/281649-nvidia-ai-can-render-
complete-urban-environments-in-unreal-engine-4
Nvidia AI Can Render Complete Urban Environments in Unreal Engine 4
https://zoox.com/journal/
Zoox merging Simulation & Reality
https://www.vertechs.jp/autocity
Reikko and Vertechs create Auto City
https://www.prnewswire.com/news-releases/otsl-strengthens-its-3d-
real-time-sensor-simulator-framework-cosmosim-r-ecosystem-for-
autonomous-driving-300883916.html
OTSL strengthens 3D Real-Time Sensor Simulator Framework COSMOsim (R) Ecosystem
https://www.microsoft.com/en-us/garage/blog/2018/04/project-road-
runner-train-autonomous-driving-algorithms-for-road-safety/
Microsoft Road-Runner photo-realistic simulation and deep learning to train autonomous driving algorithms
https://www.ijrte.org/wp-content/uploads/papers/v8i1/A7288058119.pdf
Development of Pedestrian Artificial Intelligence Utilizing Unreal Engine 4
#UE4 | @UNREALENGINE
https://www.youtube.com/watch?v=FJsn2OGsLOc
https://www.youtube.com/watch?v=wv5UeSZST5w
https://www.youtube.com/watch?v=CUH5hwkl7dI&t=10s
https://www.youtube.com/watch?v=feteiyjsHOQ https://www.youtube.com/watch?v=SyUQ2IImObA
https://www.youtube.com/watch?v=5Xqqe9WcZnk
Digital Marketing - 2020 - Examples
#UE4 | @UNREALENGINE
AV simulation and Engineering - 2020 - Examples
https://www.youtube.com/watch?v=skanz-dzaAg https://www.youtube.com/watch?v=ORpo_cpDH4shttps://www.unrealengine.com/en-US/spotlights/ike-develops-virtual-
simulator-for-automated-trucks-with-unreal-engine
https://carla.org/
https://www.dspace.com/en/pub/home/news/sensor_realistic_simulation.
cfm#143_54589
https://www.unrealengine.com/en-US/spotlights/cm-labs-links-best-in-
class-real-time-toolsets-for-highest-fidelity-engineering-and-training-
simulation
#UE4 | @UNREALENGINE
Driving Simulations | Smart and beautiful (and vice versa)
(Attributed values are projections based on typical use cases observations)
Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game
#UE4 | @UNREALENGINE
#UE4 | @UNREALENGINE
#UE4 | @UNREALENGINE
What is so special about Driving Sim?
Challenges
Content Creation
Non visible spectrum
Data accuracy
Deployment
Solutions
Handling formats / GIS / Terrain Data / Stream the world
Sensors ( handling / representation )
Identifying potential integrations
Cloud vs local
#UE4 | @UNREALENGINE
Content creation - the “classic” approach
UE4 integrated Landscape - Create your own procedural geotypical environment
● Hand-crafted landscape, Terrain splines, Foliage tools, Marketplace assets● Several training zones in same environment
● https://docs.unrealengine.com/en-
US/Engine/OpenWorldTools/index.html
● https://docs.unrealengine.com/en-US/Engine/Landscape/index.html
● With terrain generation tools (World Machine, Instant Terra, World Creator, TerraForm)
● …)
#UE4 | @UNREALENGINE
Content creation - The “GIS data integration” approach
Adapting to traditional simulation content creation pipelines
VectorZeroRoadRunner
ESRICityEngine
TrianGraphics Trian3DBuilder
Presagis O2U
OpenStreetMap(free plugin)
Presagis Terra Vista (UE4 output compiler WIP)
LiDAR Point Cloud(UE 4.24 free plugin)
#UE4 | @UNREALENGINE
Content creation - The “GIS data integration” approach
Adapting to traditional simulation content creation pipelines
VectorZeroRoadRunner
ESRICityEngine
TrianGraphics Trian3DBuilder
Presagis O2U
OpenStreetMap(free plugin)
Presagis Terra Vista (UE4 output compiler WIP)
LiDAR Point Cloud(UE 4.24 free plugin)
#UE4 | @UNREALENGINE
Content creation - The “Standard DB” approach
ESRI ArcGIS Presagis CDB ORB Viewer
SimblocksCDB RTP for UE
CESIUM 3D Tiles
#UE4 | @UNREALENGINE
#UE4 | @UNREALENGINE
Content creation - your “Homemade” solution
< Insert here your challenges >
Using Unreal Engine source code and open structure allows you to create your own importers and your optimization process from your source data
#UE4 | @UNREALENGINE
Non visible spectrum
#UE4 | @UNREALENGINE
Non visible spectrum
LIDAR semantic
#UE4 | @UNREALENGINE
Non visible spectrum
< Insert here your challenges >
We are using the sensors from our partners. We can help you to implement yours. Some implementations are being done internally by Epic Games.
Your voices are important to help us to define what is our next step.
#UE4 | @UNREALENGINE
Simulation data accuracy
#UE4 | @UNREALENGINE
Deployment
#UE4 | @UNREALENGINE
How to conclude ?
Progress have been made. Challenges have been taken care of. Partners are being supported to provide new solutions to the community.
We can do better. Let’s make sure we don’t wait until the next DSC to chat.
Send us a line ---> [email protected]
Seb Loze | Simulation Industry ManagerT : @SLFeeding #DSC2020 | [email protected]