· 12 partners epfl floor plans, meta data helimap helicopter images and lidar points cloud...

52
camptocamp SA / www.camptocamp.com / [email protected] 3D 3D Web Mapping Yes, We Can! FOSS4G 2010

Upload: others

Post on 13-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

camptocamp SA / www.camptocamp.com / [email protected]

3D3D Web Mapping

Yes, We Can!

FOSS4G 2010

Page 2:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

2

Agenda Camptocamp Why 3D Maps? 3D Models With Textures

✔ Data acquisition✔ 3D models✔ Textures

3D Web Viewer✔ Integration✔ Interaction with 2D maps

Questions

Page 3:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

Chambéry

Lausanne

Open Source solutions provider as editor and integrator

Staff of 35 in Switzerland and France Camptocamp helps you move forward

with the latest Open Source technologies

Page 4:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

4

Geospatial Solutions

Infrastructure Solutions

Business Solutions

CONSULTING, RESEARCH & DEVELOPMENT

ENGINEERING, IMPLEMENTATION

OPEN SOURCE SUPPORT

TRAINING

Webmapping GIS Geopspatial databases Spatial Data

Infrastructure OGC Web Services

ERP Business Intelligence ETL

Linux HTTP, Apache Load

balancing Cloud computing (AWS) VoIP

Camptocamp Domains of Activity

Page 5:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

5

Why 3D Maps? Because it's cool (and clients like cool stuff)

Page 6:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

6

Why 3D Maps? Because it can help understand current and future 3D data

Page 7:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

7

3D Models With Textures An example: EPFL campus in Lausanne, Switzerland

Page 8:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

8

Data Sources Architects floor plans and meta data

3D Models With Textures

Page 9:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

9

Data Sources LIDAR points clouds

3D Models With Textures

Page 10:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

10

Data Sources Helicopter images

3D Models With Textures

Page 11:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

11

Data Sources Drone (UAV) images

3D Models With Textures

Page 12:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

12

Partners EPFL

✔ Floor plans, meta data Helimap

✔ Helicopter images and LIDAR points cloud SenseFly

✔ Drone images CVLAB (Computer Vision Laboratory, EPFL)

✔ Camera position and angle out of drone images IGN (Institut Géographique National, France)

✔ Model textures and automatic model generation Camptocamp

✔ Everything else!✔ Global project management

3D Models With Textures

www.epfl.ch

www.helimap.ch

www.sensefly.com

cvlab.epfl.ch

www.ign.fr

www.camptocamp.com

Page 13:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

13

Classical Approach

HelimapImages

SenseFlyImages

PhotoshopTextures

SketchUpMapping

HelimapPoints Cloud

AutoCADModeling

ArchitectsFloor Plans

Non-textured3D Model

3D Models With Textures

Any image

Page 14:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

14

Classical Approach 3D Models With Textures

Floor plans to 3D

Page 15:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

15

Classical Approach 3D Models With Textures

Page 16:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

16

Classical Approach 3D Models With Textures

Preparing textures

Page 17:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

17

Using Helimap Images

HelimapImages

IGNMapping

HelimapPoints Cloud

AutoCADModeling

ArchitectsFloor Plans

Non-textured3D Model

3D Models With Textures

Page 18:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

18

Using Helimap Images 3D Models With Textures

Page 19:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

19

Using SenseFly Images (beta)

SenseFlyImages

IGNMapping

CVLabPositions

HelimapPoints Cloud

AutoCADModeling

ArchitectsFloor Plans

Non-textured3D Model

3D Models With Textures

Page 20:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

20

Using SenseFly Images (beta) 3D Models With Textures

Page 21:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

21

Other Buildings

SenseFlyImages

IGNModeling

CVLabPositions

HelimapImages

OR

3D Models With Textures

Page 22:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

22

Other Buildings 3D Models With Textures

Page 23:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

23

3D Web Viewer MapFish architecture

GeoExt Google Earth Module

Page 24:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

24

EDF Project 3D Web Viewer

Page 25:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

25

SITN Project 3D Web Viewer

Page 26:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

camptocamp SA / www.camptocamp.com / [email protected]

Camptocamp SA

[email protected] +41 21 619 10 10 +33 4 79 44 44 94

Thank you for your attention

Page 27:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

camptocamp SA / www.camptocamp.com / [email protected]

3D3D Web Mapping

Yes, We Can!

FOSS4G 2010

Yves Bolognini

Camptocamp, Switzerland

3D Web Mapping

Page 28:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

2

Agenda Camptocamp Why 3D Maps? 3D Models With Textures

✔ Data acquisition✔ 3D models✔ Textures

3D Web Viewer✔ Integration✔ Interaction with 2D maps

Questions

Quick presentation on Camptocamp

Why we want to display 3D data on map

This might look like a gadget

How to create 3D models, buildings in particular

How to acquire, model data and how to apply textures on models

How to display the model on Web

Interaction with classic 2D maps

Questions

Page 29:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

Click to add title

Chambéry

Lausanne

Open Source solutions provider as editor and integrator

Staff of 35 in Switzerland and France Camptocamp helps you move forward

with the latest Open Source technologies

Page 30:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

4

Geospatial Solutions

Infrastructure Solutions

Business Solutions

CONSULTING, RESEARCH & DEVELOPMENT

ENGINEERING, IMPLEMENTATION

OPEN SOURCE SUPPORT

TRAINING

Webmapping GIS Geopspatial databases Spatial Data

Infrastructure OGC Web Services

ERP Business Intelligence ETL

Linux HTTP, Apache Load

balancing Cloud computing (AWS) VoIP

Camptocamp Domains of Activity

Page 31:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

5

Why 3D Maps? Because it's cool (and clients like cool stuff)

Why do we want 3D data in maps

Because it's cool

It's a great addition to a classic 2D map application

San Francisco buildings in Google Earth

Page 32:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

6

Why 3D Maps? Because it can help understand current and future 3D data

Really usefull to visualize future installation

Here future electricity pylons in France

Can also be used to visualize current data with a interesting 3D information, like terrain modeling or even airplanes position

Page 33:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

7

3D Models With Textures An example: EPFL campus in Lausanne, Switzerland

How to create 3D models with textures

Example : EPFL Web application

Used by students and campus visitors for several years

Many functionalities

Wanted to add a 3D view of the campus

Page 34:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

8

Data Sources Architects floor plans and meta data

3D Models With Textures

We need data sources

Architect floor plans

Meta data like ceiling heights

Same source as for 2D maps

Page 35:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

9

Data Sources LIDAR points clouds

3D Models With Textures

Points clouds

LIDAR Light Detection and Ranging

Points detected by a laser

Same helicopter flight for points and images

Page 36:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

10

Data Sources Helicopter images

3D Models With Textures

Helicopter images

High resolution camera with high accuracy posititioning system

Takes the picture and knows immediately the position and angles of the camera

Useful for orthophoto

Also for building frontages due to camera lens distortion

Also using oblique images

Page 37:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

11

Data Sources Drone (UAV) images

3D Models With Textures

Drone images

Drone = Unmanned Aerial Vehicle

80 cm wide ultra light drone

Standard cheap camera with simple GPS

Approximative localization

Page 38:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

12

Partners EPFL

✔ Floor plans, meta data Helimap

✔ Helicopter images and LIDAR points cloud SenseFly

✔ Drone images CVLAB (Computer Vision Laboratory, EPFL)

✔ Camera position and angle out of drone images IGN (Institut Géographique National, France)

✔ Model textures and automatic model generation Camptocamp

✔ Everything else!✔ Global project management

3D Models With Textures

www.epfl.ch

www.helimap.ch

www.sensefly.com

cvlab.epfl.ch

www.ign.fr

www.camptocamp.com

Partners

EPFL = client

Helimap

SenseFly

CVLAB

IGN

Camptocamp

Everything else : Web application, project management, coordination

Page 39:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

13

Classical Approach

HelimapImages

SenseFlyImages

PhotoshopTextures

SketchUpMapping

HelimapPoints Cloud

AutoCADModeling

ArchitectsFloor Plans

Non-textured3D Model

3D Models With Textures

Any image

Using those sources to create a model

At EPFL they use AutoCAD a lot

Used AutoCAD to create non-textured model

Textures made in Photoshop, long process

Mapping in Google Sketchup

Page 40:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

14

Classical Approach 3D Models With Textures

Floor plans to 3D

First model out of floor plans

Misses some important infos

Sometimes too many details

Page 41:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

15

Classical Approach 3D Models With Textures

Complete EPFL campus model

Page 42:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

16

Classical Approach 3D Models With Textures

Preparing textures

Preparing textures to map them with SketchUp

Long process

Not possible in the context of this project

Decided to look for other approaches

Page 43:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

17

Using Helimap Images

HelimapImages

IGNMapping

HelimapPoints Cloud

AutoCADModeling

ArchitectsFloor Plans

Non-textured3D Model

3D Models With Textures

Using Helimap images and IGN mapping software

Take non textured model

Apply textures automatically from helicopter images

Page 44:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

18

Using Helimap Images 3D Models With Textures

First result

Nice, but

Helicopter images don't cover everything

Heavy textures (size could be reduced automatically)

Expensive update

Page 45:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

19

Using SenseFly Images (beta)

SenseFlyImages

IGNMapping

CVLabPositions

HelimapPoints Cloud

AutoCADModeling

ArchitectsFloor Plans

Non-textured3D Model

3D Models With Textures

Using drone images and IGN mapping software

Take non-textured model

Process SenseFly images

CVLAB capable of finding exact camera position and angle

Uses lots of images and finds matches between them

Still beta version

Page 46:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

20

Using SenseFly Images (beta) 3D Models With Textures

Drone flight = very low cost

Possible to update more often

Was hoping to have some results for FOSS4G

Didn't get the results in time

Good potential

Page 47:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

21

Other Buildings

SenseFlyImages

IGNModeling

CVLabPositions

HelimapImages

OR

3D Models With Textures

Building not on campus

We don't have 3D models

IGN other software

Automatic 3D modeling using only images

Same process for SenseFly images

Page 48:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

22

Other Buildings 3D Models With Textures

3D model is less accurate

Can be used so campus is not in a “no man's land”

Page 49:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

23

3D Web Viewer MapFish architecture

GeoExt Google Earth Module

MapFish = framework for building complex web mapping applications

Server MapFish services and OGC compliant services

Client GeoExt with ExtJS and OpenLayers

Extra GeoExt module for Google Earth

Page 50:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

24

EDF Project 3D Web Viewer

Example: EDF Project

Electricity pylons in France

Classic 2D map on the left

3D view in Google Earth

Specific widget for point of view

3D moves change 2D view, 2D widget moves change 3D view

Demo on Camptocamp booth

Page 51:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

25

SITN Project 3D Web Viewer

Second example: SITN Project

Much more complete, including StreetView

Possibilities to improve 2D widget:

A triangle in 2D to display borders of 3D view

A 2D widget to change height of camera

Page 52:  · 12 Partners EPFL Floor plans, meta data Helimap Helicopter images and LIDAR points cloud SenseFly Drone images CVLAB (Computer Vision Laboratory, EPFL) Camera position and angle

Thank you

Questions

camptocamp SA / www.camptocamp.com / [email protected]

Click to add title

Camptocamp SA

[email protected] +41 21 619 10 10 +33 4 79 44 44 94

Thank you for your attention