geoprocessing in the clouds foss4g 2009 bastian schäffer 52°north
DESCRIPTION
Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North. Agenda. Cloud Computing SDI to Cloud Transition The 52North WPS in the Clouds. Cloud Computing. Cloud Hype. Characteristics. Efficiency Resource Pooling Outtasking On-demand no-long term contracts Scalability - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/1.jpg)
http://www.52north.org/wpsFOSS4G 2009
Geoprocessing in the Clouds
FOSS4G 2009
Bastian Schäffer52°North
![Page 2: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/2.jpg)
http://www.52north.org/wpsFOSS4G 2009
Agenda
Cloud Computing SDI to Cloud Transition The 52North WPS in the Clouds
![Page 3: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/3.jpg)
http://www.52north.org/wpsFOSS4G 2009
Cloud Computing
![Page 4: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/4.jpg)
http://www.52north.org/wpsFOSS4G 2009
![Page 5: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/5.jpg)
http://www.52north.org/wpsFOSS4G 2009
Cloud Hype
![Page 6: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/6.jpg)
http://www.52north.org/wpsFOSS4G 2009
Characteristics
• Efficiency Resource Pooling
• Outtasking
• On-demand
no-long term contracts
• Scalability
• Cost
![Page 7: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/7.jpg)
http://www.52north.org/wpsFOSS4G 2009
IaaS
PaaS
dSaaSSaaS
![Page 8: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/8.jpg)
http://www.52north.org/wpsFOSS4G 2009
Technology
• Hardware Cluster
• Virtualization
• Grid Computing
• Application Framework
• etc.
![Page 9: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/9.jpg)
http://www.52north.org/wpsFOSS4G 2009
IT investments & maintenance
![Page 10: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/10.jpg)
http://www.52north.org/wpsFOSS4G 2009
Cloud Types
![Page 11: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/11.jpg)
http://www.52north.org/wpsFOSS4G 2009
Provider
• Amazon Web Services– Virtual (Machine) Computing Environment– Simple Storage Service (Amazon S3), SimpleDB,
Elastic Compute Cloud (Amazon EC2), Elastic MapReduce, etc.
– „0,10$ / hour“ for an running virtual system• Google App Engine
– Web applications written in Java and Python– Storage Service, Google Applications (Mail, Account)– „0,10$ / hour“ for real CPU usage
• Microsoft, Apple, SUN, IBM, Salesforce, etc.
![Page 12: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/12.jpg)
http://www.52north.org/wpsFOSS4G 2009
Projects
• DMTF Open Cloud Standards Incubator
• The Open Cloud Consortium (OCC)
• Open Cirrus - Open Cloud Computing Research Testbed
• Open Cloud Manifesto
![Page 13: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/13.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI to Cloud Transition
![Page 14: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/14.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI to Cloud Transition
• CloudSDI vs. SDICloud
![Page 15: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/15.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI concepts
• Technical / Service Perspective
SDI provides georesources through standardized interfaces over a service infrastructure
![Page 16: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/16.jpg)
http://www.52north.org/wpsFOSS4G 2009
Processing (WPS)
Data Provision(WFS, WCS, SOS)
Portrayal (WMS)
Discovery (CSW)
![Page 17: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/17.jpg)
http://www.52north.org/wpsFOSS4G 2009
IaaS
PaaS
dSaaSSaaS
Processing (WPS)
Data Provision(WFS, WCS, SOS)
Portrayal (WMS)
Discovery (CSW)
![Page 18: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/18.jpg)
http://www.52north.org/wpsFOSS4G 2009
IaaS
PaaS
dSaaSSaaS
Processing (WPS)
Data Provision(WFS, WCS, SOS)
Portrayal (WMS)
Discovery (CSW)
![Page 19: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/19.jpg)
http://www.52north.org/wpsFOSS4G 2009
Major Obstacles
• IT investments & maintenance
• Mass market
• Legally Binding Performance
![Page 20: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/20.jpg)
http://www.52north.org/wpsFOSS4G 2009
IT investments & maintenance
• High investments
<hardware, software, humans>
(for seldomly used tasks)outtasking & on demand use
e.g. Taiwan Debris Flow, French SDI Portal
![Page 21: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/21.jpg)
http://www.52north.org/wpsFOSS4G 2009
IT investments & maintenance
time
requ
ests
![Page 22: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/22.jpg)
http://www.52north.org/wpsFOSS4G 2009
IT investments & maintenance
time
requ
ests
20.000$
![Page 23: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/23.jpg)
http://www.52north.org/wpsFOSS4G 2009
IT investments & maintenance
time
requ
ests
20.000$
40.000$
![Page 24: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/24.jpg)
http://www.52north.org/wpsFOSS4G 2009
IT investments & maintenance
time
requ
ests
20.000$
40.000$
80.000$
Taifun?
![Page 25: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/25.jpg)
http://www.52north.org/wpsFOSS4G 2009
IT investments & maintenance
time
requ
ests
20.000$
40.000$
80.000$
120.000$
![Page 26: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/26.jpg)
http://www.52north.org/wpsFOSS4G 2009
Mass market
• Mass Market Application many requestsScaleability
![Page 27: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/27.jpg)
http://www.52north.org/wpsFOSS4G 2009
Mass market
![Page 28: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/28.jpg)
http://www.52north.org/wpsFOSS4G 2009
Mass market
![Page 29: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/29.jpg)
http://www.52north.org/wpsFOSS4G 2009
Mass market
![Page 30: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/30.jpg)
http://www.52north.org/wpsFOSS4G 2009
Legally Binding Performance
• INSPIRE– Search Queries
• Maximum 3 sec response time*
• Handle 30 parallel requests per second
– Image Download• Maximum 5 sec response time*
• Handle 20 parallel requests per second
– Overall 99% service availability (362 days/year uptime)
* During normal traffic (90% of uptime).
![Page 31: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/31.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI Role Model
![Page 32: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/32.jpg)
http://www.52north.org/wpsFOSS4G 2009
publish
publish
find
bind
bind
Georesource owner/provider
Georesource owner/provider
Publish-Find-Bind
![Page 33: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/33.jpg)
http://www.52north.org/wpsFOSS4G 2009
publishpublishfind
bind
bindGeoresource owner
Georesource owner
Georesource provider
Georesource provider
![Page 34: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/34.jpg)
http://www.52north.org/wpsFOSS4G 2009
The 52°North WPS in the Clouds
![Page 35: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/35.jpg)
http://www.52north.org/wpsFOSS4G 2009
WPS 101
What is a WPS?
Web Based Processing
WPS
WPS
![Page 36: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/36.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI Integration
• Processing
![Page 37: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/37.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI Integration
• Processing
![Page 38: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/38.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI Integration
• Processing
![Page 39: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/39.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI Integration
• Processing
![Page 40: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/40.jpg)
http://www.52north.org/wpsFOSS4G 2009
SDI Integration
• Processing Service
![Page 41: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/41.jpg)
http://www.52north.org/wpsFOSS4G 2009
Amazon EC2
![Page 42: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/42.jpg)
http://www.52north.org/wpsFOSS4G 2009
Amazon EC2
MasterImage„ami“
CloudWatch
AutoScale
![Page 43: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/43.jpg)
http://www.52north.org/wpsFOSS4G 2009
Amazon EC2
SaaS
PaaS
IaaS
![Page 44: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/44.jpg)
http://www.52north.org/wpsFOSS4G 2009
Amazon EC2
![Page 45: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/45.jpg)
http://www.52north.org/wpsFOSS4G 2009
Google Apps Engine
![Page 46: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/46.jpg)
http://www.52north.org/wpsFOSS4G 2009
Google Apps Engine
101010010101
![Page 47: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/47.jpg)
http://www.52north.org/wpsFOSS4G 2009
Google Apps Engine
![Page 48: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/48.jpg)
http://www.52north.org/wpsFOSS4G 2009
Google Apps Engine
![Page 49: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/49.jpg)
http://www.52north.org/wpsFOSS4G 2009
Conclusion
![Page 50: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/50.jpg)
http://www.52north.org/wpsFOSS4G 2009
Conclusion
• SDI services can be deployed in cloud environments Change in role model (P-F-B)
![Page 51: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/51.jpg)
http://www.52north.org/wpsFOSS4G 2009
publishpublishfind
bind
bindGeoresource owner
Georesource owner
Georesource provider
Georesource provider
![Page 52: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/52.jpg)
http://www.52north.org/wpsFOSS4G 2009
Conclusion
• Google Cloud easy to use good for light-weight applicationGood integration with other google apps
• Amazon cloudMore complicated to useFull-scale solutionFlexible
Scaleability provided
![Page 53: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/53.jpg)
http://www.52north.org/wpsFOSS4G 2009
Conclusion
• External Interoperability (Open Standards)
• NO internal interoperabilityVendor lock-in
Proposal:
![Page 54: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/54.jpg)
http://www.52north.org/wpsFOSS4G 2009
Abstraction Layer
Abstraction Layer
SaaS
![Page 55: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/55.jpg)
http://www.52north.org/wpsFOSS4G 2009
Abstraction Layer
Abstraction Layer
Geospatial Layerin the cloud
SaaSPaaS
![Page 56: Geoprocessing in the Clouds FOSS4G 2009 Bastian Schäffer 52°North](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56814736550346895db47390/html5/thumbnails/56.jpg)
http://www.52north.org/wpsFOSS4G 2009
Conclusion
Future:
Impact on GIS Business Models– Selling of full GIS packages SaaS