managing image data on the arcgis platform - options and ......managing image data on the arcgis...
TRANSCRIPT
Managing Image Data on the ArcGIS PlatformManaging Image Data on the ArcGIS PlatformOptions and Recommended ApproachesOptions and Recommended Approaches
Peter BeckerPeter Becker
• Petroleum requirements for imagery and raster• Traditional solutions and issues• Overview of ArcGIS imaging capabilities• Demonstration• Resolving the imagery issues• Recommendations
Imagery and Rasters in the Petroleum Industry
• Base for most geospatial applications• Background image• Source for interpretation• Temporal change• Raster Analysis
• Multiple sources:• Satellites: QB, Ikonos, ..• Aerial photography: orthophotos, (few raw camera data)• Scanned maps• Elevation data
2
Most petroleum companies have a high investment in imagery and rasters
Requirements in Petroleum Industry
• Need to maximize the value of imagery• Provide Accessibility
– Large range of applications– Different locations
• Data Managers– Large collections of existing imagery– New imagery being acquired
• Users– Accessibility– Capability
Data Managers – Traditional Approach
• Handle images as individual files–Stored on disk – Multiple formats–Stored in database – Managed ArcSDE Raster Catalogs
• Create mosaic–Raster Mosaic – ArcSDE–Bunch of (tif) files–MrSID, ECW, JPEG2000
Data Managers – Traditional Issues
• Data management• Volume – Data duplication• Disparate datasets• Different resolutions• Temporal• Dynamics• Security
t1t2
t3t4
t5
? ?
? ?
Users – Traditional Approach & Issues
• Traditional - Open File
• Updated - Open web service
• Issues– Which image / service – Formats – TIF, JPEG, JPEG2000, NITF, ECW, MrSID, ERS, BIL, FLT, RAW ……..
– Projections – DD WGS84, UTM, StatePlane,….
– Speed – zzzzzzzzzzzzzzz– Bandwidth – DSL connection– Metadata – what metadata?– Capability – What can I do?– Dynamics – New imagery available
What has changed?
• ArcGIS Desktop – Improvements• ArcGIS Server – Image Services• ArcGIS Server – Image Extension (Image Server)• ArcGIS Server – Map Caching• Web Applications – WebMap, JavaScript, Silverlight, ArcGIS Explorer,
Google Earth, Virtual Earth
ArcGIS Provides Enterprise Image Management
• Manages catalogs of imagery from various sources• Integrates imagery into workflows toCollect, Manage, Produce and Exploitall forms of geospatial data
• ESRI has a long history ofimagery/raster solutions
• ESRI users are the largestcollection of professionalimagery users in the world.
Imagery adds value to GIS, GIS adds value to imagery“They are two sides of the same coin”
UC 2008 Tech Workshop 9
ArcGIS Integrates Imagery
ArcGIS provides:A scalable, standards based andgeneric, cross industry platformtechnology to:
• Manage• Process• Analyze• Disseminate• Visualize• Exploit
Imagery, in a wide range of applications
ArcMap
RasterMosaic
MosaicTile
RectifiedScene
NoneRectified
Use
Serve
Author
Web MapViewer
Desktop Explorer
GIS Server
Mobile OpenAPIs
Enterprise Service Bus
ImageServices
As part of the complete Enterprise GIS
Components of a completeEnterprise Image Management solution
• ArcGIS Desktop• Integrates all forms of geospatial data including imagery• Is the authoring tool for information and knowledge
• ArcGIS Server• Provides the Services Orientated Architecture• Provides the GeoDatabase
• ArcGIS Server Image Extension• Provides the solution for large numbers of images
• Other important components include:ArcGIS Explorer, Spatial Analyst, GeoDatabase Rasters, ArcGIS Online, Appliances, Professional Services, Partner Solutions
ArcGIS Desktop provides for Imagery
• Access• Individual Rasters• Raster Catalogs/Mosaics• Image Services
• Visualization• Band combination, Band stretch, Contrast• Projection• Pan Sharpen, Orthorectification
• Analysis / Processing• Mosaic, clip• Georeferencing• Pan Sharpen, Orthorectification• Spatial Analysis
• Management• Files, GDB rasters, Image Services
RasterMosaic
RasterCatalog
MosaicTile
RectifiedScene
NoneRectified
GP Tools
ArcGIS Desktop
Image ServerIS Direct Connect
ArcGIS Server
Image Service WMS/WCS
ArcGIS Server Family
Serve
3 Tiers
GlobeServices
MapServices
Analysis &ModelingServices
Web MapViewer
Desktop Explorer Mobile EnterpriseService Bus
OpenAPIs
Use• Many Clients
Author• Desktop
GeoCodingServices
GeoDataServices
Imagery is an integral part of a complete GIS
ImageServices
Multi-platform
ArcGIS Server provides for Imagery
Access• Image Services
Serve any raster dataset• Open Standards: WMS, WCS, SOAP,
REST, KML…• Imagery data, not just “pictures”• Many clients ArcMap, 3rd Party, JavaScript,
Flex,…• Image extraction• Caching for optimized very large scale web
access• Processing
• Server rendering• Geoprocessing
• Management• Simple• Web based & ArcCatalog
MapDoc.
ArcGIS ServerMap
DesktopArc
Engine3rd
Party
ArcMap
ArcGlobe
Globe Mobile
Mobile.Net
Mobile
ArcGISExplorer
WebMap.NET/Java
Web
GoogleEarthKML
OGCWMS
OGCWCS
Google MapsMicrosoft
Virtual Earth
Mashup
Image
SOAP, RESTWMS, WCS, KML
ServiceDefinition
ArcGIS Server - Image ExtensionArcGIS Image Server technologyExtends ArcGIS Server to:
• Access• Single point of access to large collections of images• Client control over imagery mosaic / delivery• Maintain source information for every pixel• Additional CAD & GIS clients
• Processing• Dynamic mosaicking• On-the-fly processing• Multiple products from same source
(Natural Color, False Color, IR, NDVI) without data duplication
• Management• Maintain source data and metadata• Define image processing• Limited pre-processing required
Use
Serve
Author
Image Extension
ServiceDefinition
ServiceDefinition
ServiceDefinition
ArcGIS Server
ArcGIS Image Server Paradigm Combine Processing with Serving• Keep imagery in native form• Author service definition (catalog)
• Properties of images• Processing to be applied• Properties of the service• Generate service overviews (optional)
• Publish image service• Client application accesses image service
• Defines area of interest• Server accesses and processes imagery• Required image transmitted to client• Client displays image
Use
Serve
Author
Image ExtensionImage Extension
ServiceDefinition
ServiceDefinition
ServiceDefinition
ArcGIS Server
Radiometric Processes
• Extract / Stack Bands• Image Algebra, NDVI• Spectral Matrix• Grayscale• Stretch• Convolution Filter• Pan-sharpen• Trend• Classify• Colormap• Elevation Visualization• Histogram
Geometric Processes
• Reproject, Warp, Orthorectify• Single Sampling, improves quality
• Clip/crop image to:• Exclude non wanted areas• Seamlessly blend images
• Mosaicking Methods• Reorder overlapping imagery
• By Attribute – Date, SunAngle, …..• Closest Nadir – Most top down• Viewpoint – North, East, South, West• Lock Image – Specific image(s)• Seamline – Blend
Client Controllable Image Service Properties
• Projection• Define output projection, irrespective of input projections
• Sampling methods• Nearest neighbor, bilinear, cubic convolution
• Compression for transmission• JPEG, JPEG 2000, LZ77• Enables access over low bandwidth networks
• Mosaic method• Controls overlap• Lock Image
• Metadata Access
Accessing Image Services
• Large Number of clients• Desktop
• ArcGIS, AutoCAD, Microstation, GeoMedia, …• ArcGIS Explorer 900• WMS, WMC
• Web• WebMap, JavaScript, Flash, Silverlight• WMS, WCS
Demonstration
• Accessing image Services• Author image service of satellite imagery• Author image service of elevation data
Additional Applications
• Geospatial Raster Analysis – Spatial Analysis• Partners – Provide Best of Breed technology
• Image Analysis – ITT ENVI• Feature Extraction – ITT ENVI FX, Ecognition• Stereo Capture – BAE, DAT/EM
• Service Orientated Architectures
ArcGIS ServerImage Service
ArcGIS ServerGeoProcesing Service
Users – New Approach & Issues Resolved
• Open Application• Zoom to AOI• View Imagery• Access Metadata• Change properties
• Issues?– Which image / service: Combined, Best imagery on top– Formats: Irrelevant– Projections: Resolved– Speed: Fast– Bandwidth: Low if necessary– Metadata: Accessible– Capability:
– Use as picture (view) or data (analysis)– Order imagery to exploit temporal– Utilize dynamic range and multispectral
– Dynamics: New imagery become available
Data Managers – New Approach & Resolved Issues
• Leave images in their existing locations/formats• Create and Serve Image Service Definition• Create multiple image products• Update as new imagery or parameters becomes available• Issues
– Data management: Simplified– Volume – Reduced: No data duplication, compression where possible– Disparate datasets: No issue– Different resolutions: No issue– Temporal: Can be exploited– Dynamics: Update as required– Security: Solved
t1t2
t3t4
t5
✓ ✓
✓ ✓
How to achieve requirements?
• Catalog and Serve existing data– Create Image Services
• New image acquisition– Add to existing Image Services
• Use Image Services to make imagery accessible• Value of imagery increased• Rapid Return of Investment
Implementation Recommendations
• Identify all imagery/rasters• Formats, volume, type, projections, metadata
• Remove duplicates & derived products (eg reprojected/mosaicked)• Add to central storage (DAS,NAS,SAN)• Create ‘Best’ Image Services
• Imagery• Color Imagery• False-Color Imagery• NDVI
• Elevation• Elevation• Shaded Relief• Relief Shade• Aspect
• Add metadata attributes (eg source)• Use in all geospatial applications• Create Special Service (Security, application specific)• If need to scale to very large number of users
• Create Map Cache from Image Service• Distribute Cache on separate location
Scaling to very large number of user
ServiceDefinition
ServiceDefinition
ServiceDefinition
Image Extension
ArcGIS Server ArcGIS ServerCaching GP
AuthorService Overviews
Basic Imagery
MoreAdvancedUsers
GeneralUsers
ImageServiceWMS, WCS, KML
Cache,WMS,KML
Tiles
On Demand Caching
Use
Serve
Author
Image ExtensionImage Extension
ServiceDefinition
ServiceDefinition
ServiceDefinition
ArcGIS Server
Use
Serve
Author
Image ExtensionImage Extension
ServiceDefinition
ServiceDefinition
ServiceDefinition
ArcGIS Server
Image ExtensionArcGIS Server
GeoDatabase
Collect Manage
ExploitProduce
Files
Parameters
Services/Orthos Visualize/Analyze
Image ExtensionArcGIS Server
GeoDatabase
Collect Manage
ExploitProduce
Information Centric Approach to WorkflowsArcGIS is the interoperable organizing system to enable workflows
• GeoDatabase – Common information model. Simplifies integration of disparate systems• ArcGIS Server – Enables SOA + Federated/Distributed storage and management• ArcGIS Desktop – Uniform and integrated environment for managing and authoring• Web clients – Web query and exploitation
GISFiles
Imagery
Vectors
Image Extension
ArcGIS Server
GeoDatabase
ArcGIS Imagery Based Workflows / SolutionsWorkflows contain many standard tasks
42
31
Plan
Acquire
ProcureCatalog Refine
Radiometry (Color Enhance)
RefineGeometry
Process
MosaicMaintain
ExploitAnalyze
Visualize
Order of the tasks need not be linear
Files
Name used depends on industry
ArcGISMaximizes the Value of Imagery
• Enterprise wide image accessibility• Increases access and use• Very large image datasets• Within GIS, CAD, imaging, and Web applications
• Direct read of imagery in its native form• Simplifies data management• Reduces redundancy• Reduce delay in making imagery accessible
• On-the-fly server-based image processing• Dynamic Mosaicking• Serves multiple customized imagery products• From a single source• Utilizes image depth• Makes imagery dynamic
• End users get• Fast image access• Optimized to their requirements• Improved image quality• Important image metadata