esri uc 2014 | technical workshop | creating surfaces steve kopp steve lynch

48
Creating Surfaces Steve Kopp Steve Lynch

Upload: berniece-spencer

Post on 22-Dec-2015

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Creating SurfacesSteve Kopp

Steve Lynch

Page 2: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Overview

• Learn the types of surfaces and the data structures used to store them

• Emphasis on surface interpolation• Learn the interpolation workflow• Understand how interpolators work• Understand how to choose an appropriate interpolation technique and its parameters

Creating Surfaces

Page 3: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Types of Surfaces

• Elevation

• Soil chemistry

• Water quality

• Population

• Income

• Disease occurrence

Creating Surfaces

Page 4: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

What kind of surfaces do you create?• What is the source data?

- Points, lines, polygons, raster- Is quality a concern

• What is the phenomenon?- Measurements, counts, something else

• Anything special or odd about it?- Discontinuous- Highs and lows sampled or not

• What do you want/expect for a result?- Raster, TIN, contour lines or polygons, estimates at points, estimate of

surface quality

Creating Surfaces

Page 5: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Storing surfaces in ArcGIS• Raster

• TIN / Terrain

• Points- LAS

• Isolines / Contours

• Geostatistical Layer

78

74

72

67

69

56

71

49

58

50

69

64

53

58

44

55

37

22

38

31

48

24

68

74

61

53

47

34

21

12

16

11

19

12

46

49

Creating Surfaces

Page 6: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

TIN and Terrain

• Maintain accuracy of measured locations

• Discontinuities are handled with breaklines• Hard breaklines (cliff, fault) • Soft breaklines (road, stream)

Creating Surfaces

Page 7: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Where do I find these capabilities?

• Spatial Analyst – raster, contour

• 3D Analyst – raster, contour, TIN, terrain

• Geostatistical Analyst – raster, contour line, filled contour polygon, point, geostatistical layer

• ArcGIS Online – filled contour polygon

Creating Surfaces

Page 8: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

2 common types of surfaces

• Density surfaces = counts of things over an area

• Interpolated surfaces of measured quantitiesThis session is about interpolation

Creating Surfaces

Page 9: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Density

• Density surfaces are maps of magnitude per unit area

• Count occurrences of a phenomenon within an area and distribute it through the area.

• Simple Density and Kernel Density

• Use points or lines as input.- Population per Km2- Road density per Mi2

Creating Surfaces

Page 10: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Interpolation

• Interpolation is the process of transforming measurements of a continuous phenomenon into a continuous surface representation

Estimating new values at unsampled locations

Creating Surfaces

Page 11: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Types of input for Interpolation

• Points- Continuous values

- LAS

• Polylines- Contours

• Polygon- Centriod- Areal Interpolation- Dasymetric mapping

• Raster- Fill in missing values- Change resolution through Resampling or Interpolation- Modify surface with supplemental data

Creating Surfaces

Page 12: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Interpolation Steps

1) Understand your data

2) Experiment with techniques and parameters

3) Create surfaces

4) Evaluate your surfaces

5) Repeat…

Creating Surfaces

Page 13: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Exploratory Spatial Data Analysis

• Where is the data located?

• What are the values of the data points?

• How does the location of a point relate to its value?

Creating Surfaces

Page 14: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Explore your Data

• Outliers

• Trends

• Spatial Dependency

• Distribution- Statistical distribution of values

- Spatial distribution of points

• Stationarity

Creating Surfaces

Page 15: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Demonstration

Exploring your Data

Page 16: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Two parts of all interpolators

1) Neighborhood definition – where do I find known points to estimate a new value

2) Estimation function – from those points, how do I calculate a new value

Creating Surfaces

Page 17: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Searching neighborhood

• Variable number of points- Specify a maximum search distance and number of points, a smaller number of

points may be used.

- Can result in NoData cells

• Fixed number of points- Specify a minimum number of points, and the search distance is increased until that

number of points is found.

Tobler’s first law of geography applies "Everything is related to everything else, but near things are more related than distant things."

Creating Surfaces

Page 18: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Searching Neighborhoods with Multiple sectors

Available in Geostatistical Analyst

Creating Surfaces

• Multi-sector neighborhoods are very useful for data with an irregular spatial distribution or clustering

Page 19: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Questions to ask about your data

• Characteristics of phenomena?

• Sample spacing- Oversampled or needs extrapolation?

• Honor the input points?

• Barriers or discontinuities?

• Specialized needs- Topo To Raster (hydro applications)

• Suspected spatial patterns, trends, error?

Creating Surfaces

Page 20: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Interpolation algorithms in ArcGIS

- Natural Neighbors

- Minimum Curvature Spline

- Spline with Barriers

- Radial Basis Functions

- TopoToRaster

- Local Polynomial

- Global Polynomial

- Diffusion Interpolation with Barriers

- Kernel Interpolation with Barriers

- Inverse Distance Weighted

- Kriging

- Cokriging

- Moving Window Kriging

- Geostatistical Simulation

Creating Surfaces

Page 21: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Choosing an interpolation method

• You know nothing about your data…- Use Natural Neighbors. Its is the most conservative, honors the points. Assumes all highs

and lows are sampled, will not create artifacts.

• Going the next step in complexity…- Use Kernel Interpolation

• Your surface is not continuous…- Use Kernel Interpolation or Spline with Barriers if you know there are faults or other

discontinuities in the surface.

• Your input data is contours…- Use TopoToRaster. It is optimized for contour input. If not creating a DEM, turn off the

drainage enforcement option.

• You want a geostatistical method- Use Empirical Bayesian Kriging

Creating Surfaces

Page 22: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Considerations in choosing an interpolator

• Standard error of prediction

• Stationarity

• Normally distributed

• Exact interpolator

• Support barriers

• Speed

Creating Surfaces

Page 23: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

The simplest, safest interpolator… Natural Neighbor

Creating Surfaces

Page 24: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Kernel Interpolation

Creating Surfaces

Page 25: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Demonstration

Easy Interpolations of Ozone Concentration

Page 26: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

You want a prediction standard error map

• Choose from:• Kernel Interpolation• Local Polynomial Interpolation• Kriging

Creating Surfaces

Page 27: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

You want an exact interpolator that honors the points

• Choose from: • Natural Neighbors• Spline• Radial Basis Function• IDW

Creating Surfaces

Page 28: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

The high and low values have not been sampled… and are important

• Do not use• Natural Neighbors• IDW

Creating Surfaces

Page 29: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

You want smooth interpolation

10.1

10.3

12.5 9.1

Unlike smoothing the output, this method modifies the weights

Smooth interpolation is an option in the Geostatistical Analyst interpolatorsCreating Surfaces

Page 30: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

When to use Kriging

• Assumptions:- Spatially correlated

- Stationary *

- Normally distributed- or transformed to normal

• Want prediction and prediction standard error

Creating Surfaces

Page 31: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

If you know the phenomenon is correlated with something measured more

• If you have a sparsely measured variable such as temperature, which is correlated with another variable such as elevation that has much more sampling…

Use CoKriging

Creating Surfaces

Page 32: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Empirical Bayesian Kriging

• Advantages• Requires minimal interactive modeling • Allows accurate predictions of non-stationary data• More accurate than other kriging methods for small datasets• Geoprocessing tool

• Disadvantages• Processing is slower than other kriging methods.• Cokriging and anisotropy are unavailable.

Creating Surfaces

Page 33: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Demonstration

Kriging Ozone Concentration

Page 34: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Cliffs, faults, or barriers in your study area

• Kernel Interpolation with Barriers

• Diffusion Interpolation with Barriers

• Spline with Barriers tool - Uses Zoraster algorithm, similar result to ZMap- Straight line barrier exclusion

Creating Surfaces

Page 35: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Interpolation with Barriers

?

Barrier

?

Barrier

Non Euclidean distanceLine of sight

• IDW • Kernel Interpolation with Barriers• Diffusion Interpolation with Barriers• Spline with Barriers

Creating Surfaces

Page 36: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Demonstration

Geologic Interpolation with barriers

Page 37: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

For contour input, and creating hydrologic DEMs

• Topo To Raster- ANUDEM

• Inputs- Spot heights

- Contours

- Streams

- Sinks

- Lakes

• Optional drainage enforcement

Creating Surfaces

Page 38: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Demonstration

TopoToRaster for DEM Creation

Page 39: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Your input is polygons

• Statistically robust method for creating surfaces from aggregated polygon data

• And aggregating back to other polygons

Use Areal Interpolation

Obesity by school zoneObesity by school zone Obesity surface and Obesity surface and

error surfaceerror surface

Obesity by census blockObesity by census block

Creating Surfaces

Page 40: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

How good is your surface?

• Standard Error surface

• Cross Validation

• Subset Features

Creating Surfaces

Page 41: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Your input is equally spaced points

• If input points are already equally spaced on a regular grid, you probably don’t need to interpolate, just use PointsToRaster

Creating Surfaces

Page 42: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

You have many input points per output cell

• If your data is highly oversampled, you probably do not need to interpolate, you can just use the PointsToRaster tool, and select the statistic of interest.

Creating Surfaces

Page 43: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Working with VERY large input point data

• Point To Raster- Most frequent

- Sum, mean std. deviation

- Minimum, maximum, range, count

• Smaller input extent

• Subset Features

Creating Surfaces

Page 44: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Handling Coincident/Duplicate Points

Creating Surfaces

Page 45: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Why don’t all softwares create the same result?

Minor differences may also occur due to slight variations in implementation, or compiler optimization

Creating Surfaces

12.211.2

9.7

10.1

• Equidistant points

• Duplicate points

• Zeros or Nulls

Page 46: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

The slide to remember…

1) Understand your data

2) Experiment with techniques and parameters

3) Create surfaces

4) Evaluate your surfaces

5) Refine parameters and repeat…

Creating Surfaces

Page 47: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop |

Please fill out the session evaluation

Session ID:

Online – www.esri.com/ucsessionsurveys

Paper – pick up and put in drop box

Thank you…

Creating Surfaces

Page 48: Esri UC 2014 | Technical Workshop | Creating Surfaces Steve Kopp Steve Lynch

Esri UC 2014 | Technical Workshop | Creating Surfaces