interoperability for the enterprise...fgdc metadata, iso metadata 3. data management (semantic and...

David Danko

Senior Consultant GIS Standards, ESRI

Interoperability for the Enterprise

W hat we are going to talk about

Defining Interoperability

Standards a key com ponent

ISO

W 3C

G eographic standards

The w ork of ISO TC211 and OGC and others

Understanding Geospatial Standards

GeoW eb Service Standards

Portals

CAD

Im agery

M odels

Tables

Features

Surveys

GIS Services

W eb Services Networks

Social Factors

Roads/Infrastructure

Signal Intelligence

Land Use/Land Cover

Environm ent

Im agery

Base M aps

G IS has alw ays required Interoperability

Geographic analysisM ultiple sources, m ultiple organizations

Distributed w ithin a com m unity

M erging diverse inform ation types

Enterprise GIS

GIS evolving beyond isolated com m unities

GIS m erging w ith broader IT infrastructures

G IS W eb ServicesEnabled by distributed netw orks

Loosely coupled

G overnm ent PolicyEU Directives

US E-governm ent Act

Interoperability

Be able to:find w hat you need;

access it;

understand and em ploy it;

have goods and services responsive to the needs of

consum ers(2)

the ability of two or m ore system s or com ponents

to exchange inform ation and to use the

inform ation that has been exchanged (1)

(1) IEEE(2) ISO TC211

Types of interoperability

TechnicalM achine to m achine connections

Softw are m odule interaction

APIs

Sem anticCom m on understanding concepts, term s

inter-

Hum anCooperation

Legal /PolicyDigital rights, ow nership

=

Interoperability Enablers

Authorization

Copyright

Business Agreem ents

Policy Fram ework

Incentives to cooperate

Business M odels

Infrastructure

Networks

Support for m ultipleLanguages

Custom s

View s

Data Form ats

Projections

Datum s

M etadata

Shared Best Practices

Standards

How does ESRI address interoperability enablers?

Participating in Standards

to understand interoperability and im plem ent standards

from DIM E > SDTS > VPF > KM L > GM L3.2

w ith dom ain specialists to develop standardized data/inform ation m odels

as good GIS citizens to consensually develop good standards and

specifications

Providing

GIS education, publications

ETL capabilities to transform betw een form ats and m odels

the GeographyNetw ork and ArcW eb Services

Supporting

organizations w hich prom ote interoperability and the use of standards

GSDI, Digital Earth, FGDC, GeoConnections

Participation in Standards

Im plem enting

Platform

GIS standards

IT/industry standardsDevelopm ent

International StandardsRegional StandardsNational StandardsInform ation Com m unity Standards

UNIX®

W hat is a standard?

Definition:

Docum ented agreem ents

betw een a provider and a consum er

Reference docum ents

used in public contracts or international trade

Definitions of characteristics, Technical specifications, precise criteria, rules, guidelines,

Function:

Ensure m aterials, products, processes and services are fit for purpose

Help ensure interoperability

Prom ote innovation, com petition, com m erce and free trade

As defined by ISOhttp://w w w.iso.ch

Functions

Standards

Consensus technical solutions

Political com prom ise

Technology transfer

Dem ocratic m echanism

From H.Tom Standards for Enabling International Interoperability

Standards

M ake things w ork affect every aspect of life

W idespread use of Standards

M ake things w ork around the w orld

Increase efficiency -globally

Developing standards is a lot of w ork

M any organizations involved

Take tim e to develop

Com plicated

20% technical 80% political

International Organizationfor Standardization

Founded in 1947

146 m em ber nations

1 m em ber per country (represented through national standards organization ANSI, SAC, etc)

13700 standards, 3000 technical bodies, 30000 experts

NG O unlike UN

Delegates not national governm ents

Roots in private sector and industry associations

Hallm ark of ISO Brand

Equal footingEvery ISO m em ber institution has right to take part1 nation 1 vote regardless of size or econom ic strength

VoluntaryISO has no legal authorityAdopted by nations health, safety, etc

M arket drivenDeveloped by experts from industry, technical, business, governm ent, academ ic

Consensus Ensures w idespread applicabilityRem ain current

Benefits of ISO Standards

Business/Trade

W ide acceptance of products and services

Free to com pete in broader m arket

Rem ove technical trade barriers

Support political trade agreem ents

G overnm ent

Provides technical and scientific underpinnings for health,

safety, environm ental legislation

Consum ers

Provides assurance about quality, safety, & reliability

Contribute to quality of life

Proposal Stage

Preparatory Stage

Com m ittee Stage

Enquiry Stage

Approval Stage

Publication Stage

This is the stage to start product developm ent

This is the stage to use in RFP

This is the stage to start prototyping

The ISO Developm ent Process

All work perform ed in technical com m ittees (TC)

Form al ProcessRefined over 50 years

Stages and tim elines fully defined

Consensus basedDrafts considered until consensus reached through voting process by P-m em bers

Environm ental

Business Applications

Police

Planning

Roads

Utilities

Provides a Fram ework for Integrating GIS and Enterprise System s

W eb Services &M essaging

SO AP

W SDL

UDDIXM L

W eb Services Standards

W eb Services

An application that exposes a W eb-accessible

API.

A standard platform for building interoperable

distributed applications.

Achieves interoperability by relying on vendor

and platform neutral standards such as XM L

and XSD.

XM L eXtensible M arkup Language

XSD XM L Schem a Definition language

W eb Services Technology Stack

SOAP -Sim ple Object Access Protocol is a lightw eight XM L based protocol used for invoking w eb services and exchanging structured data and type inform ation on the W eb

UDDI -Universal Description Discovery and Integration provides a m echanism for clients to dynam ically find other w eb services.

W SDL -W eb Services Definition Language (W SDL) is an XM L docum ent that describes a W eb service. It specifies the location of the service and the operations (or m ethods) the service exposes.

Service Oriented Architecture*SOA

Service Provider

Service Requester

Service Broker Publish

Service

ServiceDescription

ServiceDescription

Client

*From W eb Service Architecture, 14 Nov. 2002

Geographic Inform ation Standardization

GIS Standardization functional areas

1. Basic Geographic Structures (sem antic interoperability)SDTS, ISO Spatial Schem a, Coordinate Ref System s standards

2. Content Description (sem antic interoperability)FACC, SDSFIE, Standardized Data M odels

ISO Feature Catalog M ethodology , UM L, Application schem a, FGDC M etadata, ISO M etadata

3. Data M anagem ent (sem antic and technical)OGC Sim ple Features

4. Data Form ats (technical interoperability)VPF, OGC GM L

5. Visualization (sem antic and technical)SLD, M IL-STD 2525

6. G eoW eb Services (technical interoperability)OGC Catalog, W eb Services, SOA

Using standardized spatial schem as

Using standardized m odeling languages

and rules for application schem as Street

Schem a forRulesRelationshipsDefinitionsBehavior

Topology

Vectors

Netw orks

Nam e

Parcel

Sm ithBuilding

provide geographic knowledge

1. Basic G eographic Structure

2. Content Description

3. Data M anagem ent4. Data Form at5. Visualization6. W eb services

Producing user view s

infrastructure, brick by brick ...

ESRI participates through ANSI/INCITS L1

w w w.ISOTC211.ORG

ISO 6709:1983, Standard representation of latitude, longitude and altitude for geographic point locationsISO 19101 -Reference m odelISO 19102 Overview -deletedISO/TS 19103 -Conceptual schem a languageISO 19104 -Term inologyISO 19105 -Conform ance and testingISO 19106 -ProfilesISO 19107 -Spatial schem aISO 19108 -Tem poral schem aISO 19109 -Rules for application schem aISO 19110 -Feature cataloguing m ethodologyISO 19111 -Spatial referencing by coordinatesISO 19112 -Spatial referencing by geographic

identifiersISO 19113 -Quality principlesISO 19114 -Quality evaluation proceduresISO 19115 -M etadataISO 19116 -Positioning servicesISO 19117 PortrayalISO 19118 -EncodingISO 19119 -ServicesISO/TR 19120 -Functional standards + new revISO/TR 19121 Im agery and gridded dataISO/TR 19122 -Qualifications and certification

of personnelISO 19123 -Schem a for coverage geom etry and

functions

ISO/RS 19124 -Im agery and gridded data com ponents

ISO 19125 -Sim ple feature access Part 1-3ISO 19126 -Profile -FACC Data DictionaryISO 19127 -Geodetic codes and param etersISO 19128 -W eb M ap Server InterfaceISO 19129 -Im agery, gridded and coverage data

fram eworkISO 19130 -Sensor and data m odel for im agery

and gridded dataISO 19131 -Data product specificationISO 19132 -Location based services possible standardsISO 19133 -Location based services tracking and navigatioISO 19134 -M ultim odal location based services

for routing and navigationISO 19135 -Procedures for registration of

geographic inform ation item sISO 19136 Geography M arkup Language (GM L)ISO 19137 - Generally used profiles of the spatial schem a and of sim ilar im portant other schem asISO 19138 -Data Quality M easuresISO 19139 -M etadata -Im plem entation SpecificationISO 19140 -Technical am endm ent to the ISO 191** Geographic inform ation series of standards for harm onization and enhancem entsISO 19141 M oving featuresISO 19142 W eb Feature ServiceISO 19143 Filter EncodingISO 19144 Classifications System s

ISO TC 211 Projects

The Foundation

Fram ew ork/standards infrastructure

Basic architecture

Locate, understand

M etadata

Quality

Basic structure

Spatial, tem poral schem as

CRS definition

Access

Sim ple feature access

W eb m ap services

Data content description

Feature Catalog M ethology

Rules for Application Schem a

Adv.G-Strat

W G 2Geospatialm odels

and operators

W G 3Geospatial

dataadm inistration

W G 4Geospatialservices

W G5Profiles andFunctionalstandards

W G 1Fram ew ork andReferencem odel

M HT

SW G-QC

Otherprojects

AG Registry

AG LBS

Chairm anOlaf Østensen

Norw ay

O rganization 1994-2001

AG Strategy

W G 6

Canada

W G 7Antony CooperSouth Africa

W G 8M artin Ford

UK

W G 9 Hiroshi Im ai

Japan

W G 4M orten Borrebæ k

Norw ay

G eospatial services

Im agery Inform ationcom m unities

Locationbasedservices

Inform ationm anagem ent

AG Outreach

M HT

Chairm anOlaf ØstensenSecretary

Bjørnhild Sæ terøyNorw ayTM G

TF 211/204

ISO TC 211 Organization 2002 -present

Countries + 61 Liaison organizations + 26 Standards com m ittees + 13

ISO TC211 StandardsUsed by ESRI Developm ent

ISO 6709:1983 Standard representation of latitude, longitude and altitude for geographic point locations

ISO 19101:2002 Reference m odel

ISO/TS 19103:2005 Conceptual schem a language

ISO 19105:2000 Conform ance and testing

ISO 19106:2004 Profiles

ISO 19107:2003 Spatial schem a

ISO 19108:2002 Tem poral schem a

ISO 19109:2005 Rules for application schem a

ISO 19110:2005 M ethodology for feature cataloguing

ISO 19111:2007 Spatial referencing by coordinates

ISO 19112:2003 Spatial referencing by geographic identifiers

ISO 19113:2002 Quality principles

ISO 19114:2003 Quality evaluation procedures

ISO 19115:2003 M etadata

ISO 19116:2004 Positioning services

ISO 19117:2005 Portrayal

ISO 19118:2005 Encoding

ISO 19119:2005 Services

ISO/TR 19120:2001 Functional standards

ISO/TR 19121:2000 Im agery and gridded data

ISO/TR 19122:2004 Qualification and certification of personnel

ISO 19123:2005 Schem a for coverage geom etry and functions

ISO 19125-1:2004 Sim ple feature access --Part 1: Com m on architecture

ISO 19125-2:2004 Sim ple feature access --Part 2: SQL option

ISO/TS 19127:2005 Geodetic codes and param eters

ISO 19128:2005 W eb m ap server interface

ISO 19131:2007 Data product specifications

ISO 19132:2007 Location-based services --Reference m odel

ISO 19133:2005 Location-based services --Tracking and navigation

ISO 19134:2007 Location-based services --M ultim odal routing and navigation

ISO 19135:2005 Procedures for item registration

ISO 19136:2007 Geography M arkup Language (GM L)

ISO 19137:2007 Core profile of the spatial schem a

ISO/TS 19138:2006 Data quality m easures

ISO/TS 19139:2007 M etadata --XM L schem a im plem entation

for a changing world.

Open Geospatial ConsortiumSpatial connectivity

Vision

A world in which everyone benefits from geographic inform ation and services m ade available across any network, application, or platform

M ission

Our core m ission is to deliver spatial interface specificationsthat are openly available for global use

W hat is the OGC?

Open Geospatial Consortium (OGC)

Global, not-for-profit, international voluntary consensus standards organization

Over 350 industry, governm ent, research and university m em ber organizations

Founded in 1994, Incorporated in US, UK, Australia

OGC leads the development, testing, promotion and harmonization of open spatial standards

W here does OGC fit in the

OASIS/IETF / W 3C

Infrastructure: W SDL,

UDDI, SOAP, XM L

ISO/ Other NationalDom ains:

Object/Abstract M odels, Content,

Vocabulary

O G C

Softw are Interfaces: Instantiate Dom ain and Dejure into Infrastructure

De Facto

De Jure

Dom ain Infrastructure

Specification Program

Board of Directors

Executive Director & Staff

Interoperability Program

Participants

Sponsors

Init. M gm t. Team

Interop.Initiative

Participants

Sponsors

Init. M gm t. Team

Interop.Initiative

Participants

Sponsors

Init. M gm t. Team

Interop.Initiative

IP M anagem ent Team

StrategicM em berAdvisoryCom m ittee

SpecialInterestG roup(SIG )

SpecialInterestG roup(SIG )

W orkingG roup(W G)

TechnicalCom m ittee

PlanningCom m ittee

M arket and Regional Program s

Strategic Alliances

Education

StandardsLiaison

StandardsLiaison

StandardsLiaison

Sub-Com m ittee

Sub-Com m ittee

Sub-Com m ittee

O utreach & Com m unityAdoption

Adopted OGC SpecificationsIm plem ented by ESRI

Catalogue Service Coordinate Transform ation Filter Encoding Geographic Objects Geography M arkup Language GM L in JPEG 2000

Grid Coverage Service Location Services (OpenLS)Observations and M easurem ents Sensor M odel Language Sensor Observation Service Sensor Planning Service

Sim ple Features

Sim ple Features CORBA

Sim ple Features OLE/COM

Sim ple Features SQL

Styled Layer Descriptor

Sym bology Encoding

Transducer M arkup Language

W eb Coverage Service

W eb Feature Service

W eb M ap Context

W eb M ap Service

W eb Processing Service

W eb Service Com m on

OGC specs equivalent in ISO

OGC Grid Coverages

ISO 19123 Schem a for coverage geom etry and functions

OGC Sim ple Feature Specification SQL

ISO 19125-1 Sim ple feature access -Part 1: Com m on architecture

ISO 19125-2 Sim ple feature access -Part 2: SQL Option

OGC W eb M ap Service

ISO 19128 W eb M ap Server interface

Geography M arkup Language

ISO 19136 GM L

OGC W eb Feature Service

ISO 19142 W eb Feature Service

OGC Filter Encoding

ISO 19143 Filter Encoding

These last tw o are now in developm ent in ISO

Exam ples of Standards and Organizations in w hich ESRI participates to establish Technical Interoperability

ISO 19139 M etadata XM L Schem a OGC W M S

OGC GM L

Exam ples of Standards and Organizations in w hich ESRI participates to establish Sem antic Interoperability

ISO 19115 M etadataTitle = nam e by w hich the resource is know n

m sgType = the code denoting the nature of the alert m essage.<elem ent nam e = "m sgType">

<sim pleType nam e = "m sgType" ><restriction base = "string"><enum eration value = "Alert"/><enum eration value = "Update"/><enum eration value = "Cancel"/><enum eration value = "Ack"/><enum eration value = "Error"/></restriction></sim pleType></elem ent>

FG DC Fram eworkdata m odels

OASIS Com m on Alerting Protocol-CAP

Standards which define term s, concepts, and inform ation schem as

M ilitary/Intel/NATO, Hydrographic, Em ergency

Digital Geographic Inform ation W GTechnical Panels and Project Team s

Data Access TPData Structures TPService and Interface TP

M ulti-National Geospatial Co-production Program

Geospatial-Intelligence Standards W orking GroupCom m unity Sensor M odel W orking Group (CSM W G) Geographic Portrayal Focus Group (PFG) M etadata Focus Group (M FG) Inform ation Transfer & Services Architecture (ITSA FG)

Transfer Standard M aintenance and Application Developm ent W orking Group

Geospatial M aritim e W G2

Em ergencyM anagem entTechnicalCom m ittee

Regional StandardsESRI Participation European Activities

European Com m ittee for StandardizationCom ité Européen de Norm alisationCEN TC 287

Sponsor secretariat (Developm ent)EU M etadata Profile (Im plem enting)

INSPIRESpatial Data Interest Com m unities SDIC (Developm ent)G eo-portal (Im plem enting)

Accredited by

ESRI is a principle m em ber INCITS L1 Subcom m ittee for geographic inform ation

Review , com m ent and approve US National Standards

by ANSI/INCITS

US TAG for ISO TC 211

Leading the developm ent of a North Am erican Profile of the ISO M etadata standards

ANSI/INCITS 320-1998 -Spatial Data Transfer Standard (SDTS)

ANSI/INCITS 353-2001 -Inform ation technology -Geographical Inform ation System s -Spatial Data Standard for Facilities, Infrastructure, and Environm ent (SDSFIE)

ISO 19100 standards adopted

National StandardsESRI Participation

Developm ent Im plem enting

Com m unicating geographic know ledge

Encapsulating the real w orldSem antic Interoperability

GIS Abstracts Geography into a M odern Inform ationTechnology Fram ew ork

M etadata

M odelsM aps

GeodataSets

DataM odels

G eodatabase

EncapsulatingReal W orld Know ledge

Data M anagem ent

GeoVisualization Decision Support

G IS

. . . Together They Represent the Building Blocks of Geographic Know ledge

G eodata Sets

Process and W orkflow M odels

M aps and Globes

M etadata

Data M odels

G IS abstracts geography into five basic elem ents

ISO 19107 Spatial Schem a(Geom etry)

Data M odels

ISO 19109 Rules for application schem a

Data M odels

Com m unity standardized Schem as to define rules, relationships, definitions, behavior Data M odels

Standardized GIS Data M odels

AddressAgriculturalAtm osphericBase M apBiodiversityCensus-Adm inBoundariesDefense-IntelEnergy UtilitiesEnvironm ental ForestryGeologyGroundw aterHealth

Historic Preservation & ArchaeologyHom eland SecurityHydroIHOLand ParcelsLocal Governm entM arineNational CadastrePetroleumPipelineTelecom m unicationsTransportationW ater UtilitiesW ater

Simple feature classHaul Contains Z values

Contains M valuesGeom etry Point

NoNo

Data typeField nam ePrec-ision ScaleLengthDom ainDefault value

Allownulls

OBJECTID Object ID

SHAPE Geometry Yes

HAULJOIN Long integer No 0

VESSELCODE Long integer No 0

CRUISE Long integer No 0

HAUL Long integer No 0

STATION_ID String No 7

SSTEMP Float No 0 0

BOTTOMTEMP Float No 0 0

EFFORT Float No 0 0

DataSourceID String Yes 50

TableDataSource


Allownulls

OBJECTID Object ID

DESC_ String Yes 35

SOURCE String Yes 35

CONTACT String Yes 20

PREC String Yes 20

CREATE_DATE Long integer Yes 0

LAST_UPDATED Long integer Yes 0


TableFishCatch


Allownulls

OBJECTID Object ID


SPECIESCODE Long integer No 0

LATINNAME String No 28

COMMONNAME String No 21

W EIGHTCPUE Double No 0 0

NUMBERCPUE Double No 0 0

Relationship class

Nam ePrim ary keyForeign key

TypeCardinalityNotification

Forward labelBackward label

No relationship rules defined.

DataSourceHasHaul

Origin table Destination feature class

Sim pleOne to m anyNone

HaulDataSource

DataSourceDataSourceIDDataSourceID

HaulNam e

Relationship class





HaulHasFishCatch

Origin feature class Destination table


FishCatchHaul

HaulHAULJOINHAULJOIN

FishCatchNam e

Local governm ent

Hom eland security

Agriculture

Cadastre

http://w ww.esri.com /softw are/arcgis/geodatabase/about/data-m odels.htm l

Created locally, regionally, nationally, globally by com m unity Subject M atter Experts

Data M odels

1. Digital orthoim agery2. Cadastral data 3. Geodetic control4. Elevation 5. Hydrography6. Transportation7. Governm ent Units

Candidate ANSI/INCITS-L1FGDC Fram ework Them e m odels

Conceptual view m ust be sem antically defined (and published) so others can decipher

M y viewYour view

Data M odelsArcG IS Data Interoperability Extension

M apping m y lexicon to yours


M aps and Globes

M etadata

Geodata Sets

Data M odels



OGC Sim ple Feature Specification

Sim ple Feature specification defines:

Data access m odel

Database schem a

2D Geom etry m odel for points, lines,

polygons

-

and spatial reference

ISO and OGC specifications for sim ple

feature access

Geodata Sets

Geom etrySpatialReference

Point Line Area

DatabaseConnection

Type 1(e.g. string)

Query

Type 2(e.g. num ber)

Value

Cursor

G eom etry

Data Access

SSiimmppllee FFeeaattuurree mmooddeellData M odels

Sim ple Feature Im plem entation SQL Profile

Feature Tables contain row s (features) sharing com m on properties (Feature Attributes).

Geom etry is a Feature Attribute.

10

11

12

area1

area2

area3

yellow

green

Blue

13 area4 red

Feature

Feature AttributeGeometry

Feature Table

Geodata Sets

Geography M arkup Language (GM L)

GM L is an XM L based encoding standard for geographic inform ation

Defines an XM L schem a for representing geographic features (attributes, geom etries, relationships, etc).

GM L Objects can represent:

Features Coverages Geom etries

Topologies Observations Values

Coordinate Referencing Styles Dynam ic Features,

Geodata Sets

Because GM L is based on XM L, it leverages a w ealth of m ainstream (beyond the geographic com m unity) standards, tools and practices for data exchange being developed by several consortia around the w orld

for Encoding and Data M odeling Expression (DTD, RDF and XSD)

for Linking and Associating resources (XLink)for Selecting & Pointing (XPath, XPointer)for Transform ing content (XSLT)for Graphical rendering (SVG, VM L, X3D)

Geodata Sets

GM L Sim ple Feature Profile

Fixed schem a

3D coordinates

Sim ple geom etry (points, lines, polygons, m ultipart)

Point, M ultipoint - 2D or 3D points

Curve, M ulticurve - Linear interpolation betw een points

Surface, M ultisurface -Polygons w ith planar faces

Geom etry, M ultigeom etry - Potentially heterogeneous geom etry collections (m ixed point / line / polygon)

Dynam ic codelists (eg, coded value dom ain lists)

Reference links (can hrefto other resources, eg, for handling foreign/prim ary keys)

M etadata links (can hrefto m etadata)

Geodata Sets

Geodata Sets UM L/GM L Data M odel/Application Schem a

<elem ent nam e="Building" substitutionGroup="gm l:AbstractFeature"><com plexType>

<com plexContent><extension base="gm l:AbstractFeatureType">

<sequence><elem ent nam e="extent" type="gm l:SurfacePropertyType"/>

<elem ent nam e="address"><com plexType>

<sequence><elem ent nam e="Address" type="ex:AddressType"/>

</sequence></com plexType>

</elem ent><elem ent nam e="type" type="ex:BuildingTypeType"/>

</sequence></extension>

</com plexContent></com plexType>

</elem ent><com plexType nam e="BuildingPropertyType">

<sequence m inOccurs="0"><elem ent ref="ex:Building"/>

Data M odels

UM L

G M L

Geodata SetsUM L/GM L Data M odel/Application Schem a

<elem ent nam e="Building" substitutionGroup="gm l:AbstractFeature"><com plexType>

<com plexContent><extension base="gm l:AbstractFeatureType">

<sequence><elem ent nam e="extent" type="gm l:SurfacePropertyType"/>

<elem ent nam e="address"><com plexType>

<sequence><elem ent nam e="Address" type="ex:AddressType"/>

</sequence></com plexType>

</elem ent><elem ent nam e="type" type="ex:BuildingTypeType"/>

</sequence></extension>

</com plexContent></com plexType>

</elem ent><com plexType nam e="BuildingPropertyType">

<sequence m inOccurs="0"><elem ent ref="ex:Building"/>

Data M odels

UM L

G M L

GM L

M apInfo

Intergraph

Laser Scan

Autodesk

S-57

SDTS

VM L

VPF

W FS

XM L

M apping

Analysis

Visualization

ArcGIS Data Interoperability ExtensionInteroperability betw een form ats

Geodata Sets

Geodata Sets


M aps and Globes

M etadata

Data M odels



M etadata

Data about Data (official definition)

Inform ation that describes a resource (data) so it can be understood

Ensures we find and use the right data for the right purpose

And used correctly

W ould you buy food or drink without knowing what it is?

title

supplemental informationabstract

time period

author

sources

(file) size

Geographic M etadata

Data about dataGeographic area coveredCurrencyRules of usePositional accuracyData dictionaryM eans of encodingDatumM ap projection

A Key interoperability technology:Producers explain their productUsers learn about products

Non standard products can be understood

M etadata UsesUnderstanding the right data for the right purpose

LocateFindDiscover

Structured searches vs. unstructured

EvaluateRestrictions

Quality

Reputation

ExtractOrder Dow nload

Em ployDefine,Apply,Use,&

Understand geographic know ledge

Pleasantville

Pleasantville

Pleasantville

Land Inform ation Ontario

Enterprise M etadata Strategy

M etadata data

describing inform ation

resources that

enable collaboration

Collaboration

interoperating

purposefully toward a com m on end

Interoperability

share and exchange inform ation

Interoperability

Collaboration

Technical (Physical)

Sem antic (Inform ation)

Business (Process)

Discover Find each

other

Determ ine

m eaning and

usefulness

Determ ine

business term s

and requirem ents

Trust Establish

physical

connection

trust

Establish

inform ation

provenance trust

Establish

business

relationship trust

Prepare Prepare for

physical data

exchange

Prepare to use

the inform ation

Enter into a

com m itm ent w ith

the other party

Transact Exchange the

physical data

Use the valid

inform ation

Establish

transaction

com pleteness

and

accountability

Stew ard Physically

safeguard and

protect the

data

Safeguard the

interpretations of

the inform ation

used

Safeguard the

organizations

involved in the

business

relationship 62

M etadata fram ew ork stages of collaboration

From Raphael Sussm an, 2003

ISO 19115:2003

Designed:

to support geographic inform ation;

to w ork w ith w ider inform ation technology standards and practices;

to support locate, evaluate, extract, em ploy

to serve the global com m unity, in a m ulti-national, m ulti-language environm ent;

based on a foundation of national, regional, and special inform ation com m unity standards and experiences

Developed through a rigorous, consensus ISO process

Provides a foundation for national, regional, and global interoperability

Sem antic Interoperability

fileIdentifier: 3A2234641211B12language: en

parentIdentifier: National M ap TopoSeries 864

hierarchyLevelNam e: (not needed)contact : CI_ResponsiblePartydateStam p : 20060417m etadataStandardNam e: ISO 19115:2003m etadataStandardVersion: (not needed) orm etadataStandardVersion: North Am erican Profile 1.0

M etadata

Identification inform ationConstraint inform ation

M aintenance inform ationReference system inform ation

Spatial representation infoData quality inform ation

Chapter 12

34

5

678

9

Distribution inform ationContent Inform ationM etadata is com posed of

inform ation chapters (packages)

ISO 19115:2003Defines how m etadata applies to a resource

M D_M etadata

<<Abstract>>DS_Aggregate

DS_DataSet

DS_Series DS_Initiative

GF_PropertyType

GF_FeatureType

FE_FeatureAttribute

FE_Feature

0..*

0..*

0..*

0..*

0..*

0..*1..*

0..*

1..*

0..*

0..*

1..*

DS_Platform DS_Sensor DS_ProductionSeries

ISO 19115:2003Defines how m etadata applies to a resource

<<Abstract>>DS_Aggregate

DS_SeriesDS_Initiative

GF_PropertyType

GF_FeatureType

FE_FeatureAttribute

FE_Feature

0..*

0..*

0..*

0..*

0..*

0..*

1..*0..*

1..*

0..*

0..*

1..*

DS_PlatformDS_Sensor

DS_ProductionSeries

M etadataDataset

XYZ Points

3-D Features

Contours

LIDAR

or

or or

GIS -Evolving to a web service environm ent Providing Geospatial Services

. . . Dynam ically Integrating Our Com m on Geospatial

Know ledge

ProvidingOGC W eb Services

M apping services

View ing services

Application Services

GeoW eb

GIS

Services

W eb Services Networks

Environm ental

Business Applications

Police

Planning

Roads

Utilities

W eb Services &M essaging

XM L

W eb Services

OGC W eb Services

W eb M apping Service (W M S)

HTTP protocol for publishing a collection of layers as a m ap (PNG, GIF, JPEG)

W eb Feature Service (W FS)

HTTP protocol for publishing feature collections that m ay be queried and updated by clients ( features

W eb Coverage Service (W CS)

coverages -band raster data) that can be accessed by clients a sort of w eb based im age processing service (GeoTiff, HDF-EOS, DTED, NITF, GM L)

Catalog Services W eb (CS-W )

Defines several w eb interfaces for data discovery

How W M S works?

Server Client

GetCapabilities

Capabilities

GetM ap

M ap Im age

GetfeatureInfo

featureInfo

W M S request flow

W ebServer

ArcGIS

ArcIM S

ArcView

M innesotam apserver

W M Sservices

Nativeservices

W eb Browser

AutoCAD

GeoM edia

O racle

M apExtrem e

W M S Request

Request (HTTP CGI form )

Response (JPEG file)

WMS GetMapGIF or PNG representation of the data on the server. It does NOT return the actual data, only a bitmap of the data.

Roma

WMS GetFeatureInfo returns attribute data for a feature or coverage at a specified point.

Lat/Long

elev. = 237 m .

W M S can query by pointing.

One many different maps!

OpenGIS Styled Layer Descriptor

-graphic

portrayals!

Web FeatureServer

GetFeaturerequest:

W eb Feature Service (W FS) returns data

I-295Geometry &attributedata

Features are returned in GM L

How W FS works?

Server Client

GetCapabilities

Capabilities

DescribeFeatureType

Feature Schem a

GetFeatures

Features

W eb Coverage Service (W CS) 1.0

Scope: Retrieval of gridded, swath, TIN or other "coverage" data in binary or other form ats(HDF, GeoTIFF, NITF, NetCDF, JPEG2000, etc.)

Elevation, Orthoim agery

O perations:

GetCapabilities

DescribeCoverageType

GetCoverage

How W CS works?

Server Client

GetCapabilities

Capabilities

DescribeCoverageType

Coverage Schem a

GetCoverage

Coverage

OpenGIS® Catalog 2 Specification

Defines a com m on interface that enables diverse but conform ant applications to perform discovery, brow se and query operations against distributed and potentially heterogeneous catalog servers.

Three Parts:

Discovery Services: allow a client to locate m etadata that describes data.

Access Services: provide the client w ith m ethods to request services on the data.Direct Access provides the client w ith a handle w hich, w hen used by the client, provides data to the client.

M anagem ent Services: defines m ethods for a client to change the m etadata held by a catalog.

There are both tightly coupled (like CORBA) and loosely coupled (HTTP/XM L CS-W eb) profiles.

Som e bindings defined:Z39.50,

CS-W : ebRIM , ISO M etadata, OGC Core

Understanding OGC Catalog Services

Catalog

Specific Data M odel

Registry Inform ation M odel

describes

M apped to

Stored By Serves

Uses

Based On

eb-RIMISO FGDC

Dublin Core

FGDCISO ISO

19115,19119

M etadata

Data

Service

Resource

Service Requester

Client

Service Provider

Service

Service Broker

ServiceDescription

Catalog Services in A GeoPortalGatew ay to/from your GIS enterprise

Faster Discovery

Collaboration

Interoperability

Technology

Direct Access

Im proved quality

and coverage

3-D BaseM ap

(Cache)

2-D Base M ap

(Cache)

OGC W eb

Services

TrackingServices

GIS DataData

Stream s

Brow ser

Catalog Services

Catalog

M obile

Desktop GIS

Geo-processingServices Search

Channels Link Brow ser M apDow nload:

ArcGIS ExplorerToolbar for ArcM ap

Collaboration

W eb Services Platform

2-D &* 3-DDesktop View ers

Enterprise GeoPortal Data W arehouse

GIS Portal Toolkit

Client Applications

Service Provider

ServiceService Provider

DataService Broker

ServiceDescription

Service Requester

Client

The GIS Portal Toolkit addresses critical factors for success:

W 3C Service Oriented Architecture*

Service Provider

Service Requester

Service Broker Publish

Service

ServiceDescription

ServiceDescription

Client

*From W eb Service Architecture, 14 Nov. 2002

UsersUsers

G eoportal

Users

FTP

Data Servers

GIS Data

G eospatial ResourcesPublish GIS data and services

Docum ent in catalog

GISData

GISData

O G C W M S,W FS, W CS. . .

OGC Catalog Services(Z39.50CS-W )

ISO 19115 M etadata/ISO 19139 M etadata

XM L Schem a Im plem entation

O AI Protocolfor M etadataHarvesting

GIS Portal

Users

M etadata

Partners

Publishers-Data & Service Providers

Gazetteer

IndexM ap

CategoryData

Spatial

Thesaurus Categories

View

Search &Navigation

SupportingData Sets

Resource Producers Publish m etadata and provide Content

GIS PortalIntegrating Role

M aps

Analysis

InternetM ap Services

BoundariesTopography

Hydrology

Geodetics

Transportation

Im agery

Producers Users

GIS PortalIntegrating Role

Portals truly standards in actionPortal Toolkit -Interoperable Architecture

A w eb super siteGatew ay to a spatial data infrastructureProducers

Advertise, expose products

Share inform ation about holdings

Provide an understanding of data and services

UsersPerform efficient searches by requirem ents

Discover data and services

Determ ine fitness for use

Acquire access inform ation

Based on W 3C Service Oriented ArchitectureM etadata for data, services, activities, data m odels anything geospatialBringing the standards together:

ISO 19115

ISO 19139

FGDC M etadata

Dublin Core m etadata

W 3C SO ASR 168OAI M etadata harvestingOGC CS-W ISO, ebRIM , Z39.50

-W M S

-W FS

-W CS

-W M C

-OpenLS

CSWZ39.50O AI-PM HW eb FolderArcIM S

Server Com ponents

ISO

G IS Portal Site

DB2, O racle, SQ L Server

Catalog Service

Search

Z39.50

ArcIM S

CSW

W eb FolderO AI-PM H

W M S

W M C

W FS/G M LW CSArcIM S

FG DC

O pen LS

ArcIM S

SDE

M etadata Catalog

M etadataHarvester

PublishM ap

View er

Open LS

ESRI approach to interoperabilitySupporting M ultiple Approaches

. . . Providing An Open & Standards-based Environm ent. . . And Enabling Successful Collaborative System s

Simple feature classHaul Contains Z values

Contains M valuesGeom etry Point

NoNo


Allownulls

OBJECTID Object ID

SHAPE Geometry Yes


VESSELCODE Long integer No 0

CRUISE Long integer No 0

HAUL Long integer No 0

STATION_ID String No 7

SSTEMP Float No 0 0

BOTTOMTEMP Float No 0 0

EFFORT Float No 0 0


TableDataSource


Allownulls

OBJECTID Object ID

DESC_ String Yes 35

SOURCE String Yes 35

CONTACT String Yes 20

PREC String Yes 20

CREATE_DATE Long integer Yes 0

LAST_UPDATED Long integer Yes 0


TableFishCatch


Allownulls

OBJECTID Object ID


SPECIESCODE Long integer No 0

LATINNAME String No 28

COMMONNAME String No 21

W EIGHTCPUE Double No 0 0

NUMBERCPUE Double No 0 0

Relationship class





DataSourceHasHaul

Origin table Destination feature class


HaulDataSource

DataSourceDataSourceIDDataSourceID

HaulNam e

Relationship class





HaulHasFishCatch

Origin feature class Destination table


FishCatchHaul

HaulHAULJOINHAULJOIN

FishCatchNam e

Content Standards

Data M odels

M etadata (19115/19139)

Transform ation Procedures (ETL)

Form ats

Schem a

Sem antic

ETL = Extract, Transform & Load Data

Technology Standards

W eb Services

O G C/ISO

DXF, KM L . . .

W M S W FS W CS

W M S W FS W CS Catalog

ArcG IS Desktop

ArcIM S / ArcG IS Server

W FS-TGM L

M anagem ent Standards

Visualization Standards

Standards Organizations

GIS Education

Providing Data and Services

Basic Structure Standards

FedUC 2007 88

Standards Support Throughout GIS Life Cycle

4. Publish

Metadata Server

Catalog Service

Z39.50, CS-W 2.0, ebRIM

3. Catalog

ArcGIS Server

2. Docum ent (M etadata)

ISO 19115ISO 19115-2ISO 19139

ArcCatalog

1. Create Content

ArcMap & ArcCatalog

6. Use/Analysis

Support SF,W M S, W FS, GM L

ArcMap

5. Discover

Z39.50, CS-WMetadata Explorer

InternetSF -Binary,SF SQL Types & Functions

W M S, W FS,W CS

ArcGIS Portal ArcGIS Explorer

W *S

interoperability for the enterprise...fgdc metadata, iso metadata 3. data management (semantic and...

Documents