mastering geospatial metadata with fme
TRANSCRIPT
FME and MetadataMastering Metadata with FME 2012
Don MurrayDean Hintz
FME ® Desktop 2012 Version
Agenda
FMEMetadataMetadata StandardsReadingUpdatingWritingHarvestingValidatingPublishing
Safe Software Facts
Private company Founded in 1993 Headquarters in
Vancouver, BC, Canada 90+ employees
50+ value-added resellers &system integrators in 35 countries
~100 FME Certified Professionals & Trainers around the globe
Thousands of customersacross 116 countries
IT Service Case Distribution
4
Introduction to FME
What is FME?
How Does FME Work? Centralized Semantic Transformational
Data Translation Basics FME Desktop Training 2012
FME Moves Data
FME is all about …
Barriers to Interoperability
Web
Data Types
Data Translation Basics FME Desktop Training 2012
Translation
FME supports reading from a wide array of data formats and types 275+ formats, with more added each year CAD, GIS, XML, raster, database, non-spatial, 3D
9
Poll Question #1: FME
How long have you been using FME?
?
Metadata – What is it?
Metadata – What it is
Metadata provides information about whatever types of data you have:
12
Metadata – Data about data
Describes data structures• tables• geometry types• data types• fields
Describes data content• coordinate system• extent• modification date• quality, ownership, etc.
Metadata - Purpose
Common Metadata Questions
What does the data set describe?Who produced the data set?Why was the data set created?How was the data set created?How reliable are the data; what problems remain
in the data set?How can someone get a copy of the data set?Who wrote the metadata?
geology.usgs.gov/tools/metadata/tools/doc/ctc/
?
Poll Question 2: Metadata
How often do you work with metadata?
?
Metadata Standards
FGDC & ISO 19115 • describes geographical
information and services
• contents, spatial-temporal, data quality, access and rights to use
• 400 metadata elements, 20 core
ISO / OGC Standards
ISO/TS 19139• defines Geographic Meta Data XML (gmd) • XML Schema implementation derived from ISO
19115• Version "2007-04-17" uses GML 3.2.1
(http://www.opengis.net/gml/3.2)• Version "2006-06-04" use GML 3.2.0 (http://
www.opengis.net/gml)• ISO 19119 – web services
Bottom line: need to know what GML version and what ISO standard you need to comply with
Poll Question #3: Standards
Which metadata standards/types are interested in?
?
Key FME Metadata Capabilities
• Reading
• Writing
• Updating
• Harvesting
• Validating
• Integration with web services
Demos
Reading
Writing
Updating
Harvesting
Validation (Syntax, Schema)
Demo: Reading
Metadata attributes
XML Reader / Fragmenter with Feature Paths and flattening
HTTPFetcher
Reading from database
Demo: Reading Metadata Attributes
Demo: Reading Geodatabase Metadata
expose the geodb_metadata_string attribute
Demo: Writing
XMLTemplaterTemplates for • FGDC• ISO 19115
Database write mode: geodatabase
Demo: Harvesting and Writing
Demo: Writing Geodatabase Metadata
Geometry:geodb_metadataExpose: geodb_metadata_string
Demo: Updating
XMLUpdater, XQueryTimeStamperXMLFormatter
Demo: Updating
XMLUpdater: Insert, Delete, Replace, Replace Contents
Poll Question 4: XML
What XML tools do you use?
?
Validation – What to validate against?
ISO 19139 with GML 3.2.0:http://schemas.opengis.net/iso/19139/20060504/gmd/gmd.xsd
To Validate XML against ISO 19139 with GML 3.2.1:http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/
See page 13 of:http://
inspire.jrc.ec.europa.eu/reports/ImplementingRules/metadata/MD_IR_and_ISO_20090218.pdf
Or Google and click top link: “inspire metadata implementing rules technical guidelines”
Key takeaway: to validate gmd:MD_Metadata you need to validate against gmd.xsd
Demo: Validation
XMLValidator• Syntax• Schema
Validation Report – Bad Syntax
Validation Report – Bad Schema
Validation Report – Good Metadata
Validation Workspace
Other Validation Options
• Tester• Field names• Data types (numeric, date etc)• IDs
• CoordinateSystemExtractor• GeometryFilter• GeometryOGCvalidator• SpatialFilter (check extents)
CSW: Catalog Service for the Web
• Deegree
• GeoNetwork
• OpenGIS
• TerraCatalog
Metadata Services: CSW
• Reading• Writing / Publishing• Updating
Poll Question #5: CSW
What CSW tools do you use?
?
Arkansas Geostor: Download
Customer Implementations: LGII – Lithuania Geospatial Portal
File Formats: AutoCAD DXF / DWG ESRI Personal Geodatabase Shape MapInfo TAB Microstation Design V8 GML GIF / PNG JPEG TIFF ERDAS IMG ECW
Coordinate systems: LKS94 WGS84 ETRS89 1963 Pulkovo 1942 UTM (34, 35 zones)
Other data sources: WFS SDE Files
Summary
Metadata describes your dataHelps with searches and
managementFME can help drive your metadata: • Read / write and update• Harvest• Validate• Automate maintenance tasks• Integrate with CSWSwitch from manual to automatic by
using FME to power your metadata
Online Training
Upcoming Online Courses in 2012 Online FME Desktop:
May 16/17 June 20/21 Sept 19/20 Oct 17/18 Dec 5/6
FME Server Authoring: May 24 Sept 27
Online Advanced FME Desktop: XML Reading May 16 or 17 XML Writing May
23 or 24 Oracle Spatial June 7 or Sept
26 Esri (demo only) Sept 6 KML Nov
14 Raster Nov
29
Poll Question 6: Training
Would you like to enter for a chance to win a free seat of online FME training?
?
FME 2012 World Tour
http://fme.safe.com/content/FME-2012-World-Tour
Twitter Hashtag: #FMEWT
Thank You
Questions?
www.safe.com/support
www.youtube.com/fmechannel
fmepedia.safe.com/knowledgeSearch?k=metadata