fme and linear referencing - keeping the product in the pipelines
TRANSCRIPT
FME and Linear Referencing -‐ Keeping the Product in the Pipelines
FME World Tour 2015
Peter Veenstra Willbros Engineering
IntroducCon & Outline
• Peter Veenstra – Principal GIS Technologist – Willbros Engineering
• Outline – Oil and Gas Transmission Pipelines – Concepts of Linear Referencing – How we do it now – Linear Referencing with FME – Lessons Learned
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Founded in 1908
Oil and Gas Transmission Pipelines
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Oil and Gas Transmission Pipelines
• Typical pipelines … – Run for 100’s if not 1000’s of miles
– Cross mulCple jurisdicCons – MulCple threats…
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Oil and Gas Transmission Pipelines
• Huge consequences if failure occurs …
– Loss of human life
– Environmental devastaCon – Tarnished corporate reputaCon – Revenue and profit loss – Stringent regulaCons – Regulatory fines – Increased administraCon
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Oil and Gas Transmission Pipelines
• Very complex ‘standard’ data models …
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Concepts of Linear Referencing
• Routes (MZ-‐Aware Polylines with Unique ID)
• Events (Relate to Route, Measured PosiCon)
• PosiCon is determined by Measure of the event (for point) or Begin/End Measure (for line)
• Many, many, many tables of events stacked on top of each other (BGM)
• Primarily ESRI (ArcGIS Desktop) soluCon
FME World Tour 2015 – St. Louis, MO – 04/15/2015
LR: How we do it now …
FME World Tour 2015 – St. Louis, MO – 04/15/2015
• A table can store a Route ID and Begin/End Measure value for linear features. These features can be symbolized on a map.
• Another table can store a Route ID and a Measure value for point features. These features can be symbolized on a map.
• Tabular data can be filtered, ordered, sorted using SQL
LR: How we do it now …
• ArcMap DemonstraCon
• LimitaCons of the soluCon – Performance – Events as Features – Non-‐support in Web for Events
– Roads & Highways and new ALRP …
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Linear Referencing with FME
• Work in progress – exploraCon …
• Two Workbenches – Events to Features – Dynamic SegmentaCon
• Linear Referencing Tools • What is missing (or what don’t I know …)
FME World Tour 2015 – St. Louis, MO – 04/15/2015
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Events to Features
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Events to Features
FME World Tour 2015 – St. Louis, MO – 04/15/2015
• Take a pipeline route with an ID=”12PL-‐A” With linear referencing using tables from the data model – mulCple layers of linear and point events can be added to the map.
• Pipe Segments with Wall Thickness, Outside Diameter, Grade, Install Date, Seam Type, Manufacturer, Join Type aiributes
• Primary coaCng with install date, type and thickness (Fusion Bonded Epoxy, 15mils)
• Secondary coaCng with install date, type and thickness (Concrete, 3")
• IsolaCon Valves • Flow Rates, OperaCng Temperature, OperaCng Pressure • Above Water, Below Water • ILI Run (Test Date, Tool Type) • Hydro Test (Test Date, Test Pressure, DuraCon) • Design Factor • Visual InspecCon (Test Date) • CP Reading • Pipe SecCons (1-‐Topsides, 2-‐Export Riser, 3-‐Export Spoolpiece, 4-‐Seabed, 5-‐Import Spoolpiece, 6-‐Import Riser, 7-‐Import Topsides)
• Environmental (Faults, Seismic, Slope Stability) Good ! Bad • Incident History (OperaCons, Incidents) Good ! Bad • Anomalies (Dents, Internal/External Corrosion) • Anomaly Points turned to Linear Ranges (Based on number of points per specified length)
Dynamic SegmentaCon
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Dynamic SegmentaCon
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Dynamic SegmentaCon
Linear Referencing with FME • Linear Referencing Tools
– LengthToPointCalculator • Calculates a length of a feature to a point on that feature – either 2D or 3D – (calculated
not assigned) – MeasureExtractor
• Extracts measure from geometries and puts them in aiributes (M have to be there, not all tools output M)
– MeasureGenerator • Calculates measure for each vertex from the start of the line (based on distance not
assigned measure) – MeasureRemover
• Removes measures from a feature’s geometry – MeasureSeier
• Sets the measure to points (based on airibute) or to vertexes in polyline (from airibute). If geometry is not the same then nothing happens
– Snipper • Creates linear features based on a distance from a specified point (with a measure value)
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Linear Referencing with FME
• Transformers most used… – FeatureMerger\Snipper – TestFilter – AiributeRenamer – AiributeFilter – LineOnLineOverlayer – Sorter – AiributeCreator – AiributeRounder – Tester
FME World Tour 2015 – St. Louis, MO – 04/15/2015
What works!
• Feature based results • Beier error checking and diagnosCcs – Runs with errors, indicates errors in ‘red’ – Log file, SQLite DB
• More formats (both in and out)
• Works beier with web/cloud integraCon
FME World Tour 2015 – St. Louis, MO – 04/15/2015
What doesn’t!
• Tools are not inherently M-‐Aware • Measures need to be preserved • Locate Events along Routes
– By XY posiCon and proximity
• Re-‐order output fields • SHIFT/CTRL scroll in Workbench (not ALT!) • Diagnose or idenCfy which transformer introduced what field
• Right click reader/writer in TOC to add ‘features types’ • DocumentaCon (show some pictures …)
FME World Tour 2015 – St. Louis, MO – 04/15/2015
Future Plans
• Data loader and Route Builder • Gap/Overlap QA/QC • Overlap Resolver – SUM, Min/Max, Latest
• Self DynSeg • RISK – Likelihood x Consequence
• Output – KML, JSON ! D3.js
FME World Tour 2015 – St. Louis, MO – 04/15/2015
The Moral of the Story (Redux)
“I am always learning that which I cannot do, in order that I may learn how to do it.”
~Pablo Picasso
FME World Tour 2015 – St. Louis, MO – 04/15/2015
• Woulda, coulda, shoulda ….. Training
• Review progress and technique with Safe Experts
• Test, test, test!
