hydrographic workflow automation
TRANSCRIPT
![Page 1: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/1.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
Hydrographic Workflow AutomationData Processing and QC
LCDR Damian Manda, NOAA24 Feb 2020
![Page 2: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/2.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
• Data management is complex• Many points of manual intervention during processing
• Checking every checkbox correctly 100% of the time is hard/impossible
• Training someone to check every checkbox is even harder• Running through different software packages to process is
tedious and error prone
Origin – Issues with Consistency in Deliverables
Concentrate Human Interaction on the “Art”
![Page 3: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/3.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
Origin - UxS Strategy
Develop Enabling Technologies
Build and Maintain Operational Expertise
Operational Innovation
Collaboration
![Page 4: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/4.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
![Page 5: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/5.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
![Page 6: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/6.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
• Difficult to determine, difficult to enter in correctly• Multiple systems, difference reference frames• Typos/transposition errors common
• Nearly impossible to track changes; ensure single value hasn’t changed
Offset Report Tool
Sonar System [Kongsberg .all]
Positioning System [POS MV .000]
Processing Sofware[HIPS HVF]
Offset Report Tool
![Page 7: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/7.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
![Page 8: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/8.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
![Page 9: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/9.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
• Automated data management• Set-and-forget processing, stored settings• Unified interface to all software
Results• 40 page SOP encompassed in 5 dropdown boxes• Training can be done from a screenshot
Charlene - Concept
Reduce daily processing to ‘Plug in data and view results’
![Page 10: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/10.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
• Checks for Common Errors:• Stub files• Datagram types• Presence of required files• Geographic locations• Timestamp correspondence• HVF Settings
Charlene - Operation
Charlene
![Page 11: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/11.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
![Page 12: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/12.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
SHAM
• Automated S-57 Feature Processing• Translates existing methodology to ellipsoidal referencing• Supports multiple acquisition methods
• Remedies tedious, error prone tasks• Datum application• Rock/islet determination• Image naming conventions• Remarks/recommendations
![Page 13: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/13.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
Processing Modes
Referencing Options
Outputs
Raw/Field Data
![Page 14: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/14.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
![Page 15: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/15.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
QC Tools
Performs automated quality control checks on surfaces and final
feature files
Quality defined by the specifications set forth by the Office of Coast Survey. • Hydrographic Surveys Specifications
and Deliverables (HSSD) • Hydrographic Technical Directives
(HTD)
![Page 16: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/16.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
QC Tools
Flier Finder
Holiday Finder
Grid QA
Feature Scan
Algorithms that scan your bathymetric grid to identify potential anomalous soundings.
Algorithm that scans your bathymetric grid to identify holidays as defined by the HSSD.
Performs math on bathymetric grids to determine if density, uncertainty, resolution, etc. meet the HSSD.
Checks .000 feature file against IHO and NOAA required attribution, as prescribed by the HSSD.
![Page 17: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/17.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
QC Tools Continued
VALSOU Check
SBDARE Export
UncertaintyCalculator
Rock or Islet Oracle
Standalone Tools
Submission Checks
Verifies your feature file VALSOU against designated soundings in bathymetric grid.
Exports your seabed area features and images into the format required for submission
Scans your entire field submission directory against the HSSD.
![Page 18: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/18.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
![Page 19: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/19.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
Scribble – Submission & Reporting
XML DRProject Stats
Submission Checks
Scribble
![Page 20: Hydrographic Workflow Automation](https://reader030.vdocuments.mx/reader030/viewer/2022041208/6250d2358eb3ce1f4a76ff75/html5/thumbnails/20.jpg)
Office of Coast SurveyNational Oceanic and Atmospheric Administration
• Packaging the workflow
• Rework of specifications for automation
• Open Source collaboration
Future Development