1 don brutzman naval postgraduate school (nps) center for autonomous underwater vehicle (auv)...
TRANSCRIPT
![Page 1: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/1.jpg)
1
Don Brutzman
Naval Postgraduate School (NPS)Center for Autonomous Underwater Vehicle (AUV) Research
Modeling, Virtual Environments & Simulation (MOVES) Institute
25 April 2007
NPS AUV Workbench:Rehearsal, Reality, Replay
forUnmanned Vehicle
Operations
![Page 2: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/2.jpg)
2
Topics
• Why modeling & simulation?
• AUV Workbench Components
• Sonar Visualization
• Technologies: X3D, XML, XMSF
• Looking ahead
• Demonstrations
![Page 3: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/3.jpg)
theory = conceptual description of reality
experiment = test theory in physical world
Scientific method, 15th-20th centuries
ExperimentTheory Analysis
Scientific method, 15th-20th centuries
![Page 4: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/4.jpg)
model = formal representation of reality
simulation = behavior of model over time
Scientific method, 1950-present
ExperimentTheory Analysis
SimulationModel
implements a corresponds to an
Scientific method, 1950-present
Scientific method, 1950-present
![Page 5: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/5.jpg)
model = formal representation of reality
simulation = behavior of model over time
Scientific method, 1950-present
ExperimentTheory Analysis
Modeling&
Simulation
running together
Scientific method, 1950-present
Scientific method, 1950-present
![Page 6: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/6.jpg)
Virtual environments can connect all models and simulations together
Scientific method, emerging 21st century
ExperimentTheory Analysis
Modeling&
Simulation
Virtual Environmentslinked together via
networking interfaces,shared semantics
Scientific method, emerging 21st centuryScientific method, emerging 21st century
![Page 7: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/7.jpg)
7
AUV Workbench Project Description
• Open source, Java, XML, X3D graphics
• Mission planning
• Robot mission execution
• Hydrodynamics response
• Sonar modeling
• 3D visualization
• Compressed radio frequency (RF) and acoustic communications
![Page 8: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/8.jpg)
AUV Workbench poster, I/ITSEC 2003
![Page 9: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/9.jpg)
9
Our 3 R’s: rehearsal, reality, replay
• Same needs and capabilities for each: mission, visualization, data support, etc.
• AUV workbench supports each ongoing work, starting to mainstream
• 12 years of effort is coming to fruition integrating great variety of successful work new work projects occurring regularly
• Collaboration is welcome
![Page 10: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/10.jpg)
10
Rehearsal
Mission planning and preparation
![Page 11: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/11.jpg)
11
Visualization, mission planning
missioncommands
robot execution
6DOF response hydrodynamics
![Page 12: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/12.jpg)
Multiple vehicles supported
![Page 13: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/13.jpg)
13
Rehearsal• Prepare missions, either manually or
automatically via other software tools• Test robot software’s ability to perform
commands• Test again with physics “in the loop”
Hydrodynamics and control are critical, difficult Sonar, environmental modeling
• Repeat until robust, with cautious respect “Simulation is doomed to success” – G. Bekey
![Page 14: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/14.jpg)
14
Mission views: iconic, tree, XML, dialog box
Each view is consistent
with GIS, 2D, 3D views
![Page 15: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/15.jpg)
15
Supporting views: mission metadata, state
![Page 16: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/16.jpg)
16
2D planner: script missions
![Page 17: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/17.jpg)
17
2D planner: script missions
Can edit missions
by adding or
removing script
commands
![Page 18: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/18.jpg)
18
2D planner: agenda missions
![Page 19: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/19.jpg)
19
OpenMap GIS display• OpenMap http://www.openmap.org
Geographic Information System (GIS) Open source Java, bundled Building layers for areas of interest Geographic coordinates throughout Will synchronize with mission definitions, X3D
![Page 20: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/20.jpg)
20
![Page 21: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/21.jpg)
21
Secure sftp download of large GIS datasets
![Page 22: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/22.jpg)
22
Reality: real-time mission support
• Monitor mission progress
• Task-level control using same mission vocabulary
• Visualize and supervise operations caveat, again: work in progress
• Integrate acoustic and RF communications
• Chat for distributed collaboration among participants, both human and robotic
![Page 23: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/23.jpg)
23
Real-time mission data import/export
• Export Mission commands that are already rehearsed Convert to specific dialect particular to that robot
• Import Mission telemetry recording detailed track data Data products: imagery, video, mission log, etc.
![Page 24: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/24.jpg)
24
Record mission metadata for archives
• Support operator keeping detailed notes, kept in context when conducting mission
• Prompt for full details as appropriate
• Archive notes for later review and followup
• Future work Automatic tests to confirm configuration, control Automate pre-underway checklists
![Page 25: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/25.jpg)
25
Serial port communications• Configurable to different devices, ports
![Page 26: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/26.jpg)
26
JavaHelp support
![Page 27: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/27.jpg)
27
Thesis list
![Page 28: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/28.jpg)
28
Snapshot support
![Page 29: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/29.jpg)
29
Sunspot• Sun Programmable Object Technology
(SPOT) devices are small wireless Java microcontrollers that include accelerometers, USB port, LEDs and other connections
• We are looking ahead towards using SunSpot devices as UUV, USV and UAV mobile robot controllers
• http://www.sunspotworld.com • https://robotics.dev.java.net
![Page 30: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/30.jpg)
30
Replay: post-mission support• Automatic archiving of mission to server
Being built into workbench – simplify user tasks
• Integration and compression of all relevant data into single compressed XML file Metadata for mission Many pieces: ordered mission, commands,
telemetry, coefficients, contacts, etc. etc. Autonomous Vehicle Control Language (AVCL)
is Ph.D. work by CDR Duane Davis
![Page 31: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/31.jpg)
Telemetry data replay
![Page 32: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/32.jpg)
32
Geographic track plot
![Page 33: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/33.jpg)
33
x y z versus t plot
![Page 34: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/34.jpg)
34
phi theta psi versus t plot
![Page 35: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/35.jpg)
36
XSBC compression of mission data• Compression of mission
commands, telemetry• XML Schema-based Binary
Compression (XSBC)• Take advantage of XML
self-validation capability• Building composable
sequence of filters for integrated data support
![Page 36: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/36.jpg)
37
Automating server-side support
Work is in progress…
![Page 38: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/38.jpg)
39
Physical modeling• Control algorithms and 6 degree-of-freedom
(6DOF) hydrodynamics response
• Sonar propagation, attenuation
• Collision detection Direct vehicle contact and sensor contact Separate use of same X3D graphics models
• Visualization greatly aids understanding provides good “forcing function” for integration
![Page 39: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/39.jpg)
40
Control algorithm coefficients
![Page 40: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/40.jpg)
41
6DOF dynamics coefficients
![Page 41: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/41.jpg)
42
Wave modeling• Triple sinusoid Pierson Moskowitz equations
provide good emulation of variable sea state Well understood example model Many other variations exist, could substitute
• Real-time modeling of underwater vehicle response when broached Split hull into sections Compute each one as linear approximation Buoyancy components add to overall response
![Page 42: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/42.jpg)
43
REMUS mission search, from above
![Page 43: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/43.jpg)
44
REMUS mission search, from
behind
![Page 44: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/44.jpg)
45
Group development support• Open standards throughout
• Open source Java for software
• All data structured as XML
• XMSF Bugtracker
• Email list with hypermail archive
• Online autoinstallers
![Page 45: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/45.jpg)
46
XMSF Bugtracker
![Page 46: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/46.jpg)
47
Mailing list support
![Page 47: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/47.jpg)
48
Autoinstall
support
also linux and other unix
![Page 48: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/48.jpg)
49
Environmental data inputs• Constant vectors for ocean current, wind
• NetCDF environmental data developed by NAVO/NRL Stennis supercomputer models
• FNMOC web-services query to live/projected meteorological
• Planned: add NITES/TED Services support
![Page 49: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/49.jpg)
50
sonar-vis Project Description• Visualize multipath 3D sonar propagation
Situational awareness, sensitivity analysis Multiple models: path, transmission loss, PD ...
Operator familiarization, training, experience
• Enhance TDAs for at-sea operators Reachback using Web services messaging,
accessing both computational and data assets Open source open standards: Java, X3D, XML
![Page 50: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/50.jpg)
Sonar Visualization poster, I/ITSEC 2003
![Page 51: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/51.jpg)
52
Goal Outcomes: sonar-vis project
• Sonar and battlespace visualization
• Link aircraft, ship and HPCC computing FNMOC, possibly Maui HPCC Similar interfaces, with/without connectivity “Tactical Supercomputing” refrigerator box
• Support Common Undersea Picture (CUP) Candidate technologies for spiral development Have started usw-xml working group for USN
![Page 52: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/52.jpg)
Sonobuoy field
visualization
![Page 53: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/53.jpg)
54
Integrating 2D/3D interfaces with Web Services
Participating in naval exercises
![Page 54: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/54.jpg)
55
XML web services for METOC data 1
• Query panel and plotted response
![Page 55: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/55.jpg)
56
XML web services for METOC data 2
• Monitoring initial query/response sequence
![Page 56: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/56.jpg)
57
XML web services for METOC data 3
Server-side supercomputer response
![Page 57: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/57.jpg)
58
XML web services for METOC data 4
![Page 58: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/58.jpg)
61
Technologies• Extensible Markup Language (XML)
Validatable data, binary compression Web Services for message exchange
• Enhance current sonar-model engines Recursive Ray Acoustics (RRA) sonar computation PC-IMAT/STAPLE/STDA(ASPECT) primary targets Environmental data from FNMOC via Web services
• Extensible 3D (X3D) Graphics Open-standard open-source interactive visualization
![Page 59: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/59.jpg)
62
XML in 10 Points http://www.w3.org/XML/1999/XML-in-10-points
• XML is for structuring data• XML looks a bit like HTML• XML is text, but isn't meant to
be read• XML is verbose by design• XML is a family of
technologies
• XML is new, but not that new
• XML leads HTML to XHTML
• XML is modular• XML is basis for RDF and
the Semantic Web• XML is license-free,
platform-independent and well-supported
400+ member companies & institutions in World Wide Web Consortium (W3C)already understand the business case
![Page 60: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/60.jpg)
63
Extensible Modeling & Simulation Framework (XMSF)
• Web services for all manner of M&S• A composable set of standards, profiles, and
recommended practices for web-based M&S• Foundational precepts: Internet network technologies,
Extensible Markup Language (XML)-based languages, and service-oriented architectures for simple messaging
• Enable a new generation of distributed M&S applications to emerge, develop, interoperate with tactical systems
• Many easily repeatable exemplars using Web Services
http://www.MovesInstitute.org/xmsf
![Page 61: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/61.jpg)
64
What is 3D?
• 2½D works for chart-oriented displays
• 3D gives “fly-thru” freedom of viewpoint View physically based propagation paths View depth separation View bottom, surface interactions View multiple overlapping sensors
• Augment (not replace) existing displays
![Page 62: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/62.jpg)
65
What is X3D?•Extensible 3D (X3D) Graphics
Virtual Reality Modeling Language (VRML) updatedThird-generation ISO specification Compatible XML .x3d and Classic VRML .wrl encodings
•DeliverablesSpecification updates, with compatible XML tagset Multiple implementations, including open-sourceScene Access Interface (SAI) strongly typed APIConformance suite and examplesAuthoring capability: X3D-Edit, using XML for XML…
![Page 63: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/63.jpg)
66
Further X3D motivations
•Authoring is hard, “Content is King”X3D is not competing with specialty formats,
instead provide common
interoperability/interchangeStrong validation checks eliminate most authoring errors before content escapes
Plays well with next-generation Web languages
“3D hardware problem” is already solved
![Page 64: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/64.jpg)
X3D Specifications honeycomb diagram
X3D Specification itself is
componentizedand extensible
![Page 65: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/65.jpg)
X3D-Edit complete interface
Context-sensitive, self-validating, multi-lingual editing tools
![Page 66: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/66.jpg)
SAVAGE 3D Model Archive
Lots of models!
![Page 67: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/67.jpg)
70
Numerous underwater vehicle models
![Page 68: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/68.jpg)
71
Looking ahead: more technologies
• XML Schema-based Binary Compression (XSBC) better than zip, adds validation Adding Forward Error Correction (FEC)
Current work
• Tactical supercomputing
• XML Tactical Chat (XTC)
![Page 69: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/69.jpg)
72
• XML encoding for validation benefits
• XML schema contains adequate information to autogenerate comprehensive encodings
• Tokenization of elements, attributes
• Strong data typing of value payloads
• Lossless
• More efficient than compressed numeric text
XML Schema-based Binary Compression (XSBC)
![Page 70: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/70.jpg)
73
XML Schema-based Binary Compression (XSBC)
Conclusion: XSBC performance already better than zip!
3.3 MB 16.6 MB 38.4 MB 11.6 MB 2.7 MB
originals
![Page 71: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/71.jpg)
XSBC comparison tool
![Page 72: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/72.jpg)
75
Forward error correction (FEC)
• Added redundancy allows receiver-side detection & correction of message errors Many military channels are noisy RF links Avoids “retry until you die” on acoustic links Big help on long-latency, low-bandwidth links!
• Hamming FEC is one technique of several Re-exploring Stephen Reimers 1995 thesis
“Towards Internet Protocol (IP) over Seawater”
![Page 73: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/73.jpg)
76
Tactical supercomputing• Linux clusters can create new resources
5 off-the-shelf new PC boxes + disk storage $10K = 10 processors = 10 Gigaflop Refrigerator-rack footprint easily fits shipboard Industry can provide even higher capabilities
• Exploring intermediate-level resources for previously supercomputer-level problems Consistent access via grid/web services
![Page 74: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/74.jpg)
XML Tactical Chat (XTC), I/ITSEC 2003 poster
![Page 75: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/75.jpg)
Chat log window
![Page 76: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/76.jpg)
Chat log debug mode shows underlying XML
![Page 77: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/77.jpg)
80
Event monitoring via instant messaging
chatbot listens and reacts tofree-form messages of interestby plotting mine onto chartlet
![Page 78: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/78.jpg)
81
Java 1.4.2 regular expression parser on chat:
Any characters or words before
"MINE"
Case-insensitive
word “MINE”
“s” or "S" occurs once or none at
all
Any character
Comma followed by 0 to
2 character "space"
Group 1 (digit)
One or no character
"space", fullstop or ")"
1 to 2 characters
"space" or "("
Comma followed by 0 to
2 character "space"
Group 2 digit)
Group 3 digit)
Breakdown of regular expression pattern:
Regular Expressio
n
^.*
(?i)MINE
[s|S]?
.*[ (]{1,2}
(\d*)
,[ ]{0,2}
(\d*),[ ]{0,2}
(\d*)[ ).]?
+
Meaningful messages can be extracted from chat text,thus enabling automatic structure for user support
![Page 79: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/79.jpg)
82
Related work: usw-xml • The usw-xml working group is improving
Undersea Warfare (USW) interoperability using Extensible Markup Language (XML) tagsets for system data interchange.
• Cooperative collaboration between many stakeholders is needed to achieve good interoperability.
![Page 80: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/80.jpg)
83
Motivation• Many XML technical capabilities enable
significantly improved capabilities for USW system interoperability Connecting legacy systems, diverse partners USW Decision Support System, other projects
• We expect this work to broadly benefit the Navy, industry and scientific community.
![Page 81: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/81.jpg)
84
HSI Stack Summary• Coalition• Joint• Battlegroup• Ship, aircraft, submarine• Watch team• Operator• Offboard unmanned systems
Usual focus of effort
• Need to go further, up + down the HSI stack
![Page 82: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/82.jpg)
Inputs/Outputs Interoperability Layers How to Accomplish
Effective, Efficient, Gridded Coalition Systems
Common Operational Picture,
Situational Awareness (SA)
Consistent Semantic Understanding
------------------------------------------------------------------------------------------
Tactical
Messaging C2IEDM/JC3IEDM providing
common shared context, tactical data interoperability
Shared coherent XML among participating platforms
------------------------------------------------------------------------------------------
HSI Level
VIII
VII
VI
------------------------------------------------------------------------------------------
Navy Battle GroupCommon CIC/CDC tactical picture for coordinated operations/shared data communications: NTDS, Link 11, Link 16, etc.
No XML interoperability,legacy stovepipe protocols
Groups of systems,HSI “in the large”
External connectionsNetworks
[Macro HSI]Complex Constructs for both humans and systems
_________________________________________________________________
![Page 83: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/83.jpg)
Internationalization (I18N)
and Localization (L10N)
for sensible coalition usage
Inputs/Outputs How to Accomplish HSI Level
Consistent XML targets, swappable terms, labels, annotations
I
_________________________________________________________________
Individual Systems,HSI “in the small”
Internal connectionsGUI designs
[Micro HSI]Discrete Human Factors/Ergonomics
---------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------
IV
III
V
II
Multimodal consistency in menus,human re-orientation capability[keyboard/pointer/tactile/voice]
Java Look & FeelCoherent usability
Some help annotationsdesirable for functionality
Application help pages & tool tips,both context-sensitive & embedded
Java Help, HTML pages,XML content & catalog
---------------------------------------------------------------------------------------------
XML datasets & GIG enterprise services,data updates via XSLT
Within-platform softwareSoftware updates
Synchronized corresponding viewsfor text / 2D / 3D displays
Based on GIG XMLdata-driven model
Java, open source andpublic software libraries
Interoperability Layers
![Page 84: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/84.jpg)
Autonomous Vehicle Control Language (AVCL)
Inputs/Outputs How to Accomplish HSI Level
Consistent messaging for tasking & reporting by diverse robots
Unmanned Systems,HSI “when adding robots”
---------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------
-1
0
Distinct, different, incompatible robot systems being directed by shipboard operators
JAUS architecture only permits internal re-use of software components
XSLT stylesheets,custom converters
Interoperability Layers
XSLT stylesheets,common converters
_________________________________________________________________
Comments welcome.
![Page 85: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/85.jpg)
88
Summary• Significant collected AUV capabilities
Support rehearsal, reality, replay
• Integrated as tactical application
• Open standards: XMSF, X3D, chat, etc.
• Open source + commercial compatibility
• Improved messaging, net-centric exemplar
• We hope to add all possible vehicles!
Collaboration and questions welcome
![Page 86: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/86.jpg)
89
Acronyms 1
• 3D: Three dimensional• 6DOF: Six degrees of
freedom (x y z, roll pitch yaw)• AUV: Autonomous
Underwater Vehicle• AVCL: Autonomous Vehicle
Control Language• CD: Compact Disk• CUP: Common Undersea
Picture• FEC: Forward Error
Correction
• FNMOC: U.S. Navy Fleet Numerical Meteorological & Oceanographic Center
• HPCC: High-Performance Computing Center
• Java: programming language• METOC: meteorological and
oceanographic (data)• NAVAIR: U.S. Naval Air
Systems Command
![Page 87: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/87.jpg)
90
Acronyms 2
• NPS: Naval Postgraduate School, Monterey California
• PD: Probability of detection
• RF: radio frequency• RRA: Recursive Ray
Acoustics Sonar Propagation• SBIR: Small Business
Innovative Research• TDA: Tactical Decision Aid• USW: Undersea Warfare
• X3D: Extensible 3D Graphics Specification
• XML: Extensible Markup Language
• XMSF: Extensible Modeling and Simulation Framework
• XSBC: XML Schema-based Binary Compression
• XTC: XML Tactical Chat
![Page 88: 1 Don Brutzman Naval Postgraduate School (NPS) Center for Autonomous Underwater Vehicle (AUV) Research Modeling, Virtual Environments & Simulation (MOVES)](https://reader036.vdocuments.mx/reader036/viewer/2022062516/56649de85503460f94ae29a8/html5/thumbnails/88.jpg)
91
Contact
Don Brutzman
[email protected] http://web.nps.navy.mil/~brutzman
Code USW/Br, Naval Postgraduate SchoolMonterey California 93943-5000 USA
1.831.656.2149 voice1.831.656.7599 fax