metavr vrsg visuals in uas simulation
TRANSCRIPT
For well over a decade, MetaVR™ visuals have been used in the US Army’s unmanned aerial system (UAS) training simulators, primarily through the Multiple Unified Simulation Environment / Air Force Synthetic Environment for Reconnaissance and Surveillance (MUSE/AFSERS) simulation system. Within MUSE/AFSERS MetaVR Virtual Reality Scene Generator™ (VRSG™) provides simulated HD video feeds for various intelligence gathering platforms.
Developed by the Joint Technology Center/Systems Integration Laboratory (JSIL), MUSE/AFSERS is the primary UAS training and simulation system used in the Department of Defense for command- and staff-level joint services training and provides the largest number of fielded simulation systems in the US. As result, MetaVR has become one of the largest suppliers of commercial licensed 3D visualization software for UAS simulation training in the US military, with nearly 2,000 active VRSG licenses in the field. The US Army uses VRSG in its Shadow Crew Trainer, and in Grey Eagle, Aerosonde, and Hunter trainers in portable, classroom, and embedded configurations Fort Huachuca and other UAS training sites. VRSG is also embedded in the Army’s Universal Ground Control Station (UGCS) for training operators on multiple platforms. A key feature of VRSG is its ability to stream real-time HD-quality simulated video with KLV metadata using the H.264 protocol, which is indiscernible in composition from actual UAV video feed. VRSG can encode STANAG 4096-compliant MISB ST 0601.8 KLV metadata and MISB security metadata standard 0104.5. This means that when UAS operators/trainees are not flying an actual UAS, they can fly a simulated UAS using the same hardware they use to operate the real system, using the JTC/SIL MUSE air vehicle and data link simulation software and VRSG.
MUSE/AFSERS is a general intelligence collection platform simulation for airborne collection systems with electro-optical (EO), infrared (IR), and synthetic aperture radar (SAR) payloads. The MetaVR MUSE VRSG system provides the visualization system component for the MUSE, which generates synthetic payload scene video and/or imagery of the 3D battlefield with simulated target entities. This video and imagery is subsequently fed to a tactical or generic UAS/intelligence platform control station where operators perform air vehicle and payload control functions, and an air vehicle and data link simulation.
VRSG can be configured to simulate a UAS in a variety of ways, ranging from using VRSG’s internal camera payload model in which the telemetry of the simulated UAV is provided by a DIS or HLA entity, to fully integrated applications such as the MUSE UAV tactical trainer.
Simulation features include:
• Capturing high-resolution virtual world screen images remotely. VRSG can instruct the UAV camera to capture the current image in its field of view from remote operators in the simulation environment, save the image as a large format NITF file, and deliver the file for display on another computer. This feature simulates the Global Hawk large image sensor capability.
• Using VRSG as a simulated, live, sensor video feed used to classify ground information from a Geographical Situational Display. Airborne or space-borne collection systems that use Ground Moving Target Indication (GMTI) and target identi- fication devices create symbolic representations of moving entities over large geographic areas. VRSG enables the operator to refine target identification and classification.
• Streaming real-time KLV metadata multiplexed into an HD H.264 (MPEG-2) transport stream. Tactical exploitation systems can use this streaming MPEG feed to visualize sensor payload imagery in real time and extract the UAV metadata. The MPEG stream can be transmitted live over UDP to a remotely operated video-enhanced receiver (ROVER) device, or any device that can play video from an ISR video feed, or streamed to a file for later playback.
• Coupling VRSG with ROVER devices, often used by JTACs/ FACs. VRSG generates the simulated 3D scene and the range and coordinates of a designated target on a ROVER’s monitor.
One aspect of training UAS operators entails interacting with JTACs/FACs in joint mission training. Training in a networked synthetic environment, the UAS operator and the JTAC/FAC on the ground work together to identify the same target in a scene.
US Army UAS classroom and embedded trainers VRSG provides the desktop and embedded 3D synthetic payload visualization system for training UAS operators on ground control stations such as the US Army’s UGCS. The Army’s UAS Universal Mission Simulator (UMS) is a Training Aids, Devices, Simulator and Simulations (TADSS) system that provides training for the operation of the Army’s UGCS for the MQ-5B Hunter, RQ-7 Shadow, and MQ-1C Gray Eagle platforms in a classroom
Image on the cover: MetaVR VRSG real-time ocean-based scene of an MQ-8C Fire Scout entity in flight above two CUSV vessels and a group of sea mines. Inset image is the Fire Scout’s simulated sensor view.
Left: MetaVR VRSG real-time scenes featuring a Shadow IE UAV entity flying over MetaVR’s geospecific terrain of Afghanistan. Center: The Shadow’s simulated sensor view of activity below. Right: JTAC character examining UAV feed on a simulated MVR III Mini-ROVER.
or portable environment. The UMS enables UAS operators to fulfill part of their qualification training and follow-on continuation training to maintain proficiency and currency.
The system uses the MUSE system with VRSG to stimulate the tactical Vehicle Control software (VCS) to simulate the following UGCS functions: air vehicle control, payload control, weapons control, communications, send and receive video data, and mission planning. The simulator incorporates multifunctional software approaches to provide UAS operators with a high-fidelity training experience for individual, crew, and collective training. In a classroom setting such as at the Army’s UAS Training Center at Ft. Huachuca, AZ, the simulators are full-size mockups of the actual GCSs from which UASs are operated in the field.
VRSG is embedded directly in the UGCS, which makes a smooth transition for training in a shelter in the field which soldiers can use to maintain flight time requirements and currency. The UGCS is a NATO STANAG 4586-compliant command-and-control platform that incorporates the Army’s Tactical Common Data Link (TCDL) for robust bandwidth and data security, and is designed to command and control multiple joint services UASs simultaneously. The TCDL, which sends secure data and streaming video from reconnaissance airborne platforms to ground stations, transmits radar, imagery, video, and other sensor information.
Since 2002, the US Army National Guard has purchased VRSG licenses for ongoing fielding in its embedded Shadow Crew Trainer (SCT). These licenses support embedded trainers in Shadow TUAS, Aerosonde, Hunter, and Grey Eagle UASs, which are used by both Army and Army National Guard units.
The SCT is a mission-level fully enclosed mobile classroom environment training device that enables users to train on their specific roles, as well as team-level communication and mission rehearsal. The SCT can train up to five students simultaneously in an integrated mode and enables recording of the mission for after-action review. Simple graphical user interfaces mimic the actual equipment. Trainees can log SCT hours as flight hours toward their overall requirements for Shadow UAS training. Each TUAS system is comprised of three air vehicles, two ground control stations, two ground data terminals, a launcher, a tactical automatic landing system, and an aerial vehicle transport. In normal operation, the GCS is used to control the flight of the UAS and receive its telemetry. When the system operators are not flying the actual UAS, they can fly a simulated UAS using the same hardware using the JTC/SIL MUSE air vehicle and data link simulation software and VRSG.
U.S. Navy’s ship-based Fire Scout UAV simulatorThe U.S. Navy at Naval Air Station Patuxent River, MD, and other locations use VRSG in MQ-8B/C Fire Scout simulators. Multiple portable training devices run VRSG in training exercises that serve to both instruct and maintain proficiency of Fire Scout air vehicle operators (who fly the aircraft) and mission payload of-ficers (who control the payload).
VRSG controls the FLIR simulation that operates in EO/IR, used mainly for ship-based operations, and sometimes for shore-based operations. The FLIR EO/IR simulation enables operators to classify ships from a far distance, with narrow fields-of-view (FOVs), and in varying environmental conditions. Such usage benefits from VRSG’s real-time, physics-based thermal sensor simulation and ability to render a scene accurately with long-range narrow FOVs. In the 4-channel system, VRSG renders for the instructor a stealth view outside the Fire Scout for situational awareness and a shipboard camera view that is attached to the automatic approach system.
AFSOC MQ-9 Reaper simulator A recent development effort at JSIL that involves the use of VRSG is the Air Force Special Operations Command (AFSOC) Reaper Extended Range (ER) Simulator. The simulator (also known as the MALET-JSIL Aircrew Trainer) is a plug-and-play training capability that converts a current tactical MQ-9 Reaper ER ground control station (GCS) into a training simulator. The trainer provides UAS operators the ability to conduct simulation training as part of their qualification and follow-on continuation training to maintain proficiency and currency in all required operator tasks. Like other JSIL developed UAS trainers, the simulator uses the MUSE software to stimulate the tactical Vehicle Control software (VCS) to simulate GCS functions: air vehicle control, payload control, weapons control, communications, send/receive video data, and mission planning.
Again, a key feature of VRSG in this trainer is the ability to stream real-time HD-quality simulated video with KLV metadata using the H.264 protocol, which means that when operators are not flying an actual MQ-9 Reaper ER, they can train by flying the simulated UAS using the same hardware they use to operate the actual system, using the MUSE air vehicle and data link simulation software and VRSG.
The AFSOC Reaper ER Simulator, which will soon be rolled out to sites across the US that house SOCOM’s MQ-9 Reaper ER aircraft, is designed to train operators to fly the new variant, which is enhanced with a number of hardware and software upgrades to extend its special forces features.
MetaVR VRSG real-time scene of MQ-9 Reaper and AH-64 entities in flight above MetaVR’s geospecific terrain of Kismayo, Somalia.
MetaVR VRSG real-time simulated sensor view tracking a vehicle of insurgents on MetaVR’s geospecific modeled Afghan village.
Field training at Mohawk Valley Community College Utica campus on the SUAS donated by MetaVR. Photo courtesy of Brian Judycki at MVCC.
MetaVR VRSG real-time screen capture of a Gray Eagle entity in flight over MetaVR’s virtual terrain of Kismayo, Somalia. Inset shows VRSG sensor view of an activity on the terrain.
MetaVR, Virtual Reality Scene Generator, VRSG, Metadesic, the phrase “geospecific simulation with game quality graphics,” and the MetaVR logo are trademarks of MetaVR, Inc. Metadesic is protected by US Patent 7,425,952. Esri and ArcGIS are registered trademarks of Esri. All other brand or product names are trademarks of their respective companies. Copyright © 2017 MetaVR, Inc.
For more information, contact [email protected] or scan the QR code to your mobile device.
AFRL’s PRINCE MQ-1/MQ-9 simulator The Air Force Research Laboratory’s (AFRL) Warfighter Readiness Research Division 711th Human Performance Wing at Wright Patterson Air Force Base has long used VRSG in various training research simulators. For example, in 2007 AFRL was an early adopter of VRSG as the IG for its JTAC training domes (precursors to the current AAJTS and JTC-TRS dome systems). Close air support (CAS) training missions that are run in their three JTAC dome systems now include an AFRL-developed Predator training-research simulator, called the Predator Research Integrated Network Combat Environment (PRINCE). PRINCE is a high fidelity, networkable MQ-1 and MQ-9 Remotely Piloted Aircraft (RPA) simulator, which was built four years ago, and serves as an R&D tactical simulator for Predator pilots and sensor operators. As part of AFRL’s research in human performance methods and technologies that provide the warfighter the necessary knowledge and skill to dominate their operational environment, the objective of the PRINCE research program is to meet known training gaps in UAV tactical operations such as JTAC integration.
VRSG is currently integrated as the simulator’s IG for cross-training with the JTAC dome systems. PRINCE team members use VRSG Scenario Editor to populate the 3D terrain with culture (such as building up dense urban areas) and Battlespace Simulations’ (BSI’s) MACE for creating realistic training scenarios, including pattern-of-life scenarios. For example, the PRINCE can take part in a CAS training mission that includes a convoy overwatch with enemy targets in the area; VRSG generates the simulated MQ-1 camera feed that appears on both the GCS monitor and a ROVER device used by the JTAC.
UAS simulation lab at Embry-Riddle Aeronautical University At Embry-Riddle Aeronautical University (ERAU), VRSG has been in use in the UAS simulation and training lab at its Prescott, AZ, campus since 2012. In 2014 the ERAU campus at Daytona Beach, FL, began using VRSG in its UAS lab as well.
The UAS operator simulator at ERAU Prescott consists of four VRSG licenses and five Battlespace Simulations (BSI) Modern Air Combat Environment (MACE) licenses for a pilot station, a payload operator station, and an instructor station. (The instructor station enables an instructor to make dynamic inputs in the students’ scenarios.). The ERAU Prescott campus currently offers UAS piloting as a minor with coursework focused on training the procedural fundamentals of communication, tools, and receiving and dispersing intelligence data for civilian applications.
UAS simulation lab and SUAS at Mohawk Valley Community College Mohawk Valley Community College (MVCC) Utica, NY, campus uses MetaVR’s visuals and donated small Unmanned Aerial Systems (SUAS) in its new state-of-the-art flight simulator lab built for the college’s new Remotely Piloted Aircraft Systems degree program. In 2016, MVCC purchased six VRSG licenses and six BSI’s MACE licenses for desktop pilot and sensor operator training stations in the new lab, which was unveiled in September 2016. As part of the software delivery, MetaVR donated to MVCC a MetaVRC, the company’s small UAS used for imagery collection. The lab consists of five student stations, an instructor station, and a 3D terrain server which runs MetaVR 3D terrain, including CONUS++ Northeast region. Students learn mission planning and operations and flight skills in the lab as part of this Associates of Applied Science degree program.
The imagery collection SUAS that MetaVR donated to MVCC was built by Swift Radioplanes (SPR) for autonomous aerial surveying at low altitudes. The aircraft takes sub-inch resolution still-frame images, which MetaVR then orthorectifies and uses to build sub-inch resolution 3D terrain in MetaVR Terrain Tools for Esri® ArcGIS® for rendering in VRSG. SPR provided field training on the SUAS to professors in the program. Students use the SUAS as they learn about long range mapping and autonomous missions.