grasp university of pennsylvania nrl logo? autonomous network of aerial and ground vehicles vijay...
TRANSCRIPT
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Autonomous Network of Aerial and Ground Vehicles
Vijay Kumar
GRASP Laboratory
University of Pennsylvania
Ron Arkin
College of Computing
Georgia Tech
Autonomous Operations Future Naval Capability Unmanned Systems Technology Review
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Adaptive Autonomous Robot TEAMS for Situational Awareness
Vijay Kumar
Univ Penn
Gaurav Sukhatme
USC
Ron Arkin
Georgia Tech
Jason Redi
BBN
A MARS 2020 project
Autonomous Operations Future Naval Capability Unmanned Systems Technology Review
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Future Combat SystemsCreation of a network-centric force of heterogeneous platforms that is strategically responsive and sustainable
Adapt to variations in communication performance and strive to maximize suitably defined network-centric measures for perception, control and communicationProvide situational awareness for remotely-located war fighters in a wide range of conditionsIntegrate heterogeneous air-ground assets in support of continuous operations over varying terrain
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Air Ground CoordinationGROUND VEHICLES
AERIAL VEHICLES
C2 VEHICLE
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
U A V
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
U A V
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Motivation
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Context
Communication Network 400 MHz (100Kbs), 2.4 GHz (10Mbs), 38 GHz (100
Mbs) Affected by foliage, buildings, terrain features,
indoor/outdoor Directionality
Small Team of Heterogeneous Robots UGVs with vision, range finders UAVs (blimp, helicopter)
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Research Thrusts
1. Localization and Control for the Team of Robots
2. Communication Sensitive Mission Planning
3. Communication Sensitive Reactive Behaviors
4. Verification and Validation
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
1. Localization, Tracking and Control for a (small) Network of Robots
Decentralized Each robot computes the others position
relative to its reference frame Each robot shares information with the rest of
the team
Assumptions Noise can be modeled by normal distribution No dynamics Ad-hoc network Robots are easily identified
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Global Estimators for Position and OrientationFinding the optimal solution involves a graph search problem
NP-complete
or optimization over 3(N-1) vars. Local minima
Suboptimal solution Each robot calls out its observations Solve for orientations Solve for relative positions
O(N3 ), but closed form
Breadth-first search enables O(N) approximation
R2
R3
R4
R5
R1
R9
R6
Self-organization, adaptation based on the spanning tree[Das, Spletzer, Kumar, Taylor 02]
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
2. Communication Sensitive Planning Provide support for terrain models and other
communications relevant topographic features to MissionLab
Use plans-as-resources as a basis for multiagent robotic communication control (spatial, behavioral, formations, etc.) and integrate within MissionLab
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Preliminary Results: Communication Planning
Additional resources in the form of internalized plans aids team communication.
No difference results when using reactive behaviors vs. communication insensitive plans.
Communication planning in serial and parallel result in significant improvement in communication.
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
3. Communication Sensitive Team Behaviors
Reactive communications preserving and recovery behaviors
Communications recovery and preserving behaviors sensitive to QoS
Behaviors in support of line-of-sight and subterranean operations
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Control for Communication
Modeling of Communication Networks Effect of foliage Buildings Dependence on frequency, directionality Statistical models of delays and “hot spots” from
experimental data Neighbors, path costs (delays, power) Time of last communication
QoS metrics Control/perception tasks Individual robots vs. end-to-end Move to improve reliability and network performance
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Simulation
Six robots maintaining communication constraints and avoiding each other
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Communication Sensitive Behaviors: Preliminary Results
Using the Nearest Neighbor Recovery behavior approximately 50% of the trials were finished completely autonomously
Retrotraverse and Move to Higher Ground were usually not able to finish the trials autonomously by themselves and will require transitions/planning once communications recovered
Number of Trials Completed
0
11
0
18
02
8
19
02468
101214161820
Communication Sensitive Behaviors
Tri
als
Co
mp
lete
d
No Preserving, No Recovery
No Preserving, Higher Ground
No Preserving, Nearest Neighbor
No Preserving, Retrotraverse
Maintain Signal Strength, No Recovery
Maintain Signal Strength, Higher Ground
Maintain Signal Strength, Retrotraverse
Maintain Signal Strength, Nearesr Neighbor
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
SatisfyConstraints
MaintainConstraints
4. Verification and Validation
UnconstrainedBehaviors
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Guarantees for Special Cases
Complete Graph Tree In-degree constraint Directed
[Pereira et al, IROS 03]
Hamiltonian Cycle (or Path) In-degree constraint Undirected
[Pereira et al, NRL MRS 03]
1. Reactive Controllers are Potential Field Controllers
2. Assumptions on “constraint” graph
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Three Robot Experiments:Satisfying Constraints
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Deploying a robot network
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Effect of Robot Failures
R3R1 R2 R3R1 R2
Control Graph Constraint Graph
R3R1 R2
Formation Graph
R3R1 R2 R3R1 R2 R3R1 R2 R3R1 R2 R3R1 R2 R3R1 R2 R3R1 R2 R3R1 R2 R3R1 R2 R3R1 R2+ =
GRASPUniversity of Pennsylvania
NRL logo?NRL logo?
Conclusion A comprehensive model and framework
integrating communications, perception, and execution
Automated acquisition of perceptual information for situational awareness
Reactive group behaviors for a team of air and ground based robots that are communications sensitive