A novel decision-estimation methodology for a team of agents cooperating under communication imperfections is presented. The scenario of interest is that of a group of uninhabited aerial vehicles (UAVs) cooperatively performing, under communication delays, multiple tasks on multiple ground targets. In the proposed architecture, each UAV in the group runs an identical centralized decision algorithm and multiple information filters in parallel on its own states, its teammates’ states, and its own states as viewed by its teammates. Under perfect information, the decision architecture allows implicit coordination. Under imperfect information, the estimation of team members’ states enables predicting their cost to prosecute new tasks. Thus, the group performance under communication imperfections can be improved. Two different algorithms are proposed for the estimation process. The first is communication efficient, in which asynchronous information updates are sent to the network by individual members based on the value of the information to the rest of the group. The second is computation efficient utilizing synchronous information updates. Taking into account that the plan and plant of each UAV are known to the group improves the overall estimation process. Utilizing the MULTIUAV2 simulation testbed, a Monte Carlo study is presented. The benefit of using the proposed algorithms is shown with regard to the target prosecution rate and the communication bandwidth required for cooperation.

1.
Clough
,
B. T.
, 2005, “
Unmanned Aerial Vehicles: Autonomous Control Challenges, a Researcher’s Perspective
,”
AIAA J. Aerospace Computing, Information, and Communication
,
2
, pp.
327
347
.
2.
Beard
,
R.
, and
McLain
,
T.
, 2003, “
Multiple UAV Cooperative Search Under Collision Avoidance and Limited Range Communication Constraints
,”
Proceedings of the IEEE Conference on Decision and Control
,
Maui, HI
, pp.
25
30
.
3.
Polycarpou
,
M. M.
,
Yang
,
Y.
, and
Passino
,
K.
, 2001, “
A Cooperative Search Framework for Distributed Agents
,”
Proceedings of the IEEE International Symposium on Intelligent Control
, pp.
1
6
.
4.
Enright
,
J.
,
Frazzoli
,
E.
,
Savla
,
K.
, and
Bullo
,
F.
, 2005, “
On Multiple UAV Routing with Stochastic Targets: Performance Bounds and Algorithms
,”
Proceedings of the AIAA Guidance, Navigation, and Control Conference
, Paper No. AIAA-2005-5830.
5.
McLain
,
T.
,
Chandler
,
P.
,
Rasmussen
,
S.
, and
Pachter
,
M.
, 2001, “
Cooperative Control of UAV Rendezvous
,”
Proceedings of the American Control Conference
, pp.
2309
2314
.
6.
Schumacher
,
C. J.
,
Chandler
,
P. R.
, and
Rasmussen
,
S. J.
, 2002, “
Task Allocation for Wide Area Search Munitions Via Iterative Network Flow Optimization
,”
Proceedings of the AIAA Guidance, Navigation, and Control Conference
, Paper No. AIAA-2002-4586.
7.
Bertsekas
,
D.
, and
Tsitsiklis
,
J.
, 1989,
Parallel and Distributed Computation: Numerical Methods
,
Prentice-Hall
,
Englewood Cliffs, NJ
.
8.
Smith
,
R. G.
, and
Davis
,
R.
, 1981, “
Frameworks for Cooperation in Distributed Problem Solving
,”
IEEE Trans. Syst. Man Cybern.
0018-9472,
11
, pp.
61
70
.
9.
Ho
,
Y.
, and
Chu
,
K.
, 1972, “
Team Decision Theory and Information Structures in Optimal Control Problems - Part 1
,”
IEEE Trans. Autom. Control
0018-9286,
AC-17
, pp.
15
22
.
10.
Bellman
,
R.
, 2003,
Dynamic Programming
,
Dover
,
New York
.
11.
Dantzig
,
G.
, 1963,
Linear Programming and Extensions
,
Princeton University Press
,
Princeton, NJ
.
12.
Bertsekas
,
D.
, 1995,
Nonlinear Programming
,
Athena Scientific
,
New York
.
13.
McLain
,
T.
, and
Beard
,
R.
, 2005, “
Coordination Variables, Coordination Functions, and Cooperative Timing Missions
,”
J. Guid. Control Dyn.
0731-5090,
28
, pp.
150
161
.
14.
Edmonds
,
J.
, and
Karp
,
R.
, 1972, “
Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems
,”
J. ACM
1535-9921,
19
, pp.
248
264
.
15.
Richards
,
A.
,
Bellingham
,
J.
,
Tollerson
,
M.
, and
How
,
J.
, 2002, “
Coordination and Control of Multiple UAVs
,”
Proceedings of the AIAA Guidance, Navigation, and Control Conference
, Paper No. AIAA-2002-4588.
16.
Schumacher
,
C. J.
,
Chandler
,
P.
,
Pachter
,
M.
, and
Pachter
,
L.
, 2007, “
Air Vehicles Operations Optimization
,”
J. Oper. Res. Soc.
(to be published).
17.
Yokoo
,
M.
,
Durfee
,
E.
,
Ishida
,
T.
, and
Kuwabara
,
K.
, 1998, “
The Distributed Constraint Satisfaction Problem: Formalization and Algorithms
,”
IEEE Trans. Knowl. Data Eng.
1041-4347,
10
, pp.
673
685
.
18.
Nemhauser
,
G.
, and
Wolsey
,
B.
, 1999,
Integer and Combinatorial Optimization
,
Wiley
,
New York
.
19.
Balas
,
E.
, and
Padberg
,
M.
, 1976, “
Set Partitioning: A Survey
,”
SIAM Rev.
0036-1445,
18
, pp.
710
760
.
20.
Rasmussen
,
S. J.
,
Schumacher
,
C.
, and
Chandler
,
P. R.
, 2002, “
Investigation of Single Versus Multiple Task Tour Assignments for UAV Cooperative Control
,”
Proceedings of the AIAA Guidance, Navigation, and Control Conference
, Paper No. AIAA-2002-4675.
21.
Bertsekas
,
D.
, and
Castanon
,
D.
, 1989, “
The Auction Algorithm for Transportation Problems
,”
Ann. Operat. Res.
0254-5330,
20
, pp.
67
96
.
22.
Olfati-Saber
,
R.
, and
Murray
,
R.
, 2003, “
Consensus Protocols for Networks of Dynamic Agents
,”
Proceedings of the American Control Conference
, pp.
951
956
.
23.
Lamport
,
L.
, 1998, “
The Part-Time Parliament
,”
ACM Trans. Comput. Syst.
0734-2071,
16
, pp.
133
169
.
24.
Bernstein
,
D. S.
,
Givan
,
R.
,
Immerman
,
N.
, and
Zilberstein
,
S.
, 2002, “
The Complexity of Decentralized Control of Markov Decision Processes
,”
Math. Op. Res.
0364-765X,
27
, pp.
819
840
.
25.
Jadbabaie
,
A.
,
Lin.
,
J.
, and
Morse
,
A. S.
, 2003, “
Coordination of Groups of Mobile Autonomous Agents Using Nearest Neighbor Rules
,”
IEEE Trans. Autom. Control
0018-9286,
AC-48
, pp.
988
1001
.
26.
Passino
,
K.
, 2005,
Biomimicry for Optimization, Control, and Automation
,
Springer-Verlag
,
Berlin
.
27.
Bertsekas
,
D.
, and
Castanion
,
D.
, 1991, “
Parallel Synchronous and Asynchronous Implementations of the Auction Algorithm
,”
Parallel Comput.
0167-8191,
17
, pp.
707
732
.
28.
Wellman
,
M.
, and
Wurman
,
P.
, 1998, “
Market-Aware Agents for a Multiagent World
,”
Rob. Auton. Syst.
0921-8890,
24
, pp.
115
125
.
29.
Groves
,
T.
, 1973, “
Incentives in Teams
,”
Econometrica
0012-9682
41
, pp.
617
631
.
30.
Shima
,
T.
,
Rasmussen
,
S.
,
Sparks
,
A.
, and
Passino
,
K.
, 2005, “
Multiple Task Assignments for Cooperating Uninhabited Aerial Vehicles Using Genetic Algorithms
,”
Comput. Oper. Res.
0305-0548,
33
, pp.
3252
3269
.
31.
Schumacher
,
C. J.
,
Chandler
,
P. R.
,
Pachter
,
M.
, and
Pachter
,
L.
, 2004, “
Constrained Optimization for UAV Task Assignment
,”
Proceedings of the AIAA Guidance, Navigation, and Control Conference
,
Providence, RI
, Paper No. AIAA-2004-5352.
32.
Walker
,
D. H.
, 2004, “
Coordinated UAV Target Assignment Using Distributed Calculation of Target-Task Tours,”
M.Sc. thesis, Brigham Young University.
33.
Rasmussen
,
J.
, and
Shima
,
T.
, “
Branch and Bound Tree Search for Assigning Cooperating UAVs to Multiple Tasks
,”
Int. J. Robust Nonlinear Control
1049-8923 (to be published).
34.
Dubins
,
L.
, 1957, “
On Curves of Minimal Length With a Constraint on Average Curvature, and With Prescribed Initial and Terminal Position
,”
Am. J. Math.
0002-9327,
79
, pp.
497
516
.
35.
Rasmussen
,
S. J.
,
Mitchell
,
J. W.
,
Schulz
,
C.
,
Schumacher
,
C. J.
, and
Chandler
,
P. R.
, 2003, “
A Multiple UAV Simulation for Researchers
,”
Proceedings of the AIAA Modeling and Simulation Technologies Conference
,
Austin, TX
, Paper No. AIAA-2003-5684.
36.
Nygard
,
K. E.
,
Chandler
,
P. R.
, and
Pachter
,
M.
, 2001, “
Dynamic Network Flow Optimization Models for Air Vehicle Resource Allocation
,”
Proceedings of the American Control Conference
,
Arlington, VA
, pp.
1853
1858
.
37.
Schumacher
,
C. J.
,
Chandler
,
P. R.
, and
Rasmussen
,
S. J.
, 2001, “
Task Allocation for Wide Area Search Munitions Via Network Flow Optimization
,”
Proceedings of the AIAA Guidance, Navigation, and Control Conference
,
Montreal, Canada
, Paper No. AIAA-2001-4147.
38.
Mitchell
,
J. W.
and
Sparks
,
A. G.
, 2003, “
Communication Issues in the Cooperative Control of Unmanned Aerial Vehicles
,”
Proceedings of the 41st Annual Allerton Conference on Communication, Control, and Computing
.
39.
Chong
,
C. Y.
,
Mori
,
S.
, and
Chang
,
K. C.
, 1990, “
Distributed Multitarget Multisensor Tracking,”
Multitarget Multisensor Tracking: Advanced Applications
,
Y.
Bar-Shalom
, ed.,
Artech House
,
Boston, MA
.
40.
Maybeck
,
S. P.
, 1979,
Stochastic Models, Estimation, and Control, Vol. 1
,
Academic
,
New York
, pp.
238
241
.
You do not currently have access to this content.