Strategic Capability-Learning for Improved Multiagent Collaboration in Ad Hoc Environments
Persistent URL
Author(s)
Jumadinova, Janyl
Dasgupta, Prithviraj
Soh, Leen-Kiat
Date Issued
November 1, 2013
Abstract
We consider the problem of distributed collaboration among multiple agents in an ad hoc setting. We have analyzed this problem within a multiagent task execution scenario, in which every task requires collaboration among multiple agents to get completed. Tasks are also ad hoc in the sense that they appear dynamically and require different sets of expertise or capabilities from agents for completion. We model collaboration within this framework as a decision-making problem in which agents have to determine what capabilities to learn and from which agents to learn them so that they can form teams that have the capabilities required to perform the current tasks satisfactorily. Our proposed technique refers to principles from human learning theory to enable an agent to strategically select appropriate capabilities to learn from other agents. We also use two openness parameters to model the dynamic nature of tasks and agents in the environment. Experimental results within the Repast agent simulator show that by using the appropriate learning strategy, the overall utility of the agents improves considerably. The performance of the agents and their utilities are also dependent on the repetitiveness of tasks and reencounter with agents within the environment. Our results also show that the agents that are able to learn more capabilities from another expert agent outperform the agents who learn only one capability at a time from many agents, and agents who use an intelligent utility maximizing strategy to choose which capabilities to learn outperform the agents who randomly make the learning decision.
Journal
IEEE Transactions on Systems, Man, and Cybernetics: Systems
Department
Computer Science
Citation
Jumadinova, J., P. Dasgupta, and L. -K Soh. Strategic Capability-Learning for Improved Multiagent Collaboration in Ad Hoc Environments. IEEE Transactions on Systems, Man, and Cybernetics: Systems. Vol. PP 2013.
Publisher
IEEE
Version of Article
Postprint
DOI
10.1109/TSMC.2013.2285527
ISSN
2168-2216
Rights
© 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works
File(s)![Thumbnail Image]()
Name
Janyl2013IEEE.pdf
Description
Final manuscript post peer review
Size
470.38 KB
Format
Adobe PDF
Checksum (MD5)
3856e4c54d372ecbd9e8b232d42a3a46