Strategic Capability-Learning for Improved Multiagent Collaboration in Ad Hoc Environments

Project Author
Issue Date
2013-11-01
Authors
Jumadinova, Janyl
Dasgupta, Prithviraj
Soh, Leen-Kiat
Loading...
Thumbnail Image
Embargo
First Reader
Additional Readers
Keywords
Ad hoc networks , collaborative work , learning , multiagent systems
Abstract
We consider the problem of distributed collaboration among multiple agents in an ad hoc setting. We have analyzed this problem within a multiagent task execution scenario, in which every task requires collaboration among multiple agents to get completed. Tasks are also ad hoc in the sense that they appear dynamically and require different sets of expertise or capabilities from agents for completion. We model collaboration within this framework as a decision-making problem in which agents have to determine what capabilities to learn and from which agents to learn them so that they can form teams that have the capabilities required to perform the current tasks satisfactorily. Our proposed technique refers to principles from human learning theory to enable an agent to strategically select appropriate capabilities to learn from other agents. We also use two openness parameters to model the dynamic nature of tasks and agents in the environment. Experimental results within the Repast agent simulator show that by using the appropriate learning strategy, the overall utility of the agents improves considerably. The performance of the agents and their utilities are also dependent on the repetitiveness of tasks and reencounter with agents within the environment. Our results also show that the agents that are able to learn more capabilities from another expert agent outperform the agents who learn only one capability at a time from many agents, and agents who use an intelligent utility maximizing strategy to choose which capabilities to learn outperform the agents who randomly make the learning decision.
Description
Chair
Major
Department
Computer Science
Recorder
License
© 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works
Citation
Jumadinova, J., P. Dasgupta, and L. -K Soh. Strategic Capability-Learning for Improved Multiagent Collaboration in Ad Hoc Environments. IEEE Transactions on Systems, Man, and Cybernetics: Systems. Vol. PP 2013.
Version
Postprint
Honors
Publisher
IEEE
Series