Strategic Capability-Learning for Improved Multiagent Collaboration in Ad Hoc Environments

Abstract

We consider the problem of distributed collaboration among multiple agents in an ad hoc setting. We have analyzed this problem within a multiagent task execution scenario, in which every task requires collaboration among multiple agents to get completed. Tasks are also ad hoc in the sense that they appear dynamically and require different sets of expertise or capabilities from agents for completion. We model collaboration within this framework as a decision-making problem in which agents have to determine what capabilities to learn and from which agents to learn them so that they can form teams that have the capabilities required to perform the current tasks satisfactorily. Our proposed technique refers to principles from human learning theory to enable an agent to strategically select appropriate capabilities to learn from other agents. We also use two openness parameters to model the dynamic nature of tasks and agents in the environment. Experimental results within the Repast agent simulator show that by using the appropriate learning strategy, the overall utility of the agents improves considerably. The performance of the agents and their utilities are also dependent on the repetitiveness of tasks and reencounter with agents within the environment. Our results also show that the agents that are able to learn more capabilities from another expert agent outperform the agents who learn only one capability at a time from many agents, and agents who use an intelligent utility maximizing strategy to choose which capabilities to learn outperform the agents who randomly make the learning decision.