Abstract
Agent teaming is a subfield of multi-agent systems that is mainly composed of artificial intelligence and distributed computing techniques. Autonomous agents are required to be able to adapt and learn in uncertain environments via communication and collaboration in both competitive and cooperative situations. The joint intension and sharedPlan are two most popular theories for the teamwork of multi-agent systems. However, there is no clear guideline for designing and implementing agents’ teaming. As a popular cognitive architecture, the BDI (Belief, Desire, and Intension) architecture has been widely used to design multi-agent systems. In this aspect, flexible multi-agent decision making requires effective reactions and adaptation to dynamic environment under time pressure, especially in real-time and dynamic systems. Due to the inherent complexity of real-time, stochastic, and dynamic environments, it is often extremely complex and difficult to formally verify their properties a priori. For real-time, non-deterministic and dynamic systems, it is often difficult to generate enough episodes via real applications for training the goal-oriented agent’s individual and cooperative learning abilities. In this article, a role-based BDI framework is presented to facilitate optimization problems at the team level such as competitive, cooperation, and coordination problems. This BDI framework is extended on the commercial agent software development environment known as JACK Teams. The layered architecture has been used to group the agents’ competitive and cooperative behaviors. In addition, we present the use of reinforcement learning techniques to learn different behaviors through experience. These issues have been investigated and analyzed using a real-time 2D simulation environment known as SoccerBots.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
InfoGrames Epic Games and Digital Entertainment. Technical report, Unreal tournament manual (2000)
Teambots (2000), http://www.cs.cmu.edu/~trb/Teambots/Domains/SoccerBots
Humaniod Kid and Medium Size League, Rules and Setup for Osaka 2005. Technical report, Robocup (2005)
Agent Oriented Software Pty Ltd. JACK Intelligent Agents User Guide (2002)
Agent Oriented Software Pty Ltd. JACK Teams User Guide (2002)
Bellman, R.: A Markovian Decision Process. Journal of Mathematics and Mechanics 6 (1957)
Bellman, R.: Dynamic Programming. Princeton University Press, Princeton (1957)
Bradshaw, J.M., Feltovich, P., Jung, H., Kulkarni, S., Allen, J., Bunch, L., Chambers, N., Galescu, L., Jeffers, R., Johnson, M., Sierhuis, M., Taysom, W., Uszok, A., Van Hoof, R.: Policy-based Coordination in Joint Human-agent Activity. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, The Hague, The Netherlands, pp. 2029–2036 (2004)
Bratman, M.E.: Intention, Plans, and Practical Reasoning. Harvard University Press, Cambridge (1987)
Cheyer, A., Martin, D.: The Open Agent Architecture. Autonomous Agents and Multi-Agent Systems 4(1-2), 143–148 (2001)
Coen, M.H.: Sodabot: A software agent construction system. Technical report. MIT AI Laboratory, Cambridge (1995)
Cohen, P., Levesque, H., Smith, I.: On Team Formation. Contemporary Action Theory (1998)
Cohen, P.R., Levesque, H.J.: Teamwork. Nous 25(4), 487–512 (1991)
Durfee, E.H., Lesser, V.: Negotiating Task Decomposition and Allocation Using Partial Global Planning. In: Gasser, L., Huhns, M. (eds.) Distributed Artificial Intelligence, pp. 229–244. Morgan Kaufmann, San Francisco
Evertsz, R., Fletcher, M., Jones, R., Jarvis, J., Brusey, J., Dance, S.: Implementing Industrial Multi-agent Systems Using JACKTM. In: Dastani, M.M., Dix, J., El Fallah-Seghrouchni, A. (eds.) PROMAS 2003. LNCS (LNAI), vol. 3067, pp. 18–48. Springer, Heidelberg (2004)
Ferber, J., Gutknecht, O., Michel, F.: From Agents to Organizations: An Organizational View of Multi-agent Systems. In: Giorgini, P., Müller, J.P., Odell, J.J. (eds.) AOSE 2003. LNCS, vol. 2935, pp. 443–459. Springer, Heidelberg (2003)
Franklin, S., Graesser, A.: Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents. In: Jennings, N.R., Wooldridge, M.J., Müller, J.P. (eds.) ECAI-WS 1996 and ATAL 1996. LNCS, vol. 1193, pp. 21–35. Springer, Heidelberg (1996)
Garey, M.R., Johnson, D.S.: Computers and Intractability: A Guide to the theory of NP-completeness. WH Freeman and Company, New York (1979)
Gilbert, D., Aparicio, M., Atkinson, B., Brady, S., Ciccarino, J., Grosof, B., O’Connor, P., Osisek, D., Pritko, S., Spagna, R., Wilson, L.: IBM Intelligent Agent Strategy. Technical report, IBM Corporation (1995)
Grosz, B., Kraus, S.: A Collaborative Plans for Complex Actions. Artificial Intelligence 86, 269–358 (1996)
Grosz, B., Sidner, C.: Plan for Discourse. In: Cohen, P., Morgan, J., Pollack, M. (eds.) Intensions in Communication, pp. 417–444. Morgan Kaufmann, San Francisco (1990)
Gutknecht, O., Michel, F., Ferber, J.: Integrating Tools and Infrastructure for Generic Multi-Agent Systems, Autonomous Agents 2001. ACM Press, New York (2001)
Jennings, N.R.: On Agent-based Software Engineering. Artificial Intelligence 117, 277–296 (2000)
Jennings, N.R., Sycara, K., Wooldridge, M.: A Roadmap of Agent Research and Development. Autonomous Agents and Multi-Agent Systems 1(1), 7–38 (1998)
Laird, J.E., Newell, A., Rosenbloom, P.S.: Soar: an architecture for general intelligence. Artificial Intelligence 33(1), 1–64 (1987)
Leng, J., Fyfe, C., Jain, L.: Reinforcement Learning of Competitive Skills with Soccer Agents. In: Apolloni, B., Howlett, R.J., Jain, L.C. (eds.) KES 2007, Part I. LNCS (LNAI), vol. 4692, pp. 572–579. Springer, Heidelberg (2007)
Leng, J., Jain, L., Fyfe, C.: Simulation and Reinforcement Learning with Soccer Agents. International Journal of Multiagent and Grid Systems 4(4), 415–436 (2008)
Lind, J.: Agents, Multiagent Systems and Software Engineering. In: Lind, J. (ed.) Iterative Software Engineering for Multiagent Systems. LNCS (LNAI), vol. 1994, pp. 9–33. Springer, Heidelberg (2001)
Pokahr, A., Braubach, L., Lamersdorf, W.: Jadex: Implementing a BDI-Infrastructure for JADE Agents. EXP – in search of innovation 3(3), 76–85 (2003)
Rao, A.S., Georgeff, M.P.: BDI-agents: from theory to practice. In: Proceedings of the First Intelligent Conference on Multiagent Systems (1995)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice-Hall, Englewood Cliffs (1995)
Russell, S., Norvig, P.: Heuristic: Intelligent Search Strategies for Computer Problem Solving, A Modern Approach. Prentice-Hall, Englewood (1995)
Sioutis, C.: Reasoning and Learning for Intelligent Agents. PhD thesis, School of Electrical and Information Engineering, University of South Australia (2005)
Stone, P.: Layered Learning in Multiagent Systems: A Winning Approach to Robotic Soccer. MIT Press, Cambridge (2000)
Stone, P., Kuhlmann, G., Taylor, M.E., Liu, Y.: Keepaway Soccer: From Machine Learning Testbed to Benchmark. In: Bredenfeld, A., Jacoff, A., Noda, I., Takahashi, Y. (eds.) RoboCup 2005. LNCS (LNAI), vol. 4020, pp. 93–105. Springer, Heidelberg (2006)
Stone, P., Sutton, R.S., Kuhlmann, G.: Reinforcement Learning for RoboCup-Soccer Keepaway. Adaptive Behavior 13(3), 165–188 (2005)
Stone, P., Veloso, M.: Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork. Artificial Intelligence 110(2), 241–273 (1999)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Sycara, K.: MultiAgent Systems. AI Magazine 19(2), 79–92 (1998)
Tambe, M.: Towards Flexible Teamwork. Journal of Artificial Intelligence Research 7, 83–124 (1997)
Tweedale, J., Ichalkaranje, N., Sioutis, C., Urlings, P., Jain, L.C.: Building a Decision Making Framework using Agent Teams. International Journal of Intelligent Decision Technologies 1(4), 175–181 (2007)
van Breemen, A.J.N.: Integrating Agents in Software Applications. In: Kowalczyk, R., Müller, J.P., Tianfield, H., Unland, R. (eds.) NODe-WS 2002. LNCS (LNAI), vol. 2592, pp. 343–354. Springer, Heidelberg (2003)
Whiteson, S., Stone, P.: Concurrent Layered Learning. In: Proceeding of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2003), Australia,, pp. 193–200 (2003)
Wooldridge, M.: Reasoning About Rational Agents. MIT Press, Cambridge (2000)
Wooldridge, M., Jennings, N.: Intelligent agents: Theory and practice. Knowledge Engineering Review 10 (1995)
Yen, J., Yin, J., Ioerger, T.R., Miller, M.S., Xu, D., Volz, R.A.: CAST: Collaborative Agents for Simulating Teamwork. In: IJCAI, pp. 1135–1144 (2001)
Zaki, Y., Pierre, S.: Mobile Agents in Distributed Meeting Scheduling: A Case Study for Distributed Applications. International Journal of Intelligent Decision Technologies 1(1-2), 71–82 (2007)
Zhang, Y.: Modelling role-based agent team. In: Kobti, Z., Wu, D. (eds.) Canadian AI 2007. LNCS (LNAI), vol. 4509, pp. 1–13. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Leng, J., Lim, C.P., Li, J., Li, D., Jain, L. (2010). A Role-Based Cognitive Architecture for Multi-Agent Teaming. In: Hãkansson, A., Hartung, R., Nguyen, N.T. (eds) Agent and Multi-agent Technology for Internet and Enterprise Systems. Studies in Computational Intelligence, vol 289. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13526-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-13526-2_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13525-5
Online ISBN: 978-3-642-13526-2
eBook Packages: EngineeringEngineering (R0)