C. M. Macal and M. J. North, Agent-based modeling and simulation: Desktop ABMS, presented at 2007 Winter Simulation Conf., Washington, DC, USA, 2007, pp. 95–106.
Z. B. Tao He, Research on the key technology of multi-agent system design, (in Chinese), Modern Electron. Techn., vol. 29, no. 14, pp. 31–34, 2006.
K. Liu, Modeling and simulation of complex adaptive system based on multi-agent, PhD dissertation, Central South University, Changsha, China, 2011.
M. Abbas, Agent-based modeling and simulation, presented at Artificial Intelligence Applications to Critical Transportation Issues, Washington, DC, USA, 2012, p. 58.
H. Z. Deng, Modeling and simulation method and its application based on multi-agent, (in Chinese), PhD dissertation, National University of Defense Technology, Xi’an, China, 2002.
H. Z. Deng, Y. J. Tan, and Y. Chi, A complex system research method-multiagent-based ensemble modeling and simulation method, (in Chinese), Syst. Eng., vol. 18, no. 4, pp. 73–78, 2000.
B. J. L. Berry, L. D. Kiel, and E. Elliott, Adaptive agents, intelligence, and emergent human organization: Capturing complexity through agent-based modeling, Proc. Nat. Acad. Sci. USA, vol. 99, no. S3, pp. 7187–7188, 2002.
M. H. Haghighat and J. Li, Intrusion detection system using voting-based neural network, Tsinghua Science and Technology, vol. 26, no. 4, pp. 484–495, 2021.
J. Zhang, Z. Tang, Y. Xie, M. Ai, and W. Gui, Visual perception-based fault diagnosis in froth flotation using statistical approaches, Tsinghua Science and Technology, vol. 26, no. 2, pp. 172–184, 2021.
D. Bloembergen, K. Tuyls, D. Hennes, and M. Kaisers, Evolutionary dynamics of multi-agent learning: A survey, J. Artif. Intell. Res., vol. 53, no. 1, pp. 659–697, 2015.
P. Tranouez, E. Daudé, and P. Langlois, A multiagent urban traffic simulation, arXiv preprint arXiv: 1201.5472, 2012.
D. Schreiber, The emergence of parties: An agent-based simulation, Polit. Res. Quart., vol. 67, no. 1, pp. 136–151, 2014.
J. L. Casti, Would-be Worlds: How Simulation is Changing the Frontiers of Science. New York, NY, USA: John Wiley & Sons, Inc., 1998.
B. Raney, N. Cetin, A. Völlmy, M. Vrtic, K. Axhausen, and K. Nagel, An agent-based microsimulation model of swiss travel: First results, Netw. Spat. Econ., vol. 3, no. 1, pp. 23–41, 2003.
J. M. Epstein and R. Axtell, Growing Artificial Societies: Social Science from the Bottom Up. Washington, DC, USA: Brookings Institution Press, 1996.
R. Pryor, N. Basu, and T. Quint, Development of ASPEN: A microanalytic simulation model of the US economy, Working Paper SAND-96–0434, Sandia National Laboratories, Albuquerque, NM, USA, 1996.
N. Basu and R. J. Pryor, Growing a market economy. SAND-97-2093 Distribution, presented at Unlimited Release Category UCD905, Albuquerque, NM, USA, 1997.
W. B. Arthur, S. N. Durlauf, and D. Lane, The Economy As an Evolving Complex System II. Boca Raton, FL, USA: CRC Press, 1997.
W. B. Arthur, J. H. Holland, B. LeBaron, R. Palmer, and P. Tayler, Asset pricing under endogenous expectations in an artificial stock market, presented at the Economy As an Evolving Complex System II, Reading, MA, USA, 1996.
A. Khalafallah, Neural network based model for predicting housing market performance, Tsinghua Science and Technology, vol. 13, no. S1, pp. 325–328, 2008.
H. Rahmandad and J. Sterman, Heterogeneity and network structure in the dynamics of diffusion: Comparing agent-based and differential equation models, Manag. Sci., vol. 54, no. 5, pp. 998–1014, 2008.
M. Komosinski and A. Adamatzky, Artificial Life Models in Software. 2nd ed. London, UK: Springer Science & Business Media, 2009.
T. Lorenz, Abductive fallacies with agent-based modeling and system dynamics, in Int. Workshop on Epistemological Aspects of Computer Simulation in the Social Sciences, F. Squazzoni, ed. Berlin, Germany: Springer-Verlag, 2009, pp. 141–152.
T. Lorenz and A. Jost, Towards an orientation framework in multi-paradigm modeling, in Proc.24th Int. Conf. System Dynamics Society, Nijmegen, the Netherlands, 2006, pp. 2134–2151.
Z. K. Ding, W. Y. Gong, S. H. Li, and Z. Z. Wu, System dynamics versus agent-based modeling: A review of complexity simulation in construction waste management, Sustainability, vol. 10, no. 7, p. 2484, 2018.
C. Swinerd and K. R. McNaught, Design classes for hybrid simulations involving agent-based and system dynamics models, Simulat. Model. Pract. Theory, vol. 25, pp. 118–133, 2012.
C. Heinze, B. Smith, and M. Cross, Thinking quickly: Agents for modeling air warfare, in Australian Joint Conf. Artificial Intelligence AI 1998, G. Antoniou and J. Slaney, eds. Berlin, Germany: Springer, 1998, pp. 47–58.
R. W. Hill, J. Chen, J. Gratch, P. Rosenbloom, and M. Tambe, Soar-RWA: Planning, teamwork, and intelligent behavior for synthetic rotary wing aircraft, in Proc.7th Conf. Computer Generated Forces & Behavioral Representation, Orlando, FL, USA, 1998, pp. 12–14.
A. Alvanchi, S. Lee, and S. AbouRizk, Modeling framework and architecture of hybrid system dynamics and discrete event simulation for construction, Comp. Aided Civil Infrastruct. Eng., vol. 26, no. 2, pp. 77–91, 2011.
L. Lättilä, P. Hilletofth, and B. S. Lin, Hybrid simulation models–when, why, how? Expert Syst. Appl., vol. 37, no. 12, pp. 7969–7975, 2010.
J. W. Forrester, System dynamics, systems thinking, and soft OR, Syst. Dynam. Rev., vol. 10, nos. 2&3, pp. 245–256, 1994.
F. Nasirzadeh, M. Khanzadi, and M. Mir, A hybrid simulation framework for modelling construction projects using agent-based modelling and system dynamics: An application to model construction workers’ safety behavior, Int.J. Construct. Manag., vol. 18, no. 2, pp. 132–143, 2018.
D. D. Wu, K. F. Xie, H. Liu, S. Zhao, and D. L. Olson, Modeling technological innovation risks of an entrepreneurial team using system dynamics: An agent-based perspective, Technol. Forecast. Soc. Change, vol. 77, no. 6, pp. 857–869, 2010.
F. Nasirzadeh, A. Afshar, and M. Khanzadi, System dynamics approach for construction risk analysis, Int.J. Civil Eng., vol. 6, no. 2, pp. 120–131, 2008.
J. Swanson, Business dynamics-systems thinking and modeling for a complex world, J. Oper. Res. Soc., vol. 53, no. 4, pp. 472–473, 2002.
M. Watkins, A. Mukherjee, N. Onder, and K. Mattila, Using agent-based modeling to study construction labor productivity as an emergent property of individual and crew interactions, J. Construct. Eng. Manage., vol. 135, no. 7, pp. 657–667, 2009.
S. E. Phelan, A note on the correspondence between complexity and systems theory, Syst. Pract. Act. Res., vol. 12, no. 3, pp. 237–246, 1999.
J. M. Epstein and R. Axtell, Growing Artificial Societies: Social Science from the Bottom Up. Cambridge, MA, USA: MIT Press, 1996.
M. Barbati, G. Bruno, and A. Genovese, Applications of agent-based models for optimization problems: A literature review, Expert Syst. Appl., vol. 39, no. 5, pp. 6020–6028, 2012.
H. J. Scholl, Agent-based and system dynamics modeling: A call for cross study and joint research, in Proc.34th Ann. Hawaii Int. Conf. System Sciences, Maui, HI, USA, 2001.
J. Pourdehnad, K. Maani, and H. Sedehi, System dynamics and intelligent agent-based simulation: Where is the synergy, in Proc. 20th Int. Conf. System Dynamics Society, Palermo, Italy, 2002, pp. 1–16.
L. Stemate, C. Pasca, and I. Taylor, A comparison between system dynamics and agent based modeling and opportunities for cross-fertilization, in Proc. Winter Simulation Conf., Washington, DC, USA, 2007, pp. 2376.
N. Schieritz, Integrating system dynamics and agent-based modeling, in Proc. 20th Int. Conf. System Dynamics Society, Palermo, Italy, 2002, pp. 1–3.
N. Schieritz and P. M. Milling, Modeling the forest or modeling the trees: A comparison of system dynamics and agent-based simulation, in Proc. System Dynamics Conf., New York, NY, USA, 2003, pp. 1–15.
N. Schieritz N and A. Grobler, Emergent structures in supply chains-a study integrating agent-based and system dynamics modeling, in Proc. 36th Ann. Hawaii Int. Conf. System Sciences, Big Island, HI, USA, 2003, p. 9.
M. Teose, K. Ahmadizadeh, E. O’Mahony, R. L. Smith, L. Zhao, S. P. Ellner, C. Gomes, and Y. Grohn, Embedding system dynamics in agent based models for complex adaptive systems, in Proc. 22nd Int. Joint Conf. Artificial Intelligence, Barcelona, Spain, 2011, pp. 2531–2538.
E. Shafiei, H. Stefansson, E. I. Asgeirsson, B. Davidsdottir, and M. Raberto, Integrated agent-based and system dynamics modelling for simulation of sustainable mobility, Transp. Rev., vol. 33, no. 1, pp. 44–70, 2013.
C. M. Macal, To agent-based simulation from system dynamics, in Proc. 2010 Winter Simulation Conf., Baltimore, MD, USA, 2010, pp. 371–382.
A. Djanatliev, R. German, P. Kolominsky-Rabas, and B. M. Hofmann, Hybrid simulation with loosely coupled system dynamics and agent-based models for prospective health technology assessments, in Proc. 2012 Winter Simulation Conf. (WSC), Berlin, Germany, 2012, pp. 1–12.
G. P. Figueredo, P. O. Siebers, U. Aickelin, A. Whitbrook, and J. M. Garibaldi, Juxtaposition of system dynamics and agent-based simulation for a case study in immunosenescence, PLoS One, vol. 10, no. 3, p. e0118359, 2015.
J. Schryver, J. Nutaro, and M. Shankar, Emulating a system dynamics model with agent-based models: A methodological case study in simulation of diabetes progression, Open J. Model. Simul., vol. 3, no. 4, p. 60811, 2015.
F. Ferrada and L. M. Camarinha-Matos, A system dynamics and agent-based approach to model emotions in collaborative networks, in Doctoral Conference on Computing, Electrical and Industrial Systems, L. Camarinha-Matos, M. Parreira-Rocha, and J. Ramezani, eds. Springer, 2017, pp. 29–43.
N. Marilleau, C. Lang, and P. Giraudoux, Coupling agent-based with equation-based models to study spatially explicit megapopulation dynamics, Ecol. Model., vol. 384, pp. 34–42, 2018.
R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998.
M. D. Awheda and H. M. Schwartz, The residual gradient FACL algorithm for differential games, presented at 2015 IEEE 28th Canadian Conf. Electrical and Computer Engineering (CCECE), Halifax, Canada, 2015, pp. 1006–1011.
W. D. Smart and L. Pack Kaelbling, Effective reinforcement learning for mobile robots, in Proc. 2002 IEEE Int. Conf. Robotics and Automation (Cat.No.02CH37292), Washington, DC, USA, 2002, pp. 3404–3410.
M. L. Littman, Markov games as a framework for multi-agent reinforcement learning, in Proc. 12th Int. Conf., Elsevier, 1994, pp. 157–163.
B. Luo, H. N. Wu, and T. W. Huang, Off-policy reinforcement learning for H∞ control design, IEEE Trans. Cybernet., vol. 45, no. 1, pp. 65–76, 2015.
B. Luo, H. N. Wu, and H. X. Li, Data-based suboptimal neuro-control design with reinforcement learning for dissipative spatially distributed processes, Ind. Eng. Chem. Res., vol. 53, no. 19, pp. 8106–8119, 2014.
W. Dixon, Optimal adaptive control and differential games by reinforcement leanring principles [book review], IEEE Contr. Syst. Mag., vol. 34, no. 3, pp. 80–82, 2014.
P. X. Cai and Y. Zhang, Intelligent cognitive spectrum collaboration: Convergence of spectrum sensing, spectrum access, and coding technology, Intelligent and Converged Networks, vol. 1, no. 1, pp. 79–98, 2020.
B. Hou, F. C. Sun, H. B. Li, and G. B. Liu, Consensus of second-order multi-agent systems with time-varying delays and antagonistic interactions, Tsinghua Science and Technology, vol. 20, no. 2, pp. 205–211, 2015.
Z. H. Zhao, Y. Gao, B. Luo, and S. F. Chen, Reinforcement learning technology in multi-agent system, (in Chinese), Comp. Sci., vol. 31, no. 3, pp. 23–27, 2004.
R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT Press, 1998, pp. 133–160.
C. J. C. H. Watkins and P. Dayan, Q-learning, Mach. Learn., vol. 8, nos. 3&4, pp. 279–292, 1992.
R. S. Sutton, D. McAllester, S. Singh, and Y. Mansour, Policy gradient methods for reinforcement learning with function approximation, in Proc. 12th Int. Conf. Neural Information Proc. Systems, Denver, CO, USA, 2000, pp. 1057–1063.
P. Stone and M. Veloso, Multiagent systems: A survey from a machine learning perspective, Auton. Robots, vol. 8, no. 3, pp. 345–383, 2000.
Y. Shoham, R. Powers, and T. Grenager, If multi-agent learning is the answer, what is the question? Artif. Intell., vol. 171, no. 7, pp. 365–377, 2006.
V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, Playing atari with deep reinforcement learning, arXiv preprint arXiv: 1312.5602, 2013.
G. Papoudakis, F. Christianos, A. Rahman, and S. V. Albrecht, Dealing with non-stationarity in multi-agent deep reinforcement learning, arXiv preprint arXiv: 1906.04737, 2019.
T. T. Nguyen, N. D. Nguyen, and S. Nahavandi, Deep reinforcement learning for multiagent systems: A review of challenges, solutions, and applications, IEEE Trans. Cybernet., vol. 50, no. 9, pp. 3826–3839, 2020.
L. Busoniu, R. Babuska, and B. De Schutter, A comprehensive survey of multiagent reinforcement learning, IEEE Trans. Syst. Man Cybernet. Part C Appl. Rev., vol. 38, no. 2, pp. 156–172, 2008.
P. Hernandez-Leal, B. Kartal, and M. E. Taylor, A survey and critique of multiagent deep reinforcement learning, Auton. Agents Multi Agent Syst., vol. 33, no. 6, pp. 750–797, 2019.
A. Tampuu, T. Matiisen, D. Kodelja, I. Kuzovkin, K. Korjus, J. Aru, J. Aru, and R. Vicente, Multiagent cooperation and competition with deep reinforcement learning, PLoS One, vol. 12, no. 4, p. e0172395, 2017.
M. Raghu, A. Irpan, J. Andreas, B. Kleinberg, Q. V. Le, and J. Kleinberg, Can deep reinforcement learning solve erdos-selfridge-spencer games? arXiv preprint arXiv: 1711.02301, 2018.
S. Sukhbaatar, A. Szlam, and R. Fergus, Learning multiagent communication with backpropagation, presented at 30th Ann. Conf. Neural Information Proc. Systems, Barcelona, Spain, 2016, pp. 2244–2252.
J. C. Jiang and Z. Q. Lu, Learning attentional communication for multi-agent cooperation, in Proc. 32nd Int. Conf. Neural Information Processing Systems, Montréal, Canada, 2018, pp. 7254–7264.
R. Lowe, Y. I. Wu, A. Tamar, J. Harb, O. P. Abbeel, and I. Mordatch, Multi-agent actor-critic for mixed cooperative-competitive environments, in Proc. 31st Int. Conf. Neural Information Processing Systems, Long Beach, CA, USA, 2017, pp. 6379–6390.
J. Foerster, G. Farquhar, T. Afouras, N. Nardelli, and S. Whiteson, Counterfactual multi-agent policy gradients, arXiv preprint arXiv: 1705.08926, 2018.
S. V. Albrecht and P. Stone, Autonomous agents modelling other agents: A comprehensive survey and open problems, Artif. Intell., vol. 258, pp. 66–95, 2018.
R. Raileanu, E. Denton, A. Szlam, and R. Fergus, Modeling others using oneself in multi-agent reinforcement learning, arXiv preprint arXiv: 1802.09640, 2018.
M. Lanctot, V. Zambaldi, A. Gruslys, A. Lazaridou, K. Tuyls, J. Pérolat, D. Silver, and T. Graepel, A unified game-theoretic approach to multiagent reinforcement learning, in Proc. 31st Int. Conf. Neural Information Processing Systems, Long Beach, CA, USA, 2017, pp. 4190–4203.
L. O. Souza, G. de Oliveira Ramos, and C. G. Ralha, Experience sharing between cooperative reinforcement learning agents, presented at 2019 IEEE 31st Int. Conf. Tools with Artificial Intelligence (ICTAI), Portland, OR, USA, 2019, pp. 963–970.
S. Barrett, A. Rosenfeld, S. Kraus, and P. Stone, Making friends on the fly: Cooperating with new teammates, Artif. Intell., vol. 242, pp. 132–171, 2017.
P. Y. Jiang, M. L. Yang, W. D. Li, J. J. Liu, W. Guo, and P. L. Li, Ci literature review and its application exploration in social manufacturing, (in Chinese), Chin Mech. Eng., vol. 31, no. 15, pp. 1852–1865, 2020.
O. Vinyals, I. Babuschkin, W. M. Czarnecki, M. Mathieu, A. Dudzik, J. Chung, D. H. Choi, R. Powell, T. Ewalds, P. Georgiev, et al., Grandmaster level in starcraft II using multi-agent reinforcement learning, Nature, vol. 575, no. 7782, pp. 350–354, 2019.
H. R. Parry and M. Bithell, Large scale agent-based modelling: A review and guidelines for model scaling, in Agent-Based Models of Geographical Systems, A. Heppenstall, A. Crooks, L. See, and M. Batty, eds. Springer, 2012, pp. 271–308.
H. R. Parry and A. J. Evans, A comparative analysis of parallel processing and super-individual methods for improving the computational performance of a large individual-based model, Ecol. Model., vol. 214, nos. 2&4, pp. 141–152, 2008.
F. Ablayev, M. Ablayev, J. Z. Huang, K. Khadiev, N. Salikhova, and D. M. Wu, On quantum methods for machine learning problems part I: Quantum tools, Big Data Mining and Analytics, vol. 3, no. 1, pp. 41–55, 2020.
J. Q. Huang, W. T. Han, X. Y. Wang, and W. G. Chen, Heterogeneous parallel algorithm design and performance optimization for WENO on the sunway taihulight supercomputer, Tsinghua Scicence and Technology, vol. 25, no. 1, pp. 56–67, 2020.
Z. Bo, H. C. Zhou, G. Q. Li, and Y. H. Huang, ZenLDA: Large-scale topic model training on distributed data-parallel platform, Big Data Mining and Analytics, vol. 1, no. 1, pp. 57–74, 2018.
J. Blythe, J. Bollenbacher, D. Huang, P. M. Hui, R. Krohn, D. Pacheco, G. Muric, A. Sapienza, A. Tregubov, Y. Y. Ahn, et al., Massive multi-agent data-driven simulations of the GitHub ecosystem, in Int. Conf. Practical Applications of Agents and Multi-Agent Systems, Y. Demazeau, E. Matson, J. Corchado, and F. De la Prieta, eds. Springer, 2019, pp. 3–15.
J. C. Campagne, A. Cardon, E. Collomb, and T. Nishida, Massive multi-agent systems control, in Int. Workshop on Formal Approaches to Agent-Based Systems, M. G. Hinchey, J. L. Rash, W. F. Truszkowski, and C. A. Rouff, eds. Springer, 2004, pp. 275–280.
Z. J. Zhou and H. Xu, Decentralized adaptive optimal control for massive multi-agent systems using mean field game with self-organizing neural networks, presented at 2019 IEEE 58th Conf. Decision and Control (CDC), Nice, France, 2019, pp. 1225–1230.
N. Fachada, V. V. Lopes, R. C. Martins, and A. C. Rosa, Parallelization strategies for spatial agent-based models, Int.J. Parallel Program., vol. 45, no. 3, pp. 449–481, 2017.
N. Fachada, V. V. Lopes, R. C. Martins, and A. C. Rosa, Towards a standard model for research in agent-based modeling and simulation, PeerJ Comp. Sci., vol. 1, no. 2, p. e36, 2015.
A. Saprykin, N. Chokani, and R. S. Abhari, Large-scale multi-agent mobility simulations on a GPU: Towards high performance and scalability, Proced. Comp. Sci., vol. 151, pp. 733–738, 2019.
W. Marurngsith and Y. Mongkolsin, Creating GPU-enabled agent-based simulations using a PDES tool, in Distributed Computing and Artificial Intelligence Advances in Intelligent Systems & Computing, S. Omatu, J. Neves, J. Rodriguez, J. Paz Santana, and S. Gonzalez, eds. Springer, vol. 217, pp. 227–234, 2013.
N. Collier and M. North, Parallel agent-based simulation with repast for high performance computing, Simulation, vol. 89, no. 10, pp. 1215–1235, 2013.
F. Klügl and G. Rindsfüser, Large-scale agent-based pedestrian simulation, in German Conf. Multiagent System Technologies, P. Petta, J. P. Müller, M. Klusch, and M. Georgeff, eds. Springer, 2007, pp. 145–156.
L. Zhang, W. C. Yang, J. M. Wang, and Q. Rao, Large-scale agent-based transport simulation in Shanghai, China, Transport. Res. Rec.J. Transport. Res. Board, vol. 2399, no. 1, pp. 34–43, 2013.
R. Haroun, F. Boumghar, S. Hassas, and L. Hamami, A massive multi-agent system for brain MRI segmentation, presented at Int. Workshop on Massively Multiagent Systems, Kyoto, Japan, 2004, pp. 174–186.
M. X. Zhang, R. Q. Meng, and A. Verbraeck, Including public transportation into a large-scale agent-based model for epidemic prediction and control, in Proc. Summer Computer Simulation (SummerSim ’15). Society for Computer Simulation International, San Diego, CA, USA, 2015, pp. 1–8.
T. Suzumura, C. Houngkaew, and H. Kanezashi, Towards billion-scale social simulations, in Proc. Winter Simulation Conf., Savannah, GA, USA, 2015, pp. 781–792.
W. H. Yu, JADE-based Multi-agent System Development Technology, (in Chinese). Beijing, China: National Defense Industry Press, 2011.
C. Zhu, Macroscopic and microscopic expressway traffic flow modeling and simulation based on multi-agent system, Master dissertation, Beijing University of Technology, Beijing, China, 2016.
S. Y. Liao, J. Chen, H. W. Lu, and J. H. Dai, Summarization of agent-based modeling and simulation, (in Chinese), Comput. Simul., vol. 25, no. 12, pp. 1–7, 2008.
D. C Zhou and X. P. Wu, Realization of ACS in repast, (in Chinese), J. Wuhan Univ. Technol., vol. 29, no. 8, pp. 121–124, 2007.
Department of Computer Science, Nguyen Engineering Building, 4400 University Drive, Mason, https://cs.gmu.edu/, 2021.
M. Zhou, The design and implement of agent modeling in complex system distributed simulation platform, (in Chinese), Master dissertation, National University of Defense Technology, Xi’an, China, 2013.