Open Access
Issue
Published:
12 July 2022
Multimodal critical-scenarios search method for test of autonomous vehicles
)
Download citation
785
Views
37
Downloads
5
Crossref
N/A
WoS
5
Scopus
N/A
CSCD
The purpose of this paper is to search for the critical-scenarios of autonomous vehicles (AVs) quickly and comprehensively, which is essential for verification and validation (V&V).
The author adopted the index F1 to quantitative critical-scenarios' coverage of the search space and proposed the improved particle swarm optimization (IPSO) to enhance exploration ability for higher coverage. Compared with the particle swarm optimization (PSO), there were three improvements. In the initial phase, the Latin hypercube sampling method was introduced for a uniform distribution of particles. In the iteration phase, the neighborhood operator was adapted to explore more modals with the particles divided into groups. In the convergence phase, the convergence judgment and restart strategy were used to explore the search space by avoiding local convergence. Compared with the Monte Carlo method (MC) and PSO, experiments on the artificial function and critical-scenarios search were carried out to verify the efficiency and the application effect of the method.
Results show that IPSO can search for multimodal critical-scenarios comprehensively, with a stricter threshold and fewer samples in the experiment on critical-scenario search, the coverage of IPSO is 14% higher than PSO and 40% higher than MC.
The critical-scenarios' coverage of the search space is firstly quantified by the index F1, and the proposed method has higher search efficiency and coverage for the critical-scenarios search of AVs, which shows application potential for V&V.
menu
Multimodal critical-scenarios search method for test of autonomous vehicles
)
Abstract
The purpose of this paper is to search for the critical-scenarios of autonomous vehicles (AVs) quickly and comprehensively, which is essential for verification and validation (V&V).
The author adopted the index F1 to quantitative critical-scenarios' coverage of the search space and proposed the improved particle swarm optimization (IPSO) to enhance exploration ability for higher coverage. Compared with the particle swarm optimization (PSO), there were three improvements. In the initial phase, the Latin hypercube sampling method was introduced for a uniform distribution of particles. In the iteration phase, the neighborhood operator was adapted to explore more modals with the particles divided into groups. In the convergence phase, the convergence judgment and restart strategy were used to explore the search space by avoiding local convergence. Compared with the Monte Carlo method (MC) and PSO, experiments on the artificial function and critical-scenarios search were carried out to verify the efficiency and the application effect of the method.
Results show that IPSO can search for multimodal critical-scenarios comprehensively, with a stricter threshold and fewer samples in the experiment on critical-scenario search, the coverage of IPSO is 14% higher than PSO and 40% higher than MC.
The critical-scenarios' coverage of the search space is firstly quantified by the index F1, and the proposed method has higher search efficiency and coverage for the critical-scenarios search of AVs, which shows application potential for V&V.
References(23)
Bak, E.N., Saraçoğlu, R. and Şehribanoğlu, S. (2019), “Optimization of holder table test function using dynamic mutated genetic algorithm”, Proceedings Book, p. 221.
Batsch, F., Daneshkhah, A., Cheah, M., Kanarachos, S. and Baxendale, A. (2019), “Performance boundary identification for the evaluation of automated vehicles using gaussian process classification”, Intelligent Transportation Systems (ITSC), 2019 IEEE Intelligent Transportation Systems Conference on IEEE, pp. 419-424.
Beglerovic, H., Stolz, M. and Horn, M. (2017), “Testing of autonomous vehicles using surrogate models and stochastic optimization”, Intelligent Transportation Systems (ITSC), 2017 IEEE 20th International Conference on IEEE, pp. 1-6.
Chen, J., Feng, T., Liu, L. and Wu, X. (2020), “An automatic generation method of concrete scenario for decision-making and planning system test”, Automobile Technology, Vol. 36, pp. 45-50.
Feng, S., Feng, Y., Sun, H., Bao, S., Zhang, Y. and Liu, H.X. (2020), “Testing scenario library generation for connected and automated vehicles, part Ⅰ: methodology ”, IEEE Transactions on Intelligent Transportation Systems, Vol. 22 No. 3, pp. 1573-1582.
Huberman, B.A., Lukose, R.M. and Hogg, T. (1997), “An economics approach to hard computational problems”, Science, Vol. 275 No. 5296, pp. 51-54.
Kalra, N. and Susan, M.P. (2016), “Driving to safety: how many miles of driving would it take to demonstrate autonomous vehicle reliability?”, Transportation Research Part A: Policy and Practice, Vol. 94, pp. 182-193.
Kennedy, J. and Eberhart, R. (1995), “Particle swarm optimization”, International Conference on Neural Networks, ICNN 95, Proceeding of the IEEE, IEEE, pp. 1942-1948.
Klischat, M., Liu, E.I., Holtke, F. and Althoff, M. (2020), “Scenario factory: creating safety-critical traffic scenarios for automated vehicles”, Intelligent Transportation Systems (ITSC), 2020 IEEE 23rd International Conference on IEEE, pp. 1-7.
McKay, M.D., Beckman, R.J. and Conover, W.J. (1979), “A comparison of three methods for selecting values of input variables in the analysis of output from a computer code”, Technometrics, Vol. 42, pp. 239-245.
Masuda, S., Nakamura, H. and Kajitani, K. (2018), “Rule-based searching for collision test cases of autonomous vehicles simulation”, IET Intelligent Transport Systems, Vol. 12 No. 9, pp. 1088-1095.
Menzel, T., Bagschik, G. and Maurer, M. (2018), “Scenarios for development, test and validation of automated vehicles”, intelligent vehicles symposium, IV 2018”, Proceeding of the IEEE, IEEE, pp. 1821-1827.
Mullins, G.E., Stankiewicz, P.G. and Hawthorne, C.R. (2018), “Adaptive generation of challenging scenarios for testing and evaluation of autonomous vehicles”, Journal of Systems and Software, Vol. 137, pp. 197-215.
Pilz, C., Steinbauer, G., Schratter, M. and Watzenig, D. (2019), “Development of a scenario simulation platform to support autonomous driving verification”, International Conference on Connected Vehicles, ICCVE, 2019 IEEE International Conference on Connected Vehicles and Expo on IEEE, IEEE, pp. 1-7.
Schuldt, F., Reschka, A. and Maurer, M. (2018), “A method for an efficient, systematic test case generation for advanced driver assistance systems in virtual environments”, Automotive Systems Engineering II, Springer, pp. 147-175.
Suganthan, P.N. (1999), “Particle swarm optimiser with neighbourhood operator”, Evolutionary Computation, CEC 99, Proceedings of the 1999 Congress on Evolutionary Computation, pp. 1958-1962.
Tuncali, C.E., Fainekos, G., Ito, H. and Kapinski, J. (2018), “Simulation-based adversarial test generation for autonomous vehicles with machine learning components”, Intelligent Vehicles Symposium, IV 2018, Proceeding of the IEEE, IEEE, pp. 1555-1562.
Vogel, K. (2003), “A comparison of headway and time to collision as safety indicators”, Accident Analysis & Prevention, Vol. 35 No. 3, pp. 427-433.
Wolpert, D.H. and Macready, W.G. (1997), “No free lunch theorems for optimization”, IEEE Transactions on Evolutionary Computation, Vol. 1 No. 1, pp. 67-82.
Zhu, B., Zhang, P., Zhao, J., Chen, H. and Xu, Z. (2019), “Review of scenario-based virtual validation methods for automated vehicles”, China Journal of Highway and Transport, Vol. 32, pp. 1-19.
Zhu, B., Zhang, P., Zhao, J. and Deng, W. (2021), “Hazardous scenario enhanced generation for automated vehicle testing based on optimization searching method”, IEEE Transactions on Intelligent Transportation Systems, pp. 1-11.
Publication history
Copyright
Rights and permissions
This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence maybe seen at http://creativecommons.org/licences/by/4.0/legalcode
FEEDBACK 
TOP