This paper investigates the potential of Vision-Language Models (VLMs) to enhance Human–Vehicle Interaction (HVI) in Autonomous Driving (AD) scenarios, particularly in interactions between vehicles and other traffic participants, with a focus on rationality and safety in external HVI. Leveraging recent advancements in large language models, VLMs demonstrate remarkable capabilities in understanding real-world contexts and generating significant interest in HVI applications. This paper provides an overview of AD, HVI, and VLMs, along with the historical context of large language model applications in HVI. The HVI discussed herein involves dynamic game processes encompassing perception and decision-making between vehicles and traffic participants, such as pedestrians. Furthermore, we examine the perceptual challenges associated with applying VLMs to HVI and compile relevant datasets. This research fills a gap in the existing literature by systematically analyzing the current status, challenges, and future opportunities of VLM applications in HVI. To advance VLM integration in AD, various implementation strategies are discussed. The findings highlight the potential of VLMs to transform HVI in AD, improving both passenger experience and driving safety. Overall, this study contributes to a comprehensive understanding of VLM applications in HVI and provides insights to guide future research and development.
- Article type
- Year
- Co-author
Open Access
Issue
Multi-UAVs operations encounter significant challenges in conflict avoidance and dynamic path replanning, which are crucial for ensuring safety and mission efficiency. To address these challenges, we propose a novel approach using Mixed Integer Linear Programming (MILP) to optimize UAV flight paths through real-time control of speed and heading angles. Our method formulates conflict resolution as an optimal control problem, aiming to minimize adjustments while satisfying constraints such as minimum separation distances, speed limits, and heading angle limits. The MILP algorithm significantly enhances operational efficiency by reducing conflict-related delays and improving mission completion rates. The effectiveness and practicality of the proposed method are validated by integrating speed and heading angle controls, demonstrating enhanced operational efficiency and cost-effectiveness in complex UAV environments.
京公网安备11010802044758号