Sort:
Open Access Research Article Issue
Towards robust motion control in multi-source uncertain scenarios by robust policy iteration
Communications in Transportation Research 2025, 5(2): 100191
Published: 20 June 2025
Abstract PDF (5.4 MB) Collect
Downloads:25

The adoption of neural networks for motion control modules emerges as a critical direction in the advancement of end-to-end autonomous driving. However, few studies have comprehensively addressed the challenges of robustness and generalization in motion control policies, including long-tailed distribution, distribution shift, and sim-to-real gap. In practical applications, motion control performance is compromised by diverse uncertainties, posing substantial challenges to real-world deployment. This work develops a training system to enhance the robustness and generalization of motion control policies when passing through multiple intersections. We first construct a task library comprising 6 driving scenarios, which are allocated to different sampling processes to rebalance the proportion of monotonous and edge scenarios. Next, we formulate a zero-sum game for uncertainties and driving actions with smoothing constraints within the range of observation noise. The driving policy is optimized by the proposed robust policy iteration method for the worst-case performance, which is approximated via Taylor expansion to avoid the computational burden caused by adversarial training on behavior disturbance, where the approximate results decouple model mismatches to ensure robust performance and action smoothness is boosted through penalty function method. Ultimately, the motion control performance and the robustness of driving policy are thoroughly validated by configuring the behavior patterns of traffic participants, ego dynamic parameters, and observation noise intensities in the simulation environment. Physical vehicle experiments on public urban roads further depict the robustness and generalization of the driving policy learned from simulations.

Open Access Research Article Issue
Controllability test for nonlinear datatic systems
Communications in Transportation Research 2024, 4(4): 100143
Published: 04 November 2024
Abstract PDF (5.7 MB) Collect
Downloads:159

Controllability is a fundamental property of control systems, serving as the prerequisite for controller design. While controllability test is well established in modelic (i.e., model-driven) control systems, extending it to datatic (i.e., data-driven) control systems is still a challenging task due to the absence of system models. In this study, we propose a general controllability test method for nonlinear systems with datatic description, where the system behaviors are merely described by data. In this situation, the state transition information of a dynamic system is available only at a limited number of data points, leaving the behaviors beyond these points unknown. Different from traditional exact controllability, we introduce a new concept called ϵ-controllability, which extends the definition from point-to-point form to point-to-region form. Accordingly, our focus shifts to checking whether the system state can be steered to a closed state ball centered on the target state, rather than exactly at that target state. Given a known state transition sample, the Lipschitz continuity assumption restricts the one-step transition of all the points in a state ball to a small neighborhood of the subsequent state. This property is referred to as one-step controllability backpropagation, i.e., if the states within this neighborhood are ϵ-controllable, those within the state ball are also ϵ-controllable. On its basis, we propose a tree search algorithm called maximum expansion of controllable subset (MECS) to identify controllable states in the dataset. Starting with a specific target state, our algorithm can iteratively propagate controllability from a known state ball to a new one. This iterative process gradually enlarges the ϵ-controllable subset by incorporating new controllable balls until all ϵ-controllable states are searched. Besides, a simplified version of MECS is proposed by solving a special shortest path problem, called Floyd expansion with radius fixed (FERF). FERF maintains a fixed radius of all controllable balls based on a mutual controllability assumption of neighboring states. The effectiveness of our method is validated in three datatic control systems whose dynamic behaviors are described by sampled data.

Open Access Research paper Issue
FPGA accelerated model predictive control for autonomous driving
Journal of Intelligent and Connected Vehicles 2022, 5(2): 63-71
Published: 28 March 2022
Abstract PDF (1.2 MB) Collect
Downloads:319
Purpose

The purpose of this paper is to reduce the difficulty of model predictive control (MPC) deployment on FPGA so that researchers can make better use of FPGA technology for academic research.

Design/methodology/approach

In this paper, the MPC algorithm is written into FPGA by combining hardware with software. Experiments have verified this method.

Findings

This paper implements a ZYNQ-based design method, which could significantly reduce the difficulty of development. The comparison with the CPU solution results proves that FPGA has a significant acceleration effect on the solution of MPC through the method.

Research limitations implications

Due to the limitation of practical conditions, this paper cannot carry out a hardware-in-the-loop experiment for the time being, instead of an open-loop experiment.

Originality value

This paper proposes a new design method to deploy the MPC algorithm to the FPGA, reducing the development difficulty of the algorithm implementation on FPGA. It greatly facilitates researchers in the field of autonomous driving to carry out FPGA algorithm hardware acceleration research.

Open Access Research paper Issue
Markov probabilistic decision making of self-driving cars in highway with random traffic flow: a simulation study
Journal of Intelligent and Connected Vehicles 2018, 1(2): 77-84
Published: 18 October 2018
Abstract PDF (1.2 MB) Collect
Downloads:54
Purpose

Decision-making is one of the key technologies for self-driving cars. The high dependency of previously existing methods on human driving data or rules makes it difficult to model policies for different driving situations.

Design/methodology/approach

In this research, a probabilistic decision-making method based on the Markov decision process (MDP) is proposed to deduce the optimal maneuver automatically in a two-lane highway scenario without using any human data. The decision-making issues in a traffic environment are formulated as the MDP by defining basic elements including states, actions and basic models. Transition and reward models are defined by using a complete prediction model of the surrounding cars. An optimal policy was deduced using a dynamic programing method and evaluated under a two-dimensional simulation environment.

Findings

Results show that, at the given scenario, the self-driving car maintained safety and efficiency with the proposed policy.

Originality/value

This paper presents a framework used to derive a driving policy for self-driving cars without relying on any human driving data or rules modeled by hand.

Total 4