Sort:
Open Access Issue
Reinforcement Learning-Based Dynamic Order Recommendation for On-Demand Food Delivery
Tsinghua Science and Technology 2024, 29 (2): 356-367
Published: 22 September 2023
Downloads:67

On-demand food delivery (OFD) is gaining more and more popularity in modern society. As a kernel order assignment manner in OFD scenario, order recommendation directly influences the delivery efficiency of the platform and the delivery experience of riders. This paper addresses the dynamism of the order recommendation problem and proposes a reinforcement learning solution method. An actor-critic network based on long short term memory (LSTM) unit is designed to deal with the order-grabbing conflict between different riders. Besides, three rider sequencing rules are accordingly proposed to match different time steps of the LSTM unit with different riders. To test the performance of the proposed method, extensive experiments are conducted based on real data from Meituan delivery platform. The results demonstrate that the proposed reinforcement learning based order recommendation method can significantly increase the number of grabbed orders and reduce the number of order-grabbing conflicts, resulting in better delivery efficiency and experience for the platform and riders.

Open Access Issue
A Review of Reinforcement Learning Based Intelligent Optimization for Manufacturing Scheduling
Complex System Modeling and Simulation 2021, 1 (4): 257-270
Published: 31 December 2021
Downloads:232

As the critical component of manufacturing systems, production scheduling aims to optimize objectives in terms of profit, efficiency, and energy consumption by reasonably determining the main factors including processing path, machine assignment, execute time and so on. Due to the large scale and strongly coupled constraints nature, as well as the real-time solving requirement in certain scenarios, it faces great challenges in solving the manufacturing scheduling problems. With the development of machine learning, Reinforcement Learning (RL) has made breakthroughs in a variety of decision-making problems. For manufacturing scheduling problems, in this paper we summarize the designs of state and action, tease out RL-based algorithm for scheduling, review the applications of RL for different types of scheduling problems, and then discuss the fusion modes of reinforcement learning and meta-heuristics. Finally, we analyze the existing problems in current research, and point out the future research direction and significant contents to promote the research and applications of RL-based scheduling optimization.

Open Access Issue
Nonlinear Equations Solving with Intelligent Optimization Algorithms: A Survey
Complex System Modeling and Simulation 2021, 1 (1): 15-32
Published: 30 April 2021
Downloads:167

Nonlinear Equations (NEs), which may usually have multiple roots, are ubiquitous in diverse fields. One of the main purposes of solving NEs is to locate as many roots as possible simultaneously in a single run, however, it is a difficult and challenging task in numerical computation. In recent years, Intelligent Optimization Algorithms (IOAs) have shown to be particularly effective in solving NEs. This paper provides a comprehensive survey on IOAs that have been exploited to locate multiple roots of NEs. This paper first revisits the fundamental definition of NEs and reviews the most recent development of the transformation techniques. Then, solving NEs with IOAs is reviewed, followed by the benchmark functions and the performance comparison of several state-of-the-art algorithms. Finally, this paper points out the challenges and some possible open issues for solving NEs.

Open Access Issue
Decomposition-Based Multi-Objective Optimization for Energy-Aware Distributed Hybrid Flow Shop Scheduling with Multiprocessor Tasks
Tsinghua Science and Technology 2021, 26 (5): 646-663
Published: 20 April 2021
Downloads:69

This paper addresses the Energy-Aware Distributed Hybrid Flow Shop Scheduling Problem with Multiprocessor Tasks (EADHFSPMT) by considering two objectives simultaneously, i.e., makespan and total energy consumption. It consists of three sub-problems, i.e., job assignment between factories, job sequence in each factory, and machine allocation for each job. We present a mixed inter linear programming model and propose a Novel Multi-Objective Evolutionary Algorithm based on Decomposition (NMOEA/D). We specially design a decoding scheme according to the characteristics of the EADHFSPMT. To initialize a population with certain diversity, four different rules are utilized. Moreover, a cooperative search is designed to produce new solutions based on different types of relationship between any solution and its neighbors. To enhance the quality of solutions, two local intensification operators are implemented according to the problem characteristics. In addition, a dynamic adjustment strategy for weight vectors is designed to balance the diversity and convergence, which can adaptively modify weight vectors according to the distribution of the non-dominated front. Extensive computational experiments are carried out by using a number of benchmark instances, which demonstrate the effectiveness of the above special designs. The statistical comparisons to the existing algorithms also verify the superior performances of the NMOEA/D.

Open Access Issue
Distributed Scheduling Problems in Intelligent Manufacturing Systems
Tsinghua Science and Technology 2021, 26 (5): 625-645
Published: 20 April 2021
Downloads:116

Currently, manufacturing enterprises face increasingly fierce market competition due to the various demands of customers and the rapid development of economic globalization. Hence, they have to extend their production mode into distributed environments and establish multiple factories in various geographical locations. Nowadays, distributed manufacturing systems have been widely adopted in industrial production processes. In recent years, many studies have been done on the modeling and optimization of distributed scheduling problems. This work provides a literature review on distributed scheduling problems in intelligent manufacturing systems. By summarizing and evaluating existing studies on distributed scheduling problems, we analyze the achievements and current research status in this field and discuss ongoing studies. Insights regarding prior works are discussed to uncover future research directions, particularly swarm intelligence and evolutionary algorithms, which are used for managing distributed scheduling problems in manufacturing systems. This work focuses on journal papers discovered using Google Scholar. After reviewing the papers, in this work, we discuss the research trends of distributed scheduling problems and point out some directions for future studies.

total 5