Traffic Status Prediction of Arterial Roads Based on the Deep Recurrent Q-Learning

Wei Hao*, Donglei Rong, Kefu Yi, Qiang Zeng, Zhibo Gao, Wenguang Wu, Chongfeng Wei, Biljana Scepanovic

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

11 Downloads (Pure)


With the exponential growth of traffic data and the complexity of traffic conditions, in order to effectively store and analyse data to feed back valid information, this paper proposed an urban road traffic status prediction model based on the optimized deep recurrent Q-Learning method. The model is based on the optimized Long Short-Term Memory (LSTM) algorithm to handle the explosive growth of Q-table data, which not only avoids the gradient explosion and disappearance but also has the efficient storage and analysis. The continuous training and memory storage of the training sets are used to improve the system sensitivity, and then, the test sets are predicted based on the accumulated experience pool to obtain high-precision prediction results. The traffic flow data from Wanjiali Road to Shuangtang Road in Changsha City are tested as a case. The research results show that the prediction of the traffic delay index is within a reasonable interval, and it is significantly better than traditional prediction methods such as the LSTM, K-Nearest Neighbor (KNN), Support Vector Machines (SVM), exponential smoothing method, and Back Propagation (BP) neural network, which shows that the model proposed in this paper has the feasibility of application.

Original languageEnglish
Article number8831521
Number of pages17
JournalJournal of Advanced Transportation
Publication statusPublished - 19 Sept 2020
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2020 Wei Hao et al.

Copyright 2020 Elsevier B.V., All rights reserved.

ASJC Scopus subject areas

  • Automotive Engineering
  • Economics and Econometrics
  • Mechanical Engineering
  • Computer Science Applications
  • Strategy and Management


Dive into the research topics of 'Traffic Status Prediction of Arterial Roads Based on the Deep Recurrent Q-Learning'. Together they form a unique fingerprint.

Cite this