|
|
|
| Improved RRT Path Planning Algorithm Based on Deep Q-network |
| LI Zhaoying1， OU Yiming2， SHI Ruoling1 |
| 1. School of Astronautics， Beihang University， Beijing 100191， China； 2. Department of Mechanical Engineering and Automation， Harbin Institute of Technology， Shenzhen 518055， Guangdong， China |
|
|
|
|
Abstract Aiming at the problems of large randomness and low search efficiency of rapid exploring random tree (RRT) path planning algorithm, combined with the characteristics that reinforcement learning can select strategies according to prior knowledge, an improved RRT optimization algorithm based on deep Q-network (DQN) is proposed. Firstly, the obstacle avoidance strategy with variable step in complex domain is designed, and the Markov decision process (MDP) model of random tree growth in RRT algorithm is established. Then, the obstacle avoidance strategy and MDP model are connected to the interface of RRT-Connect algorithm, and the specific process of training and path planning is designed. Finally, the simulation experiment is carried out on the MATLAB software platform. The simulation results show that the improved RRT-Connect algorithm based on deep Q-network (DQN-RRT-C) has a significant improvement in rapidity and search efficiency.
|
|
Received: 13 July 2021
Published: 06 September 2021
|
|
|
|
|
|
| [1] |
DONG Dejin, FAN Yunfeng, CAI Yunze. Path Planning with Designated-Points Constraints for Unstructured Environment[J]. Air & Space Defense, 2024, 7(1): 71-80. |
| [2] |
GUO Jianguo, HU Guanjie, XU Xinpeng, LIU Yue, CAO Jin. Reinforcement Learning-Based Target Assignment Method for Many-to-Many Interceptions[J]. Air & Space Defense, 2024, 7(1): 24-31. |
| [3] |
CHENG Haoyu, ZHANG Shuo, LIU Tailai, XU Shengli, HUANG Hanqiao. Review of Autonomous Decision-Making and Planning Techniques for Unmanned Aerial Vehicle[J]. Air & Space Defense, 2024, 7(1): 6-15. |
| [4] |
HUANG He, GAO Yongbo, RU Feng, YANG Lan, WANG Huifeng. 3D Path Planning of UAV Based on Adaptive Slime Mould Algorithm Optimization[J]. Journal of Shanghai Jiao Tong University, 2023, 57(10): 1282-1291. |
| [5] |
LI Erchao∗ (李二超), QI Kuankuan (齐款款). Ant Colony Algorithm Path Planning Based on Grid Feature Point Extraction[J]. J Shanghai Jiaotong Univ Sci, 2023, 28(1): 86-99. |
| [6] |
QIU Kejun, BAO Zhongkai, CHEN Lu. Task Assignment and Path Planning for Automatic Guided Vehicles in Aircraft Assembly Workshop[J]. Journal of Shanghai Jiao Tong University, 2023, 57(1): 93-102. |
| [7] |
XU Jie, WANG Zixiang, LIU Yuxin, LIU Ran, YANG Zhitao. Admission Control of Multi-Level Emergency Patients with Time-Varying Demands[J]. Journal of Shanghai Jiao Tong University, 2022, 56(8): 1067-1077. |
| [8] |
LI Shiqi (李世其), LI Xiao∗ (李肖), HAN Ke (韩可), XIONG Youjun (熊友军), XIE Zheng (谢铮), CHEN Jinliang (陈金亮). Path Planning and Optimization of Humanoid Manipulator in Cartesian Space[J]. J Shanghai Jiaotong Univ Sci, 2022, 27(5): 614-620. |
| [9] |
WANG Liang (王 亮), WANG Bing (王 冰), WANG Chunxiang∗ (王春香). Collision-Free Path Planning with Kinematic Constraints in Urban Scenarios[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(5): 731-738. |
| [10] |
LI Zheng, CHEN Jianwei, PENG Bo . UAV Cluster Path Planning Based on Pseudo-spectral Method[J]. Air & Space Defense, 2021, 4(1): 52-59. |
| [11] |
WU Xing (武星), LIU Yuan (刘远), XIE Shaorong (谢少荣), GUO Yike (郭毅可). Collaborative Defense with Multiple USVs and UAVs Based on Swarm Intelligence[J]. Journal of Shanghai Jiao Tong University (Science), 2020, 25(1): 51-56. |
| [12] |
CHEN Yaojie* (陈姚节), XIANG Shanshan (项珊珊), CHEN Feixiang (陈飞翔). Research on a Task Planning Method for Multi-Ship Cooperative Driving[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(2): 233-242. |
| [13] |
YANG Qing (杨轻), YANG Zhong (杨忠), HU Guoxiong (胡国雄), DU Wei (杜威). A New Fusion Chemical Reaction Optimization Algorithm Based on Random Molecules for Multi-Rotor UAV Path Planning in Transmission Line Inspection[J]. Journal of Shanghai Jiao Tong University (Science), 2018, 23(5): 671-677. |
| [14] |
SUN Ling (孙玲). A Real-Time Collision-Free Path Planning of a Rust Removal Robot Using an Improved Neural Network[J]. Journal of shanghai Jiaotong University (Science), 2017, 22(5): 633-640. |
| [15] |
LE Jian,ZHANG Hua,YE Yanhui,FAN Yu. Robot Tracking of Vertical Welding Seam Based on Rotating Arc Sensor[J]. Journal of Shanghai Jiaotong University, 2015, 49(03): 348-352. |
|
|
|
|
2021, Vol. 4 
