|
|
|
| Intercept Guidance Law with a Low Acceleration Ratio Based on Hierarchical Reinforcement Learning |
| WANG Xu1， CAI Yuanli1， ZHANG Xuecheng2，
ZHANG Rongliang3， HAN Chenglong3 |
| 1. Faculty of Electronic and Information Engineering， Xi’an Jiaotong University， Xi’an 710049， Shaanxi， China；
2. Third Military Representative Office of Army Equipment Department in Shanghai， Shanghai 200031, China；
3. Shanghai Electro-Mechanical Engineering Institute， Shanghai 201109，China |
|
|
|
|
Abstract This paper has proposed an intercept guidance law based on hierarchical reinforcement learning to solve the three-dimensional maneuvering target intercept guidance problem with constraints of low acceleration ratio and bearings-only measurement. The aforementioned problem was initially modelled using a Markov decision process model, where a heuristic reward function was applied considering both the energy consumption and the missile-to-target line of sight (LOS) angular rate. Besides, the policy of two levels was built up with the lower-level policy generating the required guidance command and being supervised by subgoals that were instructed by the higher levels, allowing the convergence of the LOS angular rate and guaranteeing the successful interception against a maneuvering target. Simulation results have validated the superiority of the proposed method compared with the augmented proportional navigation guidance law in terms of intercept accuracy and hit probability, and its required acceleration ratio is much lower.
|
|
Received: 12 October 2023
Published: 04 March 2024
|
|
|
|
|
|
| [1] |
LI Mengxuan, GUO Jianguo, XU Xinpeng, SHEN Yuheng. Guidance Law Based on Proximal Policy Optimization[J]. Air & Space Defense, 2023, 6(4): 51-57. |
| [2] |
LUO Tong, ZHANG Min, LIANG Chengyu. Multi-UAV Cooperative Target Tracking and Guidance Law Design[J]. Air & Space Defense, 2023, 6(3): 113-118. |
| [3] |
SUN Xinglong, MA Kemao, JIANG Yu, HOU Zhenqian. Interception Strategy Design of High Supersonic Targets in the Near Space[J]. Air & Space Defense, 2022, 5(4): 10-18. |
| [4] |
LIU Shuangxi, WANG Yichong, ZHU Mengjie, LI Yong, YAN Binbin. Research on Differential Game Guidance Law for Intercepting Hypersonic Vehicles with Small Missile-to-Target Speed Ratio[J]. Air & Space Defense, 2022, 5(2): 49-57. |
| [5] |
WU Guanghui, FANG Dongyang, CHEN Yifen, LI Rui, SHAO Xiang. Research on Sliding Mode Guidance Law Based on Immersion and Invariance Estimator[J]. Air & Space Defense, 2021, 4(1): 91-96. |
| [6] |
FU Hao, ZHOU Bohua, MA Mengchen. Adaptive Sliding Mode Guidance Law with Prescribed Performance[J]. Air & Space Defense, 2020, 3(3): 63-70. |
| [7] |
CHEN Zehong, ZHONG Jihong, ZHAO Hongyu, WANG Jian. Finite Time Convergent Guidance Law Based on Extended State Observer[J]. Air & Space Defense, 2019, 2(3): 25-30. |
| [8] |
ZANG Yuejin, LI Renjun, ZENG Liang. Research on Terminal Guidance Law for Space Kill Vehicle Based on Variable Structure[J]. Air & Space Defense, 2019, 2(1): 37-41. |
| [9] |
SHU Chuanliang, ZHU Di, ZHONG Yongjian, MENG Wanli, HAO Lianying. Design of Midcourse Guidance Law of Air Defence Missile Intercepting High Speed Maneuvering Target with Big Diving Angle[J]. Air & Space Defense, 2019, 2(1): 29-32. |
| [10] |
LI Xiaolong, ZHANG Shunjia, LI Yong, BI Peng, YIN Hang. Study on height tracking guidance laws of Cruise missile[J]. Air & Space Defense, 2018, 1(4): 29-36. |
| [11] |
Wang Kai, Zhu Mengjie, Shu Chuanliang. Research on a Guidance Law for Single Roll Control Vehicle[J]. Air & Space Defense, 2018, 1(2): 27-32. |
| [12] |
Zang Yuejin, Li Renjun, An Guochen. Research on Variable Structure Terminal Guidance Law for Exoatmospheric Anti-TBM Interceptor[J]. Air & Space Defense, 2018, 1(2): 22-26. |
|
|
|
|
2024, Vol. 7 
