|
|
|
| Urban Target Detection Algorithm Based on Multi-Modal Fusion of UAV |
| WANG Jianyuan1， CHEN Xiaotong1， ZHANG Yue1， SUN Junge2，
SHI Donghao1， CHEN Jinbao1 |
| 1. College of Astronautics， Nanjing University of Aeronautics and Astronautics， Nanjing 211100， Jiangsu， China；
2. Shanghai Electro-Mechanical Engineering Institute， Shanghai 201109，China |
|
|
|
|
Abstract Using small drones to detect urban targets such as vehicles at low altitudes in cities has gradually become a mainstream means. Given the existing problems of low detection accuracy of single-mode detection networks affected by visible light detection, inability to work at night and the blurred edge of infrared detection targets in actual scenes, this paper has proposed a multi-modal UAV detection algorithm based on image fusion and deep learning network. Firstly, based on the DUT-VTUAV visible-infrared registration data set and TIF image fusion algorithm, a multi-mode fusion data set was built up. Secondly, by comparing the detection accuracy, speed and several parameters of the existing YOLO series network, the lightweight network YOLO v5n which was most suitable for the mobile deployment of UAVs was decided. Finally, a multi-modal fusion detection algorithm was produced by combining an image fusion algorithm and a target detection model. Comparative experiments on vehicle data sets successfully show that compared with single-mode detection, the detection accuracy of the proposed algorithm is effectively increased, with mAP up to 99.6%, and a set of visible-infrared image fusion detection can be completed within 0.3s, indicating the high real-time performance.
|
|
Received: 01 January 2023
Published: 04 March 2024
|
|
|
|
|
|
| [1] |
DENG Chen, KONG Yinan, WANG Qing, CHEN Gong. Research on Empirical Engineering Correction Algorithm Integrating Physical Laws[J]. Air & Space Defense, 2022, 5(3): 73-79. |
| [2] |
CAI Yunze, ZHANG Yanjun. Infrared Dim and Small Target Detection Based on Dual-Channel Feature-Enhancement Integrated Attention Network[J]. Air & Space Defense, 2021, 4(4): 14-22. |
| [3] |
WANG Yuexing, WU Yongguo, XU Chuangang. Infrared Ship Target Detection Algorithm Based on Deep Transfer Learning[J]. Air & Space Defense, 2021, 4(4): 61-66. |
| [4] |
ZHAO Huipan, LIU Huanyu. Low Signature Target Group Detection Based on Multimodal Data Learning Fusion Network[J]. Air & Space Defense, 2021, 4(3): 41-47. |
| [5] |
TONG Pengfei, CHEN Hao, XU Xinpeng, ZHOU Ge. Study on Information Fusion Technology of Multi-missile Multi-target Collaborative Detection[J]. Air & Space Defense, 2020, 3(3): 54-62. |
| [6] |
ZHANG Yan, JIA Zhenyu, ZHOU Guren, HUANG Zhengrong, LIU Jingqiu. Infrared Dim Target Detection Based on Multi-directional Mixed Template[J]. Air & Space Defense, 2019, 2(1): 64-69. |
|
|
|
|
2024, Vol. 7 
