Journal of Guangxi Normal University(Natural Science Edition) ›› 2023, Vol. 41 ›› Issue (3): 41-52.doi: 10.16088/j.issn.1001-6600.2022060202

Previous Articles     Next Articles

A Fast Stitching Algorithm for UAV Aerial Images

LIANG Zhenfeng, XIA Haiying*   

  1. College of Electronic Engineering, Guangxi Normal University, Guilin Guangxi, 541004, China
  • Received:2022-06-02 Revised:2022-08-30 Online:2023-05-25 Published:2023-06-01

Abstract: Aiming at the problems of slow processing speed and poor matching accuracy of the existing image stitching methods for UAV aerial images with high resolution and complex image information, a fast stitching algorithm for UAV aerial images is proposed. Firstly, the FM (Fourier-Mellin) algorithm is used to find out the overlapping region of the image, and obtain ROI from the overlap area of image, combining the area blocking and the image entropy to get the region of final feature extraction as the image mask. Then, the feature points are extracted in the area of feature extraction and two rounds of filtering are performed on the feature matching pairs to reduce the number of RANSAC algorithm iterations. Finally, an improved RANSAC algorithm is used to reject the wrong pairs in order to filter out the pairs with higher accuracy. Compared the operation efficiency of this algorithm with other algorithms, as well as the image stitching quality and other related indexes, the experimental results show that this algorithm reduces the stitching time by 35%, 56% and 57% compared with SURF, SIFT and area blocking algorithms respectively, meeting the requirements of today's aerial images for stitching accuracy and real-time performance.

Key words: aerial images, image stitching, feature extraction area, Fourier-Mellin transform, image mask

CLC Number:  V19;TP391.41
[1] 陈林奇, 李廷会. 基于双空间PSO算法的四旋翼无人机自抗扰控制器优化设计[J]. 广西师范大学学报(自然科学版), 2019, 37(3):42-49. DOI: 10.16088/j.issn.1001-6600.2019.03.005.
[2] 雷荣智,杨维芳,苏小宁.基于改进YOLO-v3的无人机遥感图像农村地物分类[J].电子设计工程,2023,31(3):178-184. DOI: 10.14022/j.issn1674-6236.2023.03.037.
[3] 洪梓铭.电力巡检的移动作业无人机倾斜影像三维采集模型[J].电子设计工程,2023,31(6):149-152,157. DOI: 10.14022/j.issn1674-6236.2023.06.031.
[4] 孟现彪,刘盛庆,史雅茹,等.无人机激光雷达高程测量精度评定分析[J].桂林理工大学学报,2022,42(2):438-442.
[5] 徐俊辉,欧阳缮,廖可非,等.基于相关检测的旋翼无人机检测与识别方法[J].桂林电子科技大学学报,2021,41(6):431-436. DOI: 10.16725/j.cnki.cn45-1351/tn.2021.06.002.
[6] 李加亮, 蒋品群, 夏海英. 基于网格变形和余弦函数权重的图像拼接方法[J]. 广西师范大学学报(自然科学版), 2020, 38(4):42-53. DOI: 10.16088/j.issn.1001-6600.2020.04.005.
[7] BROWN M, LOWE D G. Automatic panoramic image stitching using invariant features[J]. International Journal of Computer Vision, 2007, 74(1): 59-73. DOI: 10.1007/s11263-006-0002-3.
[8] RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB: an efficient alternative to SIFT or SURF[C]//2011 International Conference on Computer Vision. Piscataway, NJ: IEEE, 2011: 2564-2571. DOI: 10.1109/ICCV.2011.6126544.
[9] BAY H, ESS A, TUYTELAARS T, et al. Speeded-up robust features (SURF)[J]. Computer Vision and Image Understanding, 2008, 110(3): 346-359. DOI: 10.1016/j.cviu.2007.09.014.
[10] 张红民, 张见双, 罗永涛, 等. 一种基于图像区域分块的 SIFT 快速配准方法[J]. 红外技术, 2017, 39(4): 341-344.
[11] ZARAGOZA J, CHIN T J, TRAN Q H, et al. As-projective-as-possible image stitching with moving DLT[J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2014, 36(7):1285-1298. DOI: 10.1109/TPAMI.2013.247.
[12] LIN C C, PANKANTI S U, RAMAMURTHY K N, et al. Adaptive as-natural-as-possible image stitching[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ: IEEE, 2015: 1155-1163. DOI: 10.1109/CVPR.2015.7298719.
[13] CHANG C H, SATO Y, CHUANG Y Y. Shape-preserving half-projective warps for image stitching[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2014: 3254-3261. DOI: 10.1109/CVPR.2014.422.
[14] CHEN Y S, CHUANG Y Y. Natural image stitching with the global similarity prior[C]//Computer Vision-ECCV 2016. Cham: Springer, 2016: 186-201. DOI: 10.1007/978-3-319-46454-1_12.
[15] 杨明东, 石英, 华逸伦, 等. 基于匹配策略融合的低误差快速图像拼接算法[J]. 计算机应用研究, 2019, 36(4): 1222-1227. DOI: 10.19734/j.issn.1001-3695.2017.11.0772.
[16] LIN K M, JIANG N J, CHEONG L F, et al. SEAGULL: seam-guided local alignment for parallax-tolerant image stitching[C]//Computer Vision-ECCV 2016. Cham: Springer, 2016: 370-385. DOI: 10.1007/978-3-319-46487-9_23.
[17] JIA Q, LI Z J, FAN X, et al. Leveraging line-point consistence to preserve structures for wide parallax image stitching[C]//2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ: IEEE, 2021: 12181-12190. DOI: 10.1109/CVPR46437.2021.01201.
[18] NIE L, LIN C Y, LIAO K, et al. A view-free image stitching network based on global homography[J]. Journal of Visual Communication and Image Representation, 2020, 73: 102950. DOI: 10.1016/j.jvcir.2020.102950.
[19] NIE L, LIN C Y, LIAO K, et al. Unsupervised deep image stitching: reconstructing stitched features to images[J]. IEEE Transactions on Image Processing, 2021, 30: 6184-6197. DOI: 10.1109/TIP.2021.3092828.
[20] REDDY B S, CHATTERJI B N. An FFT-based technique for translation, rotation, and scale-invariant image registration[J]. IEEE Transactions on Image Processing, 1996, 5(8): 1266-1271. DOI: 10.1109/83.506761.
[21] 周晓炜, 赵琰. 基于变换域和形状特征的感知图像哈希算法[J]. 计算机应用与软件, 2021, 38(5):218-224. DOI: 10.3969/j.issn.1000-386x.2021.05.035.
[22] B ZITOVÁ, FLUSSER J. Image registration methods: a survey[J]. Image and Vision Computing, 2003, 21(11):977-1000. DOI: 10.1016/S0262-8856(03)00137-9.
[23] 刘洋, 王利民, 孙铭会. 基于信息熵函数的启发式贝叶斯因果推理[J]. 计算机学报, 2021, 44(10):2135-2147. DOI: 10.11897/SP.J.1016.2021.02135.
[24] SINGHA ROY S, BARMAN S. A non-invasive cancer gene detection technique using FLANN based adaptive filter[J]. Microsystem Technologies, 2021, 27(2): 463-478. DOI: 10.1007/s00542-018-4036-6.
[25] 刘淑伟, 陈威, 赵伟,等. 基于簇内乘积量化的最近邻检索方法[J]. 计算机学报, 2020, 43(2):303-314. DOI: 10.11897/SP.J.1016.2020.00303.
[26] 吴禄慎, 陈小杜. 一种改进AKAZE特征和RANSAC的图像拼接算法[J]. 计算机工程, 2021, 47(1):246-254. DOI: 10.19678/j.issn.1000-3428.0056874.
[27] SUN J M, SHEN Z H, WANG Y, et al. LoFTR: detector-free local feature matching with transformers[C]//2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ: IEEE, 2021: 8918-8927. DOI: 10.1109/CVPR46437.2021.00881.
[28] 呼亚萍, 孔韦韦, 李萌,等. 改进TV图像去噪模型的全景图像拼接算法[J]. 计算机工程与应用, 2021,57(17):203-209. DOI: 10.3778/j.issn.1002-8331.2005-0216.
[1] LI Jialiang, JIANG Pinqun, XIA Haiying. An Image Stitching Method Based on Grid Warping and Cosine Function Weight [J]. Journal of Guangxi Normal University(Natural Science Edition), 2020, 38(4): 42-53.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] CHENG Rui, HE Mingxian, ZHONG Chunying, LUO Shuyi, WU Zhengjun. Comparison of Swimming Ability between Wild and Captive Breeding Shinisaurus crocodilurus[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(1): 79 -86 .
[2] CHEN Danni, CHEN Zhilin, ZHOU Shanyi. A Checklist of Family Formicidae of China: Myrmecinae (Addendum) (Insect: Hymenoptera)[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(1): 87 -97 .
[3] XU Guoliang. Seven New Records of Ferns from Guangdong, China[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(1): 114 -118 .
[4] HE Hanji, DENG Guangming, GE Menglan. Study on the Spatial Correlation of Air Quality in Central Plains Urban Agglomeration[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(3): 151 -162 .
[5] XIE Donglin, DENG Guohe. Pricing Forward-start Power Options with Product of Two Assets in a Stochastic Interest Rate and Jump Diffusion Model[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(5): 158 -172 .
[6] JIANG Xianghui, TAN Rong, YANG Yongping, XIAO Qingzong. Analysis of Network Pharmacology and Confirmation of Mahonia fortunei (Lindl. ) Fedde and Glycyrrhiza uralensis Fisch Decoction for Hepatitis[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(5): 198 -209 .
[7] XU Lunhui, LIN Shicheng. Research on Full Coverage Path Planning Algorithm of Sweeping Robot Based on Divide and Conquer[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(6): 54 -62 .
[8] ZHOU Zihao, LIU Yuhan, TAN Yanhong, MENG Yuqing, WU Hongying, HUANG Jinlong, WU Zhengjun. Enzymatic Preparation of Antimicrobial Peptides from the Viscera of Pomacea canaliculata[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(6): 154 -161 .
[9] YAN Sha. Global Existence of Solutions for a Three Species Predator-prey Model with Cross-diffusion[J]. Journal of Guangxi Normal University(Natural Science Edition), 2021, 39(2): 125 -131 .
[10] PENG Tao, TANG Jing, HE Kai, HU Xinrong, LIU Junping, HE Ruhan. Emotion Recognition Based on Multi-gait Feature Fusion[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(3): 104 -111 .