Infrared target tracking with correlation filter based on adaptive fusion of responses

Fang Shengnan; Gu Xiaojing; Gu Xingsheng

doi:10.3788/IRLA201948.0626003

Infrared target tracking is of great significance to the research in military and civil video surveillance. Due to the special thermal-imaging mechanism, infrared targets are often with low resolution, low contrast and in the lack of textures. Aiming at the deterioration of tracking performance caused by insufficient common features of infrared targets, a novel tracking algorithm was proposed based on adaptive fusion of correlation filter responses. The algorithm explored the framework of the correlation filter with continuous convolution operators. The saliency feature was comprised to enhance the object appearance description. The center location of a target was predicted by the fused responses that were calculated from an adaptive fusion of multiple correlation responses with Hedge decision-theoretic. Additionally, the final tracking result was obtained after multi-scale estimation based on scale filters. The experimental results show that the algorithm has better performance in tracking accuracy and robustness compared with other tracking methods on the public infrared video dataset VOT-TIR2016.

Infrared target tracking with correlation filter based on adaptive fusion of responses

1. Key Laboratory of Advanced Control and Optimization for Chemical Process,Ministry of Education,East China University of Science and Technology,Shanghai 200237,China

Received Date: 2019-01-25

Rev Recd Date: 2019-02-13

Publish Date: 2019-06-25

Key words:

Abstract: Infrared target tracking is of great significance to the research in military and civil video surveillance. Due to the special thermal-imaging mechanism, infrared targets are often with low resolution, low contrast and in the lack of textures. Aiming at the deterioration of tracking performance caused by insufficient common features of infrared targets, a novel tracking algorithm was proposed based on adaptive fusion of correlation filter responses. The algorithm explored the framework of the correlation filter with continuous convolution operators. The saliency feature was comprised to enhance the object appearance description. The center location of a target was predicted by the fused responses that were calculated from an adaptive fusion of multiple correlation responses with Hedge decision-theoretic. Additionally, the final tracking result was obtained after multi-scale estimation based on scale filters. The experimental results show that the algorithm has better performance in tracking accuracy and robustness compared with other tracking methods on the public infrared video dataset VOT-TIR2016.

HTML

Reference (18)

[1]	Wang X, Liu L, Tang Z. Infrared human tracking with improved mean shift algorithm based on multicue fusion[J]. Applied Optics, 2009, 48(21):4201-4212.
[2]	Liu R, Li X, Han L, et al. Track infrared point targets based on projection coefficient templates and non-linear correlation combined with Kalman prediction[J]. Infrared Physics and Technology, 2013, 57(2):68-75.
[3]	Tang Zhengyuan, Zhao Jiajia, Yang Jie, et al. Infrared target tracking algorithm based on sparse representation model[J]. Infrared and Laser Engineering, 2012, 41(5):1389-1395. (in Chinese) 唐峥远, 赵佳佳, 杨杰, 等. 基于稀疏表示模型的红外目标跟踪算法[J]. 红外与激光工程, 2012, 41(5):1389-1395.
[4]	Gundogdu E, Ozkan H, Demir H S, et al. Comparison of infrared and visible imagery for object tracking:Toward trackers with superior IR performance[C]//Computer Vision and Pattern Recognition Workshops, IEEE, 2015:1-9.
[5]	Liu Q, Lu X, He Z, et al. Deep convolutional neural networks for thermal Infrared object tracking[J]. Knowledge-Based Systems, 2017, 134:189-198.
[6]	Qian K, Zhou H, Rong S, et al. Infrared dim-small target tracking via singular value decomposition and improved Kernelized correlation filter[J]. Infrared Physics and Technology, 2017, 82:18-27.
[7]	Zheng Wuxing, Wang Chunping, Fu Qiang, et al. Aerial infrared target tracking based on gray and saliency features fusion[J]. Laser and Infrared, 2018, 48(3):338-342. (in Chinese) 郑武兴, 王春平, 付强, 等. 融合灰度与显著性特征的空中红外目标跟踪[J]. 激光与红外, 2018, 48(3):338-342.
[8]	Henriques J F, Rui C, Martins P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 37(3):583-596.
[9]	He Y J, Li M, Zhang J L, et al. Infrared target tracking via weighted correlation filter[J]. Infrared Physics and Technology, 2015, 73:103-114.
[10]	Qi Y, Zhang S, Qin L, et al. Hedged Deep Tracking[C]//Computer Vision and Pattern Recognition. IEEE, 2016:4303-4311.
[11]	Chaudhuri K, Freund Y, Hsu D. A parameter-free hedging algorithm[C]//Advances in Neural Information processing systems, 2009:297-305.
[12]	Danelljan M, Bhat G, Khan F S, et al. ECO:efficient convolution operators for tracking[C]//Computer Vision and Pattern Recognition, IEEE, 2017:6931-6939.
[13]	Dalal N, Triggs B. Histograms of oriented gradients for human detection[C]//Computer Vision and Pattern Recognition Workshops, IEEE, 2005:886-893.
[14]	Felsberg M. Enhanced distribution field tracking using channel representations[C]//International Conference on Computer Vision Workshops, IEEE, 2013:121-128.
[15]	Hou X, Zhang L. Saliency detection:a spectral residual approach[C]//Computer Vision and Pattern Recognition, IEEE, 2007:1-8.
[16]	Danelljan M, Hager G, Khan F S, et al. Discriminative scale space tracking[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(8):1561-1575.
[17]	Wu Shidong, Bao Hua, Zhang Chenbin, et al. Particle filter tracking based on visual saliency feature[J]. Journal of University of Science and Technology of China, 2015, 45(11):934-942. (in Chinese) 吴世东, 鲍华, 张陈斌,等. 基于视觉显著性特征的粒子滤波跟踪算法[J]. 中国科学技术大学学报, 2015, 45(11):934-942.
[18]	Felsberg M, Kristan M, Matas J, et al. The thermal infrared visual object tracking VOT-TIR2016 challenge results[C]//Computer Vision-ECCV 2016 Workshops, 2016:824-849.

Infrared target tracking with correlation filter based on adaptive fusion of responses

doi: 10.3788/IRLA201948.0626003

Abstract

References

Proportional views

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Related

Proportional views