Fast smoothing point-feature trajectories for digital image stabilization

Chen Xiaolu; Dai Ming; Ge Ming; Lang Xiaolong

To improve the video's image quality of airborne imaging systems, we proposed a real-time image stabilization system, based on fast smoothing point-feature trajectories. In this paper, a system framework was established to eliminate the accumulative errors between frames in global motion estimation and achieve fast and long-time video stabilization. This framework was different from the traditional real-time video stabilization. Firstly, an improved SURF algorithm was introduced to extract unstable feature points from original shaky video. Secondly, we determined the adjacency of these feature points, generated point feature trajectories with Delaunay triangulation algorithm and smoothed them with Kalman filtering. Then, we could estimate the global motion vectors which directly needed to be compensated from the original point-feature trajectories and the smoothing point-feature trajectories. The experiment results indicate that the proposed method can be used to stabilize unstable aerial video in real time. Also, it can effectively improve the image quality of the airborne imaging systems and estimate global motion vectors between independent frames. So it can be used in long-time image stabilization.

1. Key Laboratory of Airborne Optical Imaging and Measurement,Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,Changchun 130033,China;

2. University of Chinese Academy of Sciences,Beijing 100049,China;

3. Changchun Institute of Optics,Fine Mechanics and Physics,Changchun 130033,China

Received Date: 2013-10-12

Rev Recd Date: 2013-11-15

Publish Date: 2014-06-25

Key words:

Abstract: To improve the video's image quality of airborne imaging systems, we proposed a real-time image stabilization system, based on fast smoothing point-feature trajectories. In this paper, a system framework was established to eliminate the accumulative errors between frames in global motion estimation and achieve fast and long-time video stabilization. This framework was different from the traditional real-time video stabilization. Firstly, an improved SURF algorithm was introduced to extract unstable feature points from original shaky video. Secondly, we determined the adjacency of these feature points, generated point feature trajectories with Delaunay triangulation algorithm and smoothed them with Kalman filtering. Then, we could estimate the global motion vectors which directly needed to be compensated from the original point-feature trajectories and the smoothing point-feature trajectories. The experiment results indicate that the proposed method can be used to stabilize unstable aerial video in real time. Also, it can effectively improve the image quality of the airborne imaging systems and estimate global motion vectors between independent frames. So it can be used in long-time image stabilization.

HTML

Reference (23)

[1]
[2]	Sun Hui, Zhang Bao, Liu Jinghong, et al. Electronic image stabilization for aerial E-O imaging system[J]. Optics and Precision Engineering, 2007, 15(8): 1280-1286. (in Chinese) 孙辉, 张葆, 刘晶红, 等. 航空光电成像电子稳像技术[J].光学精密工程, 2007, 15(8): 1280-1286.
[3]	Matsushita Y, Ofek E, Ge W, et al. Full-frame video stabilization with motion inpainting[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(7): 1150-1163.
[4]
[5]	Wang Zhiming, Xu Xiaogang. A survey on electronic image stabilization[J]. Journal of Image and Graphics, 2010, 15 (3): 470-480. (in Chinese) 王志民, 徐晓刚. 电子稳像技术综述[J]. 中国图象图形学报, 2010, 15(3): 470-480.
[6]
[7]	Zhang Kun, Xu Tingfa, Wang Ping, et al. Real-time full-frame digital image stabilization system by SURF[J]. Optics and Precision Engineering, 2011, 19 (8): 1964-1972. (in Chinese) 张坤, 许廷发, 王平, 等. 高精度实时全帧频SURF 电子稳像方法[J]. 光学精密工程, 2011, 19(8): 1964-1972.
[8]
[9]
[10]	Wang Hong, Ji Xiaoqiang, Dai Ming, et al. Improved speed up robust feathers matching algorithm[J]. Infrared and Laser Engineering, 2012, 41(3): 811-817. (in Chinese) 王洪, 嵇晓强, 戴明, 等. 一种改进的快速鲁棒性特征匹配算法[J]. 红外与激光工程, 2012, 41(3): 811-817.
[11]
[12]	Huang K Y, Tsai Y M, Tsai C C, et al. Video stabilization for vehicular applications using SURF-Like descriptior and KD-Tree[C]//IEEE 17th International Conference on Image Processing, 2010: 3517-3520.
[13]	Battiato S, Gallo G, Puglisi G, et al. Sift features tracking for video stabilization[C]//International Conference on Image Analysis and Processing, 2007: 825-830.
[14]
[15]	Yeon G R, Myung J C. Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J]. IEEE Signal Processing Letters, 2012, 19(4): 223-226.
[16]
[17]
[18]	Wang C, Kim J H, Byun K Y, et al. Robust digital image stabilization using the kalman filter[J]. IEEE Transactions on Consumer Electronics, 2009, 55(1): 6-14.
[19]	David L. Video stabilization and target localization using fature tracking with small UAV video[D]. America: Brigham Young University, 2006.
[20]
[21]	Sand P, Teller S. Particle video: Long-range motion estimation using point trajectories[J]. International Journal of Computer Vision, 2008, 80(1): 72-91.
[22]
[23]	Herbert B, Tinne T, Lucvan G. SURF: speeded up robust features[C]//European Conference on Computer Vision, 2006: 404-417.

Fast smoothing point-feature trajectories for digital image stabilization

Abstract

References

Proportional views

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Related

Proportional views