Calibration of IR camera and 3D lidar using thermostat heating hollow net

Zong Min; Yang Yi; Zhu Hao; Fu Mengyin; Wang Shunting

With the integrated perception system of IR camera and 3D lidar, the calibration based on feature point matching was studied and the thermostat heating hollow net was designed to provide feature points. Infrared image feature points were extracted by Harris corner detector. To decrease the influence from mixed pixels, plane fitting of heating net and plane conformity check of laser points on net were used to locate the edges in depth image. Edges'average value at corner was calculated to extract depth feature point. At last, NMSM-EM method was adopted to optimize the result. The research results show that the integrated perception system can accurately perceive mobile robot's running environment in dim light.

1. State Key Laboratory of Complex System Intelligent Control and Decision,Beijing Institute of Technology,Beijing 100081,China

Received Date: 2014-04-12

Rev Recd Date: 2014-05-08

Publish Date: 2014-12-25

Key words:

automatic control technology

Abstract: With the integrated perception system of IR camera and 3D lidar, the calibration based on feature point matching was studied and the thermostat heating hollow net was designed to provide feature points. Infrared image feature points were extracted by Harris corner detector. To decrease the influence from mixed pixels, plane fitting of heating net and plane conformity check of laser points on net were used to locate the edges in depth image. Edges'average value at corner was calculated to extract depth feature point. At last, NMSM-EM method was adopted to optimize the result. The research results show that the integrated perception system can accurately perceive mobile robot's running environment in dim light.

HTML

Reference (29)

[1]	Fu Mengyin, Yang Yi, Zhu Hao, et al. Integrated perception system for mobile robot and its improved registration [J]. Acta ArmamentarII, 2011, 32(6): 712-718. (in Chinese) 付梦印, 杨毅, 朱昊, 等. 移动机器人组合感知系统及其配准方法改进[J]. 兵工学报, 2011, 32(6): 712-718.
[2]
[3]
[4]	Zhang Changjiang, Fu Mengyin, Jin Mei, et al. Approach to enhance contrast of infrared image based on wavelet transform [J]. Journal of Infrared and Millimeter Waves, 2004, 23(2): 119-124. (in Chinese) 张长江, 付梦印, 金梅, 等. 一种红外图像对比度增强的小波变换法[J]. 红外与毫米波学报, 2004, 23(2): 119-124.
[5]
[6]	Fu Mengyin, Zhao Cheng. Fusion of infrared and visible images based on the second generation curvelet transform[J]. Journal of Infrared and Millimeter Waves, 2009, 28 (4): 254-258. (in Chinese) 付梦印, 赵诚. 基于二代Curvelet 变换的红外与可见光图像融合[J]. 红外与毫米波学报, 2009, 28(4): 254-258.
[7]	Ranjith Unnikrishnan, Martial Hebert. Fast extrinsic calibration of a laser rangefinder to a camera [D]. Pittsburgh院Carnegie Mellon University, 2005.
[8]
[9]
[10]	Ganhua Li, Yunhui Liu, Li Dong, et al. An algorithm for extrinsic parameters calibration of a camera and a laser range finder Using line features[C]//Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007: 3854-3859.
[11]	Fu Mengyin, Liu Mingyang. Space alignment of vision sensor and LMS [J]. Infrared and Laser Engineering, 2009, 38(1): 74-78. (in Chinese) 付梦印, 刘明阳. 视觉传感器与激光测距雷达空间对准方法[J]. 红外与激光工程, 2009, 38(1): 74-78.
[12]
[13]	Rongqian Yang, Wei Yang, Yazhu Chen, et al. Geometric calibration of IR camera using trinocular vision [J]. Lightwave Technology, 2011, 29(24): 3797-3803.
[14]
[15]
[16]	Lakemond Vidas S, Denman R, Fookes S C, et al. A mask-based approach for the geometric calibration of thermal infrared cameras [J]. IEEE Transactions on Instrumentation and Measurement, 2012, 61(6): 1625-1635.
[17]	Polikovsky S, Kameda Y, Ohta Y. Infrared and visible spectrum camera calibration [C]//IEICE General Conference, 2011: 104.
[18]
[19]	Dariusz Rzeszotarski, Boguslaw Wiecek. Calibration for 3D reconstruction of thermal images [C]//9th International Conference on Quantitative Infrared Thermography, 2008: 563-566.
[20]
[21]
[22]	Hartley R I. In defense of the eight-point algorithm[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(6): 580-593.
[23]
[24]	Zhang Zhengyou. Flexible camera calibration by viewing a plane from unknown orientations [C]//Proceedings of the Seventh IEEE International Conference on Computer Vision 1999: 666-673.
[25]	Deng Zhihong, Liu Mingyang, Fu Mengyin. A improved method of matching point extracting for vision sensor and LMS space alignment [J]. Optical Technique, 2010, 36(1): 43-47. (in Chinese) 邓志红, 刘明阳, 付梦印. 一种改进的视觉传感器与激光测距雷达特征匹配点提取算法[J]. 光学技术, 2010, 36(1): 43-47.
[26]
[27]
[28]	Prabhat K Acharya, Thomas C Henderson. Parameter estimation and error analysis of range data [C]//Proceedings of International Conference on Robotics and Automation, 1988: 1709-1714.
[29]	Xiao Hongfeng. Large scale evolution optimization algorithm based on simplex multi-direction search [D]. Changsha: Central South University, 2009. (in Chinese)

Calibration of IR camera and 3D lidar using thermostat heating hollow net

Abstract

References

Proportional views

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Related

Proportional views