载人潜水器的深海地貌线结构光三维重建

丁忠军; 赵子毅; 张春堂; 潘文超; 刘雨萌

doi:10.3788/IRLA201948.0503001

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

载人潜水器的深海地貌线结构光三维重建

丁忠军, 赵子毅, 张春堂, 潘文超, 刘雨萌

文章导航 > 红外与激光工程 > 2019 > 48(5): 503001-0503001(9)

丁忠军, 赵子毅, 张春堂, 潘文超, 刘雨萌. 载人潜水器的深海地貌线结构光三维重建[J]. 红外与激光工程, 2019, 48(5): 503001-0503001(9). doi: 10.3788/IRLA201948.0503001

引用本文:

Ding Zhongjun, Zhao Ziyi, Zhang Chuntang, Pan Wenchao, Liu Yumeng. 3D reconstruction of deep sea geomorphologic linear structured light based on manned submersible[J]. Infrared and Laser Engineering, 2019, 48(5): 503001-0503001(9). doi: 10.3788/IRLA201948.0503001

Citation:

Ding Zhongjun, Zhao Ziyi, Zhang Chuntang, Pan Wenchao, Liu Yumeng. 3D reconstruction of deep sea geomorphologic linear structured light based on manned submersible[J]. Infrared and Laser Engineering, 2019, 48(5): 503001-0503001(9). doi: 10.3788/IRLA201948.0503001

载人潜水器的深海地貌线结构光三维重建

doi: 10.3788/IRLA201948.0503001

1.
青岛科技大学自动化与电子工程学院,山东青岛 266061;
2.
国家深海基地管理中心,山东青岛 266061

基金项目:

国家重点研发计划“深海关键技术与装备”重点专项（2017YFC0306600）

详细信息

作者简介:
丁忠军(1974-),男,研究员,教授,博士,主要从事深海探测技术及装备研发方面的研究。Email:dzj@ndsc.org.cn

中图分类号: TN247

3D reconstruction of deep sea geomorphologic linear structured light based on manned submersible

1.
College of Automation and Electronic Engineering,Qingdao University of Science and Technology,Qingdao 266061,China;
2.
China National Deep Sea Center,Qingdao 266061,China

摘要: 针对深海环境下通过视觉方法难以实现地貌的大范围、高精度三维重建的问题，提出一种基于蛟龙号载人潜水器的线结构光法深海地貌三维重建视觉传感器的设计方案。根据线结构光三维重建的原理，首先改进了Steger算法，实现了快速、精准的激光条纹中心线提取；然后利用直接标定法求解出地形特征的二维空间坐标，并克服了图像畸变对重建的影响；再将获得的二维点云与多传感器数据融合，跟随潜水器坐标实时计算偏移量，并根据传感器位姿变化对图像矫正，最终获得地貌的三维点云数据。根据重建原理设计了视觉传感器的软硬件系统，并搭建了实验模拟平台来验证方案的可行性。通过水下实验可以实现对模拟地貌的完整重建，精度达到96.9%，符合重建要求。
- 三维重建 /
- 线结构光 /
- 数据融合 /
- 视觉传感器
Abstract: Aiming at the problem that it was difficult to achieve large-scale and high-precision 3D reconstruction of land form of geomorphology by visual method in deep-sea environment, a design scheme of line structured light 3D reconstruction vision sensor for deep-sea topography features based on Jiaolong manned submersible was presented. According to the principle of 3D reconstruction of linear structured light, firstly, the Steger algorithm was improved to extract the center line of laser fringes quickly and accurately, then direct calibration method was used to solve the 2D spatial coordinates of topographic features, and the influence of image distortion on reconstruction was overcame. Then, the obtained 2D point cloud was fused with multi-sensor data, and the offset was calculated in real time according to the coordinates of the submersible, and the image was corrected according to the change of sensor position and attitude. Finally, the 3D point cloud data of landform was obtained. According to the reconstruction principle, the hardware and software system of the vision sensor was designed, and an experimental simulation platform was built to verify the feasibility of the scheme. Through underwater experiments, the complete reconstruction of simulated geomorphology can be achieved, with an accuracy of 96.9%, which meets the reconstruction requirements.
- 3D reconstruction /
- linear structured light /
- data fusion /
- visual sensor

[1]	Dong Hui, Kong Qianqian, Wen Yanan, et al. Research on underwater target color three-dimensional reconstruction mehod[J]. Electro-optic Technology Application, 2017, 32(3):46-48, 58. (in Chinese)
[2]	Zheng Taixiong, Huang Shuai, Li Yongfu, et al. Key techniques for vision based 3D reconstruction:A review[J]. Acta Automatica Sinica, 2018(11):1-22. (in Chinese)
[3]	Steger C. An unbiased detector of curvilinear structures[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(2):113-125.
[4]	Young I T, Vliet L J V. Recursive implementation of the Gaussian filter[J]. Signal Processing, 1995, 44(95):139-151.
[5]	Wang Zongyi, Li Hongwei, Li Dianpu, et al. A direct calibration method for structured light[C]//Mechatronics Automation, IEEE International Conference, 2005:1283-1287.
[6]	Liu Kaizhou, Zhu Puqiang, Zhao Yang, et al. Research on the control system of human occupied vehicle Jiaolong[J]. Chinese Science Bulletin, 2013, 58(S2):40-48. (in Chinese)
[7]	Qu Y, Huang J, Zhang X. Rapid 3D reconstruction for image sequence acquired from UAV camera[J]. Sensors, 2018,18(1):225-244.
[8]	Sun Xingwei, Yu Xinyu, Dong Zhixu, et al. High accuracy measurement model of laser triangulation method[J]. Infrared and Laser Engineering, 2018, 47(9):0906008. (in Chinese)
[9]	Yang Hongfei, Xia Hui, Chen Xin, et al. Application of image fusion in 3D reconstruction of space target[J]. Infrared and Laser Engineering, 2018, 47(9):0926002. (in Chinese)
[10]	Zhan Kunfeng, Chen Wenjian, Li Wuseng, et al. Line laser 3D scene reconstruction system and error analysis[J]. Chinese Journal of Lasers, 2018, 45(12):1204004. (in Chinese)

[1]	李铁军, 薛路明, 刘今越, 贾晓辉. 基于辅助相机的景深拓展三维重建技术研究 . 红外与激光工程, 2023, 52(4): 20220647-1-20220647-9. doi: 10.3788/IRLA20220647
[2]	孙茜, 薛庆生, 张冬雪, 白皓轩. 水下目标物三维激光重建方法研究 . 红外与激光工程, 2022, 51(8): 20210693-1-20210693-7. doi: 10.3788/IRLA20210693
[3]	王素琴, 陈太钦, 张峰, 石敏, 朱登明. 面向复杂机械零件形貌测量的高精度三维重建方法 . 红外与激光工程, 2022, 51(7): 20210730-1-20210730-11. doi: 10.3788/IRLA20210730
[4]	朱新军, 侯林鹏, 宋丽梅, 袁梦凯, 王红一, 武志超. 基于虚拟双目的条纹结构光三维重建 . 红外与激光工程, 2022, 51(11): 20210955-1-20210955-9. doi: 10.3788/IRLA20210955
[5]	纪运景, 杜思月, 宋旸, 李振华. 基于线结构光旋转扫描和光条纹修复的三维视觉测量技术研究 . 红外与激光工程, 2022, 51(2): 20210894-1-20210894-9. doi: 10.3788/IRLA20210894
[6]	邵新杰, 潘硕, 宋彬, 李晓磊, 唐香珺. 深孔内表面检测点云拼接技术研究 . 红外与激光工程, 2021, 50(12): 20210210-1-20210210-8. doi: 10.3788/IRLA20210210
[7]	魏鹏轩, 黄智, 郑晓, 刘海涛, 吴湘, 万勇健. 多鸽巢自适应排序的快速相位展开方法 . 红外与激光工程, 2020, 49(8): 20200032-1-20200032-7. doi: 10.3788/IRLA20200032
[8]	乔玉晶, 贾保明, 姜金刚, 王靖怡. 多视点立体视觉测量网络组网方法 . 红外与激光工程, 2020, 49(7): 20190492-1-20190492-8. doi: 10.3788/IRLA20190492
[9]	吴庆阳, 黄浩涛, 陈顺治, 李奇锋, 陈泽锋, 卢晓婷. 基于结构光标记的光场三维成像技术研究 . 红外与激光工程, 2020, 49(3): 0303019-0303019-6. doi: 10.3378/IRLA202049.0303019
[10]	宋晓凤, 李居朋, 陈后金, 李丰, 万成凯. 多场景下结构光三维测量激光中心线提取方法 . 红外与激光工程, 2020, 49(1): 0113004-0113004(8). doi: 10.3788/IRLA202049.0113004
[11]	杨凌辉, 张正吉, 林嘉睿, 王金旺, 徐秋宇, 刘博文. 融合光电扫描定位的大构件整体形貌测量方法 . 红外与激光工程, 2019, 48(5): 503002-0503002(8). doi: 10.3788/IRLA201948.0503002
[12]	邹媛媛, 李鹏飞, 左克铸. 三线结构光视觉传感器现场标定方法 . 红外与激光工程, 2018, 47(6): 617002-0617002(6). doi: 10.3788/IRLA201847.0617002
[13]	龚肖, 史金龙, 廖芳. 点特征柔性物体三维运动恢复方法 . 红外与激光工程, 2018, 47(9): 917009-0917009(7). doi: 10.3788/IRLA201847.0917009
[14]	杨洪飞, 夏晖, 陈忻, 孙胜利, 饶鹏. 图像融合在空间目标三维重建中的应用 . 红外与激光工程, 2018, 47(9): 926002-0926002(8). doi: 10.3788/IRLA201847.0926002
[15]	洪汉玉, 范艳, 邓哲煜, 时愈. 动目标多视角观测图像的三维去模糊方法 . 红外与激光工程, 2016, 45(2): 228001-0228001(8). doi: 10.3788/IRLA201645.0228001
[16]	赵兵, 曹剑中, 杨洪涛, 周祚峰, 史魁, 徐伟高. 改进的平方根容积卡尔曼滤波及其在POS中的应用 . 红外与激光工程, 2015, 44(9): 2819-2824.
[17]	贾同, 周忠选, 高海红, 王炳楠. 基于红外编码结构光的深度测量方法 . 红外与激光工程, 2015, 44(5): 1628-1632.
[18]	冯春, 吴洪涛, 陈柏. 基于多传感器融合的航天器间位姿参数估计 . 红外与激光工程, 2015, 44(5): 1616-1622.
[19]	杨宇, 阚凌雁, 于佳, 王姣姣, 元光, 王金城. 基于激光扫描的人脸三维重建方法 . 红外与激光工程, 2014, 43(12): 3946-3950.
[20]	都琳, 李迎春, 郭惠超, 范有臣. 互相关法实现距离选通远距离目标的三维重建 . 红外与激光工程, 2013, 42(7): 1725-1729.

点击查看大图

计量

文章访问数: 609
HTML全文浏览量: 88
PDF下载量: 170
被引次数: 0

载人潜水器的深海地貌线结构光三维重建

doi: 10.3788/IRLA201948.0503001

1. 青岛科技大学自动化与电子工程学院,山东青岛 266061;

2. 国家深海基地管理中心,山东青岛 266061

作者简介:
丁忠军(1974-),男,研究员,教授,博士,主要从事深海探测技术及装备研发方面的研究。Email:dzj@ndsc.org.cn

收稿日期: 2019-02-11
修回日期: 2019-04-13
刊出日期: 2019-05-25

基金项目:

国家重点研发计划“深海关键技术与装备”重点专项（2017YFC0306600）

中图分类号: TN247

关键词:

摘要: 针对深海环境下通过视觉方法难以实现地貌的大范围、高精度三维重建的问题，提出一种基于蛟龙号载人潜水器的线结构光法深海地貌三维重建视觉传感器的设计方案。根据线结构光三维重建的原理，首先改进了Steger算法，实现了快速、精准的激光条纹中心线提取；然后利用直接标定法求解出地形特征的二维空间坐标，并克服了图像畸变对重建的影响；再将获得的二维点云与多传感器数据融合，跟随潜水器坐标实时计算偏移量，并根据传感器位姿变化对图像矫正，最终获得地貌的三维点云数据。根据重建原理设计了视觉传感器的软硬件系统，并搭建了实验模拟平台来验证方案的可行性。通过水下实验可以实现对模拟地貌的完整重建，精度达到96.9%，符合重建要求。

English Abstract

3D reconstruction of deep sea geomorphologic linear structured light based on manned submersible

1. College of Automation and Electronic Engineering,Qingdao University of Science and Technology,Qingdao 266061,China;

2. China National Deep Sea Center,Qingdao 266061,China

Received Date: 2019-02-11
Rev Recd Date: 2019-04-13
Publish Date: 2019-05-25

Keywords:

Abstract: Aiming at the problem that it was difficult to achieve large-scale and high-precision 3D reconstruction of land form of geomorphology by visual method in deep-sea environment, a design scheme of line structured light 3D reconstruction vision sensor for deep-sea topography features based on Jiaolong manned submersible was presented. According to the principle of 3D reconstruction of linear structured light, firstly, the Steger algorithm was improved to extract the center line of laser fringes quickly and accurately, then direct calibration method was used to solve the 2D spatial coordinates of topographic features, and the influence of image distortion on reconstruction was overcame. Then, the obtained 2D point cloud was fused with multi-sensor data, and the offset was calculated in real time according to the coordinates of the submersible, and the image was corrected according to the change of sensor position and attitude. Finally, the 3D point cloud data of landform was obtained. According to the reconstruction principle, the hardware and software system of the vision sensor was designed, and an experimental simulation platform was built to verify the feasibility of the scheme. Through underwater experiments, the complete reconstruction of simulated geomorphology can be achieved, with an accuracy of 96.9%, which meets the reconstruction requirements.