-
将摄像组件加装在图7所示的车辆四周,每个方向各一个,并改装驾驶员显示屏供车辆周围全景图像显示,行驶过程中,将驾驶员前方挡风玻璃和两个后视镜遮蔽,驾驶员戴上头盔显示装置。图7(a)为常规水泥路面,图中白线可用于测试测量侧方停车能力;图7(b)为常规路面放置两个障碍物,用于测试车辆避障行驶,也可将两个障碍物之间距离缩小,用于测试车辆倒车功能;图7(c)划定了一条宽3 m的窄道,用于测试车辆窄道行车。具体测试项目及结果如表1所示,表中路况如上描述,用图7(a)、(b)、(c)表示,不再赘述。
表 1 辅助驾驶系统外场实验结果
Table 1. Outfield experiment results of driving assistant system
实验结果表明,车辆在常规路况下行驶,速度可达40 km/h,同时该辅助驾驶系统可辅助车辆窄道行车、侧方停车、障碍物绕行和倒车等事项顺利进行。
Vision assisted driving technology based on optical multi-sensor scene information
-
摘要: 为满足坦克、装甲车辆等军用车辆的闭舱、无窗驾驶需求,研制了一套新型辅助驾驶系统。系统将分布于车辆四周的多路光学传感器获取车辆近身场景,通过全景拼接算法得到车辆近身360°的全景鸟瞰视频,该视频显示于车载显示屏,用于车辆通过窄道、有障碍物等特殊路段,或倒车时,驾驶员观看。同时,在车辆通过常规路段时,上述视频可根据驾驶员头部扭转角度,裁选出符合人眼观察视角的车外场景视频,传输至驾驶员显示头盔上,供驾驶员观看。如遇特殊情况,车载显示屏会报警,驾驶员将回归车载显示屏的观看。其中,驾驶员头部位置确定方法采用了红外LED光源图像定位技术和MEMS惯性器件定位技术。在实验室,搭建模型小车,验证全景鸟瞰视频生成技术和头盔自由视点观察技术。此外,还使用真实车辆进行了跑车实验。实验结果表明,上述系统可满足闭舱无窗车辆在常规路况下行驶,速度可达40 km/h,同时可辅助车辆窄道行车、障碍物绕行和倒车等事项顺利进行。Abstract: In order to meet the needs of closed cabin and windowless driving of military vehicles such as tanks and armored vehicles, a new assisted driving system was developed. The scene around the vehicle was obtained through a multi-path optical sensors and the 360° panoramic view video of the vehicle body was obtained through the panoramic splicing algorithm. The panoramic video was displayed on the on-board display screen to assist the driver to watch the vehicle when driving in a narrow roads, an obstacles and the other special sections, or when reversing. When the vehicle driving in a standard road, the video can also provide a scene video around the vehicle according to the driver's head torsion angle, and transmit it to the driver's display helmet for the driver to use. In case of a special circumstances, the on-board display will give an alarm to driver. The driver's head position determination method used the infrared LED light source image positioning technology and the MEMS inertial device positioning technology. The vehicle modeling in the laboratory can verify the panoramic view video generation technology and the helmet free-viewpoint-observation technology. In addition, the driving experiments were carried out with a real vehicle. The experimental results show that this system can meet the requirements of vehicles with closed cabin and windowless driving with a standard road conditions, a speed of 40 km/h. It can assist in driving with a special situations such as narrow roads, obstacle detour and reversing.
-
Key words:
- assisted driving /
- display helmet /
- infrared LED light source /
- panoramic stitching
-
表 1 辅助驾驶系统外场实验结果
Table 1. Outfield experiment results of driving assistant system
-
[1] 白瑜, 邢廷文, 蒋亚东, 等. 基于衍射光学的头盔显示光学系统[J]. 红外与激光工程, 2012, 41(10): 2753-2757. doi: 10.3969/j.issn.1007-2276.2012.10.037 Bai Yu, Xing Tingwen, Jiang Yadong, et al. Design of head-mounted display optical system with DOE [J]. Infrared and Laser Engineering, 2012, 41(10): 2753-2757. (in Chinese) doi: 10.3969/j.issn.1007-2276.2012.10.037 [2] 张舒慧, 黄明和, 程其娈, 等. 头盔显示器视差自动测量中眼位点的自动对准[J]. 应用光学, 2019, 40(1): 39-44. Zhang Shuhui, Huang Minghe, Cheng Qiluan, et al. Alignment automation of observation point in automatic measurement on parallax of helmet mounted display [J]. Journal of Applied Optics, 2019, 40(1): 39-44. (in Chinese) [3] 曾飞, 张新. 全息波导头盔显示技术[J]. 中国光学, 2014, 7(5): 731-738. Zeng Fei, Zhang Xin. Waveguide holographic head-mounted display technology [J]. Chinese Optics, 2014, 7(5): 731-738. (in Chinese) [4] 张 博, 王 凌, 常伟军, 等. 头盔显示器自由曲面光学组件的优化设计[J]. 应用光学. 2014, 35(2): 193-197. Zhang Bo, Wang Ling, Chang Weijun, et al. Optimal design of free-form-surface optical component in helmet mounted display [J]. Journal of Applied Optics, 2014, 7(5): 731-738. (in Chinese) [5] You Anqing, Pan Xudong, Zhao Ping, et al. Research on road parameters calculation for auxiliary driving with LIDAR [J]. Journal of Applied Optics, 2020, 41(1): 209-213. [6] 汪同浩, 刘秉琦. 红外立体辅助驾驶系统可行性研究[J]. 光学仪器, 2018, 40(3): 60-65. Wang Tonghao, Liu Bingqi. Feasibility study on infrared stereo assisted driving system [J]. Optical Instruments, 2018, 40(3): 60-65. (in Chinese) [7] 李鸿鹏. 基于鱼眼镜头的全景辅助驾驶系统研究[J]. 光电技术应用, 2018, 33(3): 10-16. doi: 10.3969/j.issn.1673-1255.2018.03.003 Li Hongpeng. Research on panorama assistant driving system based on fish eye lens [J]. Electro-optic Technology Application, 2018, 33(3): 10-16. (in Chinese) doi: 10.3969/j.issn.1673-1255.2018.03.003 [8] 王世孚, 罗惠铎, 黄婷, 等. 汽车辅助驾驶系统设计研究[J]. 现代信息科技, 2020, 4(18): 13-16. Wang Shifu, Luo Huiduo, Huang Ting, et al. Research on the design of automobile assistant driving system [J]. Modern Information Technology, 2020, 4(18): 13-16. (in Chinese) [9] 汪同浩, 刘秉琦, 黄富瑜, 等. 平行式红外双目立体系统各参数合理效益取值[J]. 红外与激光工程, 2017, 46(9): 6. Wang Tonghao, Liu Bingqi, Huang Fuyu, et al. Reasonable benefit value of the parameters of the parallel infrared binocular stereo system [J]. Infrared and Laser Engineering, 2017, 46(9): 0904004. (in Chinese) [10] 刘金亮, 卜凡亮. 鱼眼全景拼接系统研究与实现[J]. 软件导刊, 2019, 18(1): 112-115. Liu Jinliang, Bu Fanliang. Design and implementation of fisheye panoramic stitching system [J]. Electro-optic Technology Application, 2019, 18(1): 112-115. (in Chinese) [11] 兰 红, 洪玉欢, 高晓林. SIFT 优化算法及其在全景拼接图像配准中的应用[J]. 小 型 微 型 计 算 机 系 统, 2016, 37(5): 1052-1056. Lan Hong, Hong Yuhuan, Gao Xiaolin. Optimized SIFT and application in panoramic stitching image registration [J]. Journal of Chinese Computer Systems, 2016, 37(5): 1052-1056. (in Chinese) [12] 马雪松, 张海洋, 韩 磊, 等. 激光主动探测成像中全景拼接的算法研究[J]. 激 光 与 红 外, 2015, 45(8): 977-981. Ma Xuesong, Zhang Haiyang, Han Lei, et al. Research on panoramic stitching in laser active imaging [J]. Laser & Infrared, 2015, 45(8): 977-981. (in Chinese) [13] 任 静, 姚 剑, 董颖青, 等. 一种街景全景生成的改进算法[J]. 计算机工程与应用, 2017, 53(6): 193-199. doi: 10.3778/j.issn.1002-8331.1508-0215 Ren Jing, Yao Jian, Dong Yingqing, et al. Improved algorithm of creating street-view panorama [J]. Computer Engineering and Applications, 2017, 53(6): 193-199. (in Chinese) doi: 10.3778/j.issn.1002-8331.1508-0215 [14] 李 佳, 段 平, 张 驰. 图像分块匹配下视频全景拼接方法[J]. 应用基础与工程科学学报, 2018, 26(4): 697-708. Li Jia, Duan Ping, Zhang Chi. Video panoramic stitching based on image block matching [J]. Journal of Basic Science and Engineering, 2018, 26(4): 697-708. (in Chinese) [15] 黎吉国, 王悦, 张新峰, 等. 一种鱼眼视频全景拼接中的亮度补偿算法[J]. 中国科学 : 信息科学 , 2018, 48(3): 261–273. doi: 10.1360/N112017-00243 Li Jiguo, Wang Yue, Zhang Xinfeng, et al. A luminance compensation method for fisheye video panorama stitching [J]. SCIENTIA SINICA Informationis, 2018, 48(3): 261-273. (in Chinese) doi: 10.1360/N112017-00243 [16] 周 辉, 罗 飞, 李慧娟, 等. 基于柱面模型的鱼眼影像校正方法的研究[J]. 计算机应用, 2008, 28(10): 2664–2666. Zhou Hui, Luo Fei, Li Huijuan, et al. Study on fisheye im age correction based on cylinderm odel [J]. Computer Applications, 2008, 28(10): 2664-2666. (in Chinese)