Real-time integral imaging pickup system based on binocular stereo camera

Zhao Min; Xiong Zhaolong; Xing Yan; Li Xiaowei; Wang Qionghua

doi:10.3788/IRLA201746.1103007

A real time integral imaging pickup system was proposed using a binocular stereo camera. In the proposed system, the conventional camera array was replaced by the binocular stereo camera for three-dimensional (3D) scene pickup, which made the system simpler. In the system, left view and right view images were first captured by the binocular stereo camera, and the high-resolution depth map was calculated in the graphics processing unit. Then, the depth map and color texture image were used to generate the parallax images of new perspectives in parallax, and pixel mapping algorithm was adopted to obtain the high-resolution elemental image array for the real-time integral imaging display. In the experiment, the resolution of the calculated depth map was 4.25 times more than the depth map acquired by Microsoft Kinect2, the real-time pickup and display for 3D scene can be achieved in case the resolution of elemental image array was 1 920 pixel1 080 pixel, and sub-images was 99. The experiment results demonstrate the effectiveness of the proposed system.

Real-time integral imaging pickup system based on binocular stereo camera

1. College of Electronics and Information Engineering,Sichuan University,Chengdu 610065,China

Received Date: 2017-09-27

Rev Recd Date: 2017-10-17

Publish Date: 2017-11-25

Key words:

Abstract: A real time integral imaging pickup system was proposed using a binocular stereo camera. In the proposed system, the conventional camera array was replaced by the binocular stereo camera for three-dimensional (3D) scene pickup, which made the system simpler. In the system, left view and right view images were first captured by the binocular stereo camera, and the high-resolution depth map was calculated in the graphics processing unit. Then, the depth map and color texture image were used to generate the parallax images of new perspectives in parallax, and pixel mapping algorithm was adopted to obtain the high-resolution elemental image array for the real-time integral imaging display. In the experiment, the resolution of the calculated depth map was 4.25 times more than the depth map acquired by Microsoft Kinect2, the real-time pickup and display for 3D scene can be achieved in case the resolution of elemental image array was 1 920 pixel1 080 pixel, and sub-images was 99. The experiment results demonstrate the effectiveness of the proposed system.

HTML

Reference (15)

[1]	Lippmann G. La photographie intgrale[J]. CR Acad Sci, 1908, 146:446-451.
[2]	王琼华. 3D显示技术与器件[M]. 北京:科学出版社, 2011.
[3]	Xiong Zhaolong, Wang Qionghua, Xing Yan, et al. Active integral imaging system based on multiple structured light method[J]. Optics Express, 2015, 23(21):27094-27104.
[4]	Deng Huan, Wang Qionghua, Li Dahai. Method of generating orthoscopic elemental image array from sparse camera array[J]. Chinese Optics Letters, 2012, 10(6):31-33.
[5]	Deng Huan, Li Shuli, Wu Fei, et al. Toed-in integral imaging with enhanced 3D viewing angle[J]. Optics and Precision Engineering, 2014, 22(1):1-6. (in Chinese)邓欢, 李述利, 吴非, 等. 增大3D观看视角的会聚式集成成像[J]. 光学精密工程, 2014, 22(1):1-6.
[6]	Taguchi Y, Koike T, Takahashi K, et al. TransCAIP:A live 3D TV system using a camera array and an integral photography display with interactive control of viewing parameters[J]. IEEE Transactions on Visualization Computer Graphics, 2009, 15(5):841-852.
[7]	Jiao Xiaoxue, Zhao Xing, Yang Yong, et al. Pick-up system for three-dimensional integral imaging with camera array[J]. Optics and Precision Engineering, 2012, 20(8):1653-1660. (in Chinese)焦小雪, 赵星, 杨勇, 等. 基于相机阵列的三维集成成像记录系统[J]. 光学精密工程, 2012, 20(8):1653-1660.
[8]	Jiao Xiaoxue, Zhao Xing, Yang Yong, et al. Dual-camera enabled real-time three-dimensional integral imaging pick-up and display[J]. Optics Express, 2012, 20(25):27304-27311.
[9]	Li G, Shin G H, Jeong J S, et al. Simplified integral imaging pickup method for real objects using a depth camera[J]. Journal of the Optical Society of Korea, 2012, 16(4):381-385.
[10]	Martinezcorral M. Full parallax three-dimensional display from Kinect v1 and v2[J]. Optical Engineering, 2016, 56(4):041305.
[11]	Kwon K C, Erdenebat M U, Piao Y, et al. Development of a real-time integral imaging display system based on graphics processing unit parallel processing using a depth camera[J]. Optical Engineering, 2014, 53(53):015103.
[12]	He Xiaowei, Chen Zheng, Hou Yuqing, et al. Graphics processing units-accelerated solving for simplify spherical harmonic approximation model[J]. Infrared and Laser Engineering, 2016, 45(6):0624002. (in Chinese)贺小伟, 陈政, 侯榆青, 等. 简化球谐近似模型的图形处理器加速求解[J]. 红外与激光工程, 2016, 45(6):0624002.
[13]	Zhang Zuoyu, Liao Shouyi, Zhang Jincheng, et al. Real-time battlefield smoke IR simulation based on physical model[J]. Infrared and Laser Engineering, 2016, 45(4):0404004. (in Chinese)张作宇, 廖守亿, 张金城, 等. 基于物理模型的战场烟幕实时红外仿真[J]. 红外与激光工程, 2016, 45(4):0404004.
[14]	Park K S, Min S W, Cho Y. Viewpoint vector rendering for efficient elemental image generation[J]. IEICE Transactions on Information and Systems, 2007, 90(1):233-241.
[15]	Kwon K C, Park C, Erdenebat M U, et al. High speed image space parallel processing for computer-generated integral imaging system[J]. Optics Express, 2012, 20(2):732-740.

Real-time integral imaging pickup system based on binocular stereo camera

doi: 10.3788/IRLA201746.1103007

Abstract

References

Proportional views

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Related

Proportional views