-
The light path principle of PMP is shown in Fig.1. A random point
$ H $ on the object surface, and the distance from the point to the reference plane is h. According to the triangle principle[5], the phase-height formula is shown as follows:$$ h(u,v) = \frac{{L(u,v)\Delta \varphi (u,v)}}{{2\pi fd(u,v) + \Delta \varphi (u,v)}} $$ (1) Where,
$ L(u,v) $ and$ d(u,v) $ are the system parameters and can be obtained by calibration,$ f $ is the frequency of fringe pattern and$ (u,v) $ denotes the pixel coordinates of a point in the distorted fringe pattern. Eq. (1) shows that in order to obtain the true height information$ h $ of the measured object, the phase difference$\Delta \varphi (u,v)$ of the measured object must first be obtained.By using the projection system of Fig. 1, the sinusoidal fringes with phase shift are projected on the point H of the measured object surface. The encoded sinusoidal fringes are modulated by the measured object surface, and the light intensity can be calculated as follows:
$$ I(u,v) = a(u,v) + b(u,v)\cos (\varphi (u,v) + \delta ) $$ (2) Where,
$ a(u,v) $ represents the background light intensity at any point A on the reference plane, and for a particular point, the background light intensity is constant,$ b(u,v) $ is the intensity amplitude of the projector,$ \varphi (u,v) $ is the phase distribution modulated by the measured object,$ \delta $ is the phase shift. As for the$ N(N \geqslant 3) $ -step phase-shifting method, the light intensity is presented as follows:$$ \begin{split} {I_n}(x,y) =& a(x,y) + b(x,y)\cos \Bigg[\varphi (x,y) +\\ & \dfrac{{2\pi (n - 1)}}{N}\Bigg](n = 1,2,3 \cdots N) \end{split} $$ (3) In this paper, a four
$ (N = 4) $ -step phase method is used, so the phase difference between two adjacent fringe pattern images is$ {\pi / {\text{2}}} $ , and the corresponding light intensity can be described as follows:$$ \left\{ {\begin{array}{*{20}{c}} {{I_1} = a(x,y) + b(x,y)\cos [\varphi (x,y) + {\text{0}}]} \\ {{I_2} = a(x,y) + b(x,y)\cos \left[\varphi (x,y) + \dfrac{\pi }{2}\right]} \\ {{I_3} = a(x,y) + b(x,y)\cos [\varphi (x,y) + \pi ]} \\ {{I_4} = a(x,y) + b(x,y)\cos \left[\varphi (x,y) + \dfrac{{3\pi }}{2}\right]} \end{array}} \right. $$ (4) Solving the presented equations uniquely obtains the expression for the phase map
$ \phi (u,v) $ as follows:$$ \phi (x,y) = \arctan \left[ {\frac{{{I_4}(x,y) - {I_2}(x,y)}}{{{I_1}(x,y) - {I_3}(x,y)}}} \right] $$ (5) This process is called "phase unwrapping" because the computed phase value has the range
$ \left( { - \pi ,\pi } \right] $ and needs to be calculated to obtain the continuous phase value$ \varphi (u,v) $ as follows:$$ \varphi (x,y) = \phi (x,y) + k(x,y) \cdot 2\pi $$ (6) A continuous phase map can be obtained by adopting the three frequency heterodyne phase unwrapping method[20], and the phase-height mapping could convert the absolute phase to the depth information.
-
In the measurement system shown in Fig. 1, Eq. (1) is still widely used, and its deformation formula is as follows:
$$ \frac{1}{{h(u,v)}} = \frac{1}{{L(u,v)}} + \frac{{2\pi fd(u,v)}}{{L(u,v)}} \cdot \frac{1}{{\varDelta \varphi (u,v)}} $$ (7) Letting
${C_1}(u,v) = {{\text{1}} / {L(u,v)}}$ and${C_{\text{2}}}(u,v) = {{2\pi f \cdot}} $ $ {{ d(u,v)} /} { {L(u,v)}}$ , Eq. (7) can be simplified as follows:$$ \frac{1}{{h(u,v)}} = {C_1}(u,v) + {C_2}(u,v) \cdot \frac{1}{{\Delta \varphi (u,v)}} $$ (8) Where,
$ {C_1}(u,v) $ and$ {C_{\text{2}}}(u,v) $ can be obtained by the system calibration method. In the case, a calibration method is proposed by determining the distributions of the parameters$ {C_1}(u,v) $ and$ {C_{\text{2}}}(u,v) $ . Its principle is illustrated in Fig. 2, and the procedure can be summarized as follows. First, a standard plane is positioned at$ h = 0 $ , and then the distributions of reference phase can be measured and denoted as$ {\varphi _0}(u,v) $ . Second, by shifting the plane to different positions with given depths$ {h_i} $ , the phase distributions can be obtained and denoted as$ {\varphi _i}(u,v) $ , where$ i = 1,2, \cdots ,n $ . Accordingly, the phase differences are given by$$ \Delta {\varphi _i}(u,v) = {\varphi _i}(u,v) - {\varphi _0}(u,v)\begin{array}{*{20}{c}} {}&{i = 1,...,n} \end{array} $$ (9) Third, because there are two parameters to be determined, the parameters can be estimated from the measurement result when the condition
$ n \geqslant 2 $ is satisfied. -
By using the geometric dimension relationship of the electric turntable, the measured surface of the calibration plate passes through the axis of the turntable. A customized calibration plate is placed vertically on the high-precision electric turntable. The process of the new calibration method is shown in Fig. 3.
The principle of the new phase-height mapping calibration method is as follows:
Step 1: First, the phase shift method is used to measure the surface of the calibration plane, and the phase information of the measured surface at this time is collected and recorded as
$ {\varphi _{\text{0}}}(u,v) $ .Step 2: The electric turntable drives the calibration plate to rotate at a certain angle, as shown in Fig. 3. We collect the phase information of the calibration plate’s measured plane at this moment and record it as
$ \varphi (u,v) $ .Step 3: As shown in Fig. 4, Figs. 4(a) and 4(b) are the circle centers of calibration plate image and its partial enlargement, respectively.
The camera is used to capture the marker points in the image, and the pixel coordinates of the center of each marker point are identified and saved. After obtaining the pixel coordinates of the marker point, the phase value
$ {\varphi _i}(u,v) $ at the marker point on the calibration plate after rotation is known via$ \varphi (u,v) $ .Step 4: As shown in Fig. 5, the height
$ {h_i}(x,y) $ from the marker point$ {q_i}(i = 1,2, \cdots ,n) $ to the reference plane is following:$$ {h_i} = a\sin \theta + (i - 1)l\sin \theta (i = 1,2, \cdots ,n) $$ (10) Where,
$ \theta $ is the rotation angle of the calibration plate,$ \theta $ is determined by the precision turntable, and$ a $ is the distance from the center of the first marker point to the axis of the turntable. The distance between the centers of the marker point is equal, and its value is$ l $ , and$ n $ is the number of marker points.Step 5: The phase difference
$\Delta {\varphi _i}(u,v)$ can be obtained by subtracting the phase value$ {\varphi _0}(u,v) $ of the corresponding point on the reference plane from the phase value$ {\varphi _i}(u,v) $ of the marker point$ {q_i}(i = 1,2, \cdots ,n) $ ,whose height is$ {h_i}(u,v) $ through the$ i $ marker point. Therefore, Eq. (8) can be rewritten as follows:$$ \frac{1}{{{h_i}(u,v)}} = {C_1}(u,v) + {C_2}(u,v) \cdot \frac{1}{{\Delta {\varphi _i}(u,v)}} $$ (11) As shown in Fig. 1, because the parameters
$ {C_1}(u,v) $ and$ {C_{\text{2}}}(u,v) $ are parameters related to the two constants$ L(u,v) $ and$ d(u,v) $ , so they are also constants in theory. To calculate the measured object absolute height out-of-reference plane with Eq. (8), the parameters$ {C_1}(u,v) $ and$ {C_{\text{2}}}(u,v) $ must be determined first. However, physically measuring those parameters, such as the parameter$ d $ , should be avoided in order to ensure high measurement accuracy and practicability. To cope with this issue, the parameters$ {C_1}(u,v) $ and$ {C_{\text{2}}}(u,v) $ will be determined through using a least-squares inverse approach based on$ n(n \geqslant 2) $ marker points whose heights are precisely known. The least-squares method is employed here because it utilizes many marker points to enhance the detection accuracy of the parameters$ {C_1}(u,v) $ and$ {C_{\text{2}}}(u,v) $ . The least-squares error can be expressed as follows:$$ S = \sum\limits_{i = 1}^n {\left[ {\frac{1}{{L(u,v)}} + \frac{{2\pi fd(u,v)}}{{L(u,v)}} \cdot \frac{1}{{\Delta \varphi (u,v)}} - \frac{1}{{{h_i}(u,v)}}} \right]} $$ (12) Where
$ {h_i}(u,v) $ denotes the absolute height out-of-reference-plane of the marker points,$ i $ is the ordinal number of each marker point,$ n $ is the total number of the marker points used in the calculation, and a larger$ n $ generally yields a higher accuracy. The parameters$ {C_1}(u,v) $ and$ {C_{\text{2}}}(u,v) $ in the equation can be determined by using a nonlinear least-squares algorithm such as the Levenberg–Marquardt method. -
To verify the correctness of the proposed method, physical measurements were carried out. As shown in Fig.1, a measurement system based on turntable is established, the measurement system consists of computer, camera, projector and turntable. The projector model is DLP lightcraft 4500 with a resolution of 912×1140 pixel. The camera is an industrial CMOS camera (MER-131-210U3M) with a resolution of 1280×1024 pixel. The model of turntable is RAP125 (repeated positioning accuracy is less than 0.003°), and the control box is SC300. The measured object includes a block and a sphere, the purpose of measuring the calibration plate is to evaluate the measurement accuracy of the proposed method.
First, a four-step phase-shifting fringe patterns are projected onto a calibration plane, also referred to as the reference plane, and a fringe pattern is captured with a camera. Then, the calibration plane is moved 15 mm, 20 mm, 25 mm, 30 mm and 35 mm in turn, and the four-step phase-shifting fringe patterns are projected onto the calibration plane corresponding to the moving position. Finally, the phase values of the 6 calibration planes including the reference plane are obtained, and the phase values of the 5 calibration planes are subtracted from the phase values of the reference plane to obtain the continuous phase differences of the other 5 calibration planes relative to the reference plane. The continuous phase differences of the 5 calibration planes and the heights of the corresponding calibration planes are substituted into Eq. (8), and the traditional phase-height mapping relationship can be established by calculating parameters
$ {C_1}(u,v) $ and$ {C_{\text{2}}}(u,v) $ with the least-squares method.The measurement results obtained by the traditional phase-height calibration method are shown in Fig. 6. Figure 6(a) shows a deformed fringe pattern modulated by the block with a height of 10 mm. Figure 6(b) is part of a deformed fringe pattern. Figure 6(c) shows the continuous phase value of a block obtained by PMP. Figure 6(d) is the 3D point cloud data of a block.
Figure 6. Measurement with the traditional method. (a) The deformed fringe pattern modulated by the block; (b) Part of a deformed fringe pattern; (c) The continuous phase value; (d) 3D point cloud data of a block
The measurement results obtained by using the proposed phase-height calibration method are shown in Fig. 7. Figure 7(a) shows the new calibration system, and the distance from the center of the first marker point on the left to the axis of the turntable is 20 mm, the actual distance between the centers of the marker points is 10 mm, and the rotating angle θ of the turntable is 30°. Figure 7(b) shows the 3D point cloud data of the block with a height of 10 mm.
Figure 7. Measurement with the proposed method. (a) The calibration system; (b) 3D point cloud data of a block
In 3D measurement, the root mean square error (RMSE) is commonly used to assess the measurement accuracy
$$ \sigma = \sqrt {\sum {{{\left[ {h(u,v) - A} \right]}^2}/m} } $$ (15) Where h(u,v) is the reconstruction height of the block, A is the height of the white block with a value is of 10 mm, and m is the total number of pixels in the plane. Substituting the measurement results into Eq. (15) shows that the 3D reconstruction of the block with a height of 10 mm using the traditional method has an average height of 10.018 mm, and a RMSE of 0.043 mm. Similarly, the measurement results of the proposed method show an average height of 10.047 mm, and a standard deviation of 0.072 mm.
The traditional phase-height mapping calibration method and the new phase-height mapping calibration method are respectively used to reconstruct the calibration plane with a height of 10 mm. The comparison results are shown in Tab. 1.
Table 1. Comparison of the measurement results
Method Average height/mm RMSE/mm Traditional 10.018 0.043 Proposed 10.047 0.072 Table 1 shows that no matter whether the traditional method or the proposed method is used, the 3D information of the measured object can be effectively obtained, and the measurement accuracy can be guaranteed. However, the table shows that the traditional calibration method is superior to the proposed calibration method in terms of average value, or RMSE, while the proposed method is more convenient and saves more time.
To verify the utility of the method, the measurement data of the sphere shown in Fig. 8, Figure 8(a) shows part of a sphere, whose diameter is 60.027 mm. Figure 8(b) shows a frame deformed fringe of the sphere, and Fig. 8(c) shows a phase distribution of the sphere. Figure 9 shows the 3D reconstruction results of the sphere, Figure 9(a) shows 3D shape by the traditional method. And Fig. 9(b) shows 3D shape by the proposed method, Figure 9 shows that both methods are good at restoring the 3D shape of the object.
Figure 8. Measurement data of the sphere. (a) Measured sphere; (b) The deformed fringe pattern modulated by the sphere; (c) Continuous phase distribution
Figure 9. Reconstruction results of the sphere. (a) 3D shape by the traditional method; (b) 3D shape by the proposed method
To compare the difference between the two methods more clearly, the cutaway view of a column in the green circle of Fig. 9 was extracted from the 3D shape recovered by the two methods, and the comparison result is shown in Fig. 10. The measurement results show that the maximum height of the sphere surface is 60.071 mm obtained by the traditional method and 60.095 mm obtained by the proposed method, respectively. For the traditional method, due to need to move the standard plane several times (starting from the h0 position), the measurement data fluctuates greatly due to the influence of dither and mechanical error. The new method only needs to rotate an angle
$ \theta $ accurately, which is easy to realize with a precision turntable. The subsequent calculation processes are obtained by fitting and optimization algorithm, so the measurement data is relatively smoother.In addition, another evaluation experiment is carried out by measuring a sculpture using the proposed method, as illustrated in Fig. 11. Figure 11(a) and 11(b) are the captured deformed pattern and the reconstructed 3D shape, respectively. Obviously, the proposed method can obtain satisfactory 3D shape of the measured object.
Method for phase-height mapping calibration based on fringe projection profilometry
-
摘要: 在基于条纹投影轮廓术和转台辅助的360° 三维形貌测量中,使用移动工作台标定系统几何参数时存在操作复杂、携带不便的问题。文中提出了一种基于相机、投影仪、计算机和转台组成的转台的单目全景三维形貌测量系统的柔性标定方法。该算法主要利用转台和标记点完成系统几何参数的标定。对于完整的标定过程,该方法仅要求相机捕捉参考面的变形条纹图像、旋转后标定平面上的变形条纹图像以及旋转后的标记点图像。与传统方法相比,该方法更加方便、省时。新的相位高度映射标定方法用于重建高度为10.000 mm的标定平面,结果为10.047 mm。实验验证了所提方法的有效性。Abstract: For a
$ {\text{36}}{{\text{0}}^ \circ } $ 3D shape measurement based on fringe projection profilometry with turntable assistance, calibrating the system’s geometric parameters with a moving stage has the problems of complicated operation and inconvenient carrying. A novel flexible technique was presented to calibrate the monocular system of the panoramic 3D shape measurement based on a turntable consisting of a camera, projector, computer and turntable. The proposed algorithm mainly uses the turntable and marker point to complete the system geometric parameter calibration. For the complete calibration procedure, this method only requires the camera to capture the deformed fringe image of the reference plane, deformed fringe image on the calibration plane after rotation, and marker point image after rotation. In contrast with the traditional method, the proposed method is more convenient and time-saving. The new phase height mapping calibration method was used to reconstruct the calibration plane with a height of 10.000 mm, the result was 10.047 mm. Experiments have been performed to validate the performance of the proposed technique.-
Key words:
- 3D measurement /
- fringe projection profilometry /
- calibration /
- turntable
-
Table 1. Comparison of the measurement results
Method Average height/mm RMSE/mm Traditional 10.018 0.043 Proposed 10.047 0.072 -
[1] Chen F, Brown G M, Song M. Overview of 3-D shape measurement using optical methods [J]. Optical Engineering, 2000, 39(1): 10-22. doi: 10.1117/1.602438 [2] Yin Yongkai, Zhang Zonghua, Liu Xiaoli, et al. Review of the system model and calibration for fringe projection profilometry [J]. Infrared and Laser Engineering, 2020, 49(3): 0303008. (in Chinese) doi: 10.3788/IRLA202049.0303008 [3] Hong D, Lee H, Kim M Y, et al. Sensor fusion of phase measuring profilometry and stereo vision for three-dimensional inspection of electronic components assembled on printed circuit boards [J]. Applied Optics, 2009, 48(21): 4158-4169. doi: 10.1364/AO.48.004158 [4] Zuo Chao, Zhang Xiaolei, Hu Yan, et al. Has 3D finally come of age?——An introduction to 3D structured-light sensor [J]. Infrared and Laser Engineering, 2020, 49(3): 0303001. (in Chinese) doi: 10.3788/IRLA202049.0303001 [5] Takeda M, Mutoh K. Fourier transform profilometry for the automatic measurement of 3-D object shapes [J]. Applied Optics, 1983, 22(24): 3977-3982. doi: 10.1364/AO.22.003977 [6] Cao S, Cao Y, Zhang Q. Fourier transform profilometry of a single-field fringe for dynamic objects using an interlaced scanning camera [J]. Optics Communications, 2016, 367: 130-136. doi: 10.1016/j.optcom.2016.01.033 [7] Srinivasan V, Liu H C, Halioua M. Automated phase-measuring profilometry of 3-D diffuse objects [J]. Applied Optics, 1984, 23(18): 3105-3108. doi: 10.1364/AO.23.003105 [8] Zhou H, Gao J, Hu H, et al. Fast phase-measuring profilometry through composite color-coding method [J]. Optics Communications, 2019, 440: 220-228. doi: 10.1016/j.optcom.2019.02.024 [9] Sansoni G, Biancardi L, Minoni U, et al. A novel, adaptive system for 3-D optical profilometry using a liquid crystal light projector [J]. IEEE Transactions on Instrumentation and Measurement, 1994, 43(4): 558-566. doi: 10.1109/19.310169 [10] Liu H, Su W, Reichard K, et al. Calibration-based phase-shifting projected fringe profilometry for accurate absolute 3D surface profile measurement [J]. Optics Communications, 2003, 216(1-3): 65-80. doi: 10.1016/S0030-4018(02)02290-3 [11] Zhou W, Su X. A direct mapping algorithm for phase-measuring profilometry [J]. Journal of Modern Optics, 1994, 41(1): 89-94. doi: 10.1080/09500349414550101 [12] Asundi A, Wensen Z. Unified calibration technique and its applications in optical triangular profilometry [J]. Applied Optics, 1999, 38(16): 3556-3561. doi: 10.1364/AO.38.003556 [13] Li W, Su X, Liu Z. Large-scale three-dimensional object measurement: A practical coordinate mapping and image data-patching method [J]. Applied Optics, 2001, 40(20): 3326-3333. doi: 10.1364/AO.40.003326 [14] Du H, Wang Z. Three-dimensional shape measurement with an arbitrarily arranged fringe projection profilometry system [J]. Optics Letters, 2007, 32(16): 2438-2440. doi: 10.1364/OL.32.002438 [15] Gai S, Da F. Three-dimensional surface measurement system based on projected fringe model[C]//3rd International Symposium on Advanced Optical Manufacturing and Testing Technologies: Optical Test and Measurement Technology and Equipment, 2007, 6723: 67231X. [16] Zhang Z, Huang S, Meng S, et al. A simple, flexible and automatic 3D calibration method for a phase calculation-based fringe projection imaging system [J]. Optics Express, 2013, 21(10): 12218-12227. doi: 10.1364/OE.21.012218 [17] Léandry I, Brèque C, Valle V. Calibration of a structured-light projection system: development to large dimension objects [J]. Optics and Lasers in Engineering, 2012, 50(3): 373-379. doi: 10.1016/j.optlaseng.2011.10.020 [18] Siegmann P, Felipe-Sese L, Diaz-Garrido F. Improved 3D displacement measurements method and calibration of a combined fringe projection and 2D-DIC system [J]. Optics and Lasers in Engineering, 2017, 88: 255-264. doi: 10.1016/j.optlaseng.2016.08.014 [19] Gonzalez A, Meneses J. Accurate calibration method for a fringe projection system by projecting an adaptive fringe pattern [J]. Applied Optics, 2019, 58(17): 4610-4615. doi: 10.1364/AO.58.004610 [20] Huntley J M, Saldner H O. Temporal phase-unwrapping algorithm for automated interferogram analysis [J]. Applied Optics, 1993, 32(17): 3047-3052. doi: 10.1364/AO.32.003047