基于单帧连续编码条纹的半全局立体匹配测量方法

Semi-global matching measurement method based on single-frame continuous coded fringes

  • 摘要: 为了解决双目立体测量时,散斑结构光法受到投影质量和离散编码特性制约难以实现弱纹理区域精确匹配的问题,提出了一种基于单帧连续编码条纹的半全局立体匹配测量方法。在编码方面,设计了一种与半全局立体匹配路径相关的单帧连续编码条纹,实现对空间高效且鲁棒的特征编码。在算法方面,针对编码条纹改进了代价初始化方法,为立体匹配提供高质量的初始代价;同时引入自适应分区域并行计算和分层视差预测加速机制,提高了测量效率。实验结果表明:文中方法对距离 \text1 m 的弧形弱纹理样件实现了正确匹配率为 92.77\text% ,均方根误差为 \text0\text.89 mm 的高分辨率精确测量。在0.5~4.0 m的深度范围内,平面测量误差在 \text2\text.0 m 处为1.54、4.0 m处为 \text3\text.89 mm ,台阶高度测量在 \text2\text.0 m 处平均绝对误差优于 \text1\text.25 mm ,均方根误差优于 \text1\text.45 mm ,证明了该方法在较大范围内的平面感知与平面间深度测量的能力。通过与现有双目散斑结构光法及商用双目散斑深度相机的对比试验证明,文中方法能在较大深度范围内稳定完成立体匹配,具备较高的精度和鲁棒性,在工业三维感知领域存在良好的发展潜力。

     

    Abstract:
    Objective Due to its low cost and operational simplicity, the binocular stereo vision system has become a widely adopted solution for three-dimensional perception in industrial automation. The point cloud generated through stereo matching provides real-time spatial pose feedback for production processes, whose quality directly depends on the completeness and accuracy of the point cloud. Researchers have thus focused on achieving complete and accurate stereo matching. Currently, Speckle Projection Profilometry (SPP) is a mainstream approach for this purpose. Unlike Fringe Projection Profilometry (FPP), which requires phase calculation from multiple coded fringe patterns for accurate matching, SPP offers advantages in both matching efficiency and projection cost due to its single-frame projection. However, speckle matching algorithms rely on the spatial uniqueness of speckle features, which imposes stricter requirements on projection quality. Moreover, the discontinuous nature of speckle coding often fails to provide sufficient feature information for accurate stereo matching at disparity step positions. To address these limitations, this paper proposes a semi-global matching (SGM) measurement method based on single-frame continuously coded fringes to meet the practical demands of industrial production.
    Methods Based on the binocular stereo vision system, an independent fringe generator is added in this paper. A kind of single-frame continuous coded fringes related to SGM matching path is proposed (Fig.3). The SGM cost initialize is improved by increasing the investigation of the median and average gray values of the neighborhood pixels, in order to avoid the error caused by the interference of the central pixel (Fig.4). An adaptive sub-region algorithm is designed to realize two-stage parallel computing (Fig.1). The Gaussian pyramid is introduced into the core area for stratification (Fig.5), and disparity estimation is performed on each layer to reduce the traversed disparity range.
    Results and Discussions In order to demonstrate the effectiveness and practicability of the proposed method, the experiments of feasibility verifying, three-dimensional reconstruction of weak texture regions, accuracy analysis at different distances and reconstruction of complex environments are carried out. At 1.0m, proposed method achieves an accurate matching with correct matching rate (ZNCC≥0.9) of 92.77% and RMSE of 0.89 mm, which is superior to ZNCC-based method and SIFT-based method (Tab.3). By comparing with two commercial depth cameras, proposed method behaves relatively accurate and stable plane sensing ability in a large depth range. The planar measurement error of the proposed method is 1.54 mm at 2 m and 3.89 mm at 4 m(Fig.11). The quantitative measurement of step samples shows that proposed method realizes depth measurement with MAE less than 1.25 mm and RMSE less than 1.45 mm at 2.0 m (Fig.12). This method also achieves high-quality matching and three-dimensional reconstruction of complex environments (Fig.13).
    Conclusions Focusing on the issue that single-frame speckle structured light has high requirements on projection quality and its discrete coding characteristics are difficult to provide sufficient feature information at disparity step to complete accurate matching, a semi-global matching measurement method based on single-frame continuous coded fringes is proposed. By projecting single-frame continuous coded fringes associated with matching paths, sufficient feature information is supplemented for each path without increasing the computational complexity, which helps to achieve accurate stereo matching in weak texture regions. At the same time, cost initialize of SGM is improved based on the fringe to avoid the mismatch caused by the influence of projected fringes on gray level of center pixel. An adaptive partition and core region disparity prediction method is proposed. The Gaussian pyramid is introduced to estimate the hierarchical disparity. By reducing the disparity range of the traversal, the computational complexity is reduced. It achieves complete matching in complex environments and realizes precise measurement with the correct matching rate of 92.77% and the RMSE of 0.89 mm for a week-textured target at 1.0 m. For plane detection at different depths, the measurement error is 1.54 mm at 2.0 m and 3.89 mm at 4.0 m. Proposed method exhibits high precision and robustness.

     

/

返回文章
返回