车载MMS激光点云与序列全景影像自动配准方法

摘要

An automatic registration method of mobile mapping system laser point cloud and sequence panoramic image is proposed in this paper.Firstly,hierarchical object extraction method is applied on LiDAR data to extract the building facade and outline polygons are generated to construct the skyline vectors.A virtual imaging method is proposed to solve the distortion on panoramas and corners on skylines are further detected on the virtual images combining segmentation and corner detection results.Secondly,the detected skyline vectors are taken as the registration primitives.Registration graphs are built according to the extracted skyline vector and further matched under graph edit distance minimization criteria.The matched conjugate primitives are utilized to solve the 2D-3D rough registration model to obtain the initial transformation between the sequence panoramic image coordinate system and the LiDAR point cloud coordinate system.Finally,to reduce the impact of registration primitives extraction and matching error on the registration results,the optimal transformation between the multi view stereo matching dens point cloud generated from the virtual imaging of the sequent panoramas and the LiDAR point cloud are solved by a 3D-3D ICP registration algorithm variant,thus,refine the exterior orientation parameters of panoramas indirectly.Experiments are undertaken to validate the proposed method and the results show that 1.5 pixel level registration results are achieved on the experiment dataset.The registration results can be applied to point cloud and panoramas fusion applications such as true color point cloud generation.%提出一种车载移动测量系统(MMS)激光点云与序列全景影像自动配准方法.首先采用层次化城市场景目标提取方法自激光点云提取天际线矢量,在全景影像中经虚拟成像与分割角点提取算法生成天际线矢量.然后,将提取结果作为几何配准基元,构建配准基元图,通过最小化配准基元图编辑距离进行匹配,组成共轭配准基元对,解算2D-3D粗配准模型,获得全景影像与LiDAR点云参考坐标系之间的初始转换关系.最后,为消除几何配准基元提取与匹配误差对配准结果的影响,自序列全景影像虚拟成像影像生成多视立体密集匹配点云,继而使用变种ICP算法优化其与激光点云数据间3D-3D配准参数,间接优化全景影像与激光点云间的配准参数,精化配准结果.试验结果表明,本文提出的自动配准方法可以实现车载MMS激光点云与序列全景影像的1.5像素级自动配准,配准成果可应用于真彩色点云生成等点云/影像数据融合应用.