...
首页> 外文期刊>Complexity >Multimodal Multiobject Tracking by Fusing Deep Appearance Features and Motion Information
【24h】

Multimodal Multiobject Tracking by Fusing Deep Appearance Features and Motion Information

机译:融合深度外观特征和运动信息的多模式多机器跟踪

获取原文
           

摘要

Multiobject Tracking (MOT) is one of the most important abilities of autonomous driving systems. However, most of the existing MOT methods only use a single sensor, such as a camera, which has the problem of insufficient reliability. In this paper, we propose a novel Multiobject Tracking method by fusing deep appearance features and motion information of objects. In this method, the locations of objects are first determined based on a 2D object detector and a 3D object detector. We use the Nonmaximum Suppression (NMS) algorithm to combine the detection results of the two detectors to ensure the detection accuracy in complex scenes. After that, we use Convolutional Neural Network (CNN) to learn the deep appearance features of objects and employ Kalman Filter to obtain the motion information of objects. Finally, the MOT task is achieved by associating the motion information and deep appearance features. A successful match indicates that the object was tracked successfully. A set of experiments on the KITTI Tracking Benchmark shows that the proposed MOT method can effectively perform the MOT task. The Multiobject Tracking Accuracy (MOTA) is up to 76.40% and the Multiobject Tracking Precision (MOTP) is up to 83.50%.
机译:MultiObject跟踪(MOT)是自动驾驶系统最重要的能力之一。然而,大多数现有的MOT方法仅使用单个传感器,例如相机,其具有不足的问题。在本文中,我们通过融合对象的深度外观特征和运动信息来提出一种新型多元型跟踪方法。在该方法中,首先基于2D对象检测器和3D对象检测器来确定对象的位置。我们使用非最大抑制(NMS)算法来组合两个检测器的检测结果,以确保复杂场景中的检测精度。之后,我们使用卷积神经网络(CNN)来学习物体的深度外观特征,并采用卡尔曼滤波器来获得对象的运动信息。最后,通过将运动信息和深度外观特征相关联来实现MOT任务。成功的匹配表示已成功跟踪该对象。关于基提跟踪基准测试的一组实验表明,所提出的MOT方法可以有效地执行MOT任务。多机器跟踪精度(MOTA)高达76.40%,多机器跟踪精度(MOTP)高达83.50%。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号