VISION ALGORITHM PERFORMANCE USING LOW LEVEL SENSOR FUSION

摘要

A method and system that performs low level fusion of Radar or LiDAR data with an image from a camera. The system includes a radar-sensor, a camera, and a controller. The radar-sensor is used to detect a radar-signal reflected by an object in a radar-field-of-view. The camera is used to capture an image of the object in a camera-field-of-view that overlaps the radar-field of view. The controller is in communication with the radar-sensor and the camera. The controller is configured to determine a location of a radar-detection in the image indicated by the radar-signal, determine a parametric-curve of the image based on the radar detections, define a region-of-interest of the image based on the parametric-curve derived from the radar-detection, and process the region-of-interest of the image to determine an identity of the object. The region-of-interest may be a subset of the camera-field-of-view.