COMBINED VIRTUAL AND REAL ENVIRONMENT FOR AUTONOMOUS VEHICLE PLANNING AND CONTROL TESTING

摘要

A combined virtual and real environment for autonomous vehicle planning and control testing. An autonomous vehicle is operated in a real environment where a planning module and control module operate to plan and execute vehicle navigation. Simulated environment elements, including simulated image and video detected objects, simulated radar detected objects, simulated lane lines, and other simulated elements detectable by radar, lidar, camera, and any other vehicle perception systems, are received along with real-world detected elements. The simulated and real-world elements are combined and processed to by the autonomous vehicle data processing system. Once processed, the autonomous vehicle plans and executes navigation based on mixed real-world and simulated data in the same way. By adding simulated data to real data, the autonomous vehicle systems may be tested in hypothetical situations in a real-world environment and conditions.