AV-FUZZER: Finding Safety Violations in Autonomous Driving Systems

• Main Authors: Li, Guanpeng, Li, Yiran, Jha, Saurabh, Tsai, Timothy, Sullivan, Michael, Hari, Siva Kumar Sastry, Kalbarczyk, Zbigniew, Iyer, Ravishankar
• Format: Conference Proceeding
• Language: English
• Subjects: Autonomous vehicles; Perturbation methods; Safety; safety-critical applications; Testing; Trajectory; Vehicle dynamics; Web and internet services
• ISSN: 2332-6549
• DOI: 10.1109/ISSRE5003.2020.00012

This paper proposes AV-FUZZER, a testing framework, to find the safety violations of an autonomous vehicle (AV) in the presence of an evolving traffic environment. We perturb the driving maneuvers of traffic participants to create situations in which an AV can run into safety violations. To optimally search for the perturbations to be introduced, we leverage domain knowledge of vehicle dynamics and genetic algorithm to minimize the safety potential of an AV over its projected trajectory. The values of the perturbation determined by this process provide parameters that define participants' trajectories. To improve the efficiency of the search, we design a local fuzzer that increases the exploitation of local optima in the areas where highly likely safety-hazardous situations are observed. By repeating the optimization with significantly different starting points in the search space, AV-FUZZER determines several diverse AV safety violations. We demonstrate AV-FUZZER on an industrial-grade AV platform, Baidu Apollo, and find five distinct types of safety violations in a short period of time. In comparison, other existing techniques can find at most two. We analyze the safety violations found in Apollo and discuss their overarching causes.