Conference Paper


Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing

Abstract

In an autonomous driving system, perception - identification of features and objects from the environment - is crucial. Autonomous racing, in particular, features high speeds and small margins that demand rapid and accurate perception systems. During the race, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres. In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions - the collection of which is a protracted and costly process. However, recent developments in CycleGAN architectures allow the synthesis of highly realistic scenes in multiple weather conditions. To this end, we introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-theart detectors by an average of 42.7 and 4.4 mean average precision (mAP) percentage points in the presence of night-time conditions and droplets, respectively. Furthermore, we present a comparative analysis of five object detectors - identifying the optimal pairing of detector and training data for use during autonomous racing in challenging conditions.

Attached files

Authors

Teeti, Izzeddin
Musat, Valentina
Khan, Salman
Rast, Alexander
Cuzzolin, Fabio
Bradley, Andrew

Oxford Brookes departments

School of Engineering, Computing and Mathematics

Dates

Year of publication: 2022
Date of RADAR deposit: 2022-10-19


Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License


Related resources

This RADAR resource is Identical to Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing

Details

  • Owner: Joseph Ripp
  • Collection: Outputs
  • Version: 1 (show all)
  • Status: Live
  • Views (since Sept 2022): 348