Exploring Sensor Impact and Architectural Robustness in Adverse Weather on BEV Perception

Sanjay Kumar, Sushil Sharma, Rabia Asghar, Reenu Mohandas, Tim Brophy, Ganesh Sistu, Eoin Martino Grua, Valentina Donzella, Ciarán Eising

Research output: Contribution to journalArticlepeer-review

Abstract

Reliable perception in automated vehicles under adverse conditions, such as fog, rain, snow, and lens defocus, is essential for maintaining the safety of road actors and particularly of vulnerable road users. While prior work has primarily focused on camera occlusions, the impact on RADAR and LiDAR remains underexplored, particularly in a unified Bird's Eye View (BEV) space. To address this gap, we first apply occlusion to all three primary sensors: camera, RADAR, and LiDAR, and then systematically investigate its impact by projecting their outputs into the BEV space for unified analysis of vehicle and map segmentation. A parametrised occlusion pipeline is developed to apply occlusions to each of the sensor modalities. We evaluate both geometry-based and transformer-based fusion architectures, revealing that transformer-based architectures consistently demonstrate greater robustness to sensor degradation. Notably, we demonstrate that BEVCar achieves 45.6% vehicle Intersection-over-Union (IoU) and 53.6% Mean Intersection-over-Union (mIoU) under camera occlusion, surpassing other State-of-the-art (SOTA) models such as MMTraP (37.9% IoU / 47.9% mIoU) and CVT (36.0% IoU / 46.6% mIoU). These improvements are statistically significant (paired t-tests with 95% CI bootstrap, p < 0.001). Furthermore, projecting camera features into the BEV space using a backward projection strategy seems to offer greater resilience to occlusion than forward projection. These insights highlight the importance of architectural design, projection choice, and multi-sensor fusion in developing robust perception systems for automated driving under realistic multi-sensor occlusions.

Original languageEnglish
Pages (from-to)2857-2875
Number of pages19
JournalIEEE Open Journal of Vehicular Technology
Volume6
DOIs
Publication statusPublished - 2025

Keywords

  • bird's eye view
  • camera features projection
  • geometric-based architectures
  • map segmentation
  • Multi-sensor fusion
  • sensor level occlusion
  • transformer-based architectures
  • vehicle segmentation

Fingerprint

Dive into the research topics of 'Exploring Sensor Impact and Architectural Robustness in Adverse Weather on BEV Perception'. Together they form a unique fingerprint.

Cite this