SOLAS 1.1: Automotive Optical Simulation in Computer Vision

  • Daniel Jakab
  • , Joel Herrera Vazquez
  • , Julian Barthel
  • , Jan Honsbrok
  • , Brian Deegan
  • , Reenu Mohandas
  • , Tim Brophy
  • , Anthony Scanlan
  • , Enda Ward
  • , Fiachra Collins
  • , Ciaran Eising
  • , Alexander Braun

Research output: Contribution to journalArticlepeer-review

Abstract

Automotive datasets are typically captured using a small number of cameras, with each camera fixed at a single focus setting. In practice, however, camera modules exhibit unit-to-unit variability in their effective focus due to manufacturing tolerances. Since perception models are usually trained on images captured at one nominal focus position, real-world deviations in focus can introduce a domain mismatch that degrades perception performance. We demonstrate this effect by simulating two different optical systems on synthetic and real images with fields of view of 100° and 150°. For all simulations, we utilise the Python-based ray-tracing library KrakenOS, an open-source optical simulation tool. By assigning each optical system to a suitable dataset, we degrade the held-out test data of four public automotive datasets: KITTI, Virtual KITTI 2.0, Woodscape, and Parallel Domain Woodscape. We evaluate the impact of applying optical defocus on 2D Object Detection models with the popular OpenMMLab toolkit for MMDetection and the YOLOv11 architecture. For each optical system, we simulate 9 defocus settings on the test data, representative of the production tolerance range for camera defocus. The results show that object detection performance degrades as the magnitude of defocus increases. Align DETR, despite having the second fewest parameters, establishes the strongest baseline and remains robust under modest defocus (|△z| ≤ 20, µm) across all datasets. However, at extreme defocus (±100, µm), YOLOv11x surpasses Align DETR by 1.5%–12.2% mAP50:95 across all datasets. Finally, we show that defocus-augmented training of Align DETR, recovers the performance drop caused by the defocus in the held-out test data.

Original languageEnglish
Pages (from-to)179-193
Number of pages15
JournalIEEE Open Journal of Vehicular Technology
Volume7
DOIs
Publication statusPublished - 2026

Keywords

  • Automotive
  • fisheye
  • object detection
  • OpenMMLab
  • optical simulation
  • Point Spread Function (PSF)
  • You-Only-Look-Once version 11 (YOLOv11)

Fingerprint

Dive into the research topics of 'SOLAS 1.1: Automotive Optical Simulation in Computer Vision'. Together they form a unique fingerprint.

Cite this