TY - JOUR
T1 - SOLAS 1.1
T2 - Automotive Optical Simulation in Computer Vision
AU - Jakab, Daniel
AU - Vazquez, Joel Herrera
AU - Barthel, Julian
AU - Honsbrok, Jan
AU - Deegan, Brian
AU - Mohandas, Reenu
AU - Brophy, Tim
AU - Scanlan, Anthony
AU - Ward, Enda
AU - Collins, Fiachra
AU - Eising, Ciaran
AU - Braun, Alexander
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2026
Y1 - 2026
N2 - Automotive datasets are typically captured using a small number of cameras, with each camera fixed at a single focus setting. In practice, however, camera modules exhibit unit-to-unit variability in their effective focus due to manufacturing tolerances. Since perception models are usually trained on images captured at one nominal focus position, real-world deviations in focus can introduce a domain mismatch that degrades perception performance. We demonstrate this effect by simulating two different optical systems on synthetic and real images with fields of view of 100° and 150°. For all simulations, we utilise the Python-based ray-tracing library KrakenOS, an open-source optical simulation tool. By assigning each optical system to a suitable dataset, we degrade the held-out test data of four public automotive datasets: KITTI, Virtual KITTI 2.0, Woodscape, and Parallel Domain Woodscape. We evaluate the impact of applying optical defocus on 2D Object Detection models with the popular OpenMMLab toolkit for MMDetection and the YOLOv11 architecture. For each optical system, we simulate 9 defocus settings on the test data, representative of the production tolerance range for camera defocus. The results show that object detection performance degrades as the magnitude of defocus increases. Align DETR, despite having the second fewest parameters, establishes the strongest baseline and remains robust under modest defocus (|△z| ≤ 20, µm) across all datasets. However, at extreme defocus (±100, µm), YOLOv11x surpasses Align DETR by 1.5%–12.2% mAP50:95 across all datasets. Finally, we show that defocus-augmented training of Align DETR, recovers the performance drop caused by the defocus in the held-out test data.
AB - Automotive datasets are typically captured using a small number of cameras, with each camera fixed at a single focus setting. In practice, however, camera modules exhibit unit-to-unit variability in their effective focus due to manufacturing tolerances. Since perception models are usually trained on images captured at one nominal focus position, real-world deviations in focus can introduce a domain mismatch that degrades perception performance. We demonstrate this effect by simulating two different optical systems on synthetic and real images with fields of view of 100° and 150°. For all simulations, we utilise the Python-based ray-tracing library KrakenOS, an open-source optical simulation tool. By assigning each optical system to a suitable dataset, we degrade the held-out test data of four public automotive datasets: KITTI, Virtual KITTI 2.0, Woodscape, and Parallel Domain Woodscape. We evaluate the impact of applying optical defocus on 2D Object Detection models with the popular OpenMMLab toolkit for MMDetection and the YOLOv11 architecture. For each optical system, we simulate 9 defocus settings on the test data, representative of the production tolerance range for camera defocus. The results show that object detection performance degrades as the magnitude of defocus increases. Align DETR, despite having the second fewest parameters, establishes the strongest baseline and remains robust under modest defocus (|△z| ≤ 20, µm) across all datasets. However, at extreme defocus (±100, µm), YOLOv11x surpasses Align DETR by 1.5%–12.2% mAP50:95 across all datasets. Finally, we show that defocus-augmented training of Align DETR, recovers the performance drop caused by the defocus in the held-out test data.
KW - Automotive
KW - fisheye
KW - object detection
KW - OpenMMLab
KW - optical simulation
KW - Point Spread Function (PSF)
KW - You-Only-Look-Once version 11 (YOLOv11)
UR - https://www.scopus.com/pages/publications/105024087948
U2 - 10.1109/OJVT.2025.3640419
DO - 10.1109/OJVT.2025.3640419
M3 - Article
AN - SCOPUS:105024087948
SN - 2644-1330
VL - 7
SP - 179
EP - 193
JO - IEEE Open Journal of Vehicular Technology
JF - IEEE Open Journal of Vehicular Technology
ER -