Deep learning enabled computer vision in remanufacturing and refurbishment applications: defect detection and grading for smart phones

This work demonstrates the use of Deep Learning-based Computer Vision for Remanufacturing end-of-life consumer electronics products, considering smartphones as the use-case. We implemented automated detection of screen defects such as scratches and cracks. In turn, this could lead to increased reuse of smartphones in a secondary market alongside new ones to meet consumer demand. The refurbishment of smartphone devices is a growing industry heavily dependent on manual labor, making decisions subjective, especially in grading the severity of damage. A critical analysis of defect detection and smartphone grading from a remanufacturing perspective is conducted. This analysis is significant in a remanufacturing sector that deals with dynamically varying input of cores (used products for remanufacturing), characteristics, timing, and number of returns. The solution we propose here is novel in its own right, requiring data analysis and collection, data curing, defect parameterization, and dataset building to enable model-based training and detection experiments. We collected and annotated a dataset to detect and grade the various defects based on their severity. A range of deep learning models was trained on the dataset to obtain baseline results for the state-of-the-art deep learning detection models, including YOLOv7, YOLOv8, YOLO11 variants, and Mask R-CNN. Our experiments also showed improved precision values when the pre-trained models were pre-fine-tuned using a road crack segmentation dataset before training on our phone defect dataset. The inference time for the YOLOv8x model is 8ms. This reduced inference time with a high precision of 70.4% indicates that a consistent, fast, and accurate grading is achieved here, ensuring a high throughput rate in the remanufacturing process and ensuring sustainability.