A Thorough Review of Vehicle Detection and Distance Estimation Using Deep Learning in Autonomous Cars

Muhammad Rahmat - Hasanuddin University, Makassar, 92119, Indonesia
Indrabayu Indrabayu - Hasanuddin University, Makassar, 92119, Indonesia
Andani Achmad - Hasanuddin University, Makassar, 92119, Indonesia
Andi Salam - Hasanuddin University, Makassar, 92119, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.62527/joiv.8.4.2665

Abstract


Autonomous vehicle technologies are rapidly advancing, and one key factor contributing to this progress is the enhanced precision in vehicle detection and distance calculation. Deep Learning Networks (DLNs) have emerged as powerful tools to address this challenge, offering remarkable capabilities in accurately detecting and estimating vehicle positions. This study comprehensively reviews DLN applications for vehicle detection and distance estimation. It examines prominent DLN models such as YOLO, R-CNN, and SSD, evaluating their performance on widely used datasets such as KITTI, PASCAL VOC, and COCO. Analysis results indicate that YOLOv5, developed by Farid et al. achieves the highest accuracy level with a mAP (mean Average Precision) of 99.92%. Yang et al. showcased that YOLOv5 performs exceptionally in detection and distance estimation tasks, with a mAP of 96.4% and a low mean relative error (MRE) of 10.81% for distance estimation. These achievements highlight the potential of DLNs to enhance the accuracy and reliability of vehicle detection systems in autonomous vehicles. The study also emphasizes the importance of backbone architectures like DarkNet 53 and ResNet in determining model efficiency. The choice of the appropriate model depends on the specific task requirements, with some models prioritizing real-time detection and others prioritizing accuracy. In conclusion, developing DLN-based methods is crucial in advancing autonomous vehicle technology. Research and development remain crucial in ensuring road safety and efficiency as autonomous vehicles become more common in transportation systems.


Keywords


Autonomous Cars; Deep Learning; Vehicle Detection; Distance Estimation; PRISMA

Full Text:

PDF

References


M. A. Rahmat, Indrabayu, A. Achmad, E. U. Salam, and M. F. B. Bahrunnida, “Stereo Camera Calibration for Autonomous Car Applications,” in 2022 2nd International Seminar on Machine Learning, Optimization, and Data Science (ISMODE), Jakarta, Indonesia: IEEE, Dec. 2022, pp. 567–572. doi: 10.1109/ISMODE56940.2022.10180933.

Q. Ajao, O. Oludamilare, and M. H. Prio, “Safety Challenges and Analysis of Autonomous Electric Vehicle Development: Insights from On-Road Testing and Accident Reports,” SSRN Journal, 2023, doi: 10.2139/ssrn.4454486.

M. R. Bachute and J. M. Subhedar, “Autonomous Driving Architectures: Insights of Machine Learning and Deep Learning Algorithms,” Machine Learning with Applications, vol. 6, p. 100164, Dec. 2021, doi: 10.1016/j.mlwa.2021.100164.

N. Ali̇Yev, M. T. Güzel, and O. Sezer, “Realization of the Autonomous Driving System on the Experimental Vehicle,” Academic Platform Journal of Engineering and Smart Systems, vol. 10, no. 1, pp. 48–56, Jan. 2022, doi: 10.21541/apjess.1060763.

M. Sadaf et al., “Connected and Automated Vehicles: Infrastructure, Applications, Security, Critical Challenges, and Future Aspects,” Technologies, vol. 11, no. 5, p. 117, Sep. 2023, doi: 10.3390/technologies11050117.

A. Gupta, A. Anpalagan, L. Guan, and A. S. Khwaja, “Deep learning for object detection and scene perception in self-driving cars: Survey, challenges, and open issues,” Array, vol. 10, p. 100057, Jul. 2021, doi: 10.1016/j.array.2021.100057.

Z. Zou, K. Chen, Z. Shi, Y. Guo, and J. Ye, “Object Detection in 20 Years: A Survey.” arXiv, Jan. 18, 2023. Accessed: May 03, 2024. [Online]. Available: http://arxiv.org/abs/1905.05055

X. Jia, Y. Tong, H. Qiao, M. Li, J. Tong, and B. Liang, “Fast and accurate object detector for autonomous driving based on improved YOLOv5,” Sci Rep, vol. 13, no. 1, p. 9711, Jun. 2023, doi: 10.1038/s41598-023-36868-w.

B. Neupane, T. Horanont, and J. Aryal, “Real-Time Vehicle Classification and Tracking Using a Transfer Learning-Improved Deep Learning Network,” Sensors, vol. 22, no. 10, p. 3813, May 2022, doi: 10.3390/s22103813.

S. Nazir and M. Kaleem, “Federated Learning for Medical Image Analysis with Deep Neural Networks,” Diagnostics, vol. 13, no. 9, p. 1532, Apr. 2023, doi: 10.3390/diagnostics13091532.

K. Choi, S. M. Wi, H. G. Jung, and J. K. Suhr, “Simplification of Deep Neural Network-Based Object Detector for Real-Time Edge Computing,” Sensors, vol. 23, no. 7, p. 3777, Apr. 2023, doi: 10.3390/s23073777.

M. A. Berwo et al., “Deep Learning Techniques for Vehicle Detection and Classification from Images/Videos: A Survey,” Sensors, vol. 23, no. 10, p. 4832, May 2023, doi: 10.3390/s23104832.

N. Tao, J. Xiangkun, D. Xiaodong, S. Jinmiao, and L. Ranran, “Vehicle detection method with low-carbon technology in haze weather based on deep neural network,” International Journal of Low-Carbon Technologies, vol. 17, pp. 1151–1157, Feb. 2022, doi: 10.1093/ijlct/ctac084.

M. Baczmanski, R. Synoczek, M. Wasala, and T. Kryjak, “Detection-segmentation convolutional neural network for autonomous vehicle perception,” in 2023 27th International Conference on Methods and Models in Automation and Robotics (MMAR), Aug. 2023, pp. 117–122. doi: 10.1109/MMAR58394.2023.10242398.

L. Alzubaidi et al., “Review of deep learning: concepts, CNN architectures, challenges, applications, future directions,” J Big Data, vol. 8, no. 1, p. 53, Mar. 2021, doi: 10.1186/s40537-021-00444-8.

M. Vajgl, P. Hurtik, and T. Nejezchleba, “Dist-YOLO: Fast Object Detection with Distance Estimation,” Applied Sciences, vol. 12, no. 3, p. 1354, Jan. 2022, doi: 10.3390/app12031354.

C. Neupane, A. Koirala, Z. Wang, and K. B. Walsh, “Evaluation of Depth Cameras for Use in Fruit Localization and Sizing: Finding a Successor to Kinect v2,” Agronomy, vol. 11, no. 9, p. 1780, Sep. 2021, doi: 10.3390/agronomy11091780.

L. Chen et al., “Deep Neural Network Based Vehicle and Pedestrian Detection for Autonomous Driving: A Survey,” IEEE Trans. Intell. Transport. Syst., vol. 22, no. 6, pp. 3234–3246, Jun. 2021, doi: 10.1109/TITS.2020.2993926.

A. Masoumian, D. G. F. Marei, S. Abdulwahab, J. Cristiano, D. Puig, and H. A. Rashwan, “Absolute Distance Prediction Based on Deep Learning Object Detection and Monocular Depth Estimation Models,” in Frontiers in Artificial Intelligence and Applications, M. Villaret, T. Alsinet, C. Fernández, and A. Valls, Eds., IOS Press, 2021. doi: 10.3233/FAIA210151.

M. Kalia, P. Mathur, N. Navab, and S. E. Salcudean, “Marker‐less real‐time intra‐operative camera and hand‐eye calibration procedure for surgical augmented reality,” Healthcare Technology Letters, vol. 6, no. 6, pp. 255–260, Dec. 2019, doi: 10.1049/htl.2019.0094.

B. Hammoud, G. Daou, and N. Wehn, “Multidimensional Minimum Euclidean Distance Approach Using Radar Reflectivities for Oil Slick Thickness Estimation,” Sensors, vol. 22, no. 4, p. 1431, Feb. 2022, doi: 10.3390/s22041431.

S. Arabi, A. Sharma, M. Reyes, C. Hamann, and C. Peek-Asa, “Farm Vehicle Following Distance Estimation Using Deep Learning and Monocular Camera Images,” Sensors, vol. 22, no. 7, p. 2736, Apr. 2022, doi: 10.3390/s22072736.

Annamalai University, Chidambaram, India, N. Nanthini, N. Puviarasan, and P. Aruna, “An Efficient Velocity Estimation Approach for Face Liveness Detection using Sparse Optical Flow Technique,” IJST, vol. 14, no. 25, pp. 2128–2136, Jul. 2021, doi: 10.17485/IJST/v14i25.942.

J. B. Kim, “Efficient Vehicle Detection and Distance Estimation Based on Aggregated Channel Features and Inverse Perspective Mapping from a Single Camera,” Symmetry, vol. 11, no. 10, p. 1205, Sep. 2019, doi: 10.3390/sym11101205.

A. Ortiz, E. Ortiz, J. J. Miñana, and Ó. Valero, “On the Use of Fuzzy Metrics for Robust Model Estimation: A RANSAC-Based Approach,” in Advances in Computational Intelligence, vol. 12861, I. Rojas, G. Joya, and A. Català, Eds., in Lecture Notes in Computer Science, vol. 12861. , Cham: Springer International Publishing, 2021, pp. 165–177. doi: 10.1007/978-3-030-85030-2_14.

T.-N. L. Ting-Na Liu, Z.-J. Z. Ting-Na Liu, Y.-Q. B. Zhong-Jie Zhu, G.-L. L. Yong-Qiang Bai, and Y.-X. C. Guang-Long Liao, “YOLO-Based Efficient Vehicle Object Detection,” Journal of Compurters, vol. 33, no. 4, pp. 069–079, Aug. 2022, doi: 10.53106/199115992022083304006.

Y. Wang et al., “VV-YOLO: A Vehicle View Object Detection Model Based on Improved YOLOv4,” Sensors, vol. 23, no. 7, p. 3385, Mar. 2023, doi: 10.3390/s23073385.

Ma, Q., Jiang, G., Lai, D., & Song, H. (2020).“Fast, Accurate Vehicle Detection and Distance Estimation,” KSII TIIS, vol. 14, no. 2, Feb. 2020, doi: 10.3837/tiis.2020.02.008.

L. Huang, T. Zhe, J. Wu, Q. Wu, C. Pei, and D. Chen, “Robust Inter-Vehicle Distance Estimation Method Based on Monocular Vision,” IEEE Access, vol. 7, pp. 46059–46070, 2019, doi: 10.1109/ACCESS.2019.2907984.

M. Ding, Z. Zhang, X. Jiang, and Y. Cao, “Vision-Based Distance Measurement in Advanced Driving Assistance Systems,” Applied Sciences, vol. 10, no. 20, p. 7276, Oct. 2020, doi: 10.3390/app10207276.

F. Zhang, Y. Jin, S. Kan, L. Zhang, Y. Cen, and W. Jin, “Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD:,” IJCIS, vol. 14, no. 1, p. 1426, 2021, doi: 10.2991/ijcis.d.210419.001.

A. A. Adz-Dzikri, A. Virgono, and F. M. Dirgantara, “Advance Driving Assistance Systems: Object Detection and Distance Estimation Using Deep Learning,” in 2021 8th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), Semarang, Indonesia: IEEE, Oct. 2021, pp. 381–386. doi: 10.23919/EECSI53397.2021.9624218.

A. S. Pranathi, C. S. Yadav, C. Rakshitha, and M. M. S. Kumar, “Detecting Objects and Estimating Distance using YOLO,” Industrial Engineering Journal, no. 6, 2023.

X. Liu and W. Q. Yan, “Vehicle-Related Distance Estimation Using Customized YOLOv7,” in Image and Vision Computing, vol. 13836, W. Q. Yan, M. Nguyen, and M. Stommel, Eds., in Lecture Notes in Computer Science, vol. 13836. , Cham: Springer Nature Switzerland, 2023, pp. 91–103. doi: 10.1007/978-3-031-25825-1_7.

O. Bourja, H. Derrouz, H. A. Abdelali, A. Maach, R. O. H. Thami, and F. Bourzeix, “Real Time Vehicle Detection, Tracking, and Inter-vehicle Distance Estimation based on Stereovision and Deep Learning using YOLOv3,” IJACSA, vol. 12, no. 8, 2021, doi: 10.14569/IJACSA.2021.01208101.

J. E. Espinosa, S. A. Velastin, and J. W. Branch, “Vehicle Detection Using Alex Net and Faster R-CNN Deep Learning Models: A Comparative Study,” in Advances in Visual Informatics, vol. 10645, H. Badioze Zaman, P. Robinson, A. F. Smeaton, T. K. Shih, S. Velastin, T. Terutoshi, A. Jaafar, and N. Mohamad Ali, Eds., in Lecture Notes in Computer Science, vol. 10645. , Cham: Springer International Publishing, 2017, pp. 3–15. doi: 10.1007/978-3-319-70010-6_1.

C. A and D. M, “Headlight Control Using Deep Learning-Based Vehicle Detection,” IJRASET, vol. 10, no. 12, pp. 1819–1823, Dec. 2022, doi: 10.22214/ijraset.2022.48323.

Y. Chen and Z. Li, “An Effective Approach of Vehicle Detection Using Deep Learning,” Computational Intelligence and Neuroscience, vol. 2022, pp. 1–9, Jul. 2022, doi: 10.1155/2022/2019257.

R. Yang, S. Yu, Q. Yao, J. Huang, and F. Ya, “Vehicle Distance Measurement Method of Two-Way Two-Lane Roads Based on Monocular Vision,” Applied Sciences, vol. 13, no. 6, p. 3468, Mar. 2023, doi: 10.3390/app13063468.

M. F. Afshar, Z. Shirmohammadi, S. A. A. G. Ghahramani, A. Noorparvar, and A. M. A. Hemmatyar, “An Efficient Approach to Monocular Depth Estimation for Autonomous Vehicle Perception Systems,” Sustainability, vol. 15, no. 11, p. 8897, May 2023, doi: 10.3390/su15118897.

A. Abdullah and J. Oothariasamy, “Vehicle Counting using Deep Learning Models: A Comparative Study,” IJACSA, vol. 11, no. 7, 2020, doi: 10.14569/IJACSA.2020.0110784.

A. Farid, F. Hussain, K. Khan, M. Shahzad, U. Khan, and Z. Mahmood, “A Fast and Accurate Real-Time Vehicle Detection Method Using Deep Learning for Unconstrained Environments,” Applied Sciences, vol. 13, no. 5, p. 3059, Feb. 2023, doi: 10.3390/app13053059.

H. Nguyen, “Improving Faster R-CNN Framework for Fast Vehicle Detection,” Mathematical Problems in Engineering, vol. 2019, pp. 1–11, Nov. 2019, doi: 10.1155/2019/3808064.

A. Trifu, E. Smîdu, D. O. Badea, E. Bulboacă, and V. Haralambie, “Applying the PRISMA method for obtaining systematic reviews of occupational safety issues in literature search,” MATEC Web Conf., vol. 354, p. 00052, 2022, doi: 10.1051/matecconf/202235400052.

J. Giovannoli, D. Martella, F. Federico, S. Pirchio, and M. Casagrande, “The Impact of Bilingualism on Executive Functions in Children and Adolescents: A Systematic Review Based on the PRISMA Method,” Front. Psychol., vol. 11, p. 574789, Oct. 2020, doi: 10.3389/fpsyg.2020.574789.

B. Peixoto, R. Pinto, M. Melo, L. Cabral, and M. Bessa, “Immersive Virtual Reality for Foreign Language Education: A PRISMA Systematic Review,” IEEE Access, vol. 9, pp. 48952–48962, 2021, doi: 10.1109/ACCESS.2021.3068858.

L. Francés et al., “Current state of knowledge on the prevalence of neurodevelopmental disorders in childhood according to the DSM-5: a systematic review in accordance with the PRISMA criteria,” Child Adolesc Psychiatry Ment Health, vol. 16, no. 1, p. 27, Dec. 2022, doi: 10.1186/s13034-022-00462-1.

J. Tian, Q. Jin, Y. Wang, J. Yang, S. Zhang, and D. Sun, “Performance analysis of deep learning-based object detection algorithms on COCO benchmark: a comparative study,” J. Eng. Appl. Sci., vol. 71, no. 1, p. 76, Dec. 2024, doi: 10.1186/s44147-024-00411-z.

J. Wang, Y. Dong, S. Zhao, and Z. Zhang, “A High-Precision Vehicle Detection and Tracking Method Based on the Attention Mechanism,” Sensors, vol. 23, no. 2, p. 724, Jan. 2023, doi: 10.3390/s23020724.

G. Natanael, C. Zet, and C. Fosalau, “Estimating the distance to an object based on image processing,” in 2018 International Conference and Exposition on Electrical And Power Engineering (EPE), Iasi: IEEE, Oct. 2018, pp. 0211–0216. doi: 10.1109/ICEPE.2018.8559642.

J. Ciberlin, R. Grbic, N. Teslic, and M. Pilipovic, “Object detection and object tracking in front of the vehicle using front view camera,” in 2019 Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia: IEEE, May 2019, pp. 27–32. doi: 10.1109/ZINC.2019.8769367.

“Deep Learning Based Vehicle Speed Estimation on Highways,” JST: SSAD, vol. 33, no. 1, pp. 43–53, Jan. 2023, doi: 10.51316/jst.163.ssad.2023.33.1.6.

H. Rodríguez-Rangel, L. A. Morales-Rosales, R. Imperial-Rojo, M. A. Roman-Garay, G. E. Peralta-Peñuñuri, and M. Lobato-Báez, “Analysis of Statistical and Artificial Intelligence Algorithms for Real-Time Speed Estimation Based on Vehicle Detection with YOLO,” Applied Sciences, vol. 12, no. 6, p. 2907, Mar. 2022, doi: 10.3390/app12062907.

D. Qiao and F. Zulkernine, “Vision-based Vehicle Detection and Distance Estimation,” in 2020 IEEE Symposium Series on Computational Intelligence (SSCI), Canberra, ACT, Australia: IEEE, Dec. 2020, pp. 2836–2842. doi: 10.1109/SSCI47803.2020.9308364.

Z. Chen, R. Khemmar, B. Decoux, A. Atahouet, and J.-Y. Ertaud, “Real Time Object Detection, Tracking, and Distance and Motion Estimation based on Deep Learning: Application to Smart Mobility,” in 2019 Eighth International Conference on Emerging Security Technologies (EST), Colchester, United Kingdom: IEEE, Jul. 2019, pp. 1–6. doi: 10.1109/EST.2019.8806222.

I. - et al., “A Solution for Automatic Counting and Differentiate Motorcycles and Modified Motorcycles in Remote Area,” IJACSA, vol. 13, no. 2, 2022, doi: 10.14569/IJACSA.2022.0130217.

H. Song, H. Liang, H. Li, Z. Dai, and X. Yun, “Vision-based vehicle detection and counting system using deep learning in highway scenes,” Eur. Transp. Res. Rev., vol. 11, no. 1, p. 51, Dec. 2019, doi: 10.1186/s12544-019-0390-4.

I. Azurmendi, E. Zulueta, J. M. Lopez-Guede, and M. González, “Simultaneous Object Detection and Distance Estimation for Indoor Autonomous Vehicles,” Electronics, vol. 12, no. 23, p. 4719, Nov. 2023, doi: 10.3390/electronics12234719.

H. Wang, Yi. Yu, Y. Cai, X. Chen, L. Chen, and Q. Liu, “A Comparative Study of State-of-the-Art Deep Learning Algorithms for Vehicle Detection,” IEEE Intell. Transport. Syst. Mag., vol. 11, no. 2, pp. 82–95, 2019, doi: 10.1109/MITS.2019.2903518.

S. Cepni, M. E. Atik, and Z. Duran, “Vehicle Detection Using Different Deep Learning Algorithms from Image Sequence,” BJMC, vol. 8, no. 2, 2020, doi: 10.22364/bjmc.2020.8.2.10.

K.-H. Chen, T. D. Shou, J. K.-H. Li, and C.-M. Tsai, “Vehicles Detection On Expressway Via Deep Learning: Single Shot Multibox Object Detector,” in 2018 International Conference on Machine Learning and Cybernetics (ICMLC), Chengdu: IEEE, Jul. 2018, pp. 467–473. doi: 10.1109/ICMLC.2018.8526958.

B. Strbac, M. Gostovic, Z. Lukac, and D. Samardzija, “YOLO Multi-Camera Object Detection and Distance Estimation,” in 2020 Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia: IEEE, May 2020, pp. 26–30. doi: 10.1109/ZINC50678.2020.9161805.

C. Shen, X. Zhao, Z. Liu, T. Gao, and J. Xu, “Joint vehicle detection and distance prediction via monocular depth estimation,” IET Intelligent Transport Systems, vol. 14, no. 7, pp. 753–763, Jul. 2020, doi: 10.1049/iet-its.2019.0376.

I. M. Elzayat et al., “Real-Time Car Detection-Based Depth Estimation Using Mono Camera,” in 2018 30th International Conference on Microelectronics (ICM), Sousse, Tunisia: IEEE, Dec. 2018, pp. 248–251. doi: 10.1109/ICM.2018.8704024.

Rahul and B. B. Nair, “Camera-Based Object Detection, Identification and Distance Estimation,” in 2018 2nd International Conference on Micro-Electronics and Telecommunication Engineering (ICMETE), Ghaziabad, India: IEEE, Sep. 2018, pp. 203–205. doi: 10.1109/ICMETE.2018.00052.

T. Zhe, L. Huang, Q. Wu, J. Zhang, C. Pei, and L. Li, “Inter-Vehicle Distance Estimation Method Based on Monocular Vision Using 3D Detection,” IEEE Trans. Veh. Technol., vol. 69, no. 5, pp. 4907–4919, May 2020, doi: 10.1109/TVT.2020.2977623.

P. H. Quang, P. P. Thanh, T. N. V. Anh, S. V. Phi, B. L. Nhat, and H. N. Trong, “Vietnamese vehicles speed detection with video-based and deep learning for real-time traffic flow analysis system,” in 2021 15th International Conference on Advanced Computing and Applications (ACOMP), Ho Chi Minh City, Vietnam: IEEE, Nov. 2021, pp. 62–69. doi: 10.1109/ACOMP53746.2021.00015.

F. Xie et al., “Vehicle Segmentation with Coarse Distance Estimation Based on Monocular Vision,” in 2021 IEEE International Conference on e-Business Engineering (ICEBE), Guangzhou, China: IEEE, Nov. 2021, pp. 16–20. doi: 10.1109/ICEBE52470.2021.00019.

R. Kejriwal, R. H J, A. Arora, and Mohana, “Vehicle Detection and Counting using Deep Learning basedYOLO and Deep SORT Algorithm for Urban Traffic Management System,” in 2022 First International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT), Trichy, India: IEEE, Feb. 2022, pp. 1–6. doi: 10.1109/ICEEICT53079.2022.9768653.

Y. Liu, H. Huang, J. Guo, R. Yuan, M. Xia, and Y. Chen, “Research on Target Distance Detection Technology of Vehicle Assisted driving Based on monocular Vision,” in 2021 11th International Conference on Information Technology in Medicine and Education (ITME), Wuyishan, Fujian, China: IEEE, Nov. 2021, pp. 17–20. doi: 10.1109/ITME53901.2021.00014.