Optimization of Vehicle Object Detection Based on UAV Dataset: CNN Model and Darknet Algorithm

Abdul Rangkuti - Bina Nusantara University, Jakarta, Indonesia
Varyl Athala - Bina Nusantara University, Jakarta, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.30630/joiv.7.1.1159

Abstract


This study was conducted to identify several types of vehicles taken using drone technology or Unmanned Aerial Vehicles (UAV). The introduction of vehicles from above an altitude of more than 300-400 meters that pass the highway above ground level becomes a problem that needs optimum investigation so that there are no errors in determining the type of vehicle. This study was conducted at mining sites to identify the class of vehicles that pass through the highway and how many types of vehicles pass through the road for vehicle recognition using a deep learning algorithm using several CNN models such as Yolo V4, Yolo V3, Densenet 201, CsResNext –Panet 50 and supported by the Darknet algorithm to support the training process. In this study, several experiments were carried out with other CNN models, but with peripherals and hardware devices, only 4 CNN models resulted in optimal accuracy. Based on the experimental results, the CSResNext-Panet 50 model has the highest accuracy and can detect 100% of the captured UAV video data, including the number of detected vehicle volumes, then Densenet and Yolo V4, which can detect up to 98% - 99%. This research needs to continue to be developed by knowing all classes affordable by UAV technology but must be supported by hardware and peripheral technology to support the training process.


Keywords


UAV; Vehicle; CNN Model; CsresNext-Panet50; Densenet201; Yolo V3; Yolo V4

Full Text:

PDF

References


Mittal, P., Sharma, A., & Singh, R. (2020). Deep learning-based object detection in low-altitude UAV datasets: A survey. Image and Vision Computing, 104046. https://doi.org/10.1016/j.imavis.2020.104046

Madawalagama, S. L., N. Munasinghe, S. D. P. J. Dampegama, and L. Samarakoon. 2016. Low Cost Aerial Mapping With Consumer-Grade Drones.

Martin, C., Parkes, S., Zhang, Q., Zhang, X., McCabe, M. F., & Duarte, C. M. (2018). Use of unmanned aerial vehicles for efficient beach litter monitoring. Marine Pollution Bulletin, 131, 662–673. doi:10.1016/j.marpolbul.2018.04.045.

Konoplich, G. V., Putin, E. O., & Filchenkov, A. A. (2016). Application of deep learning to the problem of vehicle detection in UAV images. Proceedings of the 19th International Conference on Soft Computing and Measurements, SCM 2016, 4–6. https://doi.org/10.1109/SCM.2016.7519666

I. Colomina, P. Molina, Unmanned aerial systems for photogrammetry and remote sensing: a review, ISPRS J. Photogramm. Remote Sens. 92 (2014) 79–97.

Udin, W. S., dan A. Ahmad. 2014. Assessment of Photogrammetric Mapping Accuracy Based on Variation Flying Altitude Using Unmanned Aerial Vehicle. IOP Conference Series: Earth and Environmental Science. 18: 12027.

Brian Dipert, Vision Processing Opportunities in Drones, [Online] Available: https://www.embedded-vision.com/platinum-members/embedded-vision-alliance/embedded-visiiontraining/documents/pages/drones 2017 (Accessed: 24- Jan-2019).

A.R. Pathak, M. Pandey, S. Rautaray, Application of deep learning for object detection, Procedia Comput. Sci. 132 (2018) 1706–

K. Mok, Deep Learning Drone Detects Fights, Bombs, Shootings in Crowds, [Online]. Available: https://thenewstack.io/deep-learning-drone-detects-fights-bombsshootings-in-crowds/ (Accessed: 13-Jan-2019).

Detection and Counting of Arabian Oryx from Aerial Image, [Online]. Available: https://blogs.flytbase.com/ai-drones/ (Accessed: 18-Sep-2018).

R. O. Prakash and C. Saravanan, “Autonomous robust helipad detection algorithm using computer vision,†Int. Conf. Electr. Electron. Optim. Tech. ICEEOT 2016, pp. 2599–2604, 2016

M. Tzelepi, A. Tefas, Human crowd detection for drone flight safety using convolutional neural networks, Signal Processing Conference (EUSIPCO), 2017 25th European 2017, pp. 743–747.

Arezoo Nazerdeylami, Babak Majidi, Ali Movaghar.(2021).Autonomous litter surveying and human activity monitoring for governance intelligence in coastal eco-cyber-physical systems,Ocean & Coastal Management, Volume 200, 105478,ISSN 0964-5691. doi:10.1016/j.ocecoaman.2020.105478.

Pathak, A. R., Pandey, M., & Rautaray, S. (2018). Application of Deep Learning for Object Detection. Procedia Computer Science, 132(Iccids), 1706-1717. https://doi.org/10.1016/j.procs.2018.05.144

Wahyudin, A., & Husin, Z. (2020). Sistem Deteksi Objek Helipad Pada Pergerakan Autonomous Fixed Wing Drone Berbasis Algoritma Yolo (Doctoral dissertation, Sriwijaya University).

Prasanta, M. R., Pranata, M. Y., Firnanda, M. A., & Sendari, S. (2022). Rancang Bangun Quadcopter Drone Untuk Deteksi Api Menggunakan YOLOv4. CYCLOTRON, 5(1).

Tian, Y., Wang, Y., Song, R., & Song, H. (2015, October). Accurate vehicle detection and counting algorithm for traffic data collection. In 2015 International Conference on Connected Vehicles and Expo (ICCVE) (pp. 285-290). IEEE.

S. Rathinam, et al., Autonomous searching and tracking of a river using an UAV, 2007 American Control Conference 2007, pp. 359–364.

P.-M. Olsson, J. Kvarnström, P. Doherty, O. Burdakov, K. Holmberg, Generating UAV communication networks for monitoring and surveillance, 2010 11th International Conference on Control Automation Robotics & Vision 2010, pp. 1070–1077.

S.M. Adams, C.J. Friedland, A survey of unmanned aerial vehicle (UAV) usage for imagery collection in disaster research and management, 9th International Workshop on Remote Sensing for Disaster Response, 8, , 2011.

E.A. George, G. Tiwari, R.N. Yadav, E. Peters, S. Sadana, UAV systems for parameter identification in agriculture, 2013 IEEE Global Humanitarian Technology Conference: South Asia Satellite (GHTC-SAS) 2013, pp. 270–273.

B. Xu, X. Xu, C.-M. Own, On the feature detection of nonconforming objects with automated drone surveillance, Proceedings of the 3rd International Conference on Communication and Information Processing 2017, pp. 484–489.

S. Campbell, W. Naeem, G.W. Irwin, A review on improving the autonomy of unmanned surface vehicles through intelligent collision avoidance manoeuvres, Annu. Rev. Control. 36 (2) (2012) 267–283.

J. Zhou, C.-M. Vong, Q. Liu, Z. Wang, Scale adaptive image cropping for UAV object detection, Neurocomputing 366 (2019) 305–313.

P. Zhu, L. Wen, X. Bian, L. Haibin, Q. Hu, Vision meets drones: a challenge, arXiv Prepr. arXiv1804.07437 (2018) 1–11.

S. Sun, C. Salvaggio, Aerial 3D building detection and modeling from airborne LiDAR point clouds, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 6 (3) (2013) 1440–1449.

Z. Li, W. Shi, P. Lu, L. Yan, Q. Wang, Z. Miao, Landslide mapping from aerial photographs using change detection-based Markov random field, Remote Sens. Environ. 187 (2016) 76–90

Esri, “How the Compute Accuracy For Object Detection tool works,†ArcGIS Pro, Esri. 2020, [Online]. Available: https://pro.arcgis.com/en/pro-app/latest/tool-reference/image-analyst/how-compute-accuracy-for-object-detection-works.htm.

A. F. Gad, “Accuracy, Precision, and Recall in Deep Learning.†2020, [Online]. Available: https://blog.paperspace.com/deep-learning-metrics-precision-recall-accuracy/.