Traffic Violation Detection Using Computer Vision Techniques

Chin Sin Ong - Multimedia University, Jalan Ayer Keroh Lama, Melaka, 75450, Malaysia
Tee Connie - Multimedia University, Jalan Ayer Keroh Lama, Melaka, 75450, Malaysia
Michael Kah Ong Goh - Multimedia University, Jalan Ayer Keroh Lama, Melaka, 75450, Malaysia


Citation Format:



DOI: http://dx.doi.org/10.62527/joiv.8.3-2.2941

Abstract


The increasing number of road accidents is still a global concern.  Traditional approaches to detecting traffic violators on the road, such as radar guns and sensors, are expensive and time-consuming to maintain and install. This often results in inefficient and ineffective detection of traffic violators. This paper proposes a more cost-effective and efficient approach to traffic violation detection utilizing visual data from CCTV footage. Specifically, the method targets two common violations: crossing red lights and overtaking on double lines. In this study, YOLO is integrated for road object detection, providing the detection of vehicles and traffic lights on the road for our system. Then, the Deep SORT tracker tracks detected vehicles, ensuring continuous monitoring over time. An automated lane detection technique is formulated to identify the stopping line/lane for red light violation detection, enabling precise detection of vehicles that cross the stop lane during red light. For overtaking detection, the system detects the double line to serve as the boundary that vehicles should not cross, identifying illegal overtaking. Furthermore, point-line distance calculation is utilized to detect traffic violators by analyzing their tracked trajectories and positions. The proposed solution is evaluated using real-world CCTV footage from online repositories to reflect the real-world scenarios as closely as possible. Experimental results show that the proposed techniques achieve promising detection of real-time traffic violators, which leads to a safer environment for road users.


Keywords


Traffic violation detection; computer vision; YOLO; lane detection; state recognition; point-line distance

Full Text:

PDF

References


B. Mohamad, “Statistics on Causes of Death, Malaysia, 2023,” Ministry of Economy Department of Statistics Malaysia.

S. K. Ahmed et al., “Road traffic accidental injuries and deaths: A neglected global health issue,” Health Science Reports, vol. 6, no. 5, May 2023, doi: 10.1002/hsr2.1240.

Y. Ren, “Intelligent Vehicle Violation Detection System Under Human–Computer Interaction and Computer Vision,” International Journal of Computational Intelligence Systems, vol. 17, no. 1, Feb. 2024, doi: 10.1007/s44196-024-00427-6.

D. Zaheri and M. Abbas, “An Algorithm for Identifying Red Light Runners from Radar Trajectory Data,” 2015 IEEE 18th International Conference on Intelligent Transportation Systems, vol. 34, pp. 2683–2687, Sep. 2015, doi: 10.1109/itsc.2015.431.

A. Jahangiri, H. A. Rakha, and T. A. Dingus, “Adopting Machine Learning Methods to Predict Red-light Running Violations,” 2015 IEEE 18th International Conference on Intelligent Transportation Systems, vol. 2, pp. 650–655, Sep. 2015, doi: 10.1109/itsc.2015.112.

A Alaydrus, W K Putra, Y Nugroho, Muhammad, and N Surantha, “A review of traffic violation detection technology in reporting mechanism,” IOP Conf Ser Earth Environ Sci, vol. 729, no. 1, pp. 1–7, Apr. 2021, doi: 10.1088/1755-1315/729/1/012005.

S. S. Wankhede and P. Bajaj, “Traffic Violation Detection Model Using Soft Computing Tools,” 2021 6th International Conference for Convergence in Technology (I2CT), pp. 1–5, Apr. 2021, doi:10.1109/i2ct51068.2021.9417887.

R. Ravish, S. Rangaswamy, and K. Char, “Intelligent Traffic Violation Detection,” 2021 2nd Global Conference for Advancement in Technology (GCAT), pp. 1–7, Oct. 2021, doi:10.1109/gcat52182.2021.9587520.

N. C. Mallela, R. Volety, S. P. R., and N. R. K., “Detection of the triple riding and speed violation on two-wheelers using deep learning algorithms,” Multimedia Tools and Applications, vol. 80, no. 6, pp. 8175–8187, Oct. 2020, doi: 10.1007/s11042-020-10126-x.

K. Klubsuwan, W. Koodtalang, and S. Mungsing, “Traffic Violation Detection Using Multiple Trajectories Evaluation of Vehicles,” 2013 4th International Conference on Intelligent Systems, Modelling and Simulation, Jan. 2013, doi: 10.1109/isms.2013.143.

M. M. Bachtiar, A. Rahman Mawardi, and A. R. Anom Besari, “Vehicle Classification and Violation Detection on Traffic Light Area using BLOB and Mean-Shift Tracking Method,” 2020 International Conference on Applied Science and Technology (iCAST), pp. 94–98, Oct. 2020, doi:10.1109/icast51016.2020.9557628.

A. T. Bhat, Anupama, Akshatha, M. S. Rao, and D. G. Pai, “Traffic violation detection in India using genetic algorithm,” Global Transitions Proceedings, vol. 2, no. 2, pp. 309–314, Nov. 2021, doi:10.1016/j.gltp.2021.08.056.

J. C. de Goma, R. J. Bautista, M. A. J. Eviota, and V. P. Lopena, “Detecting Red-Light Runners (RLR) and Speeding Violation through Video Capture,” 2020 IEEE 7th International Conference on Industrial Engineering and Applications (ICIEA), pp. 774–778, Apr. 2020, doi: 10.1109/iciea49774.2020.9102059.

P.Srinivas Reddy, T. Nishwa, R. Shiva Kiran Reddy, Ch Sadviq, and K. Rithvik, “Traffic Rules Violation Detection using Machine Learning Techniques,” 2021 6th International Conference on Communication and Electronics Systems (ICCES), pp. 1264–1268, Aug. 2021.

I. Bozcan and E. Kayacan, “Context-Dependent Anomaly Detection for Low Altitude Traffic Surveillance,” 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 224–230, May 2021, doi: 10.1109/icra48506.2021.9562043.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779–788, Jun. 2016, doi: 10.1109/cvpr.2016.91.

N. Wojke, A. Bewley, and D. Paulus, “Simple online and realtime tracking with a deep association metric,” 2017 IEEE International Conference on Image Processing (ICIP), Sep. 2017, doi:10.1109/icip.2017.8296962.

S. Srivastava and S. Gupta, “Path Detection for Self-Driving Carts by using Canny Edge Detection Algorithm,” 2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), pp. 1–5, Sep. 2021, doi:10.1109/icrito51393.2021.9596109.

K. Zhao, Q. Han, C.-B. Zhang, J. Xu, and M.-M. Cheng, “Deep Hough Transform for Semantic Line Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1–1, 2021, doi:10.1109/tpami.2021.3077129..

D. Bhatt et al., “CNN Variants for Computer Vision: History, Architecture, Application, Challenges and Future Scope,” Electronics, vol. 10, no. 20, p. 2470, Oct. 2021, doi: 10.3390/electronics10202470.

T. Diwan, G. Anirudh, and J. V. Tembhurne, “Object detection using YOLO: challenges, architectural successors, datasets and applications,” Multimedia Tools and Applications, vol. 82, no. 6, pp. 9243–9275, Aug. 2022, doi: 10.1007/s11042-022-13644-y.

C.-Y. Wang, A. Bochkovskiy, and H.-Y. M. Liao, “YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors,” 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7464–7475, Jun. 2023, doi:10.1109/cvpr52729.2023.00721.

D. Reis, J. Hong, J. Kupec, and A. Daoudi, “Real-Time Flying Object Detection with YOLOv8,” pp. 1–10, May 2024.

M. C. Raja, “Utilizing YOLO 8x Models, Deep Learning-Based Head protector Detection for Construction Workers,” Jun. 2023, doi:10.21203/rs.3.rs-3045767/v1.

J. Terven, D.-M. Córdova-Esparza, and J.-A. Romero-González, “A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS,” Machine Learning and Knowledge Extraction, vol. 5, no. 4, pp. 1680–1716, Nov. 2023, doi: 10.3390/make5040083.

M. Khodarahmi and V. Maihami, “A Review on Kalman Filter Models,” Archives of Computational Methods in Engineering (2023), vol. 30, pp. 727–747, Oct. 2022.

K. Du and A. Bobkov, “An Overview of Object Detection and Tracking Algorithms,” 15th International Conference “Intelligent Systems,” vol. 33, no. 1, pp. 1–6, Jun. 2023.

A. I. B. Parico and T. Ahamed, “Real Time Pear Fruit Detection and Counting Using YOLOv4 Models and Deep SORT,” Sensors, vol. 21, no. 14, p. 4803, Jul. 2021, doi: 10.3390/s21144803.

N. D. Lynn, A. I. Sourav, and A. J. Santoso, “Implementation of Real-Time Edge Detection Using Canny and Sobel Algorithms,” IOP Conf. Series: Materials Science and Engineering, vol. 1096, pp. 1–8, Mar. 2021.

Q. Huang and J. Liu, “Practical limitations of lane detection algorithm based on Hough transform in challenging scenarios,” Int J Adv Robot Syst, vol. 18, no. 2, pp. 1–13, Mar. 2021.

J. J. Ng, K. O. Michael Goh, and C. Tee, “Traffic Impact Assessment System using Yolov5 and ByteTrack”, J. Inform. Web Eng., vol. 2, no. 2, pp. 168–188, Sep. 2023.

M. S. Irsyad, Z. Che Embi, and K. I. B. Ghauth, “Assessing the Efficiency of Deep Learning Methods for Automated Vehicle Registration Recognition for University Entrance”, J. Inform. Web Eng., vol. 3, no. 2, pp. 57–69, Jun. 2024.

S. A. Lashari, M. M. Khan, A. Khan, S. Salahuddin, and M. N. . Ata, “Comparative Evaluation of Machine Learning Models for Mobile Phone Price Prediction: Assessing Accuracy, Robustness, and Generalization Performance”, J. Inform. Web Eng., vol. 3, no. 3, pp. 147–163, Oct. 2024.

S. T. Jimoh and S. S Al-Juboori, “Cyber-Securing Medical Devices Using Machine Learning: A Case Study of Pacemaker”, J. Inform. Web Eng., vol. 3, no. 3, pp. 271–289, Oct. 2024.