Deep Learning for Pothole Detection on Indonesian Roadways

Main Article Content

Hendra Kusumah
Mohamad Riski Nurholik
Catur Putri Riani
Ilham Riyan Nur Rahman

Abstract

Accidents are common on Indonesian roadways. Accidents are caused by vehicles, motorcycles, and public transportation. Road fatalities are caused by speeding, alcohol, distraction, fatigue, and poor road conditions. There are numerous car accidents on Indonesian roadways. 30% of Indonesian traffic incidents are explained by road infrastructure and environmental conditions, 61% by driver skill and personality, and 9% by vehicle variables such as vehicle standardization. Cars are damaged, immobilized, and crashed as a result of road conditions. Every hour, three people pass away in traffic in Indonesia, according to authorities. According to the BPS's 2021 Land Transportation Statistics report, 31.91 percent of Indonesia's roads were damaged, totaling 174,298 kilometers. Accidents among Indonesian motorists are becoming more common as roads deteriorate. Using a single camera, a deep learning algorithm can recognize and detect road degradation such as potholes and road cracks. Train and process the model using transfer learning and fine-tuning on the Nano YOLOv5 model architecture. After being validated in three major scenarios, the model performs well with the appropriate confidence level. The precision metric for the model is 0.8, while recall and mAP:0.5 are both 0.5.

Article Details

How to Cite
Kusumah, H., Nurholik, M. R., Riani, C. P., & Nur Rahman, I. R. (2023). Deep Learning for Pothole Detection on Indonesian Roadways. Journal Sensi: Strategic of Education in Information System, 9(2), 175-186. https://doi.org/10.33050/sensi.v9i2.2911
Section
Articles
Author Biographies

Hendra Kusumah, Universitas Raharja

Informatics Engineering Masters Program, Science and Technology Faculty

Mohamad Riski Nurholik, Universitas Raharja

Information Systems Bachelor Program, Science and Technology Faculty

Catur Putri Riani, Universitas Raharja

Information Systems Bachelor Program, Science and Technology Faculty

Ilham Riyan Nur Rahman, Universitas Raharja

Informatics Engineering Bachelor Program, Science and Technology Faculty

References

[1] “Angka Kecelakaan Lalu Lintas di Indonesia Meningkat di 2021, Tertinggi dari Kecelakaan Motor.” https://databoks.katadata.co.id/datapublish/2022/03/24/angka-kecelakaan-lalu-lintas-di-indonesia-meningkat-di-2021-tertinggi-dari-kecelakaan-motor (accessed May 26, 2023).
[2] H. Widyastuti and L. Adriana, “ANALYSIS OF MOTORCYCLE TRAFFIC ACCIDENT BASED ON THE RIDERS’ CHARACTERISTICS IN KUPANG, EAST NUSA TENGGARA,” Journal of Civil Engineering, vol. 37, no. 1, pp. 23–26, Jun. 2022, doi: 10.12962/J20861206.V37I1.12087.
[3] R. I. Idrus and Z. Khair, “ROAD USER AWARENESS AND ATTITUDE TO ROAD SAFETY IN INDONESIA 2000-2020,” Jurnal Kemanusiaan, vol. 19, no. 1, pp. 1–7, Jul. 2022, Accessed: May 26, 2023. [Online]. Available: https://jurnalkemanusiaan.utm.my/index.php/kemanusiaan/article/view/410
[4] K. Fahmi and M. Arifin, “Characteristics of Traffic Accidents Frequency on Connection Road Between 3 Cities in Riau - Indonesia,” Proceeding of International Conference on Science and Technology, pp. 73–77, Dec. 2022, doi: 10.36378/INTERNATIONALCONFERENCEUNIKS.V0I0.2828.
[5] F. Saffanah Didin, A. Widyanti, and H. Iridiastadi, “Exploring the Risk Factors for Rear-End Collisions on Indonesian Toll Roads”.
[6] A. A. Anisarida, W. Santosa, and C. Sutandi, “TRANSPORTATION BUSINESS AND ROAD SAFETY MANAGEMENT IN INDONESIA,” The Journal of Modern Project Management, vol. 10, no. 1, pp. 270–283, 2022, Accessed: May 26, 2023. [Online]. Available: https://journalmodernpm.com/manuscript/index.php/jmpm/article/view/555
[7] “31% Jalanan di Indonesia Rusak pada 2021.” https://databoks.katadata.co.id/datapublish/2023/04/17/31-jalanan-di-indonesia-rusak-pada-2021 (accessed May 26, 2023).
[8] “Accidents Caused By Poor Road Quality And Conditions In DC | Gilman & Bedigian.” https://www.gilmanbedigian.com/accidents-caused-by-poor-road-quality-and-conditions-in-dc/ (accessed May 26, 2023).
[9] “Kementerian Komunikasi dan Informatika.” https://www.kominfo.go.id/index.php/content/detail/10368/rata-rata-tiga-orang-meninggal-setiap-jam-akibat-kecelakaan-jalan/0/artikel_gpr (accessed May 26, 2023).
[10] “Kondisi Permukaan Jalan Nasional Tahun 2021 - Kondisi Permukaan Jalan Nasional | Open Data PUPR.” https://data.pu.go.id/dataset/kondisi-permukaan-jalan-nasional/resource/797a1ab8-1afb-483c-8ecc-b8eeab49e7a4#{view-graph:{graphOptions:{hooks:{processOffset:{},bindEvents:{}}}},graphOptions:{hooks:{processOffset:{},bindEvents:{}}}} (accessed May 26, 2023).
[11] “Situasi Jalan Protokol Di Kota Tangerang H-2 Lebaran 2023 - YouTube.” https://www.youtube.com/watch?v=zI6PaTfxN_0&t=14s (accessed May 26, 2023).
[12] “Jalan - Jalan Ke Perumnas Tangerang || Riding Perum Part 1 - YouTube.” https://www.youtube.com/watch?v=4F6j4riMvXA&t=238s (accessed May 26, 2023).
[13] “HATI-HATI‼️ Jalan rusak di Kabupaten sukabumi | motovlog cewek #femalerider #motovlog #jalanrusak - YouTube.” https://www.youtube.com/watch?v=OqT2IyeXjvU&t=296s (accessed May 26, 2023).
[14] “Motovlog melewati Jalan Raya Kali CBL Bekasi, Kondisi Rusak Parah..!! - YouTube.” https://www.youtube.com/watch?v=7T_k7IXRS90&t=41s (accessed May 26, 2023).
[15] “Roboflow: Give your software the power to see objects in images and video.” https://roboflow.com/ (accessed Jan. 15, 2023).
[16] “Pothole Motor Driving Object Detection Dataset by Muhammad Suzaki Zahran.” https://universe.roboflow.com/muhammad-suzaki-zahran/pothole-motor-driving (accessed May 26, 2023).
[17] S. Tufféry, “Deep Learning for Computer Vision,” Deep Learning, pp. 347–430, Dec. 2022, doi: 10.1002/9781119845041.CH8.
[18] D. Kesseli, V. Chidurala, R. Gooch, and G. Zhu, “A Combined Computer Vision and Deep Learning Approach for Rapid Drone-Based Optical Characterization of Parabolic Troughs,” Journal of Solar Energy Engineering, Transactions of the ASME, vol. 145, no. 2, Apr. 2023, doi: 10.1115/1.4055172/1145346.
[19] L. Li, X. Zhang, J. Lian, Y. Zhang, and Y. Zhao, “Study on Practical Utility of Image Dehazing Algorithms Based on Deep Learning in Computer Vision Scene Understanding,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13605 LNAI, pp. 601–612, 2022, doi: 10.1007/978-3-031-20500-2_49/COVER.
[20] S. Belharbi, I. Ben Ayed, L. McCaffrey, and E. Granger, “TCAM: Temporal Class Activation Maps for Object Localization in Weakly-Labeled Unconstrained Videos.” pp. 137–146, 2023. Accessed: May 26, 2023. [Online]. Available: https://github.com/sbelharbi/tcam-wsol-video.
[21] A. M. Roy, J. Bhaduri, T. Kumar, and K. Raj, “WilDect-YOLO: An efficient and robust computer vision-based accurate object localization model for automated endangered wildlife detection,” Ecol Inform, vol. 75, p. 101919, Jul. 2023, doi: 10.1016/J.ECOINF.2022.101919.
[22] B. Zhang, Z. Dong, J. Zhang, and H. Lin, “Functional network: A novel framework for interpretability of deep neural networks,” Neurocomputing, vol. 519, pp. 94–103, Jan. 2023, doi: 10.1016/J.NEUCOM.2022.11.035.
[23] N. Mamat, M. F. Othman, R. Abdulghafor, A. A. Alwan, and Y. Gulzar, “Enhancing Image Annotation Technique of Fruit Classification Using a Deep Learning Approach,” Sustainability 2023, Vol. 15, Page 901, vol. 15, no. 2, p. 901, Jan. 2023, doi: 10.3390/SU15020901.
[24] Q. Feng, K. He, H. Wen, C. Keskin, and Y. Ye, “Rethinking the Data Annotation Process for Multi-View 3D Pose Estimation With Active Learning and Self-Training.” pp. 5695–5704, 2023.
[25] H. J. Kim and M. K. Kim, “A novel deep learning-based forecasting model optimized by heuristic algorithm for energy management of microgrid,” Appl Energy, vol. 332, p. 120525, Feb. 2023, doi: 10.1016/J.APENERGY.2022.120525.
[26] R. Sadigov, E. Yıldırım, B. Kocaçınar, F. Patlar Akbulut, and C. Catal, “Deep learning-based user experience evaluation in distance learning,” Cluster Comput, pp. 1–13, Jan. 2023, doi: 10.1007/S10586-022-03918-3/TABLES/3.
[27] P. J. ; Sørensen et al., “Evaluation of the HD-GLIO Deep Learning Algorithm for Brain Tumour Segmentation on Postoperative MRI,” Diagnostics 2023, Vol. 13, Page 363, vol. 13, no. 3, p. 363, Jan. 2023, doi: 10.3390/DIAGNOSTICS13030363.
[28] S. Shukla, N. Badal, and B. K. Thakur, “Introduction to Deep Learning,” Sustainable Computing, pp. 253–267, 2023, doi: 10.1007/978-3-031-13577-4_15.
[29] N. Shlezinger, J. Whang, Y. C. Eldar, and A. G. Dimakis, “Model-Based Deep Learning,” Proceedings of the IEEE, 2023, doi: 10.1109/JPROC.2023.3247480.
[30] J. Xu, H. Ren, S. Cai, and X. Zhang, “An improved faster R-CNN algorithm for assisted detection of lung nodules,” Comput Biol Med, vol. 153, p. 106470, Feb. 2023, doi: 10.1016/J.COMPBIOMED.2022.106470.
[31] S. Fang, B. Zhang, and J. Hu, “Improved Mask R-CNN Multi-Target Detection and Segmentation for Autonomous Driving in Complex Scenes,” Sensors 2023, Vol. 23, Page 3853, vol. 23, no. 8, p. 3853, Apr. 2023, doi: 10.3390/S23083853.
[32] B. Mahaur and K. K. Mishra, “Small-object detection based on YOLOv5 in autonomous driving systems,” Pattern Recognit Lett, vol. 168, pp. 115–122, Apr. 2023, doi: 10.1016/J.PATREC.2023.03.009.
[33] J. Zhang, Z. Ti, X. Lei, R. Arifando, S. Eto, and C. Wada, “Improved YOLOv5-Based Lightweight Object Detection Algorithm for People with Visual Impairment to Detect Buses,” Applied Sciences 2023, Vol. 13, Page 5802, vol. 13, no. 9, p. 5802, May 2023, doi: 10.3390/APP13095802.
[34] R. Chen, J. Wu, Y. Peng, Z. Li, and H. Shang, “Solving floating pollution with deep learning: A novel SSD for floating objects based on continual unsupervised domain adaptation,” Eng Appl Artif Intell, vol. 120, p. 105857, Apr. 2023, doi: 10.1016/J.ENGAPPAI.2023.105857.
[35] H. Yang et al., “PVT-SSD: Single-Stage 3D Object Detector With Point-Voxel Transformer.” pp. 13476–13487, 2023.
[36] D. Demetriou, P. Mavromatidis, P. M. Robert, H. Papadopoulos, M. F. Petrou, and D. Nicolaides, “Real-Time Construction Demolition Waste Detection Using State-of-The-Art Deep Learning Methods; Single – Stage vs Two-Stage Detectors,” SSRN Electronic Journal, 2023, doi: 10.2139/SSRN.4330569.
[37] M. Yuzkat, H. O. Ilhan, and N. Aydin, “Detection of sperm cells by single-stage and two-stage deep object detectors,” Biomed Signal Process Control, vol. 83, p. 104630, May 2023, doi: 10.1016/J.BSPC.2023.104630.
[38] R. K. Al Romaihi, A. Belhi, and R. Hadjidj, “Evaluation of Single-Stage, Two-Stage, and Anchor-Free Object Recognition Methods for UAV Detection,” Lecture Notes in Networks and Systems, vol. 578, pp. 775–783, 2023, doi: 10.1007/978-981-19-7660-5_69/COVER.
[39] “YOLOv5 - Ultralytics | Revolutionizing the World of Vision AI.” https://ultralytics.com/yolov5 (accessed May 26, 2023).
[40] D. DLUŽNEVSKIJ, P. STEFANOVIČ, and S. RAMANAUSKAITE, “Investigation of yolov5 efficiency in iphone supported systems,” Baltic Journal of Modern Computing, vol. 9, no. 3, pp. 333–344, 2021, doi: 10.22364/BJMC.2021.9.3.07.
[41] G. Jocher et al., “ultralytics/yolov5: v6.0 - YOLOv5n ‘Nano’ models, Roboflow integration, TensorFlow export, OpenCV DNN support,” Oct. 2021, doi: 10.5281/ZENODO.5563715.
[42] R. Hajar, P. Sejati, R. Mardhiyyah, N. Istiqomah, R. Imam, and B. Prasetya, “Real-time Smartphone Usage Surveillance System Based on YOLOv5,” IJID (International Journal on Informatics for Development), vol. 11, no. 2, pp. 242–251, Feb. 2022, doi: 10.14421/IJID.2022.3766.
[43] S. Li, S. Liu, Z. Cai, Y. Liu, G. Chen, and G. Tu, “TC-YOLOv5: rapid detection of floating debris on raspberry Pi 4B,” J Real Time Image Process, vol. 20, no. 2, pp. 1–13, Apr. 2023, doi: 10.1007/S11554-023-01265-Z/METRICS.
[44] G. S. Ramya, “Smart Detection of Helmet Using IoT and Image Processing,” vol. 12, 2022.

Most read articles by the same author(s)