Classification of Skin Cancer Images Using Convolutional Neural Network with ResNet50 Pre-trained Model

Agus Minarno - Universitas Muhammadiyah Malang, Jl. Raya Tlogomas 246, Malang, 65144, Indonesia
Aaliyah Lusianti - Universitas Muhammadiyah Malang, Jl. Raya Tlogomas 246, Malang, 65144, Indonesia
Yufis Azhar - Universitas Muhammadiyah Malang, Jl. Raya Tlogomas 246, Malang, 65144, Indonesia
Hardianto Wibowo - Universitas Muhammadiyah Malang, Jl. Raya Tlogomas 246, Malang, 65144, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.62527/joiv.8.4.2156

Abstract


The skin, an astonishingly expansive organ within the human body, plays a pivotal role in safeguarding us against the environment's harsh elements. It acts as a formidable barrier, shielding our delicate internal systems from the scorching heat of the sun and the harmful effects of relentless exposure to light. Nevertheless, it is not impervious to damage, especially when subjected to excessive sunlight and the potentially hazardous ultraviolet (UV) radiation that accompanies it. Prolonged UV exposure can wreak havoc on our skin cells, potentially setting the stage for the development of skin cancer. This condition demands prompt and accurate diagnosis for effective treatment. To address the pressing need for swift and precise skin cancer diagnosis, cutting-edge technology has come to the fore in the form of deep learning systems. These sophisticated systems have been meticulously designed and trained to classify skin lesions autonomously with remarkable accuracy. The Convolutional Neural Network (CNN) architecture is a formidable choice for handling image classification tasks among the array of deep learning techniques. In a recent breakthrough study, a CNN-based model was meticulously constructed to explicitly classify skin lesions, leveraging the power of a pre-trained ResNet50 architectural model to augment its capabilities. This groundbreaking ResNet50 architecture was meticulously trained to classify seven distinct skin lesions, surpassing the performance of its predecessor, MobileNet. The results achieved in this endeavor are nothing short of impressive. The overall accuracy of the ResNet50 model stands at a commendable 87.42% when tasked with classifying the seven diverse classes within the dataset. Delving further into its proficiency, we find that the Top2 and Top3 accuracy rates soar to an astounding 95.52% and 97.86%, respectively, illustrating the model's exceptional precision and reliability.


Keywords


Classification; Skin Cancer; Convolutional Neural Network; ResNet50

Full Text:

PDF

References


T. J. Brinker et al., “Skin Cancer Classification Using Convolutional Neural Networks: Systematic Review,” Journal of Medical Internet Research, vol. 20, no. 10, p. e11936, Oct. 2018, doi: 10.2196/11936.

D. N. Le, H. X. Le, L. T. Ngo and H. T. Ngo, "Transfer learning with class-weighted and focal loss function for automatic skin cancer classification", arXiv:2009.05977, 2020.

Md. K. Islam et al., “Melanoma Skin Lesions Classification using Deep Convolutional Neural Network with Transfer Learning,” 2021 1st International Conference on Artificial Intelligence and Data Analytics (CAIDA), pp. 48–53, Apr. 2021, doi:10.1109/caida51941.2021.9425117.

S. P. Godlin Jasil and V. Ulagamuthalvi, “Skin Lesion Classification Using Pre-Trained DenseNet201 Deep Neural Network,” 2021 3rd International Conference on Signal Processing and Communication (ICPSC), pp. 393–396, May 2021, doi:10.1109/icspc51351.2021.9451818.

R. Garg, S. Maheshwari, and A. Shukla, “Decision Support System for Detection and Classification of Skin Cancer Using CNN,” Innovations in Computational Intelligence and Computer Vision, pp. 578–586, Sep. 2020, doi: 10.1007/978-981-15-6067-5_65.

H. K. Kondaveeti and P. Edupuganti, “Skin Cancer Classification using Transfer Learning,” 2020 IEEE International Conference on Advent Trends in Multidisciplinary Research and Innovation (ICATMRI), pp. 1–4, Dec. 2020, doi:10.1109/icatmri51801.2020.9398388.

S. Mohapatra, N. V. S. Abhishek, D. Bardhan, A. A. Ghosh, and S. Mohanty, “Comparison of MobileNet and ResNet CNN Architectures in the CNN‐Based Skin Cancer Classifier Model,” Machine Learning for Healthcare Applications, pp. 169–186, Apr. 2021, doi:10.1002/9781119792611.ch11.

A. E. Minarno, K. M. Ghufron, T. S. Sabrila, L. Husniah, and F. D. S. Sumadi, “CNN Based Autoencoder Application in Breast Cancer Image Retrieval,” 2021 International Seminar on Intelligent Technology and Its Applications (ISITIA), Jul. 2021, doi:10.1109/isitia52817.2021.9502205.

I. Hirra et al., “Breast Cancer Classification From Histopathological Images Using Patch-Based Deep Learning Modeling,” IEEE Access, vol. 9, pp. 24273–24287, 2021, doi: 10.1109/access.2021.3056516.

I. Hirra et al., “Breast Cancer Classification From Histopathological Images Using Patch-Based Deep Learning Modeling,” IEEE Access, vol. 9, pp. 24273–24287, 2021, doi: 10.1109/access.2021.3056516.

R. Kashyap, “Evolution of histopathological breast cancer images classification using stochastic dilated residual ghost model,” Turkish Journal of Electrical Engineering & Computer Sciences, vol. 29, no. SI-1, pp. 2758–2779, Oct. 2021, doi: 10.3906/elk-2104-40.

[12] V. M. Patro and M. Ranjan Patra, “Augmenting Weighted Average with Confusion Matrix to Enhance Classification Accuracy,” Transactions on Machine Learning and Artificial Intelligence, vol. 2, no. 4, Aug. 2014, doi: 10.14738/tmlai.24.328

O.-J. Skrede et al., “Deep learning for prediction of colorectal cancer outcome: a discovery and validation study,” The Lancet, vol. 395, no. 10221, pp. 350–360, Feb. 2020, doi: 10.1016/s0140-6736(19)32998-8.

A. E. Minarno, L. Aripa, Y. Azhar, and Y. Munarko, “Classification of Malaria Cell Image using Inception-V3 Architecture,” JOIV : International Journal on Informatics Visualization, vol. 7, no. 2, p. 273, May 2023, doi: 10.30630/joiv.7.2.1301.

A. E. Minarno, M. Fadhlan, Y. Munarko, and D. R. Chandranegara, “Classification of Dermoscopic Images Using CNN-SVM,” JOIV : International Journal on Informatics Visualization, vol. 8, no. 2, p. 606, May 2024, doi: 10.62527/joiv.8.2.2153.

A. E. Minarno, S. Y. Bagas, M. Yuda, N. A. Hanung, and Z. Ibrahim, “Convolutional Neural Network featuring VGG-16 Model for Glioma Classification,” JOIV : International Journal on Informatics Visualization, vol. 6, no. 3, p. 660, Sep. 2022, doi:10.30630/joiv.6.3.1230.

A. Eko Minarno, I. Setiyo Kantomo, F. D. Setiawan Sumadi, H. Adi Nugroho, and Z. Ibrahim, “Classification of Brain Tumors on MRI Images Using DenseNet and Support Vector Machine,” JOIV : International Journal on Informatics Visualization, vol. 6, no. 2, p. 404, Jun. 2022, doi: 10.30630/joiv.6.2.991.

T. Emara, H. M. Afify, F. H. Ismail, and A. E. Hassanien, “A Modified Inception-v4 for Imbalanced Skin Cancer Classification Dataset,” 2019 14th International Conference on Computer Engineering and Systems (ICCES), pp. 28–33, Dec. 2019, doi:10.1109/icces48960.2019.9068110.

K. Ali, Z. A. Shaikh, A. A. Khan, and A. A. Laghari, “Multiclass skin cancer classification using EfficientNets – a first step towards preventing skin cancer,” Neuroscience Informatics, vol. 2, no. 4, p. 100034, Dec. 2022, doi: 10.1016/j.neuri.2021.100034.

S. Bassi and A. Gomekar, “Deep Learning Diagnosis of Pigmented Skin Lesions,” 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pp. 1–6, Jul. 2019, doi: 10.1109/icccnt45670.2019.8944601.

A. Mobiny, A. Singh, and H. Van Nguyen, “Risk-Aware Machine Learning Classifier for Skin Lesion Diagnosis,” Journal of Clinical Medicine, vol. 8, no. 8, p. 1241, Aug. 2019, doi: 10.3390/jcm8081241.

H. Sharma, J. S. Jain, P. Bansal, and S. Gupta, “Feature Extraction and Classification of Chest X-Ray Images Using CNN to Detect Pneumonia,” 2020 10th International Conference on Cloud Computing, Data Science & Engineering (Confluence), pp. 227–231, Jan. 2020, doi: 10.1109/confluence47617.2020.9057809.

Q. A. Al-Haija and A. Adebanjo, “Breast Cancer Diagnosis in Histopathological Images Using ResNet-50 Convolutional Neural Network,” 2020 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS), pp. 1–7, Sep. 2020, doi:10.1109/iemtronics51293.2020.9216455.

S. S. Chaturvedi, K. Gupta, and Prakash. S. Prasad, “Skin Lesion Analyser: An Efficient Seven-Way Multi-Class Skin Cancer Classification Using MobileNet,” ArXiv, p. arXiv:1907.03220, Jul. 2019.

M. Abzalov, “Exploratory Data Analysis,” Applied Mining Geology, pp. 207–219, 2016, doi: 10.1007/978-3-319-39264-6_15.

J. Shijie, W. Ping, J. Peiyi, and H. Siping, “Research on data augmentation for image classification based on convolution neural networks,” 2017 Chinese Automation Congress (CAC), pp. 4165–4170, Oct. 2017, doi: 10.1109/cac.2017.8243510.

S. S. Yadav and S. M. Jadhav, “Deep convolutional neural network based medical image classification for disease diagnosis,” Journal of Big Data, vol. 6, no. 1, Dec. 2019, doi: 10.1186/s40537-019-0276-2.

S. Albawi, T. A. Mohammed, and S. Al-Zawi, “Understanding of a convolutional neural network,” 2017 International Conference on Engineering and Technology (ICET), pp. 1–6, Aug. 2017, doi:10.1109/icengtechnol.2017.8308186.

A. Saxena, “An Introduction to Convolutional Neural Networks,” International Journal for Research in Applied Science and Engineering Technology, vol. 10, no. 12, pp. 943–947, Dec. 2022, doi:10.22214/ijraset.2022.47789.

P. Kim, MATLAB Deep Learning. Apress, 2017. doi: 10.1007/978-1-4842-2845-6.

W. Jianxin, “Introduction to convolutional neural networks,” National Key Lab for Novel Software Technology, 2017.

B. Mandal, A. Okeukwu, and Y. Theis, “Masked Face Recognition using ResNet-50,” Apr. 2021.

P. Rathi, R. Kuwar Gupta, S. Agarwal, and A. Shukla, “Sign Language Recognition Using ResNet50 Deep Neural Network Architecture,” SSRN Electronic Journal, 2020, doi: 10.2139/ssrn.3545064.

M. Hussain, J. J. Bird, and D. R. Faria, “A Study on CNN Transfer Learning for Image Classification,” Advances in Computational Intelligence Systems, pp. 191–202, Aug. 2018, doi: 10.1007/978-3-319-97982-3_16.