Classification of Defect Photovoltaic Panel Images Using Matrox Imaging Library for Machine Vision Application

Nur Syahiera Othman - National Defense University of Malaysia, Sungai Besi, Kuala Lumpur, Malaysia
Suzaimah Ramli - National Defense University of Malaysia, Sungai Besi, Kuala Lumpur, Malaysia
Nur Diyana Kamarudin - National Defense University of Malaysia, Sungai Besi, Kuala Lumpur, Malaysia
Ahmad Umaer Mohamad - Control Easy Technology Sdn. Bhd. No.28 G & 1, Block C, The Atmosphere, Seri Kembangan, Selangor, Malaysia
Ang Teoh Ong - Control Easy Technology Sdn. Bhd. No.28 G & 1, Block C, The Atmosphere, Seri Kembangan, Selangor, Malaysia


Citation Format:



DOI: http://dx.doi.org/10.62527/joiv.8.3-2.2182

Abstract


The maintenance of large-scale photovoltaic (PV) power plants has long been a challenging task. Currently, monitoring is carried out using electrical performance measurements or image processing, which have limited ability to detect faults, are time-consuming and costly, and cannot pinpoint the defect's precise location quickly. To address these challenges, this research focused on using deep learning techniques to classify defect and non-defect PV panels. The application provided deep learning algorithms capable of image classification in various classifiers. The image dataset was carefully curated and split into training and development datasets during the training model to ensure the highest accuracy for the prediction of the presence or absence of defects on the PV panel. Statistical measures, which are the average accuracy for the training model and average prediction, were employed to evaluate the classification performance of the defect PV panel model. The results demonstrated a remarkable total accuracy of model 99.9% for each class, and prediction results showed that almost 70% of defect PV panels were detected from the testing dataset. Furthermore, a comparative analysis was conducted to benchmark the findings against other algorithms. The practical implications of this research are significant, showcasing the effectiveness of deep learning algorithms and their compatibility with machine vision applications for the classification of defect PV panel images. By leveraging these techniques, solar farm operators can significantly improve maintenance management, thereby enhancing the efficiency and reliability of solar power generation and potentially saving significant costs.


Keywords


Artificial Intelligence; Photovoltaic Panel; Deep Learning, Matrox Imaging Library, Machine Vision Applications

Full Text:

PDF

References


J. Wang et al., “Deep-Learning-Based Automatic Detection of Photovoltaic Cell Defects in Electroluminescence Images,” Sensors, vol. 23, no. 1, p. 297, Dec. 2022, doi: 10.3390/s23010297.

S. Chen, H. Li, K. Zhao, and D. Wu, “Preparation of graphene films bridged with Ag nanowires and its application in heterojunction solar cells,” Solar Energy, vol. 198, pp. 167–174, Mar. 2020, doi:10.1016/j.solener.2020.01.060.

S. Hassan and M. Dhimish, “A Survey of CNN-Based Approaches for Crack Detection in Solar PV Modules: Current Trends and Future Directions,” Solar, vol. 3, no. 4, pp. 663–683, Dec. 2023, doi:10.3390/solar3040036.

A. El Mays et al., “Improving Photovoltaic Panel Using Finned Plate of Aluminum,” Energy Procedia, vol. 119, pp. 812–817, Jul. 2017, doi:10.1016/j.egypro.2017.07.103.

J. Zhao et al., “Structures of liquid jets in supersonic crossflows in a rectangular channel with an expansion section,” Physics of Fluids, vol. 32, no. 11, Nov. 2020, doi: 10.1063/5.0032097.

G. Górecki et al., “Experimental and Numerical Study of Heat Pipe Heat Exchanger with Individually Finned Heat Pipes,” Energies, vol. 14, no. 17, p. 5317, Aug. 2021, doi: 10.3390/en14175317.

M. Meribout, V. Kumar Tiwari, J. Pablo Peña Herrera, and A. Najeeb Mahfoudh Awadh Baobaid, “Solar panel inspection techniques and prospects,” Measurement, vol. 209, p. 112466, Mar. 2023, doi:10.1016/j.measurement.2023.112466.

I. Høiaas, K. Grujic, A. G. Imenes, I. Burud, E. Olsen, and N. Belbachir, “Inspection and condition monitoring of large-scale photovoltaic power plants: A review of imaging technologies,” Renewable and Sustainable Energy Reviews, vol. 161, p. 112353, Jun. 2022, doi: 10.1016/j.rser.2022.112353.

M. Aghaei et al., “Review of degradation and failure phenomena in photovoltaic modules,” Renewable and Sustainable Energy Reviews, vol. 159, p. 112160, May 2022, doi: 10.1016/j.rser.2022.112160.

M. M. Rahman, M. Hasanuzzaman, and N. A. Rahim, “Effects of various parameters on PV-module power and efficiency,” Energy Conversion and Management, vol. 103, pp. 348–358, Oct. 2015, doi:10.1016/j.enconman.2015.06.067.

S. Meyer, S. Timmel, U. Braun, and C. Hagendorf, “Polymer Foil Additives Trigger the Formation of Snail Trails in Photovoltaic Modules,” Energy Procedia, vol. 55, pp. 494–497, 2014, doi:10.1016/j.egypro.2014.08.014.

P. Peng et al., “Microscopy study of snail trail phenomenon on photovoltaic modules,” RSC Advances, vol. 2, no. 30, p. 11359, 2012, doi: 10.1039/c2ra22280a.

A. Pozza and T. Sample, “Crystalline silicon PV module degradation after 20 years of field exposure studied by electrical tests, electroluminescence, and LBIC,” Progress in Photovoltaics: Research and Applications, vol. 24, no. 3, pp. 368–378, Nov. 2015, doi:10.1002/pip.2717.

S. Meyer, S. Timmel, U. Braun, and C. Hagendorf, “Polymer Foil Additives Trigger the Formation of Snail Trails in Photovoltaic Modules,” Energy Procedia, vol. 55, pp. 494–497, 2014, doi:10.1016/j.egypro.2014.08.014.

J. Kim, M. Rabelo, S. P. Padi, H. Yousuf, E.-C. Cho, and J. Yi, “A Review of the Degradation of Photovoltaic Modules for Life Expectancy,” Energies, vol. 14, no. 14, p. 4278, Jul. 2021, doi:10.3390/en14144278

L. Li, Z. Wang, and T. Zhang, “Photovoltaic Panel Defect Detection Based on Ghost Convolution with BottleneckCSP and Tiny Target Prediction Head Incorporating YOLOv5,” arXiv.org, Mar. 01, 2023. https://arxiv.org/abs/2303.00886.

S. Kiranyaz, O. Avci, O. Abdeljaber, T. Ince, M. Gabbouj, and D. J. Inman, “1D convolutional neural networks and applications: A survey,” Mechanical Systems and Signal Processing, vol. 151, p. 107398, Apr. 2021, doi: 10.1016/j.ymssp.2020.107398.

S. Prabhakaran, R. Annie Uthra, and J. Preetharoselyn, “Deep Learning-Based Model for Defect Detection and Localization on Photovoltaic Panels,” Computer Systems Science and Engineering, vol. 44, no. 3, pp. 2683–2700, 2023, doi: 10.32604/csse.2023.028898.

C. Tang, H. Ren, J. Xia, F. Wang, and J. Lu, “Automatic defect identification of PV panels with IR images through unmanned aircraft,” IET Renewable Power Generation, vol. 17, no. 12, pp. 3108–3119, Aug. 2023, doi: 10.1049/rpg2.12831.

D. Xia, F. Guo, H. Liu, and S. Yu, “Unsupervised learning of visual invariant features for person re-identification,” Journal of Intelligent & Fuzzy Systems, vol. 39, no. 5, pp. 7495–7503, Nov. 2020, doi:10.3233/jifs-200793.

H. Chen, Y. Pang, Q. Hu, and K. Liu, “Solar cell surface defect inspection based on multispectral convolutional neural network,” Journal of Intelligent Manufacturing, vol. 31, no. 2, pp. 453–468, Dec. 2018, doi: 10.1007/s10845-018-1458-z.

L. Falaschetti, L. Manoni, D. Di Leo, D. Pau, V. Tomaselli, and C. Turchetti, “A CNN-based image detector for plant leaf diseases classification,” HardwareX, vol. 12, p. e00363, Oct. 2022, doi:10.1016/j.ohx.2022.e00363.

M. R. U. Rahman and H. Chen, “Defects Inspection in Polycrystalline Solar Cells Electroluminescence Images Using Deep Learning,” IEEE Access, vol. 8, pp. 40547–40558, 2020, doi:10.1109/access.2020.2976843.

W. Tang, Q. Yang, K. Xiong, and W. Yan, “Deep learning based automatic defect identification of photovoltaic module using electroluminescence images,” Solar Energy, vol. 201, pp. 453–460, May 2020, doi: 10.1016/j.solener.2020.03.049.

D.-M. Tsai, M. Fan, Y.-Q. Huang, and W.-Y. Chiu, “Saw-Mark Defect Detection in Heterogeneous Solar Wafer Images using GAN-based Training Samples Generation and CNN Classification,” Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, pp. 234–240, 2019, doi: 10.5220/0007306602340240.

M. Aslam, T. M. Khan, S. S. Naqvi, G. Holmes, and R. Naffa, “On the Application of Automated Machine Vision for Leather Defect Inspection and Grading: A Survey,” IEEE Access, vol. 7, pp. 176065–176086, 2019, doi: 10.1109/access.2019.2957427.

S. Deitsch et al., “Automatic classification of defective photovoltaic module cells in electroluminescence images,” Solar Energy, vol. 185, pp. 455–468, Jun. 2019, doi: 10.1016/j.solener.2019.02.067.

Y. Zhang, H. G. Soon, D. Ye, J. Y. H. Fuh, and K. Zhu, “Powder-Bed Fusion Process Monitoring by Machine Vision With Hybrid Convolutional Neural Networks,” IEEE Transactions on Industrial Informatics, vol. 16, no. 9, pp. 5769–5779, Sep. 2020, doi:10.1109/tii.2019.2956078.

D. P. Penumuru, S. Muthuswamy, and P. Karumbu, “Identification and classification of materials using machine vision and machine learning in the context of industry 4.0,” Journal of Intelligent Manufacturing, vol. 31, no. 5, pp. 1229–1241, Nov. 2019, doi: 10.1007/s10845-019-01508-6.

C. Shorten and T. M. Khoshgoftaar, “A survey on Image Data Augmentation for Deep Learning,” Journal of Big Data, vol. 6, no. 1, Jul. 2019, doi: 10.1186/s40537-019-0197-0.

D. P. Penumuru, S. Muthuswamy, and P. Karumbu, “Identification and classification of materials using machine vision and machine learning in the context of industry 4.0,” Journal of Intelligent Manufacturing, vol. 31, no. 5, pp. 1229–1241, Nov. 2019, doi: 10.1007/s10845-019-01508-6.

Y. He et al., “Infrared machine vision and infrared thermography with deep learning: A review,” Infrared Physics & Technology, vol. 116, p. 103754, Aug. 2021, doi: 10.1016/j.infrared.2021.103754.

M. L. Smith, L. N. Smith, and M. F. Hansen, “The quiet revolution in machine vision - a state-of-the-art survey paper, including historical review, perspectives, and future directions,” Computers in Industry, vol. 130, p. 103472, Sep. 2021, doi: 10.1016/j.compind.2021.103472.

E. Zancul, H. O. Martins, F. P. Lopes, and F. A. T. V. da Silva Neto, “Machine Vision applications in a Learning Factory,” Procedia Manufacturing, vol. 45, pp. 516–521, 2020, doi:10.1016/j.promfg.2020.04.069.

S. Qiu, G. H. Chang, M. Panagia, D. M. Gopal, R. Au, and V. B. Kolachalama, “Fusion of deep learning models of MRI scans, Mini–Mental State Examination, and logical memory test enhances diagnosis of mild cognitive impairment,” Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring, vol. 10, no. 1, pp. 737–749, Jan. 2018, doi: 10.1016/j.dadm.2018.08.013.

A. Kalukhe, S. Suryawanshi, M. Ambuse, M. Ravaji, A. Chaitali, And Deshpande, “Suspicious Activity Detection In Exam Using Deep Learning,” International Research Journal of Engineering and Technology (IRJET), vol. 11, no 10, pp. 772-775, Oct 2024.

J. Shin, Md. S. Mahmud, T. U. Rehman, P. Ravichandran, B. Heung, and Y. K. Chang, “Trends and Prospect of Machine Vision Technology for Stresses and Diseases Detection in Precision Agriculture,” AgriEngineering, vol. 5, no. 1, pp. 20–39, Dec. 2022, doi: 10.3390/agriengineering5010003.

Z. Ren, F. Fang, N. Yan, and Y. Wu, “State of the Art in Defect Detection Based on Machine Vision,” International Journal of Precision Engineering and Manufacturing-Green Technology, vol. 9, no. 2, pp. 661–691, May 2021, doi: 10.1007/s40684-021-00343-6.