Investigation of RGB to HSI Conversion Methods for Early Plant Disease Detection Using Hierarchical Synthesis Convolutional Neural Networks

Raseeda Hamzah - Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA Shah Alam, 40450 Shah Alam, Selangor, Malaysia
Khyrina Airin Fariza Abu Samah - Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA Cawangan Melaka Kampus Jasin, Melaka, Malaysia
Muhammad Faiz Abdullah - Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA Shah Alam, 40450 Shah Alam, Selangor, Malaysia
Sharifalillah Nordin - Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA Shah Alam, 40450 Shah Alam, Selangor, Malaysia

Citation Format:



An early detection of disease can save the plant. One of the ways is by using eye-observation, which is time-consuming. Having a machine learning technology that can automate early detection would benefit modern and conventional farming. This study emphasizes the review of Hyperspectral Image (HSI) reconstruction using the Hierarchical Synthesis Convolutional Neural Networks (HSCNN) based method in early plant disease detection. Capturing hundreds of spectral bands during image acquisition enables the HSI capturing devices to provide more detailed information. Detection of disease with Red Green Blue (RGB) images needs to be done when it shows a notable spot or sign. However, the disease can be spotted with the correct range of spectral bands on HSI before a notable spot or sign is shown. The usage of HSI image is significantly important as it is rich in information and properties needed for image detection. Although HSI device is significantly important in early plant disease detection, the devices are expensive and require specialized hardware and expertise. Thus, reconstructing the Reg Green Blue (RGB) image to HSI is required. This research implemented two types of HSCNN-based methods, Densed network (HSCNN-D) and Rectified Linear Unit network (HSCNN-R), for HSI reconstructions. The results show that HSCNN-D outperformed the HSCNN-R with less Mean Relative Absolute Error (MRAE) of 2.15%.


Plant disease detection; hierarchical synthesis convolutional neural networks; machine learning; flexible rectified linear unit network; deep learning

Full Text:



A. H. Islam, M. S. Schreinemachers, & S. Kumar, “Farmers’ knowledge, perceptions and management of chili pepper anthracnose disease in Bangladeshâ€. Crop Protection, 133(February), 105139, 2020.

L. Ons, D. Bylemans, Thevissen, K., & Cammue, B. P. A. “Combining biocontrol agents with chemical fungicides for integrated plant fungal disease controlâ€. Microorganisms, vol.8, no.12, pp. 1–19, 2020.

R. C. Kumar., & O. Prakash, O. “The impact of chemical fertilizers on our environment and ecosystemâ€. Research Trends in Environmental Sciences, February, 2019. pp.69–86.

O. Calicioglu., A. Flammini., S. Bracco., L. Bellù., & R. Sims. “The future challenges of food and agriculture: An integrated analysis of trends and solutionsâ€. Sustainability (Switzerland), 2019.vol. 11,no. 1.

J. Ma., K. Du., F. Zheng., L. Zhang., Z. Gong., & Z. Sun . “A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural networkâ€. Computers and Electronics in Agriculture, 154(June), .2018. pp.18–24.

Liu, J., & Wang, X. “Plant diseases and pests detection based on deep learning: a review†Plant Methods, vol. 17, no.1, 2021,pp.1–18.

M. H. Saleem., S. Khanchi., J. Potgieter., & K.M. Arif. “Image-Based Plant Disease Identification by Deep Learning Meta-Architectures,†Plants, vol. 9, no. 11, p. 1451, 2020.

M. Magnusson, J. Sigurdsson, S. Armansson, M.O. Ulfarsson, H. Deborah, & J.R. Sveinsson, “Creating RGB Images from Hyperspectral Images Using a Color Matching Function,†in International Geoscience and Remote Sensing Symposium (IGARSS), 2020, pp. 2045–2048.

M. G. Selvaraj, M, A. Vergara, H. Ruiz, N. Safari, S. Elayabalan, W. Ocimati, & G. Blomme, G. (2019). “AI-powered banana diseases and pest detection†Plant Methods, vol.15 no.1, pp 1–11.

C. Nguyen., V. Sagan, M. Maimaitijiang, M. Bhadra, & M. T. Kwasniewski, “Early detection of plant viral disease using hyperspectral imaging and deep learning,†Sensors (Switzerland), vol.21, no.3, pp 1–23, 2021.

S. Kumar. “Plant Disease Detection Using CNN,†Turkish Journal of Computer and Mathematics Education (TURCOMAT), vol.12, no. 12, 2021, pp. 2106-2112.

S.M. Hassan., A.K. Maji., M. JasiÅ„ski., Z. Leonowicz, Z. and E. JasiÅ„ska. “Identification of Plant-Leaf Diseases Using CNN and Transfer-Learning Approachâ€. Electronics, 10(12), 2021. pp.1388.

J. Baghel., and P. Jain.,. “K-means segmentation method for automatic leaf disease detectionâ€. Int. J. Eng. Res. Appl, 6(3), 2016. pp.83-86.

A.S. Deshapande., S.G. Giraddi., K.G. Karibasappa., S.D. Desai. “Fungal disease detection in Maize leaves using Haar wavelet featuresâ€. (2019) Springer Singapore. https:// doi. org/ 10. 1007/978- 981- 13- 1742-2

X. Feng., L. He., Q. Cheng., X. Long., & Y. Yuan. “Hyperspectral and multispectral remote sensing image fusion based on endmember spatial informationâ€. Remote Sensing, 12(6), 2019. pp1–17.

Y. Fang, F. Yang., Z. Zhou., L. Lin., & X. Li, X. “Hyperspectral Wavelength Selection and Integration for Bruise Detection of Korla Pearsâ€. Journal of Spectroscopy, 2019.

N. Sharma., & M. Hefeeda. “Hyperspectral reconstruction from RGB images for vein visualizationâ€. MMSys 2020 - Proceedings of the 2020 Multimedia Systems Conference, 2020. pp.77–87.

J. Zhao., D. Kechasov., B. Rewald., G. Bodner., M. Verheul., M., Clarke, N., & J.L. Clarke. “Deep learning in hyperspectral image reconstruction from single rgb images—a case study on tomato quality parametersâ€. Remote Sensing, 12(19), 2020. pp1–14.

Y. Dua., V., Kumar & R.S. Singh, R. S. “Comprehensive review of hyperspectral image compression algorithmsâ€. Optical Engineering, 2020. 59(09).

N. Akhtar., & A. Mian. “Hyperspectral Recovery from RGB Images using Gaussian Processesâ€. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(1), 2020. 100–113.

N. Zhang., G. Yang., Y. Pan., X. Yang., L. Chen., & C. Zhao, C. “ A review of advanced technologies and development for hyperspectral-based plant disease detection in the past three decadesâ€. Remote Sensing, 12(19), 1–34. (2020)

L. E . Berg., S. Miller., S., M.R. Dornbusch., & D. A. Samac. “Plant Diseaseâ€. Encyclopedia Britannica, 800, 2020. pp.1–29.

Z. Shi, C. Chen, Z. Xiong, D. Liu, & F. Wu, “HSCNN+: Advanced CNN-based hyperspectral recovery from RGB images†IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2018, pp.1052–1060.

N. Sabri., Z. Ibrahim., & D. Isa, “Evaluation of color models for palm oil fresh fruit bunch ripeness classification,†Indonesian Journal of Electrical Engineering and Computer Science, vol.11, no. 2, pp. 549-557, 2018.

S. Qiu, X. Xu, & B. Cai, “FReLU: flexible rectified linear units for improving convolutional neural networksâ€. in International Conference on Pattern Recognition (ICPR), 2018, pp. 1223-1228.