A Combination of Transfer Learning and Support Vector Machine for Robust Classification on Small Weed and Potato Datasets

Faisal Adhinata - Institut Teknologi Telkom Purwokerto, Indonesia
Nur Ramadhan - Institut Teknologi Telkom Purwokerto, Indonesia
Nia Tanjung - Institut Teknologi Telkom Purwokerto, Indonesia
Muhammad Fauzi - Institut Teknologi Telkom Surabaya, Indonesia
Nia Annisa Tanjung - Institut Teknologi Telkom Purwokerto, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.30630/joiv.7.2.1164

Abstract


Agriculture is the primary sector in Indonesia for meeting people's daily food demands. One of the agricultural commodities that replace rice is potatoes. Potato growth needs to be protected from weeds that compete for nutrients. Spraying using pesticides can cause environmental pollution, affecting cultivated plants. Currently, agricultural technology is being developed using an Artificial Intelligence (AI) approach to classifying crops. The classification process using AI depends on the number of datasets obtained. The number of datasets obtained in this research is not too large, so it requires a particular approach regarding the AI method used. This research aims to use a combination of feature extraction methods with local and deep feature approaches with supervised machine learning to classify of small datasets. The local feature method used in this research is Local Binary Pattern (LBP) and Histogram of Oriented Gradients (HOG), while the deep feature method used is MobileNet and MobileNetV2. The famous Support Vector Machine (SVM) uses the classification method to separate two data classes. The experimental results showed that the local feature HOG method was the fastest in the training process. However, the most accurate result was using the MobileNetV2 deep feature method with an accuracy of 98%. Deep features produced the best accuracy because the feature extraction process went through many neural network layers. This research can provide insight on how to analyze a small number of datasets by combining several strategies


Keywords


Weed; potatoes; small dataset; machine learning; local and deep feature

Full Text:

PDF

References


A. Budi Setiawan and C. Inayati, “The Analysis of Production Factors and Income of Potato Farming,†Jejak, vol. 13, no. 1, pp. 17–29, 2020, doi: 10.15294/jejak.v13i1.21965.

N. E. Korres, Agronomic weed control: A trustworthy approach for sustainable weed management. Elsevier Inc., 2018. doi: 10.1016/B978-0-12-809881-3.00006-1.

M. Riyaz, R. A. Shah, and K. Sivasankaran, “Pesticide Residues: Impacts on Fauna and the Environment,†in Biodegradation Technology of Organic and Inorganic Pollutants, K. F. Mendes, R. N. de Sousa, and K. C. Mielke, Eds. Rijeka: IntechOpen, 2021. doi: 10.5772/intechopen.98379.

J. L. Tang, D. Wang, Z. G. Zhang, L. J. He, J. Xin, and Y. Xu, “Weed identification based on K-means feature learning combined with convolutional neural network,†Computers and Electronics in Agriculture, vol. 135, pp. 63–70, 2017, doi: 10.1016/j.compag.2017.01.001.

I. H. Sarker, “Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions,†SN Computer Science, vol. 2, no. 6, pp. 1–20, 2021, doi: 10.1007/s42979-021-00815-1.

F. J. Moreno-Barea, J. M. Jerez, and L. Franco, “Improving classification accuracy using data augmentation on small data sets,†Expert Systems with Applications, vol. 161, p. 113696, 2020, doi: 10.1016/j.eswa.2020.113696.

F. J. Moreno-Barea, J. M. Jerez, and L. Franco, “Improving classification accuracy using data augmentation on small data sets,†Expert Systems with Applications, vol. 161, p. 113696, 2020, doi: 10.1016/j.eswa.2020.113696.

C. Shorten and T. M. Khoshgoftaar, “A survey on Image Data Augmentation for Deep Learning,†Journal of Big Data, vol. 6, no. 1, 2019, doi: 10.1186/s40537-019-0197-0.

J. A. Nichols, H. W. Herbert Chan, and M. A. B. Baker, “Machine learning: applications of artificial intelligence to imaging and diagnosis,†Biophysical Reviews, vol. 11, no. 1, pp. 111–118, 2019, doi: 10.1007/s12551-018-0449-9.

K. Kanagaraj and G. G. L. Priya, “Curvelet transform based feature extraction and selection for multimedia event classification,†Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 2, pp. 375–383, 2022, doi: https://doi.org/10.1016/j.jksuci.2018.11.006.

A. K. Hussein, “Histogram of Gradient and Local Binary Pattern with Extreme Learning Machine Based Ear Recognition,†Journal of Southwest Jiaotong University, vol. 54, no. 6, pp. 1–6, 2019.

H. Mu’jizah and D. C. R. Novitasari, “Comparison of the histogram of oriented gradient, GLCM, and shape feature extraction methods for breast cancer classification using SVM,†Jurnal Teknologi dan Sistem Komputer, vol. 9, no. 3, pp. 150–156, 2021, doi: 10.14710/jtsiskom.2021.14104.

A. Michele, V. Colin, and D. D. Santika, “Mobilenet convolutional neural networks and support vector machines for palmprint recognition,†Procedia Computer Science, vol. 157, pp. 110–117, 2019, doi: 10.1016/j.procs.2019.08.147.

I. Candradewi, B. N. Prastowo, and D. Lathief, “Gender Classification from Facial Images Using Support Vector Machine,†Journal of Theoretical and Applied Information Technology, vol. 97, pp. 2684–2692, 2019.

F. D. Adhinata, A. Harjoko, and Wahyono, “Object Searching on Video Using ORB Descriptor and Support Vector Machine,†in Advances in Computational Collective Intelligence, 2020, pp. 239–251.

A. Hassan, “Potato Weed Plants Classification | Kaggle,†Kaggle.com, 2020. https://www.kaggle.com/ali7432/potato-weed-plants-classification (accessed Feb. 13, 2022).

F. Y. Manik, D. S. Br Ginting, and M. I. Aldeena, “Extraction Analysis of Texture and Morphological Features as Characteristics of Cabbage Images,†in 2021 International Conference on Data Science, Artificial Intelligence, and Business Analytics (DATABIA), 2021, pp. 88–92. doi: 10.1109/DATABIA53375.2021.9650095.

P. Zheng, D. Qin, B. Han, L. Ma, and T. M. Berhane, “Research on feature extraction method of indoor visual positioning image based on area division of foreground and background,†ISPRS International Journal of Geo-Information, vol. 10, no. 6, 2021, doi: 10.3390/ijgi10060402.

L. Liu, J. Chen, P. Fieguth, G. Zhao, R. Chellappa, and M. Pietikäinen, “From BoW to CNN: Two Decades of Texture Representation for Texture Classification,†International Journal of Computer Vision, vol. 127, no. 1, pp. 74–109, 2019, doi: 10.1007/s11263-018-1125-z.

T. Yin and Z. Lv, “Optimal Extraction Method of Feature Points in Key Frame Image of Mobile Network Animation,†Mobile Networks and Applications, pp. 2515–2523, 2022, doi: 10.1007/s11036-022-02070-x.

S. Wan et al., “Integrated local binary pattern texture features for classification of breast tissue imaged by optical coherence microscopy,†Medical Image Analysis, vol. 38, pp. 104–116, 2017, doi: 10.1016/j.media.2017.03.002.

I. Muslihah and M. Muqorobin, “Texture Characteristic of Local Binary Pattern on Face Recognition with Probabilistic Linear Discriminant Analysis,†International Journal of Computer and Information System (IJCIS), vol. 1, no. 1, pp. 22–26, 2020, doi: 10.29040/ijcis.v1i1.10.

P. A. R. Devi and R. P. N. Budiarti, “Image Classification with Shell Texture Feature Extraction Using Local Binary Pattern (LBP) Method,†Applied Technology and Computing Science Journal, vol. 3, no. 1, pp. 48–57, 2020, doi: 10.33086/atcsj.v3i1.1745.

I. Al Saidi, M. Rziza, and J. Debayle, “A New LBP Variant: Corner Rhombus Shape LBP (CRSLBP),†Journal of Imaging, vol. 8, no. 7, pp. 1–11, 2022, doi: 10.3390/jimaging8070200.

F. D. Adhinata, M. Ikhsan, and W. Wahyono, “People counter on CCTV video using histogram of oriented gradient and Kalman filter methods,†Jurnal Teknologi dan Sistem Komputer, vol. 8, no. 3, pp. 222–227, 2020, doi: 10.14710/jtsiskom.2020.13660.

L. Kalake, Y. Dong, W. Wan, and L. Hou, “Enhancing Detection Quality Rate with a Combined HOG and CNN for Real-Time Multiple Object Tracking across Non-Overlapping Multiple Cameras,†Sensors, vol. 22, no. 6, 2022, doi: 10.3390/s22062123.

L. Mohammed, “Design and Implementation an Automated System for Analyzing Brushstrokes to Distinguish between Van Gogh and his Contemporaries by using Swarm Intelligent Method,†International Journal of Computer Applications, vol. 179, no. 11, pp. 5–14, 2018, doi: 10.5120/ijca2018915896.

A. G. Howard et al., “MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications,†2017.

M. R. R. Allaam, “KLASIFIKASI GENUS TANAMAN ANGGREK MENGGUNAKAN METODE CONVOLUTIONAL NEURAL NETWORK ( CNN ) Program Studi Sarjana Informatika Fakultas Informatika Universitas Telkom Bandung,†vol. 8, no. 2, pp. 3147–3179, 2021.

S. Kolonne, C. Fernando, H. Kumarasinghe, and D. Meedeniya, “MobileNetV2 Based Chest X-Rays Classification,†2021 International Conference on Decision Aid Sciences and Application, DASA 2021, no. December, pp. 57–61, 2021, doi: 10.1109/DASA53625.2021.9682248.

J. Cervantes, F. Garcia-Lamont, L. Rodríguez-Mazahua, and A. Lopez, “A comprehensive survey on support vector machine classification: Applications, challenges and trends,†Neurocomputing, vol. 408, pp. 189–215, 2020, doi: https://doi.org/10.1016/j.neucom.2019.10.118.

F. Mostafa, E. Hasan, M. Williamson, and H. Khan, “Statistical Machine Learning Approaches to Liver Disease Prediction,†Livers, vol. 1, no. 4, pp. 294–312, 2021, doi: 10.3390/livers1040023.

R. M. Alzoman and M. J. F. Alenazi, “A comparative study of traffic classification techniques for smart city networks,†Sensors, vol. 21, no. 14, pp. 1–17, 2021, doi: 10.3390/s21144677.

“Keras Applications.†https://keras.io/api/applications/ (accessed May 22, 2021)