Data-Efficient Vision Transformer Models for Robust Classification of Sugarcane
DOI:
https://doi.org/10.31181/jscda21202446Keywords:
Artificial Intelligence, Deep-Learning, ViT, Plant diseases, Image processingAbstract
Sugar cane is an important agricultural product that provides 75% of the world's sugar production. As with all plant species, any disease affecting sugarcane can significantly impact yields and planning. Diagnosing diseases in sugarcane leaves using traditional methods is slow, inefficient, and often lacking in accuracy. This study presents a deep learning-based approach for accurate diagnosis of diseases in sugarcane leaves. Specifically, training and evaluation were conducted on the publicly available Sugarcane Leaf Dataset using leading ViT (Vision Transformer) architectures such as DeiT3-Small and DeiT-Tiny. This dataset includes 11 different disease classes and a total of 6748 images. Additionally, these models were compared with popular CNN models. The findings of the study show that there is no direct relationship between model complexity, depth, and accuracy for the 11-class sugarcane dataset. Among the 12 models tested, the DeiT3-Small model showed the highest performance with 93.79% accuracy, 91.27% precision, and 90.96% F1-score. These results highlight that rapid, accurate, and automatic disease diagnosis systems developed using deep learning techniques can significantly improve sugarcane disease management and contribute to increased yields.
References
Mueller, D. S., Wise, K. A., Sisson, A. J., Allen, T. W., Bergstrom, G. C., Bosley, D. B., Bradley, C. A., Broders, K. D., Byamukama, E., Chilvers, M. I., Collins, A., Faske, T. R., Friskop, A. J., Heiniger, R. W., Hollier, C. A., Hooker, D. C., Isakeit, T., Jackson-Ziems, T. A., Jardine, D. J., … Warner, F. (2016). Corn Yield Loss Estimates Due to Diseases in the United States and Ontario, Canada from 2012 to 2015. Plant Health Progress, 17(3), 211–222. https://doi.org/10.1094/PHP-RS-16-0030
Fowler, H. J., Kilsby, C. G., & O’Connell, P. E. (2003). Modeling the impacts of climatic change and variability on the reliability, resilience, and vulnerability of a water resource system. Water Resources Research, 39(8). https://doi.org/10.1029/2002WR001778
Kunduracıoğlu, İ. (2018). Examining the interface of lego mindstorms ev3 robot programming. Journal of Educational Technology and Online Learning, 1(1), 28-46.. https://doi.org/10.31681/jetol.372826
Kunduracıoğlu, İ., & Durak, G. (2018). A CONTENT ANALYSIS ON GAMIFICATION. European Journal of Open Education and E-Learning Studies, 3(2). https://doi.org/10.5281/zenodo.2228190
Javaid, M., Haleem, A., Singh, R. P., & Suman, R. (2022). Enhancing smart farming through the applications of Agriculture 4.0 technologies. International Journal of Intelligent Networks, 3, 150–164. https://doi.org/10.1016/j.ijin.2022.09.004
Arjunagi, S., & Patil, N. B. (2023). Optimized convolutional neural network for identification of maize leaf diseases with adaptive ageist spider monkey optimization model. International Journal of Information Technology, 15(2), 877–891. https://doi.org/10.1007/s41870-021-00657-3
He, J., Liu, T., Li, L., Hu, Y., & Zhou, G. (2023). MFaster R-CNN for Maize Leaf Diseases Detection Based on Machine Vision. Arabian Journal for Science and Engineering, 48(2), 1437–1449. https://doi.org/10.1007/s13369-022-06851-0
Viswanathan, R., & Rao, G. P. (2011). Disease Scenario and Management of Major Sugarcane Diseases in India. Sugar Tech, 13(4), 336–353. https://doi.org/10.1007/s12355-011-0102-4
Bashir, S., & Sharma, N. (2012). Remote Area Plant Disease Detection Using Image Processing. In IOSR Journal of Electronics and Communication Engineering, 2(6), 31-34. http://dx.doi.org/10.9790/2834-0263134
Taherei Ghazvinei, P., Darvishi, H. H., Mosavi, A., Bin Wan Yusof, K., Alizamir, M., Shamshirband, S., & Chau, K. W. (2018). Sugarcane growth prediction based on meteorological parameters using extreme learning machine and artificial neural network. Engineering Applications of Computational Fluid Mechanics, 12(1), 738–749. https://doi.org/10.1080/19942060.2018.1526119
Hamuda, E., Mc Ginley, B., Glavin, M., & Jones, E. (2017). Automatic crop detection under field conditions using the HSV colour space and morphological operations. Computers and Electronics in Agriculture, 133, 97–107. https://doi.org/10.1016/j.compag.2016.11.021
Akbarzadeh, S., Paap, A., Ahderom, S., Apopei, B., & Alameh, K. (2018). Plant discrimination by Support Vector Machine classifier based on spectral reflectance. Computers and Electronics in Agriculture, 148, 250–258. https://doi.org/10.1016/j.compag.2018.03.026
Hoang Trong, V., Gwang-hyun, Y., Thanh Vu, D., & Jin-young, K. (2020). Late fusion of multimodal deep neural networks for weeds classification. Computers and Electronics in Agriculture, 175, 105506. https://doi.org/10.1016/j.compag.2020.105506
Bhosle, K., & Ahirwadkar, B. (2021). Deep learning convolutional neural network (cnn) for cotton, mulberry and sugarcane classification using hyperspectral remote sensing data. Journal of Integrated Science and Technology, 9(2), 70-74.
Kunduracioglu, I., & Pacal, I. (2024). Advancements in deep learning for accurate classification of grape leaves and diagnosis of grape diseases. Journal of Plant Diseases and Protection, 131(3), 1061-1080. https://doi.org/10.1007/s41348-024-00896-z
Khan, A., Yadav, M. S., & Ahmad, S. (2017). Image processing based disease detection for sugarcane leaves. International Journal of Advance Research, Ideas and Innovations in Technology, 3(4), 497-502. https://www.jetir.org/view?paper=JETIR1806177
Arivazhagan, S., Shebiah, R. N., Ananthi, S., & Varthini, S. V. (2013). Detection of unhealthy region of plant leaves and classification of plant leaf diseases using texture features. Agricultural Engineering International: CIGR Journal, 15(1), 211-217.
Hashemi-Beni, L., Gebrehiwot, A., Karimoddini, A., Shahbazi, A., & Dorbu, F. (2022). Deep Convolutional Neural Networks for Weeds and Crops Discrimination From UAS Imagery. Frontiers in Remote Sensing, 3. https://doi.org/10.3389/frsen.2022.755939
Vezıroglu, E., Pacal, I., & Coşkunçay, A. (2023). Derin Evrişimli Sinir Ağları Kullanılarak Pirinç Hastalıklarının Sınıflandırılması. Journal of the Institute of Science and Technology, 13(2), 792-814. https://doi.org/10.21597/jist.1265769
Kılıçarslan, S., & Pacal, I. (2023). Domates Yapraklarında Hastalık Tespiti İçin Transfer Öğrenme Metotlarının Kullanılması. Mühendislik Bilimleri ve Araştırmaları Dergisi, 5(2), 215-222. https://doi.org/10.46387/bjesr.1273729
Pacal, I. (2024). Enhancing crop productivity and sustainability through disease identification in maize leaves: Exploiting a large dataset with an advanced vision transformer model. Expert Systems with Applications, 238, 122099. https://doi.org/10.1016/j.eswa.2023.122099
Srinivas, B., Satheesh, P., Rama Santosh Naidu, P., & Neelima, U. (2021). Prediction of guava plant diseases using deep learning. In ICCCE 2020: Proceedings of the 3rd International Conference on Communications and Cyber Physical Engineering (pp. 1495-1505). Springer Singapore. https://doi.org/10.1007/978-981-15-7961-5_135
Karmokar, B. C., Ullah, M. S., Siddiquee, M. K., & Alam, K. M. R. (2015). Tea leaf diseases recognition using neural network ensemble. International Journal of Computer Applications, 114(17), 27-30. https://doi.org/10.5120/20071-1993
Baranwal, S., Khandelwal, S., & Arora, A. (2019). Deep Learning Convolutional Neural Network for Apple Leaves Disease Detection. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3351641
Goluguri, N. V. R. R., Devi, K. S., & Srinivasan, P. (2021). Rice-net: an efficient artificial fish swarm optimization applied deep convolutional neural network model for identifying the Oryza sativa diseases. Neural Computing and Applications, 33(11), 5869–5884. https://doi.org/10.1007/s00521-020-05364-x
Militante, S. V., & Gerardo, B. D. (2019, December). Detecting sugarcane diseases through adaptive deep learning models of convolutional neural network. In 2019 IEEE 6th International Conference on Engineering Technologies and Applied Sciences (ICETAS) (pp. 1-5). IEEE. https://doi.org/10.1109/ICETAS48360.2019.9117332
Chen, W., Ju, C., Li, Y., Hu, S., & Qiao, X. (2021). Sugarcane Stem Node Recognition in Field by Deep Learning Combining Data Expansion. Applied Sciences, 11(18), 8663. https://doi.org/10.3390/app11188663
Wang, W., Li, C., Wang, K., Tang, L., Ndiluau, P. F., & Cao, Y. (2022). Sugarcane stem node detection and localization for cutting using deep learning. Frontiers in Plant Science, 13. https://doi.org/10.3389/fpls.2022.1089961
Borhani, Y., Khoramdel, J., & Najafi, E. (2022). A deep learning based approach for automated plant disease classification using vision transformer. Scientific Reports, 12(1), 11554. https://doi.org/10.1038/s41598-022-15163-0
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., ... & Houlsby, N. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929. http://arxiv.org/abs/2010.11929
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539
Huang, Y. L., & Fan, L. T. (1993). Artificial intelligence for waste minimization in the process industry. Computers in Industry, 22(2), 117–128. https://doi.org/10.1016/0166-3615(93)90059-A
Zhong, J., Yang, B., Huang, G., Zhong, F., & Chen, Z. (2016). Remote Sensing Image Fusion with Convolutional Neural Network. Sensing and Imaging, 17(1), 1–16. https://doi.org/10.1007/S11220-016-0135-6/TABLES/4
Jha, K., Doshi, A., Patel, P., & Shah, M. (2019). A comprehensive review on automation in agriculture using artificial intelligence. Artificial Intelligence in Agriculture, 2, 1–12. https://doi.org/10.1016/j.aiia.2019.05.004
Li, X., Li, X., Zhang, S., Zhang, G., Zhang, M., & Shang, H. (2023). SLViT: Shuffle-convolution-based lightweight Vision transformer for effective diagnosis of sugarcane leaf diseases. Journal of King Saud University - Computer and Information Sciences, 35(6), 101401. https://doi.org/10.1016/j.jksuci.2022.09.013
Thite, S., Suryawanshi, Y., Patil, K., & Chumchu, P. (2024). Sugarcane leaf dataset: A dataset for disease detection and classification for machine learning applications. Data in Brief, 53. https://doi.org/10.1016/j.dib.2024.110268
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Journal of Soft Computing and Decision Analytics
This work is licensed under a Creative Commons Attribution 4.0 International License.
