Data-Efficient Vision Transformer Models for Robust Classification of Sugarcane

Authors

DOI:

https://doi.org/10.31181/jscda21202446

Keywords:

Artificial Intelligence, Deep-Learning, ViT, Plant diseases, Image processing

Abstract

Sugar cane is an important agricultural product that provides 75% of the world's sugar production. As with all plant species, any disease affecting sugarcane can significantly impact yields and planning. Diagnosing diseases in sugarcane leaves using traditional methods is slow, inefficient, and often lacking in accuracy. This study presents a deep learning-based approach for accurate diagnosis of diseases in sugarcane leaves. Specifically, training and evaluation were conducted on the publicly available Sugarcane Leaf Dataset using leading ViT (Vision Transformer) architectures such as DeiT3-Small and DeiT-Tiny. This dataset includes 11 different disease classes and a total of 6748 images. Additionally, these models were compared with popular CNN models. The findings of the study show that there is no direct relationship between model complexity, depth, and accuracy for the 11-class sugarcane dataset. Among the 12 models tested, the DeiT3-Small model showed the highest performance with 93.79% accuracy, 91.27% precision, and 90.96% F1-score. These results highlight that rapid, accurate, and automatic disease diagnosis systems developed using deep learning techniques can significantly improve sugarcane disease management and contribute to increased yields.

References

Mueller, D. S., Wise, K. A., Sisson, A. J., Allen, T. W., Bergstrom, G. C., Bosley, D. B., Bradley, C. A., Broders, K. D., Byamukama, E., Chilvers, M. I., Collins, A., Faske, T. R., Friskop, A. J., Heiniger, R. W., Hollier, C. A., Hooker, D. C., Isakeit, T., Jackson-Ziems, T. A., Jardine, D. J., … Warner, F. (2016). Corn Yield Loss Estimates Due to Diseases in the United States and Ontario, Canada from 2012 to 2015. Plant Health Progress, 17(3), 211–222. https://doi.org/10.1094/PHP-RS-16-0030

Fowler, H. J., Kilsby, C. G., & O’Connell, P. E. (2003). Modeling the impacts of climatic change and variability on the reliability, resilience, and vulnerability of a water resource system. Water Resources Research, 39(8). https://doi.org/10.1029/2002WR001778

Kunduracıoğlu, İ. (2018). Examining the interface of lego mindstorms ev3 robot programming. Journal of Educational Technology and Online Learning, 1(1), 28-46.. https://doi.org/10.31681/jetol.372826

Kunduracıoğlu, İ., & Durak, G. (2018). A CONTENT ANALYSIS ON GAMIFICATION. European Journal of Open Education and E-Learning Studies, 3(2). https://doi.org/10.5281/zenodo.2228190

Javaid, M., Haleem, A., Singh, R. P., & Suman, R. (2022). Enhancing smart farming through the applications of Agriculture 4.0 technologies. International Journal of Intelligent Networks, 3, 150–164. https://doi.org/10.1016/j.ijin.2022.09.004

Arjunagi, S., & Patil, N. B. (2023). Optimized convolutional neural network for identification of maize leaf diseases with adaptive ageist spider monkey optimization model. International Journal of Information Technology, 15(2), 877–891. https://doi.org/10.1007/s41870-021-00657-3

He, J., Liu, T., Li, L., Hu, Y., & Zhou, G. (2023). MFaster R-CNN for Maize Leaf Diseases Detection Based on Machine Vision. Arabian Journal for Science and Engineering, 48(2), 1437–1449. https://doi.org/10.1007/s13369-022-06851-0

Viswanathan, R., & Rao, G. P. (2011). Disease Scenario and Management of Major Sugarcane Diseases in India. Sugar Tech, 13(4), 336–353. https://doi.org/10.1007/s12355-011-0102-4

Bashir, S., & Sharma, N. (2012). Remote Area Plant Disease Detection Using Image Processing. In IOSR Journal of Electronics and Communication Engineering, 2(6), 31-34. http://dx.doi.org/10.9790/2834-0263134

Taherei Ghazvinei, P., Darvishi, H. H., Mosavi, A., Bin Wan Yusof, K., Alizamir, M., Shamshirband, S., & Chau, K. W. (2018). Sugarcane growth prediction based on meteorological parameters using extreme learning machine and artificial neural network. Engineering Applications of Computational Fluid Mechanics, 12(1), 738–749. https://doi.org/10.1080/19942060.2018.1526119

Hamuda, E., Mc Ginley, B., Glavin, M., & Jones, E. (2017). Automatic crop detection under field conditions using the HSV colour space and morphological operations. Computers and Electronics in Agriculture, 133, 97–107. https://doi.org/10.1016/j.compag.2016.11.021

Akbarzadeh, S., Paap, A., Ahderom, S., Apopei, B., & Alameh, K. (2018). Plant discrimination by Support Vector Machine classifier based on spectral reflectance. Computers and Electronics in Agriculture, 148, 250–258. https://doi.org/10.1016/j.compag.2018.03.026

Hoang Trong, V., Gwang-hyun, Y., Thanh Vu, D., & Jin-young, K. (2020). Late fusion of multimodal deep neural networks for weeds classification. Computers and Electronics in Agriculture, 175, 105506. https://doi.org/10.1016/j.compag.2020.105506

Bhosle, K., & Ahirwadkar, B. (2021). Deep learning convolutional neural network (cnn) for cotton, mulberry and sugarcane classification using hyperspectral remote sensing data. Journal of Integrated Science and Technology, 9(2), 70-74.

Kunduracioglu, I., & Pacal, I. (2024). Advancements in deep learning for accurate classification of grape leaves and diagnosis of grape diseases. Journal of Plant Diseases and Protection, 131(3), 1061-1080. https://doi.org/10.1007/s41348-024-00896-z

Khan, A., Yadav, M. S., & Ahmad, S. (2017). Image processing based disease detection for sugarcane leaves. International Journal of Advance Research, Ideas and Innovations in Technology, 3(4), 497-502. https://www.jetir.org/view?paper=JETIR1806177

Arivazhagan, S., Shebiah, R. N., Ananthi, S., & Varthini, S. V. (2013). Detection of unhealthy region of plant leaves and classification of plant leaf diseases using texture features. Agricultural Engineering International: CIGR Journal, 15(1), 211-217.

Hashemi-Beni, L., Gebrehiwot, A., Karimoddini, A., Shahbazi, A., & Dorbu, F. (2022). Deep Convolutional Neural Networks for Weeds and Crops Discrimination From UAS Imagery. Frontiers in Remote Sensing, 3. https://doi.org/10.3389/frsen.2022.755939

Vezıroglu, E., Pacal, I., & Coşkunçay, A. (2023). Derin Evrişimli Sinir Ağları Kullanılarak Pirinç Hastalıklarının Sınıflandırılması. Journal of the Institute of Science and Technology, 13(2), 792-814. https://doi.org/10.21597/jist.1265769

Kılıçarslan, S., & Pacal, I. (2023). Domates Yapraklarında Hastalık Tespiti İçin Transfer Öğrenme Metotlarının Kullanılması. Mühendislik Bilimleri ve Araştırmaları Dergisi, 5(2), 215-222. https://doi.org/10.46387/bjesr.1273729

Pacal, I. (2024). Enhancing crop productivity and sustainability through disease identification in maize leaves: Exploiting a large dataset with an advanced vision transformer model. Expert Systems with Applications, 238, 122099. https://doi.org/10.1016/j.eswa.2023.122099

Srinivas, B., Satheesh, P., Rama Santosh Naidu, P., & Neelima, U. (2021). Prediction of guava plant diseases using deep learning. In ICCCE 2020: Proceedings of the 3rd International Conference on Communications and Cyber Physical Engineering (pp. 1495-1505). Springer Singapore. https://doi.org/10.1007/978-981-15-7961-5_135

Karmokar, B. C., Ullah, M. S., Siddiquee, M. K., & Alam, K. M. R. (2015). Tea leaf diseases recognition using neural network ensemble. International Journal of Computer Applications, 114(17), 27-30. https://doi.org/10.5120/20071-1993

Baranwal, S., Khandelwal, S., & Arora, A. (2019). Deep Learning Convolutional Neural Network for Apple Leaves Disease Detection. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3351641

Goluguri, N. V. R. R., Devi, K. S., & Srinivasan, P. (2021). Rice-net: an efficient artificial fish swarm optimization applied deep convolutional neural network model for identifying the Oryza sativa diseases. Neural Computing and Applications, 33(11), 5869–5884. https://doi.org/10.1007/s00521-020-05364-x

Militante, S. V., & Gerardo, B. D. (2019, December). Detecting sugarcane diseases through adaptive deep learning models of convolutional neural network. In 2019 IEEE 6th International Conference on Engineering Technologies and Applied Sciences (ICETAS) (pp. 1-5). IEEE. https://doi.org/10.1109/ICETAS48360.2019.9117332

Chen, W., Ju, C., Li, Y., Hu, S., & Qiao, X. (2021). Sugarcane Stem Node Recognition in Field by Deep Learning Combining Data Expansion. Applied Sciences, 11(18), 8663. https://doi.org/10.3390/app11188663

Wang, W., Li, C., Wang, K., Tang, L., Ndiluau, P. F., & Cao, Y. (2022). Sugarcane stem node detection and localization for cutting using deep learning. Frontiers in Plant Science, 13. https://doi.org/10.3389/fpls.2022.1089961

Borhani, Y., Khoramdel, J., & Najafi, E. (2022). A deep learning based approach for automated plant disease classification using vision transformer. Scientific Reports, 12(1), 11554. https://doi.org/10.1038/s41598-022-15163-0

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., ... & Houlsby, N. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929. http://arxiv.org/abs/2010.11929

LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539

Huang, Y. L., & Fan, L. T. (1993). Artificial intelligence for waste minimization in the process industry. Computers in Industry, 22(2), 117–128. https://doi.org/10.1016/0166-3615(93)90059-A

Zhong, J., Yang, B., Huang, G., Zhong, F., & Chen, Z. (2016). Remote Sensing Image Fusion with Convolutional Neural Network. Sensing and Imaging, 17(1), 1–16. https://doi.org/10.1007/S11220-016-0135-6/TABLES/4

Jha, K., Doshi, A., Patel, P., & Shah, M. (2019). A comprehensive review on automation in agriculture using artificial intelligence. Artificial Intelligence in Agriculture, 2, 1–12. https://doi.org/10.1016/j.aiia.2019.05.004

Li, X., Li, X., Zhang, S., Zhang, G., Zhang, M., & Shang, H. (2023). SLViT: Shuffle-convolution-based lightweight Vision transformer for effective diagnosis of sugarcane leaf diseases. Journal of King Saud University - Computer and Information Sciences, 35(6), 101401. https://doi.org/10.1016/j.jksuci.2022.09.013

Thite, S., Suryawanshi, Y., Patil, K., & Chumchu, P. (2024). Sugarcane leaf dataset: A dataset for disease detection and classification for machine learning applications. Data in Brief, 53. https://doi.org/10.1016/j.dib.2024.110268

Published

2024-06-23

How to Cite

Paçal, İshak, & Kunduracıoğlu, İsmail. (2024). Data-Efficient Vision Transformer Models for Robust Classification of Sugarcane. Journal of Soft Computing and Decision Analytics, 2(1), 258-271. https://doi.org/10.31181/jscda21202446