Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
Accurate wheat spike detection is crucial in wheat field phenotyping for precision farming. Advances in artificial intelligence have enabled deep learning models to improve the accuracy of detecting wheat spikes. However, wheat growth is a dynamic process characterized by important changes in the color feature of wheat spikes and the background. Existing models for wheat spike detection are typically designed for a specific growth stage. Their adaptability to other growth stages or field scenes is limited. Such models cannot detect wheat spikes accurately caused by the difference in color, size, and morphological features between growth stages. This paper proposes WheatNet to detect small and oriented wheat spikes from the filling to the maturity stage. WheatNet constructs a Transform Network to reduce the effect of differences in the color features of spikes at the filling and maturity stages on detection accuracy. Moreover, a Detection Network is designed to improve wheat spike detection capability. A Circle Smooth Label is proposed to classify wheat spike angles in drone imagery. A new micro-scale detection layer is added to the network to extract the features of small spikes. Localization loss is improved by Complete Intersection over Union to reduce the impact of the background. The results show that WheatNet can achieve greater accuracy than classical detection methods. The detection accuracy with average precision of spike detection at the filling stage is 90.1%, while it is 88.6% at the maturity stage. It suggests that WheatNet is a promising tool for detection of wheat spikes.
Weiss M, Jacob F, Duveiller G. Remote sensing for agricultural applications: A meta-review. Remote Sens Environ. 2020;236:Article 111402.
Cisternas I, Velásquez I, Caro A, Rodríguez A. Systematic literature review of implementations of precision agriculture. Comput Electron Agric. 2020;176:Article 105626.
Buetti S, Xu J, Lleras A. Predicting how color and shape combine in the human visual system to direct attention. Sci Rep. 2019;9:20258.
Fernandez-Gallego JA, Kefauver SC, Gutiérrez NA, Nieto-Taladriz MT, Araus JL. Wheat ear counting in-field conditions: High throughput and low-cost approach using RGB images. Plant Methods. 2018;14:22.
Zhou C, Liang D, Yang X, Yang H, Yue J, Yang G. Wheat ears counting in field conditions based on multi-feature optimization and TWSVM. Front Plant Sci. 2018;9:1024.
Li Q, Cai J, Berger B, Okamoto M, Miklavcic S. Detecting spikes of wheat plants using neural networks with Laws texture energy. Plant Methods. 2017;13:83.
Xiong H, Cao Z, Lu H, Madec S, Liu L, Shen C. TasselNetv2: In-field counting of wheat spikes with context-augmented local regression networks. Plant Methods. 2019;15:150.
Misra T, Arora A, Marwaha S, Chinnusamy V, Rao AR, Jain R, Sahoo RN, Ray M, Kumar S, Raju D, et al. SpikeSegNet—A deep learning approach utilizing encoder-decoder network with hourglass for spike segmentation and counting in wheat plant from visual imaging. Plant Methods. 2020;16:40.
Jiang Y, Li C. Convolutional neural networks for image-based high-throughput plant phenotyping: A review. Plant Phenomics. 2020;2020:4152816.
Ren S, He K, Girshick R, Sun J. Faster R-CNN: Towards real-time object detection with region proposal networks. Adv Neural Inf Proces Syst. 2015;28.
Dai J, Li Y, He K, Sun J. R-FCN: Object detection via region-based fully convolutional networks. Adv Neural Inf Proces Syst. 2016;29.
Tan M, Le Q. Efficientnet: Rethinking model scaling for convolutional neural networks. Int Conf Mach Learn. 2019;2019:6105–6114.
Lin T, Goyal P, Girshick R, He K, Dollár P. Focal loss for dense object detection. Proc IEEE Int Conf Comp Vision. 2017;2017:2980–2988.
Redmon J, Divvala S, Girshick R, Farhadi A. You only look once: Unified, real-time object detection. Proc IEEE/CVF Conf Comp Vision Pattern Recognit. 2016;2016:779–788.
Zhu Y, Cao Z, Lu H, Li Y, Xiao Y. In-field automatic observation of wheat heading stage using computer vision. Biosyst Eng. 2016;143:28–41.
Ma J, Shao W, Ye H, Wang L, Wang H, Zheng Y, Xue X. Arbitrary-oriented scene text detection via rotation proposals. IEEE Trans Multimed. 2018;20(11):3111–3122.
Wang D, Zhang D, Yang G, Xu B, Luo Y, Yang X. SSRNet: In-field counting wheat ears using multi-stage convolutional neural network. IEEE Trans Geosci Remote Sens. 2021;60:1–11.
Hasan M, Chopin J, Laga H, Miklavcic S. Detection and analysis of wheat spikes using convolutional neural networks. Plant Methods. 2018;14(1):1–13.
Li J, Li C, Fei S, Ma C, Chen W, Ding F, Wang Y, Li Y, Shi J, Xiao Z. Wheat ear recognition based on RetinaNet and transfer learning. Sensors. 2021, 2021;21(14):4845.
Xu X, Li H, Yin F, Xi L, Qiao H, Ma Z, Shen S, Jiang B, Ma X. Wheat ear counting using K-means clustering segmentation and convolutional neural network. Plant Methods. 2020;16:106.
Chen J, Chen J, Zhang D, Sun Y, Nanehkaran YA. Using deep transfer learning for image-based plant disease identification. Comput Electron Agric. 2020;173:Article 105393.
Coulibaly S, Kamsu-Foguem B, Kamissoko D, Traore D. Deep neural networks with transfer learning in millet crop images. Comput Ind. 2019;108:115–120.
Ma J, Li Y, Liu H, Wu Y, Zhang L. Towards improved accuracy of UAV-based wheat ears counting: A transfer learning method of the ground-based fully convolutional network. Expert Syst Appl. 2022;191:Article 116226.
Weiss K, Khoshgoftaar T, Wang D. A survey of transfer learning. J Big Data. 2016;3(1):1–40.
Zhao J, Zhang X, Yan J, Qiu X, Yao X, Tian Y, Cao W. A wheat spike detection method in UAV images based on improved YOLOv5. Remote Sens. 2021;13(16):3095.
Zhao J, Yan J, Xue T, Wang S, Qiu X, Yao X, Tian Y, Zhu Y, Cao W, Zhang X. A deep learning method for oriented and small wheat spike detection (OSWSDet) in UAV images. Comput Electron Agric. 2022;2022(198):Article 107087.
Szegedy C, Ioffe S, Vanhoucke V, Alemi A. Inception-v4, inception-ResNet and the impact of residual connections on learning. Proc AAAI Conf Artif Intell. 2017;4278–4284.
Hu J, Shen L, Sun G. Squeeze-and-excitation networks. Proc IEEE Conf Comput Vis Pattern Recognit. 2018;2018:7132–7141.
Passalis N, Tefas A. Learning bag-of-features pooling for deep convolutional neural networks. Proc IEEE Int Conf Comp Vision. 2017;2017:5755–5763.
Yang X, Yan J. Arbitrary-oriented object detection with circular smooth label. Eur Conf Comp Vision. 2020;2020:677–694.
Zheng Z, Wang P, Ren D, Liu W, Ye R, Hu Q, Zuo W. Enhancing geometric factors in model learning and inference for object detection and instance segmentation. IEEE Trans Cybern. 2021;52(8):8574–8586.
Ming Q, Miao L, Zhou Z, Yang X, Dong Y. Optimization for arbitrary-oriented object detection via representation invariance loss. IEEE Geosci Remote Sens Lett. 2021;19:8021505.
Yang X, Yang J, Yan J, Zhang Y, Zhang T, Guo Z, Sun X, Fu K. Scrdet: Towards more robust detection for small, cluttered and rotated objects. Proc IEEE/CVF Int Conf Comp Vision. 2019;2019:8232–8241.
Bai X, Cao Z, Zhao L, Zhang J, Lv C, Li C, Xie J. Rice heading stage automatic observation by multi-classifier cascade based rice spike detection method. Agric For Meteorol. 2018;259:260–270.https://doi.org/10.48550/arXiv.1911.08299
Tan S, Lu H, Yu J, Lan M, Hu X, Zheng H, Peng Y, Wang Y, Li Z, Qi L, et al. In-field rice panicles detection and growth stages recognition based on RiceRes2Net. Comput Electron Agric. 2023;206:Article 107704.
Ma J, Li Y, Du K, Zheng F, Zhang L, Gong Z, Jiao W. Segmenting ears of winter wheat at flowering stage using digital images and deep learning. Comput Electron Agric. 2020;2020(168):Article 105159.
Wang X, Cai Z, Gao D, Vasconcelos N. Towards universal object detection by domain attention. Proc IEEE/CVF Conf Comp Vision Pattern Recognit. 2019;2019:7289–7298.
Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).