AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Application of Improved UNet and EnglightenGAN for Segmentation and Reconstruction of In Situ Roots

Qiushi Yu1,Jingqi Wang1,Hui Tang1Jiaxi Zhang1Wenjie Zhang1Liantao Liu2( )Nan Wang1( )
College of Mechanical and Electrical Engineering, Hebei Agricultural University, 071000, Baoding, China
College of Agronomy, Hebei Agricultural University, 071000, Baoding, China

†These author contributed equally to this work.

Show Author Information

Abstract

The root is an important organ for crops to absorb water and nutrients. Complete and accurate acquisition of root phenotype information is important in root phenomics research. The in situ root research method can obtain root images without destroying the roots. In the image, some of the roots are vulnerable to soil shading, which severely fractures the root system and diminishes its structural integrity. The methods of ensuring the integrity of in situ root identification and establishing in situ root image phenotypic restoration remain to be explored. Therefore, based on the in situ root image of cotton, this study proposes a root segmentation and reconstruction strategy, improves the UNet model, and achieves precise segmentation. It also adjusts the weight parameters of EnlightenGAN to achieve complete reconstruction and employs transfer learning to implement enhanced segmentation using the results of the former two. The research results show that the improved UNet model has an accuracy of 99.2%, mIOU of 87.03%, and F1 of 92.63%. The root reconstructed by EnlightenGAN after direct segmentation has an effective reconstruction ratio of 92.46%. This study enables a transition from supervised to unsupervised training of root system reconstruction by designing a combination strategy of segmentation and reconstruction network. It achieves the integrity restoration of in situ root system pictures and offers a fresh approach to studying the phenotypic of in situ root systems, also realizes the restoration of the integrity of the in situ root image, and provides a new method for in situ root phenotype study.

References

1

Zhu H, Zhang LM, Garg A. Investigating plant transpiration-induced soil suction affected by root morphology and root depth. Comput Geotech. 2018;103:26–31.

2

Canarini A, Kaiser C, Merchant A, Richter A, Wanek W. Root exudation of primary metabolites: Mechanisms and their roles in plant responses to environmental stimuli. Front Plant Sci. 2019;10:Article 157.

3

Cheng B, Wang C, Yue L, Chen F, Cao X, Lan Q, Liu T, Wang Z. Selenium nanomaterials improve the quality of lettuce (Lactuca sativa L.) by modulating root growth, nutrient availability, and photosynthesis. NanoImpact. 2023;29:Article 100449.

4

Xiao S, Liu L, Zhang Y, Sun H, Bai Z, Zhang K, Tian S, Dong H, Li C. Review on new methods of in situ observation of plant micro-roots and interpretation of root images. J Plant Nutri Ferti. 2020;26(2):370–385.

5

Liu X, Gu H, Han J, Jiang H, Duan S. Research progress of ground penetrating radar and electrical capacitance for in-situ non-destructive measurement of crop roots. Trans Chin Soc Agric Eng. 2020;36(20):226–237.

6

Bates GH. A device for the observation of root growth in the soil. Nature. 1937;139(3527):966–967.

7

Rajurkar AB, Mccoy SM, Ruhter J, Mulcrone J, Freyfogle L, Leakey ADB. Installation and imaging of thousands of minirhizotrons to phenotype root systems of field-grown plants. Plant Methods. 2022;18(1):Article 39.

8

Jahnke S, Menzel MI, Van Dusschoten D, Roeb GW, Bühler J, Minwuyelet S, Blümler P, Temperton VM, Hombach T, Streun M, et al. Combined MRI–PET dissects dynamic changes in plant structures and functions. Plant J. 2009;59(4):634–644.

9

Shao MR, Jiang N, Li M, Howard A, Lehner K, Mullen JL, Gunn SL, Mckay JK, Topp CN. Complementary phenotyping of maize root system architecture by root pulling force and X-ray imaging. Plant Phenomics. 2021;2021:Article 9859254.

10

Mehra P, Kumar P, Bolan N, Desbiolles J, Orgill S, Denton MD. Changes in soil-pores and wheat root geometry due to strategic tillage in a no-tillage cropping system. Soil Research. 2020;59(1):83–96.

11

Hou LH, Gao W, Weng ZH, Doolette CL, Maksimenko A, Hausermann D, Zheng Y, Tang C, Lombi E, Kopittke PM. Use of X-ray tomography for examining root architecture in soils. Geoderma. 2022;405:Article 115405.

12

Borisjuk L, Rolletschek H, Neuberger T. Surveying the plant’s world by magnetic resonance imaging. Plant J. 2012;70(1):129–146.

13

Koch A, Meunier F, Vanderborght J, Garré S, Pohlmeier A, Javaux M. Functional–structural root-system model validation using a soil MRI experiment. J Exp Bot. 2019;70(10):2797–2809.

14

Haber-Pohlmeier S, Tötzke C, Lehmann E, Kardjilov N, Pohlmeier A, Oswald SE. Combination of magnetic resonance imaging and neutron computed tomography for three-dimensional rhizosphere imaging. Vadose Zone J. 2019;18(1):Article 180166.

15

Pflugfelder D, Kochs J, Koller R, Jahnke S, Mohl C, Pariyar S, Fassbender H, Nagel KA, Watt M, van Dusschoten D. The root system architecture of wheat establishing in soil is associated with varying elongation rates of seminal roots: Quantification using 4D magnetic resonance imaging. J Exp Bot. 2021;73(7):2050–2060.

16

Metzner R, Eggert A, Van Dusschoten D, Pflugfelder D, Gerth S, Schurr U, Uhlmann N, Jahnke S. Direct comparison of MRI and X-ray CT technologies for 3D imaging of root systems in soil: Potential and challenges for root trait quantification. Plant Methods. 2015;11(1): 17.

17

Hammac WA, Pan WL, Bolton RP, Koenig RT. High resolution imaging to assess oilseed species’ root hair responses to soil water stress. Plant Soil. 2011;339(1):125–135.

18

Tamura A, Oguma H, Fujimoto R, Kuribayashi M, Makita N. Phenology of fine root and shoot using high frequency temporal resolution images in a temperate larch forest. Rhizosphere. 2022;22:Article 100541.

19

Selvaraj MG, Montoya-P ME, Atanbori J, French AP, Pridmore T. A low-cost aeroponic phenotyping system for storage root development: Unravelling the below-ground secrets of cassava (Manihot esculenta). Plant Methods. 2019;15:1–13.

20

Tiwari JK, Sapna D, Buckseth T, Nilofer A, Singh RK, Zinta R, Chakrabarti SK. Precision phenotyping of contrasting potato (Solanum tuberosum L.) varieties in a novel aeroponics system for improving nitrogen use efficiency: In search of key traits and genes. J Integr Agric. 2020;19(1):51–61.

21

Lynch JP. Steep, cheap and deep: An ideotype to optimize water and N acquisition by maize root systems. Ann Bot. 2013;112(2):347–357.

22

Abramoff MD, Magalhães PJ, Ram SJ. Image processing with ImageJ. Biophotonics Int. 2004;11(7):36–42.

23

Le Bot J, Serra V, Fabre J, Draye X, Adamowicz S, Pagès L. DART: A software to analyse root system architecture and development from captured images. Plant Soil. 2010;326(1):261–273.

24

Wang T, Rostamza M, Song Z, Wang L, Mcnickle G, Iyer-Pascuzzi AS, Qiu Z, Jin J. SegRoot: A high throughput segmentation method for root image analysis. Comput Electron Agric. 2019;162:845–854.

25

Badrinarayanan V, Kendall A, Cipolla R. SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell. 2017;39(12):2481–2495.

26

Jubery TZ, Carley CN, Singh A, Sarkar S, Ganapathysubramanian B, Singh AK. Using machine learning to develop a fully automated soybean nodule acquisition pipeline (snap). Plant Phenomics. 2021;2021:Article 9834746.

27
Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. ArXiv. 2015. https://doi.org/10.48550/arXiv.1505.04597
28
Lin T-Y, Goyal P, Girshick R, He K, and Dollár P. Focal loss for dense object detection, in: Proceedings of the IEEE International Conference on Computer Vision; 2017 Oct 22–29; Venice, Italy.
29

Gaggion N, Ariel F, Daric V, Lambert E, Legendre S, Roulé T, Camoirano A, Milone DH, Crespi M, Blein T, et al. ChronoRoot: High-throughput phenotyping by deep segmentation networks reveals novel temporal parameters of plant root system architecture. GigaScience. 2021;10(7):Article giab052.

30

Yuan L, Ruan C, Hu H, Chen D. Image Inpainting based on patch-GANs. IEEE Access. 2019;7:46411–46421.

31

Zhang X, Wang X, Shi C, Yan Z, Li X, Kong B, Lyu S, Zhu B, Lv J, Yin Y, et al. DE-GAN: Domain embedded GAN for high quality face image Inpainting. Pattern Recogn. 2022;124:Article 108415.

32

Thesma V, Mohammadpour Velni J. Plant root phenotyping using deep conditional GANs and binary semantic segmentation. Sensors (Basel). 2023;23(1):309.

33

Mi J, Gao W, Yang S, Hao X, Li M, Wang M, Zheng L. A method of plant root image restoration based on GAN. IFAC-PapersOnLine. 2019;52(30):219–224.

34

Jiang Y, Gong X, Liu D, Cheng Y, Fang C, Shen X, Yang J, Zhou P, Wang Z. Enlightengan: Deep light enhancement without paired supervision. IEEE Trans Image Process. 2021;30:2340–2349.

35

Zhao H, Wang N, Sun H, Zhu L, Zhang K, Zhang Y, Zhu J,Li A, Bai Z, Liu X, et al. RhizoPot platform: A high-throughput in situ root phenotyping platform with integrated hardware and software. Front Plant Sci. 2022;13:Article 1004904.

36

Shen C, Liu L, Zhu L, Kang J, Shao L. High-throughput in situ root image segmentation based on the improved DeepLabv3+ method. Front Plant Sci. 2020;11:Article 576791.

37

Jia KA, Llbc D, Fz E, Chen SA, Nan W, Ls A. Semantic segmentation model of cotton roots in-situ image based on attention mechanism. Comput Electron Agric. 2021;189:Article 106370.

38

Yu Q, Tang H, Zhu L, Zhang W, Liu L, Wang N. A method of cotton root segmentation based on edge devices. Front Plant Sci. 2023;14:Article 1122833.

39
Woo S, Park J, Lee J-Y, Kweon IS. Cbam: Convolutional block attention module, Proceedings of the European conference on computer vision (ECCV), Cham: Springer; 2018.
40

Zhu L, Liu L, Sun H, Zhang K, Zhang Y, Li A, Bai Z, Wang G, Liu X, Dong H, et al. Low nitrogen supply inhibits root growth but prolongs lateral root lifespan in cotton. Ind Crop Prod. 2022;189:Article 115733.

41

Zhu L, Liu L, Sun H, Zhang Y, Liu X, Wang N, Chen J, Zhang K,Bai Z, Wang G, et al. The responses of lateral roots and root hairs to nitrogen stress in cotton based on daily root measurements. J Agron Crop Sci. 2022;208(1):89–105.

42
Shi W, Caballero J, Huszár F, Totz J, Aitken AP, Bishop R, Rueckert D, Wang Z. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Paper presented at: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2016; Las Vegas, NV.
43

Seethepalli A, Dhakal K, Griffiths M, Guo H, Freschet GT, York LM. RhizoVision explorer: Open-source software for root image analysis and measurement standardization. AoB Plants. 2021;13(6):Article plab056.

44

Smith AG, Han E, Petersen J, Olsen N, Giese C, Athmann M, Dresbøll DB, Thorup-Kristensen K. RootPainter: Deep learning segmentation of biological images with corrective annotation. New Phytol. 2022;236(2):774–791.

Plant Phenomics
Article number: 0066
Cite this article:
Yu Q, Wang J, Tang H, et al. Application of Improved UNet and EnglightenGAN for Segmentation and Reconstruction of In Situ Roots. Plant Phenomics, 2023, 5: 0066. https://doi.org/10.34133/plantphenomics.0066

173

Views

5

Crossref

7

Web of Science

7

Scopus

0

CSCD

Altmetrics

Received: 13 March 2023
Accepted: 14 June 2023
Published: 06 July 2023
© 2023 Qiushi Yu et al. Exclusive licensee Nanjing Agricultural University. No claim to original U.S. Government Works.

Distributed under a Creative Commons Attribution License 4.0 (CC BY 4.0).

Return