Journal Home > Volume 9 , Issue 6

Forest is one of the most challenging environments to be recorded in a three-dimensional (3D) digitized geometrical representation, because of the size and the complexity of the environment and the data-acquisition constraints brought by on-site conditions. Previous studies have indicated that the data-acquisition pattern can have more influence on the registration results than other factors. In practice, the ideal short-baseline observations, i.e., the dense collection mode, is rarely feasible, considering the low accessibility in forest environments and the commonly limited labor and time resources. The wide-baseline observations that cover a forest site using a few folds less observations than short-baseline observations, are therefore more preferable and commonly applied. Nevertheless, the wide-baseline approach is more challenging for data registration since it typically lacks the required sufficient overlaps between datasets. Until now, a robust automated registration solution that is independent of special hardware requirements has still been missing. That is, the registration accuracy is still far from the required level, and the information extractable from the merged point cloud using automated registration could not match that from the merged point cloud using manual registration. This paper proposes a discrete overlap search (DOS) method to find correspondences in the point clouds to solve the low-overlap problem in the wide-baseline point clouds. The proposed automatic method uses potential correspondences from both original data and selected feature points to reconstruct rough observation geometries without external knowledge and to retrieve precise registration parameters at data-level. An extensive experiment was carried out with 24 forest datasets of different conditions categorized in three difficulty levels. The performance of the proposed method was evaluated using various accuracy criteria, as well as based on data acquired from different hardware, platforms, viewing perspectives, and at different points of time. The proposed method achieved a 3D registration accuracy at a 0.50-cm level in all difficulty categories using static terrestrial acquisitions. In the terrestrial-aerial registration, data sets were collected from different sensors and at different points of time with scene changes, and a registration accuracy at the raw data geometric accuracy level was achieved. These results represent the highest automated registration accuracy and the strictest evaluation so far. The proposed method is applicable in multiple scenarios, such as 1) the global positioning of individual under-canopy observations, which is one of the main challenges in applying terrestrial observations lacking a global context, 2) the fusion of point clouds acquired from terrestrial and aerial perspectives, which is required in order to achieve a complete forest observation, 3) mobile mapping using a new stop-and-go approach, which solves the problems of lacking mobility and slow data collection in static terrestrial measurements as well as the data-quality issue in the continuous mobile approach. Furthermore, this work proposes a new error estimate that units all parameter-level errors into a single quantity and compensates for the downsides of the widely used parameter- and object-level error estimates; it also proposes a new deterministic point sets registration method as an alternative to the popular sampling methods.


menu
Abstract
Full text
Outline
About this article

Automated registration of wide-baseline point clouds in forests using discrete overlap search

Show Author's information Onni Pohjavirtaa,1Xinlian Liangb,a,1( )Yunsheng WangaAntero KukkoaJiri Pyöräläa,cEric HyyppäaXiaowei YuaHarri Kaartinena,dJuha Hyyppäa
Department of Remote Sensing and Photogrammetry, Finnish Geospatial Research Institute, Vuorimiehentie 5, Espoo, 02150, Finland
The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, 430070, China
Department of Forest Sciences, University of Helsinki, Helsinki, FI-00014, Finland
Department of Geography and Geology, University of Turku, Turku, FI-20500, Finland

1 Xinlian Liang and Onni Pohjavirta are the joint first authors.]]>

Abstract

Forest is one of the most challenging environments to be recorded in a three-dimensional (3D) digitized geometrical representation, because of the size and the complexity of the environment and the data-acquisition constraints brought by on-site conditions. Previous studies have indicated that the data-acquisition pattern can have more influence on the registration results than other factors. In practice, the ideal short-baseline observations, i.e., the dense collection mode, is rarely feasible, considering the low accessibility in forest environments and the commonly limited labor and time resources. The wide-baseline observations that cover a forest site using a few folds less observations than short-baseline observations, are therefore more preferable and commonly applied. Nevertheless, the wide-baseline approach is more challenging for data registration since it typically lacks the required sufficient overlaps between datasets. Until now, a robust automated registration solution that is independent of special hardware requirements has still been missing. That is, the registration accuracy is still far from the required level, and the information extractable from the merged point cloud using automated registration could not match that from the merged point cloud using manual registration. This paper proposes a discrete overlap search (DOS) method to find correspondences in the point clouds to solve the low-overlap problem in the wide-baseline point clouds. The proposed automatic method uses potential correspondences from both original data and selected feature points to reconstruct rough observation geometries without external knowledge and to retrieve precise registration parameters at data-level. An extensive experiment was carried out with 24 forest datasets of different conditions categorized in three difficulty levels. The performance of the proposed method was evaluated using various accuracy criteria, as well as based on data acquired from different hardware, platforms, viewing perspectives, and at different points of time. The proposed method achieved a 3D registration accuracy at a 0.50-cm level in all difficulty categories using static terrestrial acquisitions. In the terrestrial-aerial registration, data sets were collected from different sensors and at different points of time with scene changes, and a registration accuracy at the raw data geometric accuracy level was achieved. These results represent the highest automated registration accuracy and the strictest evaluation so far. The proposed method is applicable in multiple scenarios, such as 1) the global positioning of individual under-canopy observations, which is one of the main challenges in applying terrestrial observations lacking a global context, 2) the fusion of point clouds acquired from terrestrial and aerial perspectives, which is required in order to achieve a complete forest observation, 3) mobile mapping using a new stop-and-go approach, which solves the problems of lacking mobility and slow data collection in static terrestrial measurements as well as the data-quality issue in the continuous mobile approach. Furthermore, this work proposes a new error estimate that units all parameter-level errors into a single quantity and compensates for the downsides of the widely used parameter- and object-level error estimates; it also proposes a new deterministic point sets registration method as an alternative to the popular sampling methods.

Keywords: In situ, Point cloud, Forest, Unmanned aerial vehicle, Terrestrial laser scanning, Drone, Close-range sensing, Registration, Wide-baseline, Discrete overlap search

References(50)

Balenović, I., Liang, X., Jurjević, L., Hyyppä, J., Seletković, A., Kukko, A., 2021. Handheld personal laser scanning: current status and perspectives for forest inventory application. Croat. J. For. Eng. 42, 163–174. https://doi.org/10.5552/crojfe.2021.858.

Bienert, A., Maas, H. -G., 2009. Methods for the automatic geometric registration of terrestrial laser scanner point clouds in forest stands. In: Bretar, F., PierrotDeseilligny, M., Vosselman, G. (Eds. ), Laser Scanning 2009. ISPRS, Vol. XXXVIII, Part 3/W8, Paris, France, September 1-2, 2009.

Borrmann, D., Elseberg, J., Lingemann, K., Nüchter, A., Hertzberg, J., 2008. Globally consistent 3D mapping with scan matching. Robot. Autonom. Syst. 56, 130–142. https://doi.org/10.1016/j.robot.2007.07.002.

Crum, W.R., Hartkens, T., Hill, D.L.G., 2004. Non-rigid image registration: theory and practice. BJR 77, S140–S153. https://doi.org/10.1259/bjr/25329214.

Dai, W., Yang, B., Liang, X., Dong, Z., Huang, R., Wang, Y., Pyörälä, J., Kukko, A., 2020. Fast registration of forest terrestrial laser scans using key points detected from crowns and stems. Int. J. Digit. Earth 1–19. https://doi.org/10.1080/17538947.2020.1764118.

Durrant-Whyte, H., Bailey, T., 2006. Simultaneous localization and mapping: part I. IEEE Robot. Autom. Mag. 13, 99–110. https://doi.org/10.1109/MRA.2006.1638022.

Govindu, V.M., 2004. Lie-algebraic averaging for globally consistent motion estimation. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. IEEE, Washington, DC, USA, pp. 684–691. https://doi.org/10.1109/CVPR.2004.1315098.
DOI

Guan, H., Su, Y., Hu, T., Wang, R., Ma, Q., Yang, Q., Sun, X., Li, Y., Jin, S., Zhang, J., Ma, Q., Liu, M., Wu, F., Guo, Q., 2020a. A novel framework to automatically fuse multiplatform LiDAR data in forest environments based on tree locations. IEEE Trans. Geosci. Rem. Sens. 58, 2165–2177. https://doi.org/10.1109/TGRS.2019.2953654.

Guan, H., Su, Y., Sun, X., Xu, G., Li, W., Ma, Q., Wu, X., Wu, J., Liu, L., Guo, Q., 2020b. A marker-free method for registering multi-scan terrestrial laser scanning data in forest environments. ISPRS J. Photogrammetry Remote Sens. 166, 82–94. https://doi.org/10.1016/j.isprsjprs.2020.06.002.

Henning, J.G., Radtke, P.J., 2008. Multiview range-image registration for forested scenes using explicitly-matched tie points estimated from natural surfaces. ISPRS J. Photogrammetry Remote Sens. 63, 68–83.

Henning, J.G., Radtke, P.J., 2006. Ground-based laser imaging for assessing three dimensional forest canopy structure. Photogramm. Eng. Rem. Sens. 72, 1349.

Hilker, T., Coops, N.C., Culvenor, D.S., Newnham, G., Wulder, M.A., Bater, C.W., Siggins, A., 2012. A simple technique for co-registration of terrestrial LiDAR observations for forestry applications. Remote Sens. Lett. 3, 239–247. https://doi.org/10.1080/01431161.2011.565815.

Hyyppä, E., Hyyppä, J., Hakala, T., Kukko, A., Wulder, M.A., White, J.C., Pyörälä, J., Yu, X., Wang, Y., Virtanen, J. -P., Pohjavirta, O., Liang, X., Holopainen, M., Kaartinen, H., 2020a. Under-canopy UAV laser scanning for accurate forest field measurements. ISPRS J. Photogrammetry Remote Sens. 164, 41–60. https://doi.org/10.1016/j.isprsjprs.2020.03.021.

Hyyppä, E., Kukko, A., Kaijaluoto, R., White, J.C., Wulder, M.A., Pyörälä, J., Liang, X., Yu, X., Wang, Y., Kaartinen, H., Virtanen, J. -P., Hyyppä, J., 2020b. Accurate derivation of stem curve and volume using backpack mobile laser scanning. ISPRS J. Photogrammetry Remote Sens. 161, 246–262. https://doi.org/10.1016/j.isprsjprs.2020.01.018.

Hyyppä, J., Yu, X., Hakala, T., Kaartinen, H., Kukko, A., Hyyti, H., Muhojoki, J., Hyyppä, E., 2021. Under-canopy UAV laser scanning providing canopy height and stem volume accurately. Forests 12, 856. https://doi.org/10.3390/f12070856.

Jurjević, L., Liang, X., Gašparović, M., Balenović, I., 2020. Is field-measured tree height as reliable as believed – Part II, A comparison study of tree height estimates from conventional field measurement and low-cost close-range remote sensing in a deciduous forest. ISPRS J. Photogrammetry Remote Sens. 169, 227–241. https://doi.org/10.1016/j.isprsjprs.2020.09.014.

Kaartinen, H., Hyyppä, J., Vastaranta, M., Kukko, A., Jaakkola, A., Yu, X., Pyörälä, J., Liang, X., Liu, J., Wang, Y., Kaijaluoto, R., Melkas, T., Holopainen, M., Hyyppä, H., 2015. Accuracy of Kinematic positioning using global satellite navigation systems under forest canopies. Forests 6, 3218–3236. https://doi.org/10.3390/f6093218.

Kelbe, D., van Aardt, J., Romanczyk, P., van Leeuwen, M., Cawse-Nicholson, K., 2016. Marker-free registration of forest terrestrial laser scanner data pairs with embedded confidence metrics. IEEE Trans. Geosci. Rem. Sens. 54, 4314–4330. https://doi.org/10.1109/TGRS.2016.2539219.

Kukko, A., Kaijaluoto, R., Kaartinen, H., Lehtola, V.V., Jaakkola, A., Hyyppä, J., 2017. Graph SLAM correction for single scanner MLS forest data under boreal forest canopy. ISPRS J. Photogrammetry Remote Sens. 132, 199–209. https://doi.org/10.1016/j.isprsjprs.2017.09.006.

Liang, X., Hyyppä, J., 2013. Automatic stem mapping by merging several terrestrial laser scans at the feature and decision levels. Sensors 13, 1614–1634. https://doi.org/10.3390/s130201614.

Liang, X., Hyyppä, J., Kaartinen, H., Lehtomäki, M., Pyörälä, J., Pfeifer, N., Holopainen, M., Brolly, G., Francesco, P., Hackenberg, J., Huang, H., Jo, H. -W., Katoh, M., Liu, L., Mokroš, M., Morel, J., Olofsson, K., Poveda-Lopez, J., Trochta, J., Wang, D., Wang, J., Xi, Z., Yang, B., Zheng, G., Kankare, V., Luoma, V., Yu, X., Chen, L., Vastaranta, M., Saarinen, N., Wang, Y., 2018a. International benchmarking of terrestrial laser scanning approaches for forest inventories. ISPRS J. Photogrammetry Remote Sens. 144, 137–179. https://doi.org/10.1016/j.isprsjprs.2018.06.021.

Liang, X., Kankare, V., Hyyppä, J., Wang, Y., Kukko, A., Haggrén, H., Yu, X., Kaartinen, H., Jaakkola, A., Guan, F., Holopainen, M., Vastaranta, M., 2016. Terrestrial laser scanning in forest inventories. ISPRS J. Photogrammetry Remote Sens. 115, 63–77. https://doi.org/10.1016/j.isprsjprs.2016.01.006.

Liang, X., Kukko, A., Balenovic, I., Saarinen, N., Junttila, S., Kankare, V., Holopainen, M., Mokros, M., Surovy, P., Kaartinen, H., Jurjevic, L., Honkavaara, E., Nasi, R., Liu, J., Hollaus, M., Tian, J., Yu, X., Pan, J., Cai, S., Virtanen, J. -P., Wang, Y., Hyyppa, J., 2022. Close-range remote sensing of forests: the state of the art, challenges, and opportunities for systems and data acquisitions. IEEE Geosci. Remote Sens. Mag. 10, 32–71. https://doi.org/10.1109/MGRS.2022.3168135.

Liang, X., Kukko, A., Hyyppä, J., Lehtomäki, M., Pyörälä, J., Yu, X., Kaartinen, H., Jaakkola, A., Wang, Y., 2018b. In-situ measurements from mobile platforms: an emerging approach to address the old challenges associated with forest inventories. ISPRS J. Photogrammetry Remote Sens. 143, 97–107. https://doi.org/10.1016/j.isprsjprs.2018.04.019.

Liang, X., Litkey, P., Hyyppa, J., Kaartinen, H., Vastaranta, M., Holopainen, M., 2012. Automatic stem mapping using single-scan terrestrial laser scanning. IEEE Trans. Geosci. Rem. Sens. 50, 661–670. https://doi.org/10.1109/TGRS.2011.2161613.

Liang, X., Wang, Y., Pyörälä, J., Lehtomäki, M., Yu, X., Kaartinen, H., Kukko, A., Honkavaara, E., Issaoui, A.E.I., Nevalainen, O., Vaaja, M., Virtanen, J. -P., Katoh, M., Deng, S., 2019. Forest in situ observations using unmanned aerial vehicle as an alternative of terrestrial measurements. For. Ecosyst. 6, 20. https://doi.org/10.1186/s40663-019-0173-3.

Liu, J., Liang, X., Hyyppä, J., Yu, X., Lehtomäki, M., Pyörälä, J., Zhu, L., Wang, Y., Chen, R., 2017. Automated matching of multiple terrestrial laser scans for stem mapping without the use of artificial references. Int. J. Appl. Earth Obs. Geoinf. 56, 13–23. https://doi.org/10.1016/j.jag.2016.11.003.

Liu, Q., Wang, J., Ma, W., Zhang, J., Deng, Y., Shao, D., Xu, D., Liu, Y., 2021. Target-free ULS-TLS point-cloud registration for alpine forest lands. Comput. Electron. Agric. 190, 106460. https://doi.org/10.1016/j.compag.2021.106460.

Magnusson, M., Lilienthal, A., Duckett, T., 2007. Scan registration for autonomous mining vehicles using 3D-NDT. J. Field Robot. 24, 803–827. https://doi.org/10.1002/rob.20204.

Mulverhill, C., Coops, N.C., Tompalski, P., Bater, C.W., 2020. Digital terrestrial photogrammetry to enhance field-based forest inventory across stand conditions. Can. J. Rem. Sens. 46, 622–639. https://doi.org/10.1080/07038992.2020.1831376.

Myronenko, A., Song, Xubo, 2010. Point Set registration: coherent point drift. IEEE Trans. Pattern Anal. Mach. Intell. 32, 2262–2275. https://doi.org/10.1109/TPAMI.2010.46.

Ni, W., Sun, G., Guo, Z., Huang, H., 2011. A method for the registration of multiview range images acquired in forest areas using a terrestrial laser scanner. Int. J. Rem. Sens. 32, 9769–9787. https://doi.org/10.1080/01431161.2011.578597.

Paris, C., Kelbe, D., van Aardt, J., Bruzzone, L., 2017. A novel automatic method for the fusion of ALS and TLS Lidar data for robust assessment of tree crown structure. IEEE Trans. Geosci. Rem. Sens. 55, 3679–3693. https://doi.org/10.1109/TGRS.2017.2675963.

Pfeifer, N., Briese, C., 2007. Geometrical aspects of airborne laser scanning and terrestrial laser scanning. Int. Arch. Photogram. Rem. Sens. Spatial Inf. Sci. 36, 311–319.

Pierzchała, M., Giguère, P., Astrup, R., 2018. Mapping forests using an unmanned ground vehicle with 3D LiDAR and graph-SLAM. Comput. Electron. Agric. 145, 217–225. https://doi.org/10.1016/j.compag.2017.12.034.

Polewski, P., Yao, W., Cao, L., Gao, S., 2019. Marker-free coregistration of UAV and backpack LiDAR point clouds in forested areas. ISPRS J. Photogrammetry Remote Sens. 147, 307–318. https://doi.org/10.1016/j.isprsjprs.2018.11.020.

Pomerleau, F., Colas, F., Siegwart, R., 2015. A review of point cloud registration algorithms for mobile robotics. FNT Robot 4, 1–104. https://doi.org/10.1561/2300000035.

Pooja, A., Govindu, V.M., 2010. A multi-view extension of the ICP algorithm. In: Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing - ICVGIP '10. ACM Press, Chennai, India, pp. 235–242. https://doi.org/10.1145/1924559.1924591.
DOI

Pyörälä, J., Liang, X., Saarinen, N., Kankare, V., Wang, Y., Holopainen, M., Hyyppä, J., Vastaranta, M., 2019. Assessing branching structure for biomass and wood quality estimation using terrestrial laser scanning point clouds. Can. J. Rem. Sens. 44, 462–475. https://doi.org/10.1080/07038992.2018.1557040.

Qian, C., Liu, H., Tang, J., Chen, Y., Kaartinen, H., Kukko, A., Zhu, L., Liang, X., Chen, L., Hyyppä, J., 2016. An integrated GNSS/INS/LiDAR-SLAM positioning method for highly accurate forest stem mapping. Rem. Sens. 9, 3. https://doi.org/10.3390/rs9010003.

Saarinen, N., Kankare, V., Vastaranta, M., Luoma, V., Pyörälä, J., Tanhuanpää, T., Liang, X., Kaartinen, H., Kukko, A., Jaakkola, A., Yu, X., Holopainen, M., Hyyppä, J., 2017. Feasibility of terrestrial laser scanning for collecting stem volume information from single trees. ISPRS J. Photogrammetry Remote Sens. 123, 140–158. https://doi.org/10.1016/j.isprsjprs.2016.11.012.

Shao, J., Zhang, W., Mellado, N., Wang, N., Jin, S., Cai, S., Luo, L., Lejemble, T., Yan, G., 2020. SLAM-aided forest plot mapping combining terrestrial and mobile laser scanning. ISPRS J. Photogrammetry Remote Sens. 163, 214–230. https://doi.org/10.1016/j.isprsjprs.2020.03.008.

Tam, G.K.L., Cheng, Z.Q., Lai, Y.K., Langbein, F.C., Liu, Yonghuai, Marshall, D., Martin, R.R., Sun, X.F., Rosin, P.L., 2013. Registration of 3D point clouds and meshes: a survey from rigid to nonrigid. IEEE Trans. Visual. Comput. Graph. 19, 1199–1217. https://doi.org/10.1109/TVCG.2012.310.

Tremblay, J.-F., Béland, M., 2018. Towards operational marker-free registration of terrestrial lidar data in forests. ISPRS J. Photogrammetry Remote Sens. 146, 430–435. https://doi.org/10.1016/j.isprsjprs.2018.10.011.

Vaaja, M.T., Virtanen, J.-P., Kurkela, M., Lehtola, V., Hyyppä, J., Hyyppä, H., 2016. The effect of wind on tree stem parameter estimation using terrestrial laser scanning. ISPRS Ann. Photogramm. Remote Sens. Spat. Inform. Sci. III– 8, 117–122. https://doi.org/10.5194/isprsannals-III-8-117-2016.

Wang, Y., Kukko, A., Hyyppä, E., Hakala, T., Pyörälä, J., Lehtomäki, M., El Issaoui, A., Yu, X., Kaartinen, H., Liang, X., Hyyppä, J., 2021. Seamless integration of above- and under-canopy unmanned aerial vehicle laser scanning for forest investigation. For. Ecosyst. 8, 10. https://doi.org/10.1186/s40663-021-00290-3.

Wang, Y., Lehtomäki, M., Liang, X., Pyörälä, J., Kukko, A., Jaakkola, A., Liu, J., Feng, Z., Chen, R., Hyyppä, J., 2019a. Is field-measured tree height as reliable as believed – a comparison study of tree height estimates from field measurement, airborne laser scanning and terrestrial laser scanning in a boreal forest. ISPRS J. Photogrammetry Remote Sens. 147, 132–145. https://doi.org/10.1016/j.isprsjprs.2018.11.008.

Wang, Y., Pyörälä, J., Liang, X., Lehtomäki, M., Kukko, A., Yu, X., Kaartinen, H., Hyyppä, J., 2019b. In situ biomass estimation at tree and plot levels: what did data record and what did algorithms derive from terrestrial and aerial point clouds in boreal forest. Remote Sens. Environ. 232, 111309. https://doi.org/10.1016/j.rse.2019.111309.

Zhang, W., Chen, Y., Wang, H., Chen, M., Wang, X., Yan, G., 2016. Efficient registration of terrestrial LiDAR scans using a coarse-to-fine strategy for forestry applications. Agric. For. Meteorol. 225, 8–23. https://doi.org/10.1016/j.agrformet.2016.05.005.

Zhang, W., Shao, J., Jin, S., Luo, L., Ge, J., Peng, X., Zhou, G., 2021. Automated marker-free registration of multisource forest point clouds using a coarse-to-global adjustment strategy. Forests 12, 269. https://doi.org/10.3390/f12030269.

Publication history
Copyright
Rights and permissions

Publication history

Received: 17 August 2022
Revised: 01 December 2022
Accepted: 01 December 2022
Published: 07 December 2022
Issue date: December 2022

Copyright

© 2022 The Authors.

Rights and permissions

This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Return