Efficient generation of occlusion-aware multispectral and thermographic point clouds

• Published in: Computers and electronics in agriculture 2023-04, Vol.207, p.107712, Article 107712
• Main Authors: López, Alfonso, Ogayar, Carlos J., Jurado, Juan M., Feito, Francisco R.
• Format: Article
• Language: English
• Subjects: 3D point cloud; agriculture; case studies; color; computer software; data collection; electronics; GPGPU; Multispectral; multispectral imagery; photogrammetry; Thermography; UAV
• ISSN: 0168-1699; 1872-7107
• DOI: 10.1016/j.compag.2023.107712

The reconstruction of 3D point clouds from image datasets is a time-consuming task that has been frequently solved by performing photogrammetric techniques on every data source. This work presents an approach to efficiently build large and dense point clouds from co-acquired images. In our case study, the sensors co-acquire visible as well as thermal and multispectral imagery. Hence, RGB point clouds are reconstructed with traditional methods, whereas the rest of the data sources with lower resolution and less identifiable features are projected into the first one, i.e., the most complete and dense. To this end, the mapping process is accelerated using the Graphics Processing Unit (GPU) and multi-threading in the CPU (Central Processing Unit). The accurate colour aggregation in 3D points is guaranteed by taking into account the occlusion of foreground surfaces. Accordingly, our solution is shown to reconstruct much more dense point clouds than notable commercial software (286% on average), e.g., Pix4Dmapper and Agisoft Metashape, in much less time (−70% on average with respect to the best alternative). [Display omitted] •Fusion of large RGB point clouds with multispectral and thermal imagery.•Alignment of multiple RGB point clouds from different sensors.•GPU accelerated mapping of imagery into 3D RGB point clouds.•Occlusion-aware projection of information over point clouds from additional data sources.