基于多视角自动成像系统的作物三维点云重建策略优化
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391.4

基金项目:

国家重点研发计划项目(2022YFD2001001);国家自然科学基金项目(32201664、31871522、31801263);江苏省自然科学基金项目(BK20200277);江苏省重点研发计划项目(BE2022351);江苏省农业自主创新资金项目(CX(21)2042)


Optimization of crop 3D point cloud reconstruction strategy based on the multi-view automatic imaging system
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为满足高通量作物表型分析需求,提升三维点云重建效率和精度,该研究针对不同作物、不同生育时期、不同植株部位(地上部和根系),基于研发的多视角自动成像系统和SFM(structure from motion)-MVS(multi-view stereo)算法,采用不同视角和不同相机数获取的图像重建作物三维点云,通过重建效率和精度(Hausdorff距离)评估,以及基于点云提取表型参数(株高、幅宽、凸包体积和总表面积)的可靠性评价,优化作物三维点云重建策略。结果显示,对于结构相对稀松、遮挡较少的盆栽植株(苗期、蕾薹期、盛花期、成熟期油菜)、结构相对紧凑、遮挡较多的植株地上部(花铃期棉花、抽穗期水稻、拔节期和灌浆期小麦)以及器官密集、遮挡严重且有较多细长结构的地上部和根系(分蘖期小麦和成熟期水稻地上部、成熟期玉米和油菜根系),分别采用3~4、6和10个相机为其最优重建策略(Hausdorff距离小于或接近0.20 cm,且重建时长和Hausdorff距离归一化值之和最小)。采用不少于4个相机获取的图像重建作物三维点云,可提取较为可靠的表型参数(决定系数R2>0.90,相对均方根误差RRMSE≤9%)。该研究提出的最优重建策略平衡了自动成像系统构建成本、三维重建效率和精度以及适用植株复杂程度,为实现多种作物高效、低成本、高精度三维重建和表型参数提取提供了重要依据。

    Abstract:

    Digital photography has provided an economic and convenient way to generate three-dimensional (3D) point clouds for high-throughput crop phenotyping in plant 3D reconstruction. Manual acquisition of multi-view images is time-consuming and labor-intensive, as hundreds of images can be required to generate high-quality 3D point clouds. Multi-view automatic imaging systems can be expected to significantly reduce the cost of labor and time. However, the currently available systems cannot balance the number of cameras, the cost of equipment, the efficiency and accuracy of the 3D reconstruction, as well as the applicability to the complexity of plants. In this study, the automatic imaging system was developed to acquire multi-view images of different crops at various growth stages. 3D point clouds were then generated from the multi-view images acquired by different strategies (i.e., different imaging perspectives) and the number of cameras (1, 2, 3, 4, 6, and 10 camera/cameras) using the SFM (structure from motion)-MVS (multi-view stereo) algorithm. Statistical filtering was used to remove the noise and outliers. The non-plant 3D point clouds were removed using RGB colors. The reconstructed 3D models were aligned to the reference 3D models using the ICP (Iterative Closest Point) algorithm. Hausdorff distance between the two models was calculated to combine the reconstruction time for the evaluation of the precision and efficiency of 3D point clouds reconstruction with different strategies. The 3D point cloud reconstruction strategies were optimized for different crops at different growth stages using the efficiency and precision of reconstruction. The optimization criteria:the average Hausdorff distance was less than or close to 0.20 cm, with the minimum normalization of reconstruction time and Hausdorff distance. The reliability of extracting phenotypic parameters (height, width, convex hull volume, and total surface area of plants) was evaluated from the 3D models reconstructed with different strategies. Plant height and the maximum width were calculated directly using the reconstructed 3D point clouds. The Convex Hull was generated to calculate the Convex Hull Volume. Poisson-disk sampling (Explicit radius=0.5, and MonteCarlo oversampling=20) and Ball Pivoting algorithm were used to reconstruct the 3D mesh model. The total surface area of plants was then calculated using the generated 3D mesh model. The results showed that the time of 3D reconstruction increased, whereas, the Hausdorff distance decreased with the increase of the number of cameras. According to the optimization criteria, three to four cameras were used as the optimal reconstruction strategy for rapeseed at seedling, bolting, flowering, and mature stages, while six cameras were used as the optimal reconstruction strategy for rice at the heading stage, cotton at flowering and boll-setting stages, as well as wheat at jointing and filling stages, and ten cameras were as the optimal reconstruction strategy for wheat at tillering stage, rice at maturity stage, maize roots and rapeseed roots at maturity stage. The reliable phenotypic parameters were obtained using the 3D reconstruction system with no less than four cameras (determination coefficient R2>0.90; relative root mean square error RRMSE ≤ 9%). The optimal reconstruction strategy can greatly contribute to the high-efficiency, low-cost, and high-precision 3D reconstruction and phenotypic parameter extraction of multiple crops at different growth stages.

    参考文献
    相似文献
    引证文献
引用本文

李百明,吴茜,吴劼,张美娜,李华勇,于堃,曹静,张伟欣,曹宏鑫,张文宇.基于多视角自动成像系统的作物三维点云重建策略优化[J].农业工程学报,2023,39(9):161-171. DOI:10.11975/j. issn.1002-6819.202303004

LI Baiming, WU Qian, WU Jie, ZHANG Meina, LI Huayong, YU Kun, CAO Jing, ZHANG Weixin, CAO Hongxin, ZHANG Wenyu. Optimization of crop 3D point cloud reconstruction strategy based on the multi-view automatic imaging system[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE),2023,39(9):161-171. DOI:10.11975/j. issn.1002-6819.202303004

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-03-01
  • 最后修改日期:2023-04-10
  • 录用日期:
  • 在线发布日期: 2023-05-26
  • 出版日期:
文章二维码
您是第位访问者
ICP:京ICP备06025802号-3
农业工程学报 ® 2024 版权所有
技术支持:北京勤云科技发展有限公司