基于双目结构光三维重建的类球形水果外形指标测量
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

S126

基金项目:

国家自然科学基金项目(32371987,32001414);浙江省教育厅一般科研项目(Y202353696)


Measuring the appearance indicators of spherical fruits using binocular structured light 3D reconstruction
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    水果外形指标的准确获取,如畸形指数、体积、最大直径等,是实现水果品质分级的重要前提。该研究搭建了一套双目结构光成像系统,经过系统验证后用于获取类球形水果(苹果、柑桔、梨)表面的轮廓信息,结合单视角和多视角点云重建实现三维形貌重构,并在此基础上提取其外形指标。试验结果表明,基于三维重建的标准件外形尺寸测量的相对误差在4 %以内;以人工测量结果为参考,该研究所测苹果畸形指数R2值为0.97,所测类球形水果的体积与最大直径的R2值分别为0.99和0.92。该研究提出的基于双目结构光三维重建方法可以准确地测量畸形指数、体积、最大直径等类球形水果的外形指标,为其产后品质检测与分级提供重要参考。

    Abstract:

    Three typical types of spherical fruits, namely apples, oranges, and pears, have accounted for 40.86 % of the total fruit production in China in 2023. However, there is a huge trade deficit in the import and export trade of fruits in China. Furthermore, grading technology has limited the largest production and consumption of fruits. Appearance indicators, such as size, volume and deformity index, are the main external quality traits of fruits in commercial grading lines. Alternatively, computer vision has been widely used in the field of nondestructive detection of fruits and vegetables, due to the simple operation, non-contact and low cost. The surface information can be obtained to measure the external indicators using two-dimensional images. However, some limitations are still remained to capture the detailed appearance indicators, especially in the high-accuracy measurement. Compared with traditional two-dimensional images, three-dimensional (3D) imaging with the depth information can be beneficial to the appearance indicators of fruits. Among them, binocular structured light is the promising 3D reconstruction with the cost-saving, high-precision and non-contact extraction. This study focuses on spherical fruits, selecting apple, orange, and pear as representative examples, with the aim of constructing binocular structured light imaging to obtain surface contour information. The system was also validated using standard samples. Single-view point cloud reconstruction was performed as well. Three-step phase shifting was used to determine the wrapped phase. While multi-frequency heterodyne was applied to determine the absolute phase. Afterwards, stereo matching, disparity optimization, and point cloud calculation were conducted to obtain a 3D point cloud map. A rotary table was utilized to match the point cloud images from different perspectives to the same coordinate axis. Coarse point cloud registration was also achieved. A complete point cloud was obtained to conduct more precise registration using the iterative closure point (ICP) to obtain. Finally, the 3D reconstruction of spherical fruits was realized. The deformity index of the apple was extracted from the reconstruction image of single-view point cloud using normal vector angle. According to the normal vector angle, the point cloud of the fruit stem position was projected to the bottom of the fruit point cloud image. The complete fruit point cloud was improved to calculate the convex hull of the point cloud for the volume of fruit. The maximum fruit diameter was extracted through oriented bounding box (OBB) bounding box. The experimental results show that the relative error was within 4% in the external dimensions of standard parts using 3D reconstruction. Taking manual measurement as the references, the values of coefficient of determination (R2), root mean squared error (RMSE), and mean absolute percentage error (MAPE) were 0.97, 0.755 mm, and 7.23%, respectively, for the measured apple deformity index. In the volume of spherical fruits, R2 was 0.99, RMSE was 6.015 cm3, and MAPE was 1.946%, while those were 0.92, 1.823 mm, and 1.859%, respectively, for the maximum diameter. The 3D reconstruction with binocular structured light can be expected to significantly enhance the accuracy and efficiency in the appearance indicators of spherical fruits. The finding can also provide a valuable tool to improve fruit quality control and grading.

    参考文献
    相似文献
    引证文献
引用本文

陈旭佳,彭羽萌,俞盛旗,胡栋.基于双目结构光三维重建的类球形水果外形指标测量[J].农业工程学报,2024,40(20):187-194. DOI:10.11975/j. issn.1002-6819.202405154

CHEN Xujia, PENG Yumeng, YU Shengqi, HU Dong. Measuring the appearance indicators of spherical fruits using binocular structured light 3D reconstruction[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE),2024,40(20):187-194. DOI:10.11975/j. issn.1002-6819.202405154

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-05-21
  • 最后修改日期:2024-09-14
  • 录用日期:
  • 在线发布日期: 2024-10-14
  • 出版日期:
文章二维码
您是第位访问者
ICP:京ICP备06025802号-3
农业工程学报 ® 2024 版权所有
技术支持:北京勤云科技发展有限公司