李雨龙, 陈松, 李鑫, 李昌龙, 赵耀耀, 李顺. 基于深度学习的管件识别与位姿估计研究[J]. 制造技术与机床, 2022, (12): 70-75. DOI: 10.19287/j.mtmt.1005-2402.2022.12.011
引用本文: 李雨龙, 陈松, 李鑫, 李昌龙, 赵耀耀, 李顺. 基于深度学习的管件识别与位姿估计研究[J]. 制造技术与机床, 2022, (12): 70-75. DOI: 10.19287/j.mtmt.1005-2402.2022.12.011
LI Yulong, CHEN Song, LI Xin, LI Changlong, ZHAO Yaoyao, LI Shun. Research on pipe fitting identification and pose estimation based on deep learning[J]. Manufacturing Technology & Machine Tool, 2022, (12): 70-75. DOI: 10.19287/j.mtmt.1005-2402.2022.12.011
Citation: LI Yulong, CHEN Song, LI Xin, LI Changlong, ZHAO Yaoyao, LI Shun. Research on pipe fitting identification and pose estimation based on deep learning[J]. Manufacturing Technology & Machine Tool, 2022, (12): 70-75. DOI: 10.19287/j.mtmt.1005-2402.2022.12.011

基于深度学习的管件识别与位姿估计研究

Research on pipe fitting identification and pose estimation based on deep learning

  • 摘要: 管件的6D位姿估计是机器人抓取抛光的前提,传统的估计策略工作量大,基于深度学习提出改进的深度对象姿态估计(deep object pose estimation,DOPE)框架对管件实时检测。首先,制作合成数据训练网络。其次,对网络提出改进:针对管件的旋转对称性,自定义损失函数,提高管件检测精度;且采用Resnet18提取管件特征,减轻网络规模。最后,探究热图阶段数对推理时间的影响。改进后的DOPE网络估计管件位姿时,其精度-阈值曲线下面积(area under the curve,AUC)提高了17%,参数量和浮点计算量分别减少9%和20%,检测单张图片仅需102 ms。估计管件位姿试验证明了改进DOPE的有效性,且满足工业要求。

     

    Abstract: The 6D pose estimation of pipe fitting is the premise of robot grasping and polishing.Heavy workload is required for traditional estimation strategies.Based on deep learning,an improved deep object pose estimation (DOPE) framework was proposed for real-time detection pipe fitting. First of all, a synthetic dataset was created to train the network. In the next place, some suggestions were put forward: in order to solve the symmetry of pipe fitting and improve the detection accuracy of pipe fitting, a custom loss function was proposed. The network size has been reduced by using resnet18 to extract pipe fitting features. In the end, the effect of the number of heatmap stages on reasoning time was explored. The AUC is 17% higher, the number of parameters and floating point operations are 9% and 20% lower, and it only takes 102 ms to detect a picture when using the improved DOPE to estimate the pipe fitting pose. The effectiveness of modified DOPE was proved by the test of estimated pipe fitting pose, and it also meet the industrial requirements.

     

/

返回文章
返回