Vision-Based 6D Pose Analytics Solution for High-Precision Industrial Robot Pick-and-Place Applications
Creators
Description
High-precision 6D pose estimation for pick-and-place operations remains a critical problem for industrial robot arms in manufacturing. This study introduces an analytics-based solution for 6D pose estimation designed for a real-world industrial application: it enables the Staubli TX2-60L (manufactured by St & auml;ubli International AG, Horgen, Switzerland) robot arm to pick up metal plates from various locations and place them into a precisely defined slot on a brake pad production line. The system uses a fixed eye-to-hand Intel RealSense D435 RGB-D camera (manufactured by Intel Corporation, Santa Clara, California, USA) to capture color and depth data. A robust software infrastructure developed in LabVIEW (ver.2019) integrated with the NI Vision (ver.2019) library processes the images through a series of steps, including particle filtering, equalization, and pattern matching, to determine the X-Y positions and Z-axis rotation of the object. The Z-position of the object is calculated from the camera's intensity data, while the remaining X-Y rotation angles are determined using the angle-of-inclination analytics method. It is experimentally verified that the proposed analytical solution outperforms the hybrid-based method (YOLO-v8 combined with PnP/RANSAC algorithms). Experimental results across four distinct picking scenarios demonstrate the proposed solution's superior accuracy, with position errors under 2 mm, orientation errors below 1 degrees, and a perfect success rate in pick-and-place tasks.
Files
bib-5b7c25c4-36dd-48d7-b4ca-d4577995fa53.txt
Files
(171 Bytes)
| Name | Size | Download all |
|---|---|---|
|
md5:47fcc83b036f92bf99d4055137d6b8af
|
171 Bytes | Preview Download |