DeepHMap++: Combined Projection Grouping and Correspondence Learning for Full DoF Pose Estimation. 2019

Mingliang Fu, and Weijia Zhou
State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China. fumingliang@sia.cn.

In recent years, estimating the 6D pose of object instances with convolutional neural network (CNN) has received considerable attention. Depending on whether intermediate cues are used, the relevant literature can be roughly divided into two broad categories: direct methods and two-stage pipelines. For the latter, intermediate cues, such as 3D object coordinates, semantic keypoints, or virtual control points instead of pose parameters are regressed by CNN in the first stage. Object pose can then be solved by correspondence constraints constructed with these intermediate cues. In this paper, we focus on the postprocessing of a two-stage pipeline and propose to combine two learning concepts for estimating object pose under challenging scenes: projection grouping on one side, and correspondence learning on the other. We firstly employ a local-patch based method to predict projection heatmaps which denote the confidence distribution of projection of 3D bounding box's corners. A projection grouping module is then proposed to remove redundant local maxima from each layer of heatmaps. Instead of directly feeding 2D⁻3D correspondences to the perspective-n-point (PnP) algorithm, multiple correspondence hypotheses are sampled from local maxima and its corresponding neighborhood and ranked by a correspondence⁻evaluation network. Finally, correspondences with higher confidence are selected to determine object pose. Extensive experiments on three public datasets demonstrate that the proposed framework outperforms several state of the art methods.

UI MeSH Term Description Entries

Related Publications

Mingliang Fu, and Weijia Zhou
November 2022, IEEE transactions on pattern analysis and machine intelligence,
Mingliang Fu, and Weijia Zhou
January 2024, IEEE transactions on pattern analysis and machine intelligence,
Mingliang Fu, and Weijia Zhou
December 2023, Sensors (Basel, Switzerland),
Mingliang Fu, and Weijia Zhou
November 2022, Sensors (Basel, Switzerland),
Mingliang Fu, and Weijia Zhou
January 2018, IEEE transactions on pattern analysis and machine intelligence,
Mingliang Fu, and Weijia Zhou
January 2021, Frontiers in robotics and AI,
Mingliang Fu, and Weijia Zhou
October 2014, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Mingliang Fu, and Weijia Zhou
April 2023, Sensors (Basel, Switzerland),
Mingliang Fu, and Weijia Zhou
October 2016, IEEE transactions on pattern analysis and machine intelligence,
Mingliang Fu, and Weijia Zhou
February 2020, IEEE transactions on pattern analysis and machine intelligence,
Copied contents to your clipboard!