Unsupervised Learning of Depth and Camera Pose with Feature Map Warping. 2021

Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
College of Physics and Information Engineering, Fuzhou University, Fuzhou 350108, China.

Estimating the depth of image and egomotion of agent are important for autonomous and robot in understanding the surrounding environment and avoiding collision. Most existing unsupervised methods estimate depth and camera egomotion by minimizing photometric error between adjacent frames. However, the photometric consistency sometimes does not meet the real situation, such as brightness change, moving objects and occlusion. To reduce the influence of brightness change, we propose a feature pyramid matching loss (FPML) which captures the trainable feature error between a current and the adjacent frames and therefore it is more robust than photometric error. In addition, we propose the occlusion-aware mask (OAM) network which can indicate occlusion according to change of masks to improve estimation accuracy of depth and camera pose. The experimental results verify that the proposed unsupervised approach is highly competitive against the state-of-the-art methods, both qualitatively and quantitatively. Specifically, our method reduces absolute relative error (Abs Rel) by 0.017-0.088.

UI MeSH Term Description Entries

Related Publications

Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
June 2023, Sensors (Basel, Switzerland),
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
July 2020, Sensors (Basel, Switzerland),
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
December 2021, IEEE transactions on neural networks and learning systems,
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
August 2005, Medical image analysis,
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
June 2014, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
March 2024, PLoS computational biology,
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
July 2023, IEEE transactions on neural networks and learning systems,
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
April 2017, Journal of the American College of Cardiology,
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
September 2023, IEEE International Conference on Smart Cloud,
Ente Guo, and Zhifeng Chen, and Yanlin Zhou, and Dapeng Oliver Wu
December 2022, Sensors (Basel, Switzerland),
Copied contents to your clipboard!