Learning-Based Depth and Pose Estimation for Monocular Endoscope with Loss Generalization. 2021

Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki

Gastroendoscopy has been a clinical standard for diagnosing and treating conditions that affect a part of a patient's digestive system, such as the stomach. Despite the fact that gastroendoscopy has a lot of advantages for patients, there exist some challenges for practitioners, such as the lack of 3D perception, including the depth and the endoscope pose information. Such challenges make navigating the endoscope and localizing any found lesion in a digestive tract difficult. To tackle these problems, deep learning-based approaches have been proposed to provide monocular gastroendoscopy with additional yet important depth and pose information. In this paper, we propose a novel supervised approach to train depth and pose estimation networks using consecutive endoscopy images to assist the endoscope navigation in the stomach. We firstly generate real depth and pose training data using our previously proposed whole stomach 3D reconstruction pipeline to avoid poor generalization ability between computer-generated (CG) models and real data for the stomach. In addition, we propose a novel generalized photometric loss function to avoid the complicated process of finding proper weights for balancing the depth and the pose loss terms, which is required for existing direct depth and pose supervision approaches. We then experimentally show that our proposed generalized loss performs better than existing direct supervision losses.

UI MeSH Term Description Entries
D003198 Computer Simulation Computer-based representation of physical systems and phenomena such as chemical processes. Computational Modeling,Computational Modelling,Computer Models,In silico Modeling,In silico Models,In silico Simulation,Models, Computer,Computerized Models,Computer Model,Computer Simulations,Computerized Model,In silico Model,Model, Computer,Model, Computerized,Model, In silico,Modeling, Computational,Modeling, In silico,Modelling, Computational,Simulation, Computer,Simulation, In silico,Simulations, Computer
D004724 Endoscopy Procedures of applying ENDOSCOPES for disease diagnosis and treatment. Endoscopy involves passing an optical instrument through a small incision in the skin i.e., percutaneous; or through a natural orifice and along natural body pathways such as the digestive tract; and/or through an incision in the wall of a tubular structure or organ, i.e. transluminal, to examine or perform surgery on the interior parts of the body. Endoscopic Surgical Procedures,Surgical Procedures, Endoscopic,Endoscopic Surgical Procedure,Endoscopy, Surgical,Surgical Endoscopy,Surgical Procedure, Endoscopic,Procedure, Endoscopic Surgical,Procedures, Endoscopic Surgical
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D019723 Endoscopes Instruments for the visual examination of interior structures of the body. There are rigid endoscopes and flexible fiberoptic endoscopes for various types of viewing in ENDOSCOPY. Endoscope
D021621 Imaging, Three-Dimensional The process of generating three-dimensional images by electronic, photographic, or other methods. For example, three-dimensional images can be generated by assembling multiple tomographic images with the aid of a computer, while photographic 3-D images (HOLOGRAPHY) can be made by exposing film to the interference pattern created when two laser light sources shine on an object. Computer-Assisted Three-Dimensional Imaging,Imaging, Three-Dimensional, Computer Assisted,3-D Image,3-D Imaging,Computer-Generated 3D Imaging,Three-Dimensional Image,Three-Dimensional Imaging, Computer Generated,3 D Image,3 D Imaging,3-D Images,3-D Imagings,3D Imaging, Computer-Generated,3D Imagings, Computer-Generated,Computer Assisted Three Dimensional Imaging,Computer Generated 3D Imaging,Computer-Assisted Three-Dimensional Imagings,Computer-Generated 3D Imagings,Image, 3-D,Image, Three-Dimensional,Images, 3-D,Images, Three-Dimensional,Imaging, 3-D,Imaging, Computer-Assisted Three-Dimensional,Imaging, Computer-Generated 3D,Imaging, Three Dimensional,Imagings, 3-D,Imagings, Computer-Assisted Three-Dimensional,Imagings, Computer-Generated 3D,Imagings, Three-Dimensional,Three Dimensional Image,Three Dimensional Imaging, Computer Generated,Three-Dimensional Images,Three-Dimensional Imaging,Three-Dimensional Imaging, Computer-Assisted,Three-Dimensional Imagings,Three-Dimensional Imagings, Computer-Assisted

Related Publications

Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
October 2023, Sensors (Basel, Switzerland),
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
January 2022, PeerJ. Computer science,
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
September 2020, International journal of computer assisted radiology and surgery,
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
December 2020, Sensors (Basel, Switzerland),
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
January 2024, Biomedical optics express,
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
June 2023, Sensors (Basel, Switzerland),
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
January 2022, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
May 2023, IEEE transactions on pattern analysis and machine intelligence,
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
August 2020, Sensors (Basel, Switzerland),
Aji Resindra Widya, and Yusuke Monno, and Masatoshi Okutomi, and Sho Suzuki, and Takuji Gotoda, and Kenji Miki
July 2022, Sensors (Basel, Switzerland),
Copied contents to your clipboard!