Spectral Shape Recovery and Analysis Via Data-driven Connections. 2021

Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
Sapienza University of Rome, Rome, Italy.

We introduce a novel learning-based method to recover shapes from their Laplacian spectra, based on establishing and exploring connections in a learned latent space. The core of our approach consists in a cycle-consistent module that maps between a learned latent space and sequences of eigenvalues. This module provides an efficient and effective link between the shape geometry, encoded in a latent vector, and its Laplacian spectrum. Our proposed data-driven approach replaces the need for ad-hoc regularizers required by prior methods, while providing more accurate results at a fraction of the computational cost. Moreover, these latent space connections enable novel applications for both analyzing and controlling the spectral properties of deformable shapes, especially in the context of a shape collection. Our learning model and the associated analysis apply without modifications across different dimensions (2D and 3D shapes alike), representations (meshes, contours and point clouds), nature of the latent space (generated by an auto-encoder or a parametric model), as well as across different shape classes, and admits arbitrary resolution of the input spectrum without affecting complexity. The increased flexibility allows us to address notoriously difficult tasks in 3D vision and geometry processing within a unified framework, including shape generation from spectrum, latent space exploration and analysis, mesh super-resolution, shape exploration, style transfer, spectrum estimation for point clouds, segmentation transfer and non-rigid shape matching. BACKGROUND The online version supplementary material available at 10.1007/s11263-021-01492-6.

UI MeSH Term Description Entries

Related Publications

Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
January 2023, PloS one,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
October 2013, IEEE transactions on medical imaging,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
January 2012, Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
February 2022, Nature communications,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
April 2017, Proceedings. IEEE International Symposium on Biomedical Imaging,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
January 2013, IEEE/ACM transactions on computational biology and bioinformatics,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
November 2019, Scientific reports,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
February 2012, Proceedings of SPIE--the International Society for Optical Engineering,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
March 2008, Computer vision and image understanding : CVIU,
Riccardo Marin, and Arianna Rampini, and Umberto Castellani, and Emanuele Rodolà, and Maks Ovsjanikov, and Simone Melzi
December 2021, IEEE transactions on visualization and computer graphics,
Copied contents to your clipboard!