Learning Detail Transfer based on Geometric Features


Sema Berkiten Maciej Halber Justin Solomon Chongyang Ma Hao Li Szymon Rusinkiewicz


Paper Data(236MB)


Teaser Image
Given input source meshes with high-quality surface details, shown in blue, our algorithm transfers the surface details to target meshes, shown in pink. Left / Middle: Details from the source mesh in the top row are transferred to target mesh in the bottom row. Right: Surface details are transferred from the middle seat, shown in blue, to the rest of the seats.

Abstract

The visual richness of computer graphics applications is frequently limited by the difficulty of obtaining high-quality, detailed 3D models. This paper proposes a method for realistically transferring details (specifically, displacement maps) from existing high-quality 3D models to simple shapes that may be created with easy-to-learn modeling tools. Our key insight is to use metric learning to find a combination of geometric features that successfully predicts detail-map similarities on the source mesh, and use the learned feature combination to drive the detail transfer. The latter uses a variant of multi-resolution non-parametric texture synthesis, augmented by a high-frequency detail transfer step in texture space. We demonstrate that our technique can successfully transfer details among a variety of shapes including furniture and clothing.

Video

Bibtex

@inproceddings{ Berkiten17,
                author = "S. Berkiten, M. Halber, J. Solomon, C. Ma, H. Li, S. Rusinkiewicz",
                title = "Learning Detail Transfer based on Geometric Features",
                year = "2017" }

Materials

Paper
Supplemental
Data(236MB)