Three-Dimensional Reconstruction with a Laser Line Based on Image In-Painting and Multi-Spectral Photometric Stereo

Liang Lu, Hongbao Zhu, Junyu Dong*, Yakun Ju, Huiyu Zhou

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Downloads (Pure)

Abstract

This paper presents a multi-spectral photometric stereo (MPS) method based on image in-painting, which can reconstruct the shape using a multi-spectral image with a laser line. One of the difficulties in multi-spectral photometric stereo is to extract the laser line because the required illumination for MPS, e.g., red, green, and blue light, may pollute the laser color. Unlike previous methods, through the improvement of the network proposed by Isola, a Generative Adversarial Network based on image in-painting was proposed, to separate a multi-spectral image with a laser line into a clean laser image and an uncorrupted multi-spectral image without the laser line. Then these results were substituted into the method proposed by Fan to obtain high-precision 3D reconstruction results. To make the proposed method applicable to real-world objects, a rendered image dataset obtained using the rendering models in ShapeNet has been used for training the network. Evaluation using the rendered images and real-world images shows the superiority of the proposed approach over several previous methods.

Original languageEnglish
Article number2131
Number of pages18
JournalSensors
Volume21
Issue number6
DOIs
Publication statusPublished - 18 Mar 2021
Externally publishedYes

Bibliographical note

Funding Information:
This research was funded by the Natural Science Foundation of Shandong Province of China (ZR2018ZB0852).

Publisher Copyright:
© 2021 by the authors. Licensee MDPI, Basel, Switzerland.

Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.

Keywords

  • And laser extraction
  • Generative adversarial network
  • Image in-painting
  • Multi-spectral photometric stereo

ASJC Scopus subject areas

  • Analytical Chemistry
  • Biochemistry
  • Atomic and Molecular Physics, and Optics
  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Three-Dimensional Reconstruction with a Laser Line Based on Image In-Painting and Multi-Spectral Photometric Stereo'. Together they form a unique fingerprint.

Cite this