Concealed object segmentation in terahertz imaging via adversarial learning

Dong Liang*, Jiaxing Pan, Yang Yu, Huiyu Zhou

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

18 Citations (Scopus)

Abstract

Terahertz imaging (frequency between 0.1 to 10 THz) is a modern technique for public security check. Due to poor imaging quality, traditional machine vision methods often fail to detect concealed weapons in Terahertz samples, while modern instance segmentation approaches have complex multiple-stage concatenation and often hunger for massive and accurate training data. In this work, we realize a novel Conditional Generative Adversarial Nets (CGANs), named as Mask-CGANs to segment weapons in such a challenging imaging quality. The Mask-Generator network employs a “selected-connection U-Net” to restrain false alarms and speed up training convergence. The loss function takes reconstruction errors and sparse priors into consideration to preserve precise segmentation. Such a learning architecture works well with a small training dataset. Experiments show that the proposed model outperforms CGANs (more than 16–32% in Recall, Precision and Accuracy) and Mask-RCNN (more than 3–6%). Moreover, its testing speed (69.7 FPS) is fast enough to be implemented in a real-time security check system, which is 44 times faster than Mask-RCNN. In the experiments for mammographic mass segmentation on INBreast dataset, the Dice index of the proposed method is 91.29, surpasses the-state-of-the-art medical issue segmentation methods. The full implementation (based on TensorFlow) is available at https://github.com/JXPanzz/THz).

Original languageEnglish
Pages (from-to)1104-1114
Number of pages11
JournalOptik
Volume185
Early online date08 Apr 2019
DOIs
Publication statusPublished - May 2019
Externally publishedYes

Bibliographical note

Funding Information:
This work is supported by the National Key R&D Program of China under Grant 2017YFB0802300, National Natural Science Foundation of China61601223, Natural Science Foundation of Jiangsu ProvinceBK20150756, Postdoctoral Science Foundation of China (Top level)2015M580427. H. Zhou was supported by UK EPSRC under Grant EP/N011074/1, Royal Society-Newton Advanced Fellowship under Grant NA160342, and European Union's Horizon 2020 research and innovation program under the Marie-Sklodowska-Curie grant agreement No 720325.

Funding Information:
This work is supported by the National Key R&D Program of China under Grant 2017YFB0802300 , National Natural Science Foundation of China 61601223 , Natural Science Foundation of Jiangsu Province BK20150756 , Postdoctoral Science Foundation of China (Top level) 2015M580427 . H. Zhou was supported by UK EPSRC under Grant EP/N011074/1 , Royal Society-Newton Advanced Fellowship under Grant NA160342 , and European Union’s Horizon 2020 research and innovation program under the Marie-Sklodowska-Curie grant agreement No 720325 .

Publisher Copyright:
© 2019 Elsevier GmbH

Copyright:
Copyright 2019 Elsevier B.V., All rights reserved.

Keywords

  • Generative adversarial nets
  • Object segmentation
  • Terahertz

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Concealed object segmentation in terahertz imaging via adversarial learning'. Together they form a unique fingerprint.

Cite this