Vehicle Detection in Aerial Images Based on Lightweight Deep Convolutional Network and Generative Adversarial Network

Jiaquan Shen, Ningzhong Liu*, Han Sun, Huiyu Zhou

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)
2 Downloads (Pure)

Abstract

Vehicle detection in aerial images is a challenging task and plays an important role in a wide range of applications. Traditional detection algorithms are based on sliding-window searching and shallow-learning-based features, which limits the ability to represent features and generates a lot of computational costs. Recently, with the successful application of convolutional neural network in computer vision, many state-of-The-Art detectors have been developed based on deep CNNs. However, these CNN-based models still face some difficulties and challenges in vehicle detection in aerial images. Firstly, the CNN-based detection model requires extensive calculations during training and detection, and the accuracy of detection for small objects is not high. In addition, deep learning models often require a large amount of sample data to train a robust detection model, while the annotated data of aerial vehicles is limited. In this study, we propose a lightweight deep convolutional neural network detection model named LD-CNNs. The detection algorithm not only greatly reduces the computational costs of the model, but also significantly improves the accuracy of the detection. What's more, in order to cope with the problem of insufficient training samples, we develop a multi-condition constrained generative adversarial network named MC-GAN, which can effectively generate samples. The detection performance of the proposed model has been evaluated on the Munich public dataset and the collected dataset respectively. The results show that on the Munich dataset, the proposed method achieves 86.9% on mAP (mean average precision), F1-score is 0.875, and the detection time is 1.64s on Nvidia Titan XP. At present, these detection indicators have reached state-of-The-Art level in vehicle detection of aerial images.

Original languageEnglish
Article number8867888
Pages (from-to)148119-148130
Number of pages12
JournalIEEE Access
Volume7
DOIs
Publication statusPublished - 14 Oct 2019
Externally publishedYes

Bibliographical note

Funding Information:
This work was supported in part by the National Natural Science Foundation of China under Grant 61375021, in part by the Fundamental Research Funds for the Central Universities under Grant NS2016091, and in part by the Collaborative Innovation Center of Novel Software Technology and Industrialization.

Publisher Copyright:
© 2013 IEEE.

Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.

Keywords

  • aerial images
  • generative adversarial network
  • lightweight convolutional network
  • Vehicle detection

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Fingerprint Dive into the research topics of 'Vehicle Detection in Aerial Images Based on Lightweight Deep Convolutional Network and Generative Adversarial Network'. Together they form a unique fingerprint.

Cite this