Remote sensing inversion of PM10 based on spark platform

Zhenyu Yu, Zhibao Wang, Lu Bai, Liangfu Chen, Jinhua Tao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

With the continuous growth of remote sensing data and the application of fast and effective atmosphere remote sensing inversion algorithm, this paper proposes a PM10 fast inversion approach based on Spark platform which uses Apache Spark as the analytics engine and integrates with the traditional atmospheric remote sensing inversion algorithm. We first store aerosol data which is MYD04_3K from NASA into HDFS. Then the inversion algorithm is combined with Spark via the function interface to realise rapid atmospheric remote sensing inversion. The experimental results based on Spark platform are compared with those obtained from the traditional physical hardware. The results prove that the proposed atmospheric remote sensing inversion method based on Spark has high efficiency.

Original languageEnglish
Title of host publicationProceedings of the IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1685-1688
Number of pages4
ISBN (Electronic)9781665403696
ISBN (Print)9781665447621
DOIs
Publication statusPublished - 12 Oct 2021
Externally publishedYes
EventIEEE International Geoscience and Remote Sensing Symposium 2021 - Brussels, Belgium
Duration: 12 Jul 202116 Jul 2021

Publication series

NameIEEE International Geoscience and Remote Sensing Symposium: Proceedings
ISSN (Print)2153-6996
ISSN (Electronic)2153-7003

Conference

ConferenceIEEE International Geoscience and Remote Sensing Symposium 2021
Abbreviated titleIGARSS 2021
Country/TerritoryBelgium
CityBrussels
Period12/07/202116/07/2021

Keywords

  • Atmospheric remote sensing inversion
  • big data
  • HDFS
  • Spark

ASJC Scopus subject areas

  • Computer Science Applications
  • General Earth and Planetary Sciences

Fingerprint

Dive into the research topics of 'Remote sensing inversion of PM10 based on spark platform'. Together they form a unique fingerprint.

Cite this