Remote Sensing Inversion of PM10 Based on Spark Platform

With the continuous growth of remote sensing data and the application of fast and effective atmosphere remote sensing inversion algorithm, this paper proposes a PM10 fast inversion approach based on Spark platform which uses Apache Spark as the analytics engine and integrates with the traditional at...

Full description

Saved in:
Bibliographic Details
Main Authors: Yu, Zhenyu, Wang, Zhibao, Bai, Lu, Chen, Liangfu, Tao, Jinhua
Format: Conference Proceeding
Language:English
Subjects:
Aerosols
Atmosphere
Atmospheric remote sensing inversion
big data
Cluster computing
Hardware
HDFS
NASA
Remote sensing
Spark
Sparks
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With the continuous growth of remote sensing data and the application of fast and effective atmosphere remote sensing inversion algorithm, this paper proposes a PM10 fast inversion approach based on Spark platform which uses Apache Spark as the analytics engine and integrates with the traditional atmospheric remote sensing inversion algorithm. We first store aerosol data which is MYD04_3K from NASA into HDFS. Then the inversion algorithm is combined with Spark via the function interface to realise rapid atmospheric remote sensing inversion. The experimental results based on Spark platform are compared with those obtained from the traditional physical hardware. The results prove that the proposed atmospheric remote sensing inversion method based on Spark has high efficiency.
ISSN:2153-7003
DOI:10.1109/IGARSS47720.2021.9554323