Satellite-Terrestrial Collaborative Object Detection via Task-Inspired Framework

• Published in: IEEE internet of things journal 2023-12, Vol.10 (23), p.1-1
• Main Authors: Lu, Anqi, Cheng, Yun, Hu, Youbing, Cao, Zhiqiang, Chen, Yongrui, Li, Zhijun
• Format: Article
• Language: English
• Subjects: Accuracy; Adaptive sampling; Big Data; Collaboration; Data transmission; Edge computing; Internet of Things; Internet of Things (IoT); Low Earth orbit (LEO) satellite; Low earth orbit satellites; Low earth orbits; Modules; Object detection; Object recognition; Optical imaging; optical remote sensing object detection; Optical sensors; Remote sensing; satellite edge computing (SEC); Satellite imagery; satellite-terrestrial collaboration; Satellites; Task analysis
• ISSN: 2327-4662; 2327-4662
• DOI: 10.1109/JIOT.2023.3287973

Recently, buoyed by advances in the space industry, low Earth orbit (LEO) satellites have become an important part of the Internet of Things (IoT). LEO satellites have entered the era of a big data link with IoT, how to deal with the data from the satellite IoT is a problem worthy of consideration. Conventional object detection method in optical remote sensing simply transmits the raw data to the ground. However, it ignores the properties of the images and the connection with the downstream task. To obtain efficient data transmission and accurate object detection, we propose a task-inspired satellite-terrestrial collaborative object detection framework called STCOD. It detects regions of interest (ROIs) and adopts a block-based adaptive sampling method to compress the background (BG) in optical remote sensing images by introducing satellite edge computing (SEC) on satellites. The STCOD framework also sets the transmission priority of image blocks according to their contributions to the task and uses fountain code to ensure the reliable transmission of important image blocks. We build a whole software simulation framework to validate our method, including the satellite module, the transmission module, and the terrestrial module. Extensive experimental results show that the STCOD framework can reduce the amount of downlink data decreased by 50.04% while losing the detection accuracy by 0.54%. In our simulated satellite-terrestrial link, the STCOD framework can reduce the number of satellite-to-terrestrial transmissions by half. When the packet loss rate is between 5% and 20%, the detection accuracy is lost only 0.05% to 0.5%.