IPFSz: An Efficient Data Compression Scheme in InterPlanetary File System

InterPlanetary File System (IPFS) is a peer-to-peer (P2P) distributed file system that allows data to be shared and exchanged between connected nodes. Recently, IPFS aims to replace existing protocols used in a centralized system (e.g., HTTP) by overcoming their weaknesses such as a single point of...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2022, Vol.10, p.122601-122611
Main Authors: Song, Mansub, Han, Jongbeen, Eom, Hyeonsang, Son, Yongseok
Format: Article
Language:English
Subjects:
Algorithms
Compression algorithms
Data compression
Data transmission
decentralized system
Distributed databases
distributed file system
File systems
InterPlanetary File System
Metadata
Nodes
P2P network
Servers
Time compression
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:InterPlanetary File System (IPFS) is a peer-to-peer (P2P) distributed file system that allows data to be shared and exchanged between connected nodes. Recently, IPFS aims to replace existing protocols used in a centralized system (e.g., HTTP) by overcoming their weaknesses such as a single point of failure and arbitrary control. However, we observe that the performance of IPFS is worse as the data size increases since it demands large numbers of storage and network I/O operations. In this paper, we present an efficient data transmission scheme in IPFS called IPFSz to improve the I/O performance of IPFS. To do this, we extend IPFS by enabling real-time compression functionality while maintaining its existing operations in IPFS. In IPFSz, we compress/decompress the data during I/O operations by using a compression algorithm, manage the states of data (e.g., compressed or decompressed), and provide a compression/decompression interface to applications. Thus, IPFSz can reduce the number of storage and network I/O operations and storage space without sacrificing the integrity of the existing IPFS. We have implemented and evaluated IPFSz on five Amazon EC2 nodes. The experimental results show that IPFSz provides higher performance by up to 7.9\times and saves the storage space by up to 6.3\times compared with existing IPFS.
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2022.3223107