Low-Overhead Paxos Replication

• Published in: Data science and engineering 2017-06, Vol.2 (2), p.169-177
• Main Authors: Guo, Jinwei, Chu, Jiajia, Cai, Peng, Zhou, Minqi, Zhou, Aoying
• Format: Article
• Language: English
• Subjects: Algorithm Analysis and Problem Complexity; Artificial Intelligence; Backups; Chemistry and Earth Sciences; Computer Science; Consistency; Data Mining and Knowledge Discovery; Database Management; Physics; Replicating; Replication; Statistics for Engineering; Synchronism; Systems and Data Security
• ISSN: 2364-1185; 2364-1541
• DOI: 10.1007/s41019-017-0039-z

Log replication is a key component in highly available database systems. In order to guarantee data consistency and reliability, it is common for modern database systems to utilize Paxos protocol, which is responsible for replicating transactional logs from one primary node to multiple backups. However, the Paxos replication needs to store and synchronize some additional metadata, such as committed log sequence number (commit point), to guarantee the consistency of the database. This increases the overhead of storage and network, which would have a negative impact on the throughput in the update intensive work load. In this paper, we present an implementation of log replication and database recovery methods, which adopts the idea of piggybacking, i.e., commit point can be embedded in the commit logs. This practice not only retains virtues of Paxos replication, but also reduces disk and network IO effectively. We implemented and evaluated our approach in a main memory database system. Our experiments show that the piggybacking method can offer 1.3× higher throughput than typical log replication with synchronization mechanism.