A Scalable and Elastic Publish/Subscribe Service

The rapid growth of sense-and-respond applications and the emerging cloud computing model present a new challenge: providing publish/subscribe as a scalable and elastic cloud service. This paper presents the Blue Dove attribute based publish/subscribe service that seeks to address such a challenge....

Full description

Saved in:
Bibliographic Details
Main Authors: Ming Li, Fan Ye, Minkyong Kim, Han Chen, Hui Lei
Format: Conference Proceeding
Language:English
Subjects:
Peer to peer computing
Routing
Servers
Silicon
Subscriptions
Throughput
Vehicles
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The rapid growth of sense-and-respond applications and the emerging cloud computing model present a new challenge: providing publish/subscribe as a scalable and elastic cloud service. This paper presents the Blue Dove attribute based publish/subscribe service that seeks to address such a challenge. Blue Dove uses a gossip-based one-hop overlay to organize servers into a scalable cluster. It proactively exploits skewness in data distribution to achieve high performance. By assigning each subscription to multiple servers through a multidimensional subscription space partitioning technique, it provides multiple candidate servers for each publication message. A message can be matched on any of its candidate servers with one hop forwarding. The performance-aware forwarding in Blue Dove ensures that the message is sent to the least loaded candidate server for processing, leading to low latency and high throughput. The evaluation shows that Blue Dove has a linear capacity increase as the system scales up, adapts to sudden workload changes within tens of seconds, and achieves multifold higher throughput than the techniques used in the existing enterprise and peer-to-peer pub/sub systems.
ISSN:1530-2075
DOI:10.1109/IPDPS.2011.119