The Trickle-Down Effect: Web Caching and Server Request Distribution

Web proxies and Content Delivery Networks (CDNs) are widely used to accelerate Web content delivery and to conserve Internet bandwidth. These caching agents are highly effective for static content, which is an important component of all Web-based services. This paper explores the effect of ubiquitou...

Full description

Saved in:
Bibliographic Details
Published in:Computer communications 2002-03, Vol.25 (4), p.345-356
Main Authors: Doyle, Ronald P, Chase, Jeffrey S, Gadde, Syam, Vahdat, Amin M
Format: Article
Language:English
Subjects:
Caching
Internet
Load balancing
Request distribution
URL hashing
Web proxy cache
World Wide Web
Zipf
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Web proxies and Content Delivery Networks (CDNs) are widely used to accelerate Web content delivery and to conserve Internet bandwidth. These caching agents are highly effective for static content, which is an important component of all Web-based services. This paper explores the effect of ubiquitous Web caching on the request patterns seen by other components of an end-to-end content delivery architecture, including Web server clusters and interior caches. In particular, object popularity distributions in the Web tend to be Zipf-like, but caches disproportionately absorb requests for the most popular objects, changing the reference properties of the filtered request stream in fundamental ways. We call this the trickle-down effect. This paper uses trace-driven simulation and synthetic traffic patterns to illustrate the trickle-down effect and to investigate its impact on other components of a content delivery architecture, focusing on the implications for request distribution strategies in server clusters.
ISSN:0140-3664
1873-703X
DOI:10.1016/S0140-3664(01)00406-6