The Memory-Bounded Speedup Model and Its Impacts in Computing

With the surge of big data applications and the worsening of the memory-wall problem, the memory system, instead of the computing unit, becomes the commonly recognized major concern of computing. However, this “memory-centric” common understanding has a humble beginning. More than three decades ago,...

Full description

Saved in:
Bibliographic Details
Published in:Journal of computer science and technology 2023-02, Vol.38 (1), p.64-79
Main Authors: Sun, Xian-He, Lu, Xiaoyang
Format: Article
Language:English
Subjects:
Analysis
Artificial Intelligence
Big Data
Computer memory
Computer Science
Data Structures and Information Theory
Information Systems Applications (incl.Internet)
Multiprocessing
Optimization
Parallel processing
Review
Software
Software Engineering
Theory of Computation
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With the surge of big data applications and the worsening of the memory-wall problem, the memory system, instead of the computing unit, becomes the commonly recognized major concern of computing. However, this “memory-centric” common understanding has a humble beginning. More than three decades ago, the memory-bounded speedup model is the first model recognizing memory as the bound of computing and provided a general bound of speedup and a computing-memory trade-off formulation. The memory-bounded model was well received even by then. It was immediately introduced in several advanced computer architecture and parallel computing textbooks in the 1990’s as a must-know for scalable computing. These include Prof. Kai Hwang’s book “Scalable Parallel Computing” in which he introduced the memory-bounded speedup model as the Sun-Ni’s Law, parallel with the Amdahl’s Law and the Gustafson’s Law. Through the years, the impacts of this model have grown far beyond parallel processing and into the fundamental of computing. In this article, we revisit the memory-bounded speedup model and discuss its progress and impacts in depth to make a unique contribution to this special issue, to stimulate new solutions for big data applications, and to promote data-centric thinking and rethinking.
ISSN:1000-9000
1860-4749
DOI:10.1007/s11390-022-2911-1