Loading…

Optimizing disk storage to support statistical analysis operations

Data stored in spreadsheets and relational database tables can be viewed as “worksheets” consisting of rows and columns, with rows corresponding to records. Correspondingly, the typical practice is to store the data on disk in row major order. While this practice is reasonable in many cases, it is n...

Full description

Saved in:
Bibliographic Details
Published in:Decision Support Systems 2005, Vol.38 (4), p.621-628
Main Authors: Parrish, Allen, Vrbsky, Susan, Dixon, Brandon, Ni, Weigang
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Data stored in spreadsheets and relational database tables can be viewed as “worksheets” consisting of rows and columns, with rows corresponding to records. Correspondingly, the typical practice is to store the data on disk in row major order. While this practice is reasonable in many cases, it is not necessarily the best practice when computation is dominated by column-based statistics. This short note discusses the performance tradeoffs between row major and column major storage of data in the context of statistical data analysis. A comparison of a software package utilizing column major storage and one using row major storage confirms our results.
ISSN:0167-9236
1873-5797
DOI:10.1016/j.dss.2003.09.005