Data access skipping for recursive partitioning methods

• Published in: Computer languages, systems & structures systems & structures, 2018-09, Vol.53, p.143-162
• Main Authors: Kislal, Orhan, Kandemir, Mahmut T.
• Format: Article
• Language: English
• Subjects: Compiler optimization; Machine learning; Memory; Parallel programming
• ISSN: 1477-8424; 1873-6866
• DOI: 10.1016/j.cl.2018.03.003

•Recursive partitioning methods have non-uniform data access time distribution.•Some data accesses have a minor impact on accuracy but a major impact on performance.•A cache miss skipping module and a pooling technique are proposed.•Skipping 3% of the data accesses improves performance by 13–15%.•The loss of accuracy is usually at acceptable levels (4–6%). The memory performance of data mining applications became crucial due to increasing dataset sizes and multi-level cache hierarchies. Recursive partitioning methods such as decision tree and random forest learning are some of the most important algorithms in this field, and numerous researchers worked on improving the accuracy of model trees as well as enhancing the overall performance of the learning process. Most modern applications that employ decision tree learning favor creating multiple models for higher accuracy by sacrificing performance. In this work, we exploit the flexibility inherent in recursive partitioning based applications regarding performance and accuracy tradeoffs, and propose a framework to improve performance with negligible accuracy losses. This framework employs a data access skipping module (DASM) using which costly cache accesses are skipped according to the aggressiveness of the strategy specified by the user and a heuristic to predict skipped data accesses to keep accuracy losses at minimum. Our experimental evaluation shows that the proposed framework offers significant performance improvements (up to 25%) with relatively much smaller losses in accuracy (up to 8%) over the original case. We demonstrate that our framework is scalable under various accuracy requirements via exploring accuracy changes over time and replacement policies. In addition, we explore NoC/SNUCA systems for similar opportunities of memory performance improvement.