Experiences with nested parallelism in task-parallel applications using malleable BLAS on multicore processors

• Published in: The international journal of high performance computing applications 2024-03, Vol.38 (2), p.55-68
• Main Authors: Rodríguez-Sánchez, Rafael, Castelló, Adrián, Catalán, Sandra, Igual, Francisco D., Quintana-Ortí, Enrique S.
• Format: Article
• Language: English
• Subjects: Linear algebra; Microprocessors; Parallel processing; Processors
• ISSN: 1094-3420; 1741-2846
• DOI: 10.1177/10943420231157653

Malleability is defined as the ability to vary the degree of parallelism at runtime, and is regarded as a means to improve core occupation on state-of-the-art multicore processors tshat contain tens of computational cores per socket. This property is especially interesting for applications consisting of irregular workloads and/or divergent executions paths. The integration of malleability in high-performance instances of the Basic Linear Algebra Subprograms (BLAS) is currently nonexistent, and, in consequence, applications relying on these computational kernels cannot benefit from this capability. In response to this scenario, in this paper we demonstrate that significant performance benefits can be gathered via the exploitation of malleability in a framework designed to implement portable and high-performance BLAS-like operations. For this purpose, we integrate malleability within the BLIS library, and provide an experimental evaluation of the result on three different practical use cases.