Fast Heuristic-Based GPU Compiler Sequence Specialization

• Type: Article in International Conference Proceedings Book
• Date: 2019-12-31

Authors

Ricardo Nobre (Author) FEUP; Luís Reis (Author) FEUP; João M. P. Cardoso (Author) FEUP

Conference proceedings International

Title: EURO-PAR 2018: PARALLEL PROCESSING WORKSHOPS

Pages: 494-505

International European Conference on Parallel and Distributed Computing (Euro-Par)

Turin, ITALY, AUG 27-28, 2018

Indexing

ISI Web of Knowledge - 0 Citations

Scopus - 0 Citations

Other information

Authenticus ID: P-00Q-2NK

DOI: 10.1007/978-3-030-10549-5_39

Abstract (EN): Iterative compilation focused on specialized phase orders (i.e., custom selections of compiler passes and orderings for each program or function) can significantly improve the performance of compiled code. However, phase ordering specialization typically needs to deal with large solution space. A previous approach, evaluated by targeting an x86 CPU, mitigates this issue by first using a training phase on reference codes to produce a small set of high-quality reusable phase orders. This approach then uses these phase orders to compile new codes, without any code analysis. In this paper, we evaluate the viability of using this approach to optimize the GPU execution performance of OpenCL kernels. In addition, we propose and evaluate the use of a heuristic to further reduce the number of evaluated phase orders, by comparing the speedups of the resulting binaries with those of the training phase for each phase order. This information is used to predict which untested phase order is most likely to produce good results (e.g., highest speedup). We performed our measurements using the PolyBench/GPU OpenCL benchmark suite on an NVIDIA Pascal GPU. Without heuristics, we can achieve a geomean execution speedup of 1.64x, using cross-validation, with 5 non-standard phase orders. With the heuristic, we can achieve the same speedup with only 3 non-standard phase orders. This is close to the geomean speedup achieved in our iterative compilation experiments exploring thousands of phase orders. Given the significant reduction in exploration time and other advantages of this approach, we believe that it is suitable for a wide range of compiler users concerned with performance.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 12