Performance Evaluations of Multiple GPUs based on MPI Environments

GPU-based computations are widely used in various computing areas because GPU provides very high computing performance when compared to typical CPU. In this paper, we evaluate and analyze the computing performance of multiple GPUs based on MPI environments. We examine the performance of sparse matric-vector multiply (SpMV). SpMV is one of the most heavily used components in many scientific applications. Based on the performance evaluation results, generally, the execution time of SpMV is decreased as the number of GPUs increase. In some case, the performance was reduced according to the computation overhead, the memory copy overhead among GPUs, and the characteristics of sparse matrices.