Changes between Initial Version and Version 1 of Fast_GEMM_Implementation_On_Cypress


Ignore:
Timestamp:
Nov 7, 2010 11:22:02 AM (14 years ago)
Author:
nakasato
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Fast_GEMM_Implementation_On_Cypress

    v1 v1  
     1= A Fast GEMM Implementation On a Cypress GPU = 
     2by N.Nakasato (University of Aizu), submitted September 7, 2010. Accepted for presentation October 10, 2010. 
     3 
     4We will present out results on this paper at 1st International Workshop on  
     5Performance Modeling, Benchmarking and Simulation of High Performance Computing Systems (PMBS 10 http://www.dcs.warwick.ac.uk/~sdh/pmbs10/pmbs10/Workshop_Home.html) 
     6held as part of SC10, New Orleans, November 13-19, 2010. 
     7 
     8== abstract == 
     9We present benchmark results of optimized dense matrix multiplication 
     10kernels for Cypress GPU.  
     11We write general matrix multiply (GEMM) kernels 
     12for single (SP), double (DP) and double-double (DDP) precision.  
     13Our SGEMM and DGEMM kernels show ~ 2 Tflop/s and ~ 470 Glop/s, respectively. 
     14These results for SP and DP correspond to 73% and 87% of  
     15the theoretical performance of the GPU, respectively. 
     16Currently, our SGEMM and DGEMM kernels are fastest with one GPU chip to our knowledge. 
     17Furthermore, the performance of our matrix multiply kernel in DDP is 31 Gflop/s. 
     18This performance in DDP is more than 200 times faster than the performance  
     19results in DDP on single core of a recent CPU (with mpack version 0.6.5).We describe our GEMM kernels with main focus on the SGEMM implementation 
     20since all GEMM kernels share common programming and optimization techniques.While a conventional wisdom of GPU programming recommends us  
     21to heavily use shared memory on GPUs,  we show that texture cache is very effective on the Cypress architecture.  
     22 
     23 
     24== Sample program for DGEMM == 
     25 
     26http://github.com/dadeba/dgemm_cypress/ 
     27 
     28== preliminary results == 
     29 * [wiki:"GEMM_Performance_Cypress"] 
     30 * [wiki:"MatrixMultiply"] 
     31 
     32== preprint == 
     33 
     34[attachment:Nakasato_PBMS2010.pdf]