References for Learners

Why GPUs for High-Performance Computing?

• The end of Moore’s law: Opportunities for natural computing?

• The future of computing beyond Moore’s law

• An introduction to parallel programming

• GPU computing

• Evolution of graphics processing unit

• The TOP500 project: Looking back over 15 years of supercomputing experience

• The LINPACK benchmark: Past, present and future

• The International Exascale Software Project roadmap

GPU Hardware and Software Ecosystem

• Scalable parallel programming with CUDA

• Fundamentals of heterogeneous parallel programming with CUDA C/C++

• AMD ROCm documentation

• Introduction to the HIP programming model

• Data parallel C++: Mastering DPC++ for programming of heterogeneous systems using C++ and SYCL

• Heterogeneous programming with SYCL

• oneAPI specification

What Problems Fit Well on GPUs?

• GPU-accelerated molecular modeling coming of age

• 3D finite difference computation on GPUs using CUDA

• High-order finite-element seismic wave propagation modeling with MPI on a large GPU cluster

• cuDNN: Efficient primitives for deep learning

• High-throughput sequence alignment using graphics processing units

• Heritage recording and 3D modeling with photogrammetry and 3D scanning

• Machine learning applications in archaeological practices: A review

• Harnessing graphics processing units for improved neuroimaging statistics

GPU Programming Concepts & Models

• Mapping computational concepts to GPUs

• Modern GPU programming for MLSys

• Is OpenACC the best thing to happen to OpenMP?

• Evaluating GPU programming models for the LUMI supercomputer

• Alpaka workshop materials

• A comparison of OpenCL, CUDA, and HIP as compilation targets for a functional array language

• An evaluative comparison of performance portability across GPU programming models

• Comparing SYCL with HPX, Kokkos, Raja and C++ Executors: The future of ISO C++ heterogeneous computing

• Using Python in an HPC environment

• Python for scientific computing

• Python - High performance computing

• Python in High performance computing

• Effective extensible programming: Unleashing Julia on GPUs

• Julia for high-performance scientific computing

• Julia for high-performance data analytics

• Bridging HPC communities through the Julia programming language

• Julia for high performance computing

Modular Lesson Materials from the EVITA Platform

• Introduction to CUDA

• CUDA memory management

• OpenACC

• OpenMP

• Directive-based GPU programming models

• Kernel-based GPU programming models

• Python for high-performance computing