Kokkos Lecture Series

The Kokkos Lectures

First Held: July-September 2020

The following Kokkos Lecture series presents an extensive introduction into everything necessary to start using Kokkos to write performance portable code. The Kokkos Lectures consist of 2-hour lectures and associated exercises. If you have question please join our slack channel at https://kokkosteam.slack.com

The first instance of the training is currently running. We will update this page with links to the recording, and Q&A when they become available. For updates and questions on the currently running series please visit: https://github.com/kokkos/kokkos-tutorials/issues/38

Office Hours Tuesday 3-5PM ET: login-info

Contents of the Lectures

This is a preliminary outline of the training. We are keeping a 9th day in reserve for anticipated schedule slippage. The lectures will be held Fridays: 10:00-12:00 MT (12:00-14:00 ET; 9:00-11:00 PT).

• Module 1: Introduction 07/17/2020 [ Slides ] [ Recording ] [ Q&A ]
  • Introduction
  • Concepts for Data Parallelism
  • Data parallel patterns
  • Building Applications with Kokkos
• Module 2: Views and Spaces 07/24/2020 [ Slides ] [ Recording ] [ Q&A ]
  • Views
  • Execution and Memory Spaces
  • Managing memory access patterns for performance portability
  • Advanced Reductions
• Module 3: Data Structures and MDRange 07/31/2020 [ Slides ] [ Recording ] [ Q&A ]
  • Tightly Nested Loops with MDRangePolicy
  • Subviews: Taking slices of Views
  • Unmanaged Views: Dealing with external memory
  • Thread safety and atomic operations
  • ScatterView
  • DualView
• Module 4: Hierarchical Parallelism 08/07/2020 [ Slides ] [ Recording ] [ Q&A ]
  • Hierarchical parallelism
  • Scratch memory
  • Unique Token
• Module 5: Streams, Tasking and SIMD 08/14/2020 [ Slides ] [ Recording ] [ Q&A ]
  • SIMD
  • Asynchronicity and Streams
  • Task parallelism
• Module 6: Fortran, Python, MPI and PGAS 08/21/2020 [ Slides ] [ Recording ] [ Q&A ]
  • Fortran InterOp
  • Python InterOp
  • MPI - Kokkos Interoperability
  • Kokkos Remote Spaces: Support for PGAS in Kokkos
• Module 7: Tools 08/28/2020 [ Slides ] [ Recording ] [ Q&A ]
  • Kokkos Tools
  • Vendor and Independent Profiling GUIs
  • Tuning
  • Custom Tools
  • Clang Based Static Analysis
• Module 8: Kokkos Kernels 09/04/2020 [ Slides ] [ Recording ] [ Q&A ]
  • Kokkos Kernels: Library Based Approach for Performance Portable Sparse/Dense linear algebra and Graph Kernels
  • BLAS and LAPACK
  • Batched BLAS and LAPACK
  • Sparse Linear Algebra
  • Graph Kernels
  • Sparse Solvers
  • Sparse Solvers 2
  • Building Applications with Kokkos Kernels

How to Attend

• The lecture series is available to everyone
• No-cost registration is necessary, meeting password will be send to registrants.
• For the exercises access to an NVIDIA GPU system or AMD GPU system with up-to-date software stack is recommended.

Additional Lectures

Kokkos Tools Lecture Series

This is an in-depth dive into the tools interface, with sections on autotuning, UVM profiling, and many other advanced topics

• Introduction
• Simple Tools
• Caliper
• Third Party Tools
• Autotuning
• Advanced Topics