Overview of High Performance Computing（高性能计算的概述）.pdf

Overview of High Performance Computing Timothy H. Kaiser, PH.D. tkaiser@ /workshop 1 This tutorial will cover all three time slots.   In the first session we will discuss the importance of parallel computing to high performance computing. We will by example, show the basic concepts of parallel computing. The advantages and disadvantages of parallel computing will be discussed. We will present an overview of current and future trends in HPC hardware.   The second session will provide an introduction to MPI, the most common package used to write parallel programs for HPC platforms. As tradition dictates, we will show how to write Hello World in MPI. Attendees will be shown how to and allowed to build and run relatively simple examples on a consortium resource.   The third session will briefly discuss other important HPC topics. This will include a discussion of OpenMP, hybrid programming, combining MPI and OpenMP. Some computational libraries available for HPC will be highlighted. We will briefly mention parallel computing using graphic processing units (GPUs).   2 Today’s Overview • HPC computing in a nutshell? • Basic MPI - run an example • A few additional MPI features • A “Real” MPI example • Scripting • OpenMP • Libraries and other stuff 3 Introduction • What is parallel computing? • Why go parallel? • When do you go parallel? • What are some limits of parallel computing? • Types of parallel computers • Some terminology 4 What is Parallelism? • Consider your favorite computational application • One processor can