MPI Tutorial     Tutorials     Recommended Books     About

Tutorials

Welcome to the MPI tutorials! In these tutorials, you will learn a wide array of concepts about MPI. Below are the available lessons, each of which contain example code.

The tutorials assume that the reader has a basic knowledge of C, some C++, and Linux.

Introduction and MPI installation

• MPI tutorial introduction (中文版) (日本語)
• Installing MPICH2 on a single machine (中文版) (日本語)
• Launching an Amazon EC2 MPI cluster (日本語)
• Running an MPI cluster within a LAN (日本語)
• Running an MPI hello world application (中文版) (日本語)

Blocking point-to-point communication

• Sending and receiving with MPI_Send and MPI_Recv (中文版) (日本語)
• Dynamic receiving with MPI_Probe and MPI_Status (中文版) (日本語)
• Point-to-point communication application - Random walking (中文版) (日本語)

Basic collective communication

• Collective communication introduction with MPI_Bcast (中文版) (日本語)
• Common collectives - MPI_Scatter, MPI_Gather, and MPI_Allgather (中文版) (日本語)
• Application example - Performing parallel rank computation with basic collectives (中文版) (日本語)

Advanced collective communication

• Using MPI_Reduce and MPI_Allreduce for parallel number reduction (中文版) (日本語)

Groups and communicators

• Introduction to groups and communicators (中文版) (日本語)

© 2026 MPI Tutorial. All rights reserved.