Message-Passing Programming with MPI (IT4I training)

Europe/Prague
conf. room (Institute of Geonics of the Czech Academy of Sci.)

conf. room

Institute of Geonics of the Czech Academy of Sci.

Studentská 1768 Ostrava Czech Republic
Description

Annotation

The world’s largest supercomputers are used almost exclusively to run applications which are parallelised using Message Passing. The course covers all the basic knowledge required to write parallel programs using this programming model, and is directly applicable to almost every parallel computer architecture.

The course will be delivered in an intensive format using the Anselm supercomputer for practical exercises. It will be taught using a variety of methods including formal lectures, practical exercises, programming examples and informal tutorial discussions. This enables lecture material to be supported by the tutored practical sessions in order to reinforce the key concepts.

Parallel programming by definition involves co-operation between many processors to solve a common problem. The programmer has to define the individual tasks that will be executed by the processors, and also how these tasks are to synchronise and exchange data with one another. In the message-passing model the tasks are separate processes that communicate and synchronise by explicitly sending each other messages. All these parallel operations are performed via calls to some message-passing interface that is entirely responsible for interfacing with the physical communication network linking the actual processors together. This course uses the de facto standard for message passing, the Message Passing Interface (MPI). It covers point-to-point communication, non-blocking operations, derived datatypes, virtual topologies, collective communication and general design issues.

Tutor

David Henty (EPCC)

Level

basic - intermediate

Language

English

Purpose of the course (benefits for the attendees)

On completion of this course students should be able to:

  • Understand the message-passing model in detail.
  • Implement standard message-passing algorithms in MPI.
  • Debug simple MPI codes.
  • Measure and comment on the performance of MPI codes.
  • Design and implement efficient parallel programs to solve regular-grid problems.
  • Thursday, 12 December
    • 10:00 11:30
      Message-Passing Concepts; Practical: Parallel Traffic Modelling conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
    • 11:30 12:00
      Coffee break 30m conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
    • 12:00 13:30
      MPI Programs; MPI on Anselm; Practical: Hello World conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
    • 13:30 14:30
      Lunch break 1h
    • 14:30 16:00
      Point-to-Point Communication; Practical: Pi conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
      • 14:30
        Coffee break 30m
    • 16:00 16:30
      Coffee break 30m conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
    • 16:30 18:00
      Communicators, Tags and Modes; Practical: Pi continued / Ping-Pong conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
      • 16:30
        Coffee break 30m
  • Friday, 13 December
    • 09:00 10:30
      Non-Blocking Communication; Practical: Message Round a Ring conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
    • 10:30 11:00
      Coffee break 30m conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
    • 11:00 12:30
      Collective Communicaton; Practical: Collective Communication conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic
    • 12:30 13:30
      Lunch break 1h
    • 13:30 15:30
      Introduction to the Case Study; Practical: Case Study conf. room

      conf. room

      Institute of Geonics of the Czech Academy of Sci.

      Studentská 1768 Ostrava Czech Republic