Name: [HYBRID] Data Parallelism: How to Train Deep Learning Models on Multiple GPUs (EuroCC)
Start: 2023-10-04T08:45:00+02:00
End: 2023-10-04T16:00:00+02:00
Location: 207

Monday, 2 October 2023
Tuesday, 3 October 2023
Wednesday, 4 October 2023

08:45 Time to join the meeting

08:45 - 09:00

09:00 Introduction

09:00 - 09:30

09:30 Stochastic Gradient Descent

09:30 - 10:00

10:00 Coffee Break
Coffee Break
10:00 - 10:15

10:15 Hands-On: Stochastic Gradient Descent

10:15 - 11:15

11:15 Introduction to Distributed Training

11:15 - 12:00

12:00 Lunch break
Lunch break
12:00 - 13:00

13:00 Introduction to Distributed Training

13:00 - 13:40

13:40 Algorithmic Challenges of Distributed SGD

13:40 - 14:30

14:30 Coffee Break
Coffee Break
14:30 - 14:45

14:45 Hands-On: Algorithmic Challenges of Distributed SGD

14:45 - 15:45

15:45 Wrap up and Q&A

15:45 - 16:00