BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//CERN//INDICO//EN
BEGIN:VEVENT
SUMMARY:[HYBRID] HyperQueue: Running Millions of Tasks on HPC Systems Made
  Easy
DTSTART:20261123T090000Z
DTEND:20261123T110000Z
DTSTAMP:20261113T124500Z
UID:indico-event-420@events.it4i.cz
CONTACT:training@it4i.cz
DESCRIPTION:\nThis course is organised in collaboration with MAX CoE\, Eur
 oCC Czechia and EuroCC Germany.\nAnnotation\nMany scientific workflows con
 sist of huge numbers of small tasks\, which traditional HPC schedulers suc
 h as SLURM and PBS handle poorly. This tutorial\, presented by the core de
 velopers of HyperQueue\, introduces this open-source scheduler and meta-sc
 heduler for large pipelines.\nStarting from the basics\, we show how to ru
 n millions of tasks on SLURM- or PBS-managed clusters. HyperQueue requests
  allocations automatically and distributes tasks into them with minimal ov
 erhead. It also works on systems without any batch scheduler. It installs 
 as a single binary without admin rights and is already preinstalled on man
 y supercomputers.\nParticipants will learn to submit and monitor tasks and
  to define complex resource requests for heterogeneous clusters. We conclu
 de with best practices and tips drawn from our experience supporting real-
 world pipelines.\nBenefits for the attendees\, what will they learn:\n\n\n
 Recognise when the “many small tasks” pattern overwhelms SLURM or PBS\
 , and how a meta-scheduler solves it.\n\n\nInstall HyperQueue on their own
  machine or use an existing installation on a supercomputer. \n\n\nSubmit\
 , monitor\, and manage large numbers of tasks\, including task dependencie
 s. \n\n\nLet HyperQueue request SLURM/PBS allocations automatically instea
 d of submitting jobs by hand. \n\n\nDefine complex resource requests (e.g.
  GPUs\, CPU counts\, custom resources) and use heterogeneous clusters effe
 ctively. \n\nKeep scheduling overhead low when scaling to millions of task
 s.\nApply best practices and avoid common pitfalls\, with tips from real-w
 orld pipelines shared by the HyperQueue developers.\n\n \nLevel\nbeginner
 \, intermediate \nPrerequisites\nNo prior HyperQueue experience is requir
 ed\, only basic familiarity with the command line and HPC clusters.\nLangu
 age\nEnglish\nTutor\nAda Böhm holds a Ph.D. in Computer Science and is a 
 researcher at the IT4Innovations National Supercomputing Center\, Czech Re
 public. She works on task scheduling and distributed computing for HPC and
  is a core author of HyperQueue. Her work also covers Rust systems program
 ming\, and infrastructure for quantum computing. She has a background in f
 ormal methods and automata theory.\n \nAcknowledgements\n\nEuroCC 3 has r
 eceived funding from the European High-Performance Computing Joint Underta
 king (JU) under Grant Agreement No. 101306701. The JU receives support fro
 m European Union‘s Digital Europe Programme and Germany\, Albania\, Aust
 ria\, Belgium\, Bosnia and Herzegovina\, Bulgaria\, Croatia\, Cyprus\, Cze
 chia\, Denmark\, Estonia\, Finland\, France\, Greece\, Hungary\, Iceland\,
  Ireland\, Italy\, Latvia\, Lithuania\, Luxembourg\, Malta\, Montenegro\, 
 Netherlands\, North Macedonia\, Norway\, Poland\, Portugal\, Romania\, Ser
 bia\, Slovakia\, Slovenia\, Spain\, Sweden\, Türkiye\, Kosovo. The EuroCC
  3 project received funding from the Ministry of Education\, Youth and Spo
 rts of the Czech Republic.\n \n \nMaX - Materials design at the Exascale
  has received funding from the European High Performance Computing Joint U
 ndertaking and Participating Countries in Project (Czechia\, France\, Germ
 any\, Italy\, Slovenia and Spain) under grant agreement no. 101093374.\n 
 \n\n \n\nThis course was supported by the Ministry of Education\, Youth a
 nd Sports of the Czech Republic through the e-INFRA CZ (ID:90254).\n \nAl
 l presentations and educational materials of this course are provided unde
 r the Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 
 4.0) license.\n\nhttps://events.it4i.cz/event/420/
LOCATION:Training room 207 (IT4Innovations\, online)
URL:https://events.it4i.cz/event/420/
END:VEVENT
END:VCALENDAR