Speaker
Description
For years, the ATLAS experiment is running selection of its workflows (mostly Monte Carlo simulations, which have small inputs and outputs and can run even on tens of cores for hours) at IT4Innovation. As the experiment and its computing evolves, so does constitution of its workflows. Recently, we are more often getting into a situation when there is insufficient number of these jobs while there are many other jobs from other workflows. The most common example would be event generation which has small or no input and small output but, unlike simulations, runs only on one core. Insufficient number of runnable jobs means leaving available resources idle. To address that, the submission system was updated to allow, for example, jobs using one CPU core running next to jobs requiring 30+ CPU cores. This allows running more workflows. With the help of HyperQueue, available ATLAS jobs can efficiently fill available resources.