Tools for Many Task Computing

Learn how to use tools like Slurm job arrays and HyperShell for many-task computing workloads, which involve parallel processing of a large number of similar tasks. Common use cases include file processing workflows and model parameter sweeps.

Slides: https://uschpc.github.io/workshop-mtc/

Prerequisites

• Basic proficiency in running shell commands
• Basic proficiency in running Slurm jobs

Learning objectives

• Explain many task computing
• Submit a Slurm job array
• Submit a Slurm job that uses HyperShell