Skip to content
naulon

Not checkedNot checked for notices yet.

Job Management and Task Bundling

Berkowitz Evan, Jansen Gustav R., McElvain Kenneth and 1 more

EPJ Web of Conferences · 2018

doi:10.1051/epjconf/201817509007 (opens in a new tab)

We email you when a new notice or a question about this paper appears.

Abstract

High Performance Computing is often performed on scarce and shared computing resources. To ensure computers are used to their full capacity, administrators often incentivize large workloads that are not possible on smaller systems. Measurements in Lattice QCD frequently do not scale to machine-size workloads. By bundling tasks together we can create large jobs suitable for gigantic partitions. We discuss METAQ and mpi_jm, software developed to dynamically group computational tasks together, that can intelligently backfill to consume idle time without substantial changes to users’ current workflows or executables.

Abstract licence: CC BY

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.