htcondor#

Methods for working with the HTCondor cluster system.

class hsr4hci.htcondor.DAGFile[source]#

Create submit files for HTCondors DAGman.

__init__()[source]#
Return type:

None

class hsr4hci.htcondor.Node[source]#

Auxiliary class to represent nodes in a directed acyclic graph.

__init__(name, attributes)[source]#
Parameters:

  • name (str) –

  • attributes (dict) –

Return type:

None

class hsr4hci.htcondor.SubmitFile[source]#

A class that provides the methods to comfortably create a submit file for the HTCondor cluster.

__init__(clusterlogs_dir=None, executable=sys.executable, getenv=True, memory=8192, cpus=1, gpus=0, requirements=())[source]#

Initialize a new submit file object.

Parameters:

  • clusterlogs_dir (Optional[Union[Path, str]]) – The path to the folder where the log files for this submit file will be stored. If None is given, no logs will be created and all output will be forwarded to /dev/null.

  • executable (str) – The executable parameter for the submit file.

  • memory (int) – How much memory (in MB) to request from the cluster.

  • cpus (int) – The number of CPUs to request from the cluster.

  • gpus (int) – The number of GPUs to request from the cluster.

  • requirements (Sequence[str]) – A sequence (usually: a list) with any additional requirements, for example, limitations on the available GPU memory, or the machines on which to run (e.g., “Target.CpuFamily =!= 21” to block certain types of nodes from running the job).

  • getenv (bool) –