Dynamic Agents OverviewΒΆ

PEDL consists of several components:

  • a master that schedules workloads and stores metadata

  • one or more agents that run workloads, typically using GPUs

When running PEDL with Dynamic Agents, the PEDL master dynamically provisions and terminates cloud instances to meet the needs of the cluster.

  • Provisioning new PEDL agents is quick: we make API calls to the cloud provider to provision new instances within a few seconds of new tasks arriving. Within a few minutes new instances will have registered themselves with the PEDL master and start running tasks.

  • When PEDL agents become idle, we give them a five minute grace period before terminating the instances. This grace period provides for a short interval of time for the PEDL agent instance to receive new tasks.

The PEDL master and agents should typically be installed and configured by a system administrator. Each user of PEDL should also install a copy of the command-line tools, see Install PEDL CLI.