This document describes the networking requirements for Determined clusters.
For best performance, we recommend that the Determined master and agents use the same physical network or VPC.
The Determined Docker images are hosted on Docker Hub. Determined agents need access to Docker Hub, e.g., to build new images for user workloads.
If packages, data, or other resources needed by user workloads are hosted on the public Internet, Determined agents will need to be able to access them. Note that agents can be configured to use proxies when accessing network resources.
When using VPCs on a public cloud provider, additional steps may need to be taken to ensure that instances in the VPC can access the Internet:
The firewall rules must satisfy the following requirements.
The Determined master needs the following network access:
Inbound TCP to the master’s HTTP and/or HTTPS ports from the Determined agent instances, as well as all machines where developers want to use the Determined CLI. The default HTTP port is
8080. If HTTPS is enabled, the default HTTPS port is
Outbound TCP to all ports on the Determined agents.
Determined agents need the following network access:
Inbound TCP from all ports on the master to all ports on the agent.
Outbound TCP from all ports on the agent to the master’s HTTP port (
Inbound and outbound TCP on all ports to and from each Determined agent.
Outbound TCP to the services that host the Docker images, packages, data, and other resources that need to be accessed by user workloads.
For example, if your data is stored on Amazon S3, ensure the firewall rules allow access to this data.