Skip to content

nodus.cluster

View Markdown

nodus.cluster.info(): the gang env contract of distributed-training.md §3.6, as one object.

It works in @nodus.clustered Functions and in plain gang Jobs alike; outside a gang it describes a gang of one.

class ClusterInfo(rank: int, size: int, ips: list[str], master_addr: str, master_port: int, epoch: int, transport: str | None, gpus_per_node: int) -> None

Type: int

Type: int

Type: list[str]

Type: bool

Rank 0 hosts the rendezvous, and its return value is the clustered call’s result.

Type: str

Type: int

Type: int

Type: int

Type: str | None

info(env: Mapping[str, str] | None = None) -> ClusterInfo