Also known as: Node (Data Structure) Β· Data Structure Β· Node Data Structure
A node is a basic unit in a data structure, such as a tree, graph, or linked list. In different computing contexts, the same term may also refer to a unit of computation, such as a virtual machine within a cluster.
A single virtual machine (Compute Engine instance) within a cluster. In the context of Managed Training on reserved clusters, a node refers to an individual virtual machine (VM) that serves as a single unit of computation within your cluster. Think of it as one of the dedicated worker machines that runs a portion of your overall training job. Each node is equipped with specific resources like CPU, memory, and accelerators (for example, A3 or A4 GPUs), and they all work together in a coordinated way to handle large-scale, distributed training tasks.