A typical Gaudi cluster looks like this:

• Compute nodes: bare-metal servers, 8 Gaudi accelerators each.
• Node-to-node networking: Gaudi chips have built-in RDMA networking ports (RoCEv2) — no separate InfiniBand card needed like on NVIDIA. Gaudi 3 can often connect node-to-node directly for small clusters; bigger clusters need external switches.
• Management network, storage, monitoring stack: identical to our NVIDIA setup — same tools, same team.
• Job scheduling: Slurm or Kubernetes, with Gaudi nodes kept in their own pool so jobs land on the right hardware.

← Previous | Guide Index | Next →