Intel Gaudi 3 AI Accelerator Official: 5nm, 128 GB HBM2e, Up To 900W, 50% Faster Than NVIDIA H100 & 40% More Efficient

Intel has finally revealed its next-gen AI Accelerator, the Gaudi 3, based on a 5nm process node and competing directly against NVIDIA's H100 GPUs.

Intel Gaudi 3 AI Accelerators Take the Fight To NVIDIA, Offers 50% Faster AI Performance On Average While Being 40% Efficient

Intel's Gaudi AI accelerators have been a big competitor and the only alternative to NVIDIA's GPUs in the AI segment. We recently saw some heated benchmark comparisons between the Gaudi 2 & the NVIDIA A100/H100 GPUs with Intel showcasing its strong perf/$ lead while NVIDIA remained an overall AI leader in terms of performance. Now begins the third chapter in Intel's AI journey with its Gaudi 3 accelerator which has been fully detailed.

Related Story Intel Arc Battlemage “Xe2” GPUs Expected To Launch By The End of 2024

The company announced the Gaudi 3 accelerator which features the latest (5th Gen) Tensor Core architecture with a total of 64 tensor cores packed within two compute dies. The GPU itself has a 96 MB cache pool which is shared across both dies and there are eight HBM sites, each featuring 8-hi stacks of 16 Gb HBM2e DRAM for up to 128 GB capacities & up to 3.7 TB/s bandwidth. The entire chip is fabricated using TSMC 5nm process node technology and there are a total of 24 200GbE interconnect links.

In terms of product offerings, the Intel Gaudi 3 AI accelerators will come in both Mezzanine OAM (HL-325L) form factor with up to 900W standard and over 900W liquid-cooled variants & PCIe AIC with a full-height, double-wide and 10.5" length design. The Gaudi 3 HL-338 PCIe cards will come in passive cooling and support up to 600W TDP with the same specifications as the OAM variant.

The company also announced its own HLB-325 baseboard and HLFB-325L integrated subsystem which can carry up to 8 Gaudi 3 accelerators. This system has a combined TDP of 7.6 Kilowatts & measures 19".

The follow up to Gaudi 3 will come in the form of Falcon Shores which is expected for 2025 and will be combining both