The large image: As Nvidia begins rolling out its hotly anticipated Blackwell server GPUs, data concerning an upcoming lineup refresh is beginning to emerge. Set for launch in late 2025, GB300 options quite a few upgrades in reminiscence, connectivity, cooling, and different areas in comparison with its predecessor.
Provide chain sources have revealed detailed specs of Nvidia’s GB300 information heart GPU to UDN (translated by TechPowerUp). Codenamed “Blackwell Extremely,” the chip goals to offer substantial efficiency enhancements over the corporate’s just lately launched GB200.
One of the vital notable enhancements is a reminiscence enhance, with GB300 rising from its predecessor’s 192 GB to 288 GB of HBM3e RAM. Moreover, Nvidia shifted the structure from eight layers to 12, and the computing board makes use of LPCAMM reminiscence.
Every B300 chip on the coronary heart of the GB300 would require 1,400W. Furthermore, networking has been upgraded from ConnectX 7 to ConnectX 8, and optical modules have expanded from 800G to 1.6T.
Every card guarantees a 50 p.c FP4 efficiency enchancment over GB200. Nvidia’s utilization of FP4, which is well-suited to inference workloads, is without doubt one of the major causes behind the heightened anticipation for GB300.
Nonetheless, the elevated efficiency comes with an additional value. Every cupboard requires over 300 supercapacitors, which carry a roughly $20 to $25 manufacturing value per unit. Nvidia can even provide elective battery backup models costing roughly $1,500 for an entire unit.
Prior stories indicated that the corporate is contemplating a socket configuration for GB300, which might simplify manufacturing and upkeep necessities. Sadly, the choice would additionally enhance energy and cooling calls for.
Mass manufacturing and shipments of GB200 are anticipated to peak in mid-2025 following delays stemming from late-stage design flaws and overheating issues. Regardless of the setbacks, orders from Nvidia’s purchasers, together with Microsoft, are backlogged for a 12 months. The AI increase has created intense demand for Nvidia’s server GPUs, rising its market cap to over $3 trillion and making it one of many world’s three most beneficial corporations.
Blackwell Extremely is predicted to reach in late 2025, nevertheless it stays unclear whether or not this schedule will collide with Nvidia’s subsequent era, Rubin, which could emerge across the similar time. Rubin will make the most of TSMC’s 3nm N3 course of node and HBM4 reminiscence.
Nvidia can also be getting ready to launch its next-generation client Blackwell GPUs subsequent 12 months with a probable reveal coming throughout CES in January.
