SC24: Giga Computing/Gigabyte Servers to Accelerate AI and LLMs with AMD EPYC 9005 Series Processors and Instinct MI325X GPUs

Giga Computing Co. Ltd., subsidiary of GigabyteTechnology Co., Ltd., announced support for AMD EPYC 9005 Series processors with the release of new servers alongside BIOS updates for some existing the company’s servers using the SP5 platform.

This 1st wave of updates supports over 60 servers and motherboards that customers can choose from that deliver performance for 5th Gen EPYC processors. In addition, with the launch of the AMD Instinct MI325X accelerator, a newly designed Gigabyte server was created, and it will be showcased at SC24 (November 19-21) in Atlanta, GA.

Servers and updates

XV23-ZX0 server

To fill in all possible workload scenarios, using modular design servers to edge servers to enterprise-grade motherboards, these new solutions will ship already supporting EPYC 9005 Series processors. The XV23-ZX0 is 1 of the many new solutions and it is notable for its modularized server design using 2 EPYC 9005 processors and supporting up to 4 GPUs and 3 additional FHFL slots. It also has 2+2 redundant power supplies on the front-side for ease of access.

To support the number of EPYC 9004 Series CPU-based servers and motherboards in the the company’s portfolio, 2 waves of updates will roll out in support of EPYC 9005 CPUs, covering most models. To determine if an existing server supports 5th Gen EPYC CPUs, the firm’s product pages will identify this in their description, and if so, there will be a BIOS update available to download for that product. If not, then EPYC 9005 will not be supported and only EPYC 9004 is listed on the description. Because of the generational difference in memory speeds for 1 DIMM/channel configurations, customers must check the product page to determine whether 6,000MT/s is supported.

Technological advances with AMD
EPYC 9005 Series processors are the latest in the EPYC family, featuring the ‘Zen5’ architecture, offering a wide range of core counts (up to 192 cores and 384 threads), frequencies (up to 5GHz), cache capacities, and more. Designed for AI-enabled data centers, these processors provide performance, efficiency, and x86 software compatibility. They support applications from corporate AI-enablement initiatives to large-scale cloud-based infrastructures to hosting business-critical applications, improving energy efficiency and reducing the data center sprawl. EPYC 9005 Series CPU-based servers provide a path for businesses looking to lead in compute and AI solutions.

The AMD Instinct MI325X accelerators set new standards in AI performance with AMD CDNA 3 architecture, delivering performance and efficiency for training and inference. With industry-leading memory and 6TB/s bandwidth, they optimize performance and help reduce system TCO. Integrated with AMD ROCm software, AMD accelerators support key AI frameworks and simplify deployment. Instinct MI325X accelerators will also offer integration within Gigabyte infrastructure, as well as including strong Day 0 support for ecosystem partners like OpenAI, PyTorch, Hugging Face, Databricks, Lamini and many more, helping enterprises scale efficiently.

“Using the same socket to support multiple generations of AMD EPYC processors is quite impressive, considering the boost in compute performance that we have seen with EPYC 9005 Series CPUs,” said Vincent Wang, VP, sales, Giga Computing. “As these technological advancements such as the AMD Instinct MI325X continue to push boundaries in compute in AI and more, we appreciate the relationship we have with AMD that allows us to echo our updates at the same time as AMD’s announcement.”

“AMD is the data center solutions provider of choice for leading organizations, whether they are enabling corporate AI initiatives, building large-scale cloud deployments, or hosting demanding business applications on-premises,” said Ravi Kuppuswamy, SVP, server business unit, AMD (Advanced Micro Devices Inc). “Our latest 5th Gen AMD EPYC CPUs provide the performance, flexibility and reliability – with compatibility across the data center ecosystem – to deliver tailored solutions that meet the unique demands of the modern data center.”

“AMD is leading the AI revolution, setting new benchmarks in generative AI performance and capabilities with our Instinct accelerators,” said Travis Karr, corporate VP, business development, AMD. “Our latest Instinct MI325X accelerators, built on CDNA3 architecture and featuring an industry-leading 256GB of HBM3E memory, enable organizations to efficiently scale their most complex AI workloads, driving unprecedented advancements in natural language processing, computer vision, and beyond.“

R283-ZK0 ‘zig zag’ server

At Advancing AI 2024, Gigabyte showcases its released, and only known server with 48 DIMMs on a single node, R283-ZK0 ‘zig zag’ server. And showing a 8U server design concept, a revamped 8-GPU baseboard server for the Instinct MI325X GPU is also at the event to show a needed solution for large language models and AI inference.

Resources:
Gigabyte AMD EPYC 9005 solutions
Gigabyte MD Instinct MI300 Series