OCP Global Summit 2024: Supermicro Petascale 2U JBOF All-Flash Storage Solution Integrating Nvidia BlueField-3 DPU for AI Data Pipeline Acceleration

Supermicro, Inc. is launching an optimized storage system for high performance AI training, inference and HPC workloads.

This JBOF (Just a Bunch of Flash) system utilizes up to 4 Nvidia BlueField-3 data processing units (DPUs) in a 2U form factor to run SDS workloads. Each BlueField-3 DPU features 400GbE or IB networking and hardware acceleration for high computation storage and networking workloads such as encryption, compression and erasure coding, as well as AI storage expansion. The dual port JBOF architecture enables active-active clustering ensuring HA for scale up mission critical storage applications as well as scale-out storage such as object storage and parallel file systems.

“Supermicro’s new high performance JBOF Storage System is designed using our Building Block approach which enables support for either E3.S or U.2 form-factor SSDs and the latest PCIe Gen 5 connectivity for the SSDs and the DPU networking and storage platform,” said Charles Liang, president and CEO, Supermicro. “Supermicro’s system design supports 24 or 36 SSD’s enabling up to 1.105PB of raw capacity using 30.71TB SSDs. Our balanced network and storage I/O design can saturate the full 400 Gb/s BlueField-3 line-rate realizing more than 250GB/s bandwidth of the Gen 5 SSDs.”

The Supermicro JBOF with Nvidia BlueField-3 solution replaces the traditional storage CPU and memory subsystem with the BlueField-3 DPU and runs the storage application on the DPU’s 16 Arm cores. In addition to storage acceleration such as erasure coding and decompression algorithms, the BlueField-3 also accelerates networking through hardware support for RoCE (RDMA over Converged Ethernet), GPU Direct Storage and GPU Initiated Storage.

“Accelerated computing and AI are transforming every industry and delivering benefits for society,” said Kevin Deierling, SVP, networking, Nvidia Corp. “Nvidia BlueField-3 DPUs enable innovative solutions like the Supermicro Petascale JBOF, which is the foundation for a new class of AI data platforms delivering extreme performance and efficiency.“

In collaboration with Nvidia, Supermicro is creating a JBOF ecosystem including data platform company Hammerspace, Inc. and object storage provider Cloudian, Inc. to enable these storage infrastructure software platforms to run natively on the Nvidia BlueField-3 DPU in the company’s JBOF. In addition, the firm has qualified SSDs from Micron Technology, Inc. and Kioxia Corp. with the JBOF system to provide a range of capacities and single and dual-port capability.

“The Supermicro JBOF using Nvidia’s BlueField-3 DPU offers a highly integrated storage approach for large-scale AI training and analytics storage workloads,” said Ashish Nadkarni, group VP and GM, WW infrastructure research, IDC. “This implementation provides a more power efficient solution than CPU-based storage servers and lower read latency due to the direct data path provided by the JBOF and DPU architecture. Supermicro and Nvidia have assembled an ecosystem of partners which makes this something that all large-scale AI, CSP and HPC customers should consider.“

Supermicro, in collaboration with Nvidia, was presenting this JBOF solution with the BlueField-3 in detail at the 2024 OCP Global Summit conference in San Jose, CA, on October 16.

Resource:
Supermicro Petascale All-Flash Gen 5 JBOF Storage Solution with Nvidia BlueField-3 DPU solution brief