SC24: AIC and ScaleFlux Unveils Storage Array Based on Nvidia BlueField-3 DPU

As global electricity demand from AI and data centers is projected to surge by 75% between 2022 and 2026, the need for more efficient solutions is urgent. ⁽¹⁾

In response, AIC Inc. and ScaleFlux, Inc. unveils a storage solution designed to meet the demands of AI and ML workloads. The F2026 Inference AI server is a 2U Just-a-Bunch-of-Flash (JBOF) array featuring dual Nvidia BlueField-3 data processing units (DPUs) and 26 performance ScaleFlux CSD5000 SSDs.

Developed by AIC, this solution provides unparalleled speed, density, and efficiency, tailored specifically for high-performance, data-intensive AI applications. By leveraging the capabilities of CSD5000 NVMe SSDs alongside the Nvidia BlueField-3 DPUs, this storage array is ready to handle the storage workloads for the most demanding AI model building, machine learning and inferencing tasks. The array will be on display in the AIC booth (#1107) at Supercomputing 2024 in Atlanta, GA, November 19-21.

The ever-increasing complexity of AI workloads requires storage solutions that not only offer high performance but also maximize data density and efficiency. Each BlueField-3 DPU provides 400Gb/s connectivity, plus networking and storage accelerations to this infrastructure compute platform, enabling line-rate processing of software-defined networking, storage, and cybersecurity workloads.

When combined with the ScaleFlux CSD5000 drives, which feature advanced write reduction and compression technology, the BlueField DPUs provide users increased performance, storage efficiency, and longevity — all critical for AI applications that rely on massive data throughput.

“AIC and ScaleFlux are developing systems, built with Nvidia accelerated computing solutions like BlueField-3, that equip AI developers to innovate and expand the latest technological advancements with the storage capabilities they need” said Rob Davis, VP, storage technology, Nvidia Corp.

Key benefits of 2U storage array with 26 PCIe 5 SSDs:

• Exceptional data throughput: The integration of BlueField-3 DPUs accelerates data processing, offering rapid access and reduced latency. This is especially valuable for AI and ML models that require fast data handling. 
• Enhanced storage density: With 26 ScaleFlux CSD5000 drives, users can achieve over 1.6PB (Petabyte effective) per 2U today – 6 times the capacity density compared to traditional HDD arrays – and scale to over 6.6PB/2U next year— maximizing the use of data center space for AI operations.
• Excellent Reliability Availability and Serviceability (RAS): The system is designed not only with fully redundant hardware to ensure reliable access to the data, but also with a focus on ease of serviceability.
• High efficiency and reduced power consumption: The combination of BlueField-3’s efficient computing and ScaleFlux’s power-efficient storage technology helps minimize power consumption, enabling the achievement of users’ sustainability goals.
• Remarkable endurance and reliability: ScaleFlux’s write reduction technology enables 6 times the endurance of ordinary SSDs, ideal for high-write AI applications that demand resilience.
• Optimized TCO: With storage, networking, and security functions combined in one efficient system, users benefit from reduced operational costs, minimized space requirements, and a lower TCO.

Performance testing results
Initial testing results yielded up to 55.4GB/s read throughput and over 69.4GB/s write throughput with only 2 of the Nvidia BlueField-3 DPU sockets populated. “The early results are exciting. We expect to achieve higher levels of NVMeoF throughput as we tune the system and populate additional BlueField DPUs,” said CT Sun, CTO, AIC.

“Data-intensive AI workloads demand an infrastructure that doesn’t just keep up but actively drives progress forward. By incorporating Nvidia BlueField-3 DPUs with ScaleFlux’s CSD5000 drives, we’re enabling a level of performance and efficiency that gives our customers an edge in the data race,” states Michael Liang, CEO, AIC. “This collaboration with ScaleFlux and Nvidia exemplifies our commitment to delivering solutions that redefine performance standards.”

“The AI ecosystem needs high-performance storage systems to continue its rapid growth,” said Rob Davis, VP, storage technology, Nvidia. “AIC and ScaleFlux are developing systems, built with Nvidia accelerated computing solutions like BlueField-3, that equip AI developers to innovate and expand the latest technological advancements with the storage capabilities they need.”

This collaboration between AIC and ScaleFlux, with support from Nvidia, underscores a significant advancement in the AI storage space, offering a scalable, high-performance solution built to support next-gen workloads.

⁽¹⁾ Kindig, Beth. AI Power Consumption: Rapidly Becoming Mission-Critical. Forbes, 20 June 2024