Dell AI Factory Transforms Data Centers with Advanced Cooling, High Density Compute and AI Storage Innovations

Summary:

• Integrated Rack 7000 offers liquid cooled high density compute infrastructure with scalable power management
• PowerEdge XE9712 is an Nvidia GB200 NVL72-based platform targeted toward the largest AI GPU clusters for large language model (LLM) training and real-time inference
• PowerEdge M7725 is a direct-to-chip liquid cooled 5^th Gen AMD EPYC-based system for high-performance, dense compute
• PowerScale advancements deliver increased capacity, accelerate AI workload performance and improve data discoverability
• Dell Data Lakehouse and Dell Services simplify how customers access and manage their data
• Dell GenAI solutions with Intel provide AI optimized solutions for any size workload

Dell Technologies, Inc. introduces integrated rack-scalable systems, server, storage and data management innovations to the Dell AI Factory, powering high density computing and AI workloads at scale.

“Today’s data centers can’t keep up with the demands of AI, requiring high density compute and liquid cooling innovations with modular, flexible and efficient designs,” said Arthur Lewis, president, infrastructure solutions group. “These new systems deliver the performance needed for organizations to remain competitive in the fast-evolving AI landscape.“

Future of accelerated compute with cooling innovations
The Integrated Rack 7000 (IR7000) handles accelerated computing demands with superior density, more sustainable power management and advanced cooling technologies. This Open Compute Project (OCP) standards-based rack is for large-scale deployment and features a futureproof design for multigen and heterogenous technology environments.

Key features include:

• Designed for density, the 21-inch IR7000 is designed to support industry CPU and GPU density.
• Future-ready and efficient, the rack features wider, taller server sleds to accommodate the latest, larger CPU and GPU architectures. This rack was purpose built for liquid cooling natively, capable of cooling future deployments of up to 480KW, and is able to capture nearly 100% of heat created.  
• Engineered for greater choice and flexibility, this integrated rack offers support for both Dell and off-the-shelf networking.
• Deployments are simple and energy-efficient with Dell Integrated Rack Scalable Systems (IRSS). IRSS delivers rack-scale infrastructure optimized for AI workloads, making the setup process seamless and efficient with a fully integrated plug-and-play rack scale system.

Introducing AI-ready platforms designed for IR7000:

• Part of the Dell AI Factory with Nvidia Corp., the PowerEdge XE9712 offers high-performance, dense acceleration for LLM training and real-time inferencing of large-scale AI deployments. Designed for industry GPU density with Nvidia GB200 NVL72, this platform connects up to 36 Nvidia Grace CPUs with 72 Nvidia Blackwell GPUs in a rack-scale design. The 72 GPU NVLink domain acts as a single GPU for up to 30x faster real-time trillion-parameter LLM inferencing. The liquid cooled Nvidia GB200 NVL72 is up to 25x more efficient than the air-cooled Nvidia H100-powered systems.

• The PowerEdge M7725 provides performance dense compute for research, government, fintech and higher education environments. Designed to be deployed in the IR7000 rack, the PowerEdge M7725 delivers more compute with improved serviceability scaling between 24K-27K cores per rack, with 64 or 72 two socket nodes, powered by 5^th Gen AMD EPYC CPUs Front IO slots enables high speed IO connectivity and provides connectivity for demanding applications. The server’s energy-efficient form factor allows for more sustainable deployments through both direct liquid cooling (DLC) to CPUs and air cooling via quick connect to the integrated rack.

Unstructured storage and data management innovations for AI era
Dell unstructured storage portfolio innovations improve AI application performance and deliver simplified global data management.

PowerScale, a world’s 1st Ethernet storage certified for Nvidia DGX SuperPOD, delivers new updates that enhance data management strategies, improve workload performance and offer greater support for AI workloads. ⁽¹⁾

• Enhanced discoverability: Unlock data insights for faster smarter decision-making using PowerScale metadata and the Dell Data Lakehouse. A forthcoming Dell open-source document loader for Nvidia NeMo services and RAG frameworks is designed to help customers improve data ingestion time and decrease compute and GPU cost.
• Denser storage: Customers can fine tune their AI models by training them on larger datasets with new 61TB drives that increase capacity and efficiency while reducing data center storage footprint by half. ⁽²⁾
• Improved AI performance: AI workload performance is enhanced through front-end Nvidia IB capabilities and 200GbE adapter support that delivers up to 63% faster throughput. ⁽³⁾  

Click to enlarge

With enhancements to the Dell Data Lakehouse data management platform, customers can save time and improve operations with new features like DR, automated schema discovery, comprehensive management APIs, and self-service full stack upgrades.

Customers can simplify their data-driven journey and quickly scale their AI and business use cases with Optimization Services for Data Cataloging and Implementation Services for Data Pipelines. These services increase accessibility to high-quality data through discovery, organization, automation and integration.

Dell GenAi solutions with Intel components
Click to enlarge

GenAI solutions with Intel for modern workflows
As part of the Dell AI Factory, Dell GenAI Solutions with Intel offers jointly engineered, tested and validated platforms for AI deployment. Featuring the PowerEdge XE9680 and Intel Gaudi 3 AI accelerators with Dell storage, networking, services and an open-source software stack, these preconfigured, flexible and high performing solutions support a range of GenAI use cases including content creation, digital assistants, design and data creation, code generation and more.

Availability:

• Dell IR7000 will be globally available 1Q25.
• Dell PowerEdge XE9712 is sampling for select customers.
• Dell PowerEdge M7725 will be globally available 1Q25.
• PowerScale updates will be available in 4Q24.
• Dell Data Lakehouse updates will be available in 1H25.
• Dell GenAI Solutions with Intel will be available in 4Q24.

(1) Based on Dell internal analysis, Mar. 2024. 
(2) Based on 61TB SSD availability vs previously max availability of 30TB SSDs. October, 2024
(3) Based on 200GbE Ethernet connectivity vs previously available 100GbE. October, 2024

Resources:
Blog: Leading the Charge: Dell’s OCP Solutions Propel AI Innovation    
Blog: Unstructured Storage Innovations for AI and Data Management    
Blog: Empowering GenAI Choice: Dell AI Factory Expands with Intel     
Join Dell for its Making AI Real with Data event