The Next Generation AI Solutions with Dell and Nvidia

Dell Technologies has revealed significant updates to its Dell AI Factory collaboration with Nvidia.

The announcement introduces new infrastructure, software and managed services targeted at enterprises moving beyond initial AI experimentation into organisation-wide implementation.

The centrepiece of the announcement includes a new generation of advanced compute solutions featuring both air-cooled and liquid-cooled servers designed for different deployment scenarios.

The air-cooled Dell PowerEdge XE9780 and XE9785 servers integrate into existing enterprise data centres, while the liquid-cooled Dell PowerEdge XE9780L and XE9785L servers support rack-scale deployment.

These PowerEdge servers can be configured with up to 192 Nvidia Blackwell Ultra graphics processing units (GPUs) and the systems can be further customised with up to 256 Nvidia Blackwell Ultra GPUs per Dell IR7000 rack.

According to Dell, these platforms deliver up to four times faster large language model (LLM) training with the 8-way Nvidia HGX B300.

Dell PowerEdge and PowerCool technology transforming data centre capabilities for AI workloads

The Dell PowerEdge XE9712 featuring Nvidia GB300 NVL72 focuses on rack-scale efficiency for training workloads.

Dell reports that the platform provides 50 times more AI reasoning inference output — the process of running a trained AI model to make predictions — and five times improvement in throughput.

The platform also incorporates new Dell PowerCool technology that helps businesses achieve greater power efficiency.

For the future, plans include support for the Nvidia Vera CPU and Nvidia Vera Rubin platform with a new Dell PowerEdge XE server designed for Dell Integrated Rack Scalable Systems.

“We're on a mission to bring AI to millions of customers around the world,” says Michael Dell, Chairman and CEO of Dell Technologies.

“Our job is to make AI more accessible. With the Dell AI Factory with Nvidia, enterprises can manage the entire AI lifecycle across use cases, from training to deployment, at any scale.”

Dell’s enhanced AI Data Platform

Dell has also enhanced its AI Data Platform to provide AI applications with continuous access to data resources.

Updates to Dell ObjectScale — the company's software-defined object storage platform — support large-scale AI deployments while helping reduce cost and data centre footprint through a denser system design.

Now, the platform features Nvidia BlueField-3 — a data processing unit that offloads networking tasks from the CPU — and Spectrum-4 networking integrations to improve performance and scalability.

Furthermore, the company has introduced a high-performance solution built with Dell PowerScale, Dell Project Lightning and PowerEdge XE servers.

This combination creates an environment optimised for AI workloads with fast access to structured and unstructured data.

Dell ObjectScale will support S3 over RDMA (Remote Direct Memory Access) — a protocol that allows direct data exchange between storage and compute resources — which Dell claims achieves up to 230% higher throughput, up to 80% lower latency and 98% reduced CPU load compared to traditional S3 transfers.

These improvements result in better GPU utilisation for AI training and inference tasks.

The firm has further announced an integrated solution incorporating the Nvidia AI Data Platform to accelerate insights from data and enhance agentic AI applications — autonomous AI systems that can perform tasks with minimal human supervision.

Dell Managed Services for Nvidia AI Factory addressing enterprise skills shortage

To address the challenge of skills gaps in enterprise AI deployment, Dell has also launched Managed Services for the Dell AI Factory with Nvidia.

These services manage the full Nvidia AI solutions stack, including AI platforms, infrastructure and Nvidia AI Enterprise software — a suite of tools for developing and deploying AI applications.

The Dell managed services offering includes 24/7 monitoring, reporting, version upgrades and patching, targeted at teams facing resource and expertise constraints in maintaining complex AI systems.

Additionally, Dell is expanding its networking portfolio with the Dell PowerSwitch SN5600, SN2201 Ethernet, which forms part of the Nvidia Spectrum-X Ethernet networking platform, and Nvidia Quantum-X800 InfiniBand switches.

These high-density switches deliver up to 800 gigabits per second of throughput and are supported by Dell ProSupport and Deployment Services.

The Nvidia AI Enterprise software platform, available directly from Dell, gives organisations the option to implement Nvidia NIM — inference microservices that deploy AI models efficiently — along with Nvidia NeMo microservices, Nvidia Blueprints, Nvidia NeMo Retriever for RAG (Retrieval Augmented Generation) and Nvidia Llama Nemotron reasoning models on the Dell AI Factory with Nvidia.

Furthermore, Dell has added Red Hat OpenShift — an enterprise Kubernetes platform for container orchestration — availability on the Dell AI Factory with Nvidia to simplify business-critical AI deployments while providing flexibility and security.

“AI factories are the infrastructure of modern industry, generating intelligence to power work across healthcare, finance and manufacturing,” says Jensen Huang, Founder and CEO of Nvidia.

“With Dell Technologies, we're offering the broadest line of Blackwell AI systems to serve AI factories in clouds, enterprises and at the edge.”

Explore the latest edition of AI Magazine and be part of the conversation at our global conference series, Tech & AI LIVE. 

Discover all our upcoming events and secure your tickets today.

Also sign up to our free weekly newsletter for the latest insights and stories straight into your inbox.

AI Magazine is a BizClik brand