What New AI Infrastructure Boost Gives Dell AI Factory

AI's mass roll out at a rapid pace has, although brought a number of benefits for those implementing them, created a new challenge where those initial implementations need to be scaled as their use grows.

This is because the integration of AI into existing business processes demands not only robust hardware but also sophisticated software and guidance to show what solutions could work where so that enterprises are really extracting value from their digital transformations.

Many companies therefore find themselves struggling with various aspects of AI adoption, from data preparation and model training to the deployment and maintenance of AI systems at scale.

To address these growing challenges, Dell Technologies has recently unveiled significant enhancements to its Dell AI Factory, expanding its suite of AI solutions for enterprises. This strategic move aims to democratise AI technology, making it more accessible to businesses of all sizes.

Advancing AI Infrastructure

Dell has introduced new infrastructure, solutions and services designed to accelerate, simplify and streamline AI workloads and data management. These advancements focus on providing high-performance computing capabilities tailored for AI applications.

Dell PowerEdge XE9685L

The Dell PowerEdge XE9685L stands out as a high-density, 4U liquid-cooled server engineered for AI, machine learning, high performance computing (HPC) and other data-intensive workloads

This server is part of Dell's expanded Integrated Rack Scalable Systems (IRSS) programme, which delivers fully loaded, plug-and-play rack-scale systems with Dell Smart Cooling

"The continued reimagining and improvement of AI and HPC technologies is critical to accelerating discoveries across industries. With Dell's AI solutions we are building complex HPC systems that allow innovation to thrive in research communities. Ultimately, these advances have the potential to reshape society and drive progress that benefits everyone," says Dan Stanzione, Executive Director at Texas Advanced Computing Center (TACC).

Dell PowerEdge XE7740

Complementing the XE9685L is the Dell PowerEdge XE7740, a 4U air-cooled server that utilises dual Intel Xeon 6 processors with P-cores and supports up to 8 double-wide accelerators or 16 single-wide accelerators

This flexibility allows enterprises to tailor their server configuration for various AI tasks, from fine-tuning or inferencing Gen AI models to extracting value from large datasets.

This flexibility allows enterprises to tailor their server configuration for various AI tasks, from fine-tuning or inferencing Gen AI models to extracting value from large datasets.

Dell PowerEdge XE

Dell has also announced plans to support the upcoming Nvidia GB200 Grace Blackwell NVL4 Superchip with a new Dell PowerEdge XE server designed for the Dell IR7000, supporting up to 144 GPUs per rack in a 50OU standard rack.

Dell Data Lakehouse

Meanwhile, Dell’s updates to the Dell Data Lakehouse, a modern architecture for managing and analysing data efficiently for AI tasks, provide enterprises with modern architectures for efficiently managing and analysing data for AI tasks.

The platform will expand to include Apache Spark for distributed data processing at scale, offering significant efficiency gains for businesses managing massive data volumes.

Collaborative solutions with Nvidia

Dell is working closely with partners across the AI ecosystem to power and simplify AI deployments. Updates to the Dell AI Factory with Nvidia deliver accelerated performance and reduced time-to-outcomes for AI operations and use case deployment

Dell has also announced plans to support the upcoming Nvidia GB200 Grace Blackwell NVL4 Superchip with a new Dell PowerEdge XE server designed for the Dell IR7000, supporting up to 144 GPUs per rack in a 50OU standard rack.

The Dell Agentic RAG with Nvidia, part of the Dell AI Factory with Nvidia, allows customers to perform complex queries and accelerate their retrieval augmented generation (RAG) operations

This solution leverages Dell PowerEdge, Dell PowerScale and Nvidia AI Enterprise software and Gen AI tools.

Empowering AI development

Outside of these announcement, Dell has a number of other solutions that allow enterprises to embrace AI in various elements of their operations.

"Getting AI up and running across a company can be a real challenge. We're making it easier for our customers with new AI infrastructure, solutions and services that simplify AI deployments, paving the way for smarter, faster ways to work and a more adaptable future," says Arthur Lewis, President of Dell's Infrastructure Solutions Group.

Dell Validated Designs for AI PCs are open-source guides designed to boost the development of AI applications on Dell AI PCs with NPU technology. Developers can easily customise these modular designs to integrate features like large language models (LLMs), vision, text and speech into applications.

To address the challenge of finding talent to develop strategies and implement AI, Dell Professional Services offers a range of support options. These include advisory and implementation services for sustainable data centres, data management services, and design services for AI networking.

******

Make sure you check out the latest edition of AI Magazine and also sign up to our global conference series - Tech & AI LIVE 2024

******

AI Magazine is a BizClik brand