Levelling the AI playing field
Now more than ever, artificial intelligence (AI) is emerging as a technology that is transforming change within and across industries. We continue to see AI integrated into more of how businesses operate; far beyond just automation and process optimization to being the foundation of data centers and the driver of business operations. And perhaps the most significant breakthrough yet is the emergence of generative AI (GenAI).
According to Dell Technologies Innovation Catalyst Research, GenAI and AI will transform industries in the future, according to 90% of respondents from Singapore. Despite that, respondents mentioned data privacy and cybersecurity concerns (44%), lack of right talent (38%), and outdated technology environments (28%) as challenges they face in driving innovation.
AI’s endless potential remains largely untapped by many businesses thanks to significant barriers such as costly infrastructure, complex deployments, and a lack of interoperability. This is no doubt hindering widespread adoption and preventing many organizations from realizing AI’s full potential.
Sharing the same vision
To empower democratization and allow more organizations of all sizes to harness the power of AI and drive innovation, an open ecosystem is necessary. Unlike closed, proprietary systems, an open ecosystem thrives on interoperability, choice, and collaboration. This means businesses are no longer locked into a single vendor’s offerings. Instead, they can leverage the best tools and technologies from various providers, creating a customized AI infrastructure that perfectly aligns with their specific needs and budget. This flexibility is crucial for fostering innovation and accelerating the adoption of AI across industries.
Central to an open ecosystem is Dell and AMD’s shared vision in bringing it to life. The Dell AI Factory approach simplifies GenAI adoption with tailored, right-sized strategies and engineered architectures for diverse needs. Adding Dell GenAI Solutions with AMD enables focused and repeatable outcomes while reducing time to value by up to 86%.
Now, Dell has expanded the world’s broadest GenAI solutions portfolio with Dell AI Factory additions tailored for AMD environments – spanning infrastructure, solutions, and services to simplify and speed enterprise AI adoption. Five new Dell PowerEdge servers with AMD 5th Generation EPYC™ processors deliver industry-leading AI performance, efficiency and flexibility at scale, and the Dell Enterprise Hub now supports Dell PowerEdge XE9680 with AMD Instinct™ MI300X accelerators to securely deploy the latest Llama and Mixtral models.
Systems based on 5th Gen AMD EPYC™ processors can support IT initiatives from data center consolidation and modernization to increasingly demanding enterprise application needs. These systems can enable expanding AI within the enterprise while supporting business imperatives to improve energy efficiency and rein in data center sprawl through high-density support for virtualization and cloud environments.
In many ways, AMD EPYC™ processors are the world’s best data center processors for demanding enterprise applications. The AMD EPYC™ family has established more than 400 world records on industry-standard benchmarks, many of which evaluate real-world application performance. The latest generation CPUs will not disappoint. AMD have consistently achieved double-digit gains in instruction-per-clock-cycle (IPC) performance with each new generation, and the latest ‘Zen 5’ core in 5th Gen AMD EPYC™ processors delivers significant uplifts for ML, HPC, and enterprise workloads.
Incorporating the Dell PowerEdge servers and AMD’s latest EPYC™ processors and Instinct™ accelerators provides a robust, scalable, and unified foundation optimized for data-driven AI workloads. These AMD-tailored solutions simplify deployment and management while addressing the growing demand for accessible AI across businesses of all sizes.
“By integrating AMD technology into the latest Dell servers, AI solutions and services through the Dell AI Factory, we’re providing the performance and efficiencies enterprises need today and, in the future,” said Chris Kelly, Senior Vice President, APJC ISG (Infrastructure Solutions Group) Specialty Sales, Dell Technologies. Kelly also said, “Together with AMD, we are setting new standards in AI performance, giving enterprises powerful and cost-effective solutions essential for modern data-driven environments.”
Powering AI workloads
Today’s modern data centers handle diverse workloads, from enterprise AI initiatives and large-scale cloud-based infrastructures to business-critical applications. A unified platform based on AMD’s EPYC™ processors and Instinct™ accelerators provides exceptional performance gains, especially for such demanding AI applications. This accelerates complex computations and enabling faster training of machine learning models – resulting in faster insights and quicker time-to-market for AI-powered solutions.
“Our latest AMD EPYC™ processors and Instinct™ accelerators provide Dell customers with advanced end-to-end solutions, at scale, that will speed AI deployments and power business critical IT infrastructure,” said Peter Chambers, Managing Director, APAC Sales & Country Manager, Australia AMD. “Our longstanding collaboration with Dell continues to deliver cutting-edge solutions that help enhance operational efficiency and reduce time to value, fostering innovation across highly competitive industries.”
To further power workloads, the PowerEdge XE7745, purpose-built for AI inferencing, model fine-tuning, and high-performance computing servers offer flexible configurations and modular designs, allowing businesses to easily scale their AI infrastructure as their needs evolve and adapt to growing data volumes without costly overhauls.
The PowerEdge R6725 and R7725 servers are optimized for scalability with high performing AMD EPYC™ processors. Complemented by simplified deployment and management, these platforms maintain rigorous data analytics and AI workloads, and offer unprecedented performance for workloads like virtualization, databases, and AI. Even more so, the R7725 offers up to 66% increased performance and up to 33% increased efficiency at the top of the stack.
Ultimately, these three platforms can support up to 50% more cores, with up to 37% higher per-core performance, resulting in significant gains in performance, efficiency, and total cost of ownership (TCO). This consolidation power allows replacing up to seven five-year-old servers with a single modern server, reducing CPU power consumption by up to 65%.
Speeding up deployment
The Dell AI Factory is designed to be a one-stop shop for all AI needs, regardless of an organization’s size or specific requirements. It streamlines the process of adopting and utilizing AI with the world’s broadest AI solutions portfolio from desktop to data center to cloud. This approach allows businesses to “right-size” their AI investments, meaning they can choose solutions that fit their budget and scale as needed.
The core of Dell’s GenAI offering with AMD is the Dell PowerEdge XE9680 server with AMD Instinct™ MI300X accelerators, to deliver AI inferencing, retrieval augmented generation (RAG) and customization. This integration simplifies AI deployment, enhances security, allows for scalable and modular architectures, and reduces time to value by up to 86%, helping organizations optimize their AI investments.
To better leverage pre-trained models such as Llama and Mixtral and simplifying development, the addition of the Dell Enterprise Hub on Hugging Face, can now support the PowerEdge XE9680 with Instinct™ MI300X accelerators. These containerized models are uniquely optimized to boost inferencing performance based on the model and server and leverage the Hugging Face Text Generation Inference (TGI) back-end.
Navigating AI can be complex. The Dell Professional Services for GenAI can now support AMD environments, bridging the gap between technology and business outcomes. These expanded services, including the new Dell Implementation Services for the GenAI Platform with AMD, offer a tailored operational platform encompassing Kubernetes configuration, advanced AI framework deployment, and best-practice knowledge transfer to maximize return on investment (ROI). Dell is guiding customers through every stage of the AI lifecycle, from strategy and data preparation to platform and model implementation and scaling.
Driving continuous innovation
Deploying AI involves complex infrastructure, software, and integration challenges. That is why by pooling resources and sharing knowledge and expertise, such hurdles can be overcome easily. By combining Dell’s deep understanding of enterprise-grade server hardware and comprehensive solutions with AMD’s cutting-edge processor and accelerator technology, the collaboration streamlines the deployment process, making AI more accessible to a wider range of organizations.
This combined expertise also simplifies infrastructure design, optimizes software integration, and provides readily available support, enabling businesses to tap into the power of AI more easily. Furthermore, this collaborative approach accelerates the pace of AI innovation as new solutions are being brought to market more quickly.
Building on a shared vision for an open ecosystem, with the principles of interoperability and choice, both Dell and AMD continue to democratize AI by reducing vendor lock-in, lowering costs, and simplifying the scaling of AI infrastructure as business needs evolve.
For a deeper dive into open-source GenAI adoption with the Dell AI Factory and AMD, explore how these solutions can support your AI journey.
