OEM AMD EPYC™ 9555 Zen5 Generation Processors For AI Inferencing

AMD EPYC™ 9005 SERIES PROCESSORS

BUILT FOR AI-ENABLED, BUSINESS-CRITICAL DATA CENTER WORKLOADS

AT A GLANCE If you need to power a new generation of AI-enabled, business-critical workloads, while supporting traditional, virtualized, and cloud applications, 5th Gen AMD EPYC™ processors were designed for you. Built using the new ‘Zen 5’ processor core, the EPYC 9005 Series helps you expand AI within the enterprise while supporting business imperatives to improve energy efficiency and rein in data center sprawl. Modernizing with proven, advanced, x86 architecture can make room in your data center while powering your AI inferencing and machine learning operations.

 * INTRODUCING THE 5TH GEN AMD EPYC PROCESSOR FAMILY The AMD EPYC 9005 Series uses a hybrid, multi-chip design and new ‘Zen 5’ and ‘Zen 5c’ cores to address data center challenges such as delivering leadership performance, density, and efficiency in virtualized and cloud environments, and supporting new AI workloads. The processor family has a wide range of core counts, including high-frequency products for CPU-based AI inference and fueling GPU-accelerated workloads, high-density CPUs for virtualized workloads, and CXL® 2.0 capabilities for memory-intensive tasks. All processors in the series have support for up to 12 DDR5-6000 memory channels, 128 PCIe® Gen 5 I/O lanes (up to 160 in 2-socket servers), and the AMD Secure Processor to enable virtual machine encryption domains.

 * OPTIMIZE APPLICATION PERFORMANCE Modernizing your infrastructure is key to making room for AI initiatives Servers based on the EPYC 9005 Series support data center consolidation and modernization to address increasingly demanding enterprise application needs. High core counts help you do more with fewer servers. For example, you can replace 100 old 2-socket servers with 28-core Intel® Xeon® 8280 CPUs, with only ~14 new 2-socket servers powered by 192-core AMD EPYC 9965 processors. The AMD solution delivers the same 39,100 units of integer performance, reduces power consumption by 69%, and lowers three-year total cost of ownership (TCO) by up to 65%.9xx5

 * POWER AI INFERENCE AND MACHINE LEARNING Delivers leadership AI inference performance while also marshaling data for GPU-accelerated servers The EPYC 9005 Series is designed to manage the voracious appetite that AI applications have for data and processing power. With full 512-bit data paths in the core, instruction pipeline optimizations, and additional integer and floating-point units, the CPU can run a broad class of AI workloads on CPU-only infrastructure, without requiring GPU acceleration. For example, you can achieve up to 2.7x the inference throughput when running extreme gradient boosting with the Higgs boson data set (XG Boost) on servers with two 192-core EPYC 9965 processors compared to those with two 64-core Intel Xeon 8592+ CPUs.9xx5-010 Also, high-frequency-optimized EPYC 9005 Series CPUs perform exceptionally well as host processors in GPU-accelerated systems, enabling fast and efficient handling of extensive data preparation and post-processing tasks. When hosting eight GPU accelerators, servers with two high-frequency, 64-core EPYC 9575F CPUs process up to 20% more inference requests and accomplish ~15% faster training time compared to servers with two 64-core Xeon 8592+ CPUs on Llama 3.1-70B and 3.1-8B, respectively.

 * TRUSTED BY INDUSTRY LEADERS AMD is a trusted supplier for global computing installations today The proven performance, efficiency, and easy x86-software compatibility of AMD EPYC processors have prompted companies, governments, and organizations around the globe to make the switch to EPYC processor-based servers for the most demanding computing tasks. With the leadership AMD EPYC portfolio available from leading systems vendors, and qualified with leading applications and AI frameworks, models, and tools, servers with AMD EPYC processors can enhance your computing and AI-powered business solutions, providing a seamless path towards excellence.

AMD EPYC™ 9005 SERIES PROCESSORS