ASUS LLM AI Server (up to 8x RTX Pro 6000 or NVidia H200 & Dual 192-Core EPYC 9965)

ASUS Dual EPYC 9005, Octa 600W NVidia GPU Server AI System

The ASUS 4U rackmount high-performance computing (HPC) AI server is the ideal HPC system for AI LLM training, deep learning, high-performance computing clusters.  Featuring support for up to 8 NVidia H200 NVL 141GB HBM3e ECC or NVidia RTX Pro 6000 Blackwell 96GB GDDR7 ECC 600W GPUs, dual (2) 192-core EPYC 9965 processors, 3TB of 24-channel DDR5 ECC RDIMM memory, 10 Gen4/5 SSDs including 8 M.2 or U.2 in ZRAID and 15 NICs with 10 at 200GbE, no single artificial intelligence server measures up in terms of high-density computing performance and cost-savings.  Rather than build an HPC computing cluster with separate management, storage and GPU server nodes, you can opt for the ASUS LLM AI system which has the computing power to perform all 3 functions.

The ASUS Octa NVidia GPU Server AI System, powered by 2 AMD EPYC™ 9005 processors, delivers outstanding performance with up to 8 NVIDIA H200 NVL or RTX 6000 Blackwell GPUs, faster GPU interconnects, and a high-bandwidth fabric. This robust high-performance computing server directly provides flexible scalability through options like the NVIDIA® NVLink® Bridge. This HPC server ensures seamless scaling and performance optimization, making the ASUS NVidia server ML system a perfect solution for handling demanding AI training and inferencing workloads within an AI cluster.

KEY FEATURES

• High performance computing server configuration: Equipped with 2 AMD EPYC 9005 processors featuring up to 192 Zen 5c cores, 24-channel DDR5 RDIMM memory up to 6400MHz and a maximum TDP of 500 watts per socket.
• Artificial Intelligence system setup: Designed for HPC clusters as a high-density 4U GPU server capable of housing eight 600W NVIDIA H200 NVL 141GB HBM3e or NVIDIA RTX PRO 6000 Blackwell 96GB GPUs.
• Superior networking connectivity: Supporting up to 15 total NICs including up to 10 high-bandwidth 200GbE NICs and DPUs, connected directly to CPU to reduce latency.
• Vast Storage expansion: Supporting up to 10 total PCIe 5.0 x4 NVMe SSDs including up to 8 hot-swap M.2 or U.2 Gen5 NVMe SSDs with ZFS RAID function at storage capacities of up to 122.88TB per each of the 10 drives.
• Efficient maintenance: Features ASUS-exclusive toolless design for streamlined maintenance and maximum efficiency.
• Advanced management: Includes ASUS Control Center IT-management software and a hardware-level Root-of-Trust solution for enhanced security and control.

Vast Memory Bandwidth, Storage and Networking Capabilities

The ASUS Octa NVidia GPU Server AI System offers vast, flexible and scalable expansion.  Optimal LLM system performance is achieved with memory support for up to 3TB of 24-channel DDR5 RDIMM RAM.  Storage is supported up to 10 Gen5 NVMe SSD drives at 122.88TB each including 8 hot-swap SSDs with optional HBA card for ZFS RAID. Networking is supported up to 15 NICs including up to ten 200GbE QSFP112, up to two 100GbE QSFP28 and up to two 10GbE RJ45 LAN with 1 GbE management port.  This versatile expansion allows for the ASUS Octa AI Server HPC System to serve as the single node of a machine learning cluster.

Eight 600W GPUs in a high-density 4U compute server

Powered by 2 AMD EPYC™ 9005 processors, the ASUS Octa NVidia GPU Server AI System delivers exceptional performance, featuring top-tier GPUs, faster GPU interconnects, and higher-bandwidth fabric. This powerhouse LLM server supports up to eight 600W NVidia H200 NVL 141GB or RTX 6000 Blackwell 96GB GPUs, and offers flexible scalability with options for NVIDIA® NVLink® Bridge or AMD Infinity Fabric™ Link. This configuration allows seamless scaling and performance enhancement, making this ASUS AI server high-performance computing system an ideal choice for tackling the most Enterprise AI and HPC tasks.

Streamline IT operations via a single dashboard

ASUS Control Center (ACC) is remote IT-management software application designed for monitoring hardware and software IT assets and inventory status, and enabling seamless remote BIOS configurations and updates, efficient IT diagnostics and troubleshooting and enhanced security with hotfix updates — allowing easier server management for any IT infrastructure.