Inspur / IEIT NF5488M6 AI Server Datasheet

The NF5488M6 is a 4U high-density AI server optimized for artificial intelligence, deep learning, high-performance computing (HPC), and large-scale data analytics. It integrates dual 3rd Gen Intel® Xeon® Scalable processors with eight fully interconnected NVIDIA® A100 SXM4 GPUs via NVSwitch technology to deliver up to 5 PETAFLOPS of AI computing performance.

Key Features & Highlights

High-Density Compute: Packs 2 CPUs and 8 high-speed NVSwitch-interconnected GPUs into a compact 4U rackmount chassis.
Ultra-Low Latency Topology: Features an industry-leading CPU-GPU retimer-free design that direct-connects PCIe lanes to eliminate signal relay overhead and minimize communication latency.
Extreme Memory & Bandwidth: Supports up to 32 DDR4 DIMMs (3200 MT/s) and provides 600 GB/s GPU-to-GPU interconnect bandwidth via NVSwitch.
Enterprise Reliability: Outfitted with 6x 3000W 80 Plus Platinum power supplies configured in 3+3 redundancy, alongside hot-swappable N+1 cooling fans.
Ecosystem Compatibility: Fully compatible with major AI frameworks (TensorFlow, PyTorch, PaddlePaddle) and optimized for scheduling platforms like Inspur AIStation.

Technical Specifications

Parameter	Specification
Form Factor	4U Rackmount Chassis
Dimensions (W × H × D)	448 mm × 175.5 mm × 850 mm (17.6 in × 6.9 in × 33.5 in)
Max Weight	≤ 73 kg (160.9 lbs fully loaded)
Processors	Up to 2× 3rd Gen Intel® Xeon® Scalable Processors (Ice Lake) • TDP up to 270W per socket • 3× UPI links inter-socket
Chipset	Intel® C621A Series Chipset (Lewisburg-R)
GPU Subsystem	8× NVIDIA® A100 SXM4 GPUs (40GB or 80GB) • NVSwitch fully interconnected topology (600 GB/s bi-directional bandwidth)
System Memory	32× DDR4 RDIMM / LRDIMM slots • Speeds up to 3200 MT/s
Local Storage	• Up to 8× 2.5-inch hot-swap SATA / SAS / NVMe SSDs • Onboard 2× SATA / NVMe M.2 SSD slots for OS/boot
PCIe Expansion	• 4× PCIe 4.0 x16 full-height slots • 1× PCIe 4.0 x8 Mezzanine slot
RAID Controller	Optional hardware RAID (RAID 0/1/10/5/50/6/60) with supercapacitor cache protection
Networking	1× PCIe 4.0 x16 OCP 3.0 slot (supports 10G / 25G / 100G / 200G NICs / InfiniBand)
Front I/O Ports	1× USB 3.0, 1× USB 2.0, 1× VGA port
Rear I/O Ports	2× USB 3.0, 1× VGA port, 1× RJ45 dedicated BMC management port
System Management	Onboard BMC chip supporting IPMI 2.0, Redfish, SOL, KVM over IP, and virtual media
Power Supply	6× 3000W 80 Plus Platinum PSUs (supports 3+3 N+N redundancy)
Cooling	N+1 hot-swappable redundant cooling fan modules
Supported OS	Red Hat Enterprise Linux 7.8 / 8.x (64-bit), CentOS 7.8+, Ubuntu 18.04 LTS or later
Operating Temp.	10°C to 35°C (50°F to 95°F)