Inspur NF5688M6 AI Server
NF5688M6
Enterprise stock · tested · export documentation available
Product Overview
The Inspur NF5688M6 is an enterprise-grade 6U 8-GPU AI server designed for ultra-large-scale artificial intelligence model training, deep learning, high-performance computing (HPC), and massive data analytics. Powered by dual 3rd Gen Intel Xeon Scalable Processors and eight high-bandwidth NVIDIA A100 SXM4 GPUs, it delivers massive compute density, high energy efficiency, and scalable expansion capabilities for hyperscale datacenters.
Key Highlights
-
Massive AI Compute Density: Houses 8x NVIDIA A100 SXM4 GPUs interconnected via NVSwitch, delivering up to 600 GB/s bidirectional GPU-to-GPU bandwidth.
-
Balanced 1:1 Network Topology: Matches each GPU with a dedicated high-speed network card (up to 200G InfiniBand/RoCE), eliminating communication bottlenecks in multi-node AI clusters.
-
Enhanced Heat Dissipation & Power: Optimized wind tunnel cooling architecture with support for air cooling or hybrid liquid cooling to maintain sustained full-load performance under high TDP conditions.
-
Flexible Storage & Expansion: Up to 24x 2.5-inch hot-swappable drive bays with extensive NVMe high-speed SSD support for fast data pre-processing and checkpointing.
Technical Specifications
| Feature | Specification Details |
| Form Factor | 6U Rackmount Chassis |
| Processor | Dual 3rd Gen Intel Xeon Scalable Processors (Ice Lake), up to 40 cores/CPU (TDP up to 270W) |
| GPU Acceleration |
8x NVIDIA A100 SXM4 GPUs (40GB or 80GB) Interconnect: NVSwitch (NVLink 600 GB/s) |
| Memory |
32x DDR4 DIMM Slots (up to 3200 MHz) Supports Intel Optane Persistent Memory 200 Series |
| Storage Bays |
Front: Up to 16/24x 2.5-inch SAS/SATA/NVMe SSDs Internal: 2x M.2 NVMe SSDs (for OS boot) |
| RAID Controller | Hardware SAS/SATA RAID controllers with cache protection |
| PCIe Expansion | Up to 10x PCIe 4.0 slots (including dedicated PCIe slots for 1:1 GPU-to-NIC fabric connection) |
| Network Interfaces | Integrated OCP 3.0 mezzanine card + PCIe 4.0 add-in cards (100G/200G InfiniBand or Ethernet/RoCE) |
| Power Supply | N+N / N+M redundant hot-swap power supply units (3000W / 3300W 80 PLUS Platinum/Titanium) |
| System Management | Onboard IPMI 2.0, BMC management chip, Redfish API support, Inspur InService / ISMP |
| Cooling | High-efficiency hot-swappable cooling fans; air cooling & liquid cooling options |
| Operating System | Red Hat Enterprise Linux, SUSE Linux Enterprise Server, Ubuntu Server, CentOS |
| Dimensions | 6U Height (Standard 19-inch rack compatible) |
Primary Target Workloads
-
Large Language Model (LLM) Training & Fine-Tuning: Handles models with tens to hundreds of billions of parameters.
-
Computer Vision & Video Analytics: High-throughput processing for Autonomous Driving (AV) training, medical imaging, and smart city data streams.
-
Scientific Research & HPC: Molecular dynamics, genomic sequencing, weather forecasting, and climate modeling.
-
Recommendation Engines & AI Inference: Massive parallel vector search and real-time enterprise AI inference.

















评价
目前还没有评价