Maximum Performance in a Small Package
Inspur has launched the world’s densest and most powerful AI server AGX-2 (model name: Inspur NF5288M5) with 300GB/s high speed NVIDIA® NVLink™ to connect 8 high performance GPU accelerators within 2U space. This server is immensely important for AI training and HPC applications where it can provide 200 times higher performance than the traditional dual-CPU servers. The flexible and scalable design can achieve dual-system horizontal expansion to 16 GPU structure which extremely useful to cater for different computing scenarios.
AGX-2 utilizes P100’s Linpack’s floating point computing power to achieve 29.33TFLOPS, 2.47 times that of NF5288M4, which also utilizes P100. When it comes to AI deep-learning model training, AGX-2, which utilizes TensorFlow framework and GoogLeNet model, processes data at 1165 images per second, can provide single node with a peak value computing power of 960 Tensor TFLOPs. Moreover, AGX-2 is based on high-density design can easily allow a 42U rack’s cluster’s peak performance to rise above 1 PFLOPS (one quadrillion floating point operations per second). It can make inter-GPU bandwidth as high as 300 GB/s and allow for little to no lag, allowing an over 60% increase in the efficiency of parallel GPU. Apart from this, it has incorporated two latest Intel® Xeon® Scalable Processor and 16 2666 MHz speeds based memory sticks.
Specifications
| Feature | NF5288M5 Technical Specification |
| Form Factor | 2U |
| Chipset | Intel® C624 chipset |
| Processor family | 2 Intel Xeon Scalable processors, TDP up to 165W |
| Processor core available | Maximum 28-core per processor |
| Processor speed | 3.6 GHz, maximum depending on processor |
| Processor cache | 38.5 MB L3 cache |
| GPU | 8 SXM2 GPU with NVLink
· 8 x SXM2 GPU on NVLink cube mesh with 2 x 96lane PCIe Switch，4 x PCIe x16 HHHL Rear slot 8 PCIe GPU with PCIe Switch · 8 x PCIe3.0 x16 double width GPGPU |
| Memory slot | 16 DIMM slots |
| Memory type | RDIMMs, LDIMMs and Apache Pass |
| Memory protection features | ECC |
| Storage | · Support front 8 × 2.5 inch SAS/SATA hard disk or U.2 NVMe SSD drive
· Support 2 × SATA or PCIe M.2 SSD on board |
| Storage controller | SAS 3108 Mezz Card support RAID 0, 1, 5, 10 |
| I/O Expansion slot | · 2* HHHL x16 card
· 1* SAS Mezz x8 card · Optional 4* PCIE x16 card |
| Network Controller | Integrated LAN controller; up to 4*10GbE |
| Integrated I/O port | · 2 front set USB 3.0 port, 1 VGA 1 ID button & ID LED & BMC reset button, 1 system power button & LED, 1 system reset button
· 2 rear set USB 3.0 port, 1 VGA, 1 serial port, 1 ID button & LED, 1 BMC management port |
| Power Supply | · Dual 3000W Platinum Power Supply
· Support PMBUS |
| Dimensions | 448(W), 87.5(H), 899.5(D)mm |
| Management | IPMI 2.0 compliant with AST2500 |
| Supported Operating Systems | Linux and Windows |
| Operating Temperature | 10°C to 35°C |
| Input Voltage | 110-240V |
| Warranty | 3 years standard warranty |
