BIOS IT Blog
MN-3, the Most Efficient Supercomputer in the World
Sophisticated Systems Supporting Deep Learning Projects at Preferred Networks Earn International Recognition
The mechanical solution required out-of-the-box thinking by Supermicro -- the ability to fit not only two CPUs, four MNCore boards, but also up to 6TB of DDR4 memory. Each server would also have to house the Intel® Optane™ persistent memory modules, each containing 3TB of memory. Image AA below shows the overall architecture and workflow of an MN-Core server, including Intel Xeon scalable processors, Intel® SSDs, Intel® Optane™ persistent memory, and the MN-Core board, all integrated on to a Supermicro motherboard.
The solution that PFN designed is based on the Supermicro GPU server that contains the X11DPG-OT-CPU motherboard. This advanced system is ideal for housing multiple GPUs or accelerators, as well as the interconnects that enable ultra-fast communication between GPUs. The PFN customized server is shown below, containing all this technology, and is housed in a 7U high rack-mounted unit.
The server's four MN-Core boards are connected to PCIe x16 slots on a Supermicro motherboard and to the MN-Core Direct Connect board that enables high-speed communication between the MN-Core boards.
With the server designed, PFN built a supercomputer called MN-3 that would serve many constituents at once. The initial cluster would consist of 40 servers; four interconnect nodes, and five 100GbE switches. A total of 2080 cores delivers 1,621.1 TFlops of performance while using just 77 kW of power. The supercomputer ranked #393in the world Top500 list, based on the LINPAC benchmark as of June 2020.
Available from BIOS IT - contact us to discuss your requirements.
Not what you're looking for? Check out our archives for more content