Russian SGD, a lot of platforms for ML, new GPUs and switches. Server hardware digest for February

Russian SGD, a lot of platforms for ML, new GPUs and switches. Server hardware digest for February

Greeting! My name is Serhiy, in this article I will talk about the news in the world of iron for the past month. Many of them were shown at the Mobile World Congress 2024 exhibition in Barcelona. Bonus – review of new equipment from Russian vendors. Already taking care of the iron for yours

servers

? Details below!

Use the navigation if you don’t want to read the entire text:

→ Platforms
→ GPU
→ Switches
→ SGD
→ Server cabinets
→ Conclusion

Platforms


Supermicro

Supermicro introduced new servers for work with artificial intelligence and peripheral computing with GPU support. Characteristics – in the table.

In the context of renting dedicated servers in Russia, we are not yet aware of public offers on the NVIDIA GH200TM hybrid chip. It would also be interesting to learn about cases that require such equipment. The characteristics of such a device are impressive.

Mobile World Congress 2024 showcases GPU-enabled IOT servers.

One of the main tasks of such servers with GPU support is to process information on the spot, without placing it in remote servers or data centers.

A server has also been announced

SYS-211SE-31D

for two 5th/4th Gen Intel Xeon Scalable processors. The main feature is that the two-unit housing houses three hot-swappable servers.

The device is an analogue of Supermicro’s MicroCloud, which allows you to save space in racks. Each chassis has two slots for M.2 NVMe drives and eight slots for DDR5-5600 memory.

Power is provided by two 2000 W units.

ASRock

At MWC 2024, ASRock presented a compact two-unit server

MECAI-GH200

with the hybrid NVIDIA GH200TM Grace Hopper, which includes a 72-core NVIDIA Grace ARM processor and an NVIDIA H100 accelerator with 96 GB of HBM3 memory.

Power is provided by two units of 1,600 W, it is possible to install E1.S drives (PCIe 5.0 x4), two M.2 drives (PCIe 5.0 x4) and two FHFL expansion cards with a PCIe 5.0 x16 interface. According to the manufacturer, such a system is the most compact in the world, because usually such servers occupy from three units.

At Selectel, we offer dedicated servers with GPUs based on the previous generation GPU A100 from NVIDIA. Such ready-made servers can be rented in almost a few minutes. By the way, if you have such experience, share it in the comments.

At the ASRock exhibition, they showed a two-unit platform

MEC2U-SIENA

with one socket for AMD EPYCTM 8004 processors. The platform is powered by two 1200 W units, it is possible to install eight DDR5 memory modules with a volume of up to 96 GB each.

Six 2.5″ NVMe drives with quick replacement and two M.2 NVMe drives can be installed in the platform.

GIGABYTE

GIGABYTE at Mobile World Congress 2024 also showed new servers. The most powerful and most interesting novelties are designed for solving ML problems and high-performance computing. The solutions support both the most popular H100 from NVIDIA and the competitor Instinct from AMD.

IN

past digest

I have already talked about a new product from GIGABYTE for large language models – a storage server

S183-SH0

, which was also demonstrated at the exhibition. The expansion of the server line seems expected and in line with the demands of the growing market.

Lenovo

Lenovo at MWC 2024 showed more modest solutions, but they are also positioned as servers for ML tasks and peripheral computing and support the installation of GPUs.

GPU


NVIDIA RTXTM 2000 Ada

NVIDIA presented a younger workstation video card

NVIDIA RTXTM 2000 Ada

. The dual-slot device is presented in a low-profile form factor and consumes only 70 watts.

Compared to its predecessor RTX A2000, the new product has an increased memory capacity from 6 or 12 to 16 GB. But not the only memory: the number of CUDA cores decreased from 3328 to 2816, and tensor and RT cores – from 104 to 88 and from 26 to 22, respectively. We’ve already seen a similar downgrade when the performance of the NVIDIA A2 GPU dropped significantly compared to its predecessor, the Tesla T4, which it was positioned as a replacement for.

Preliminary prices for the 2000 Ada will remain at the level of the previous generation model. We at Selectel are running the A2000 version with 6GB of memory and are considering an upgrade, but performance tests are needed to make a decision.

Switches


Morion

The Morion company, a developer and manufacturer of telecommunications equipment from the Perm region, has started serial production of managed Ethernet switches. Novelties include models of the KRM-5960 and KAM-3284 families, which are designed for building high-performance network systems.

KRM-5960 are monoblock switches with 20 1 GbE RJ-45 ports, four 1 GbE RJ-45/SFP connectors and four 10 GbE SFP+ ports. They are available in two versions with a range of operating temperatures from 0 to 50 or from 5 to 40 degrees Celsius.

KAM-3284 includes block-module systems with four optical or electrical ports per module (up to 24 ports per block). They can operate at temperatures from -10 to 55 degrees Celsius, resistant to vibration, repeated shocks and salt fog. These devices can be used in difficult technical conditions and video surveillance systems.

The level of localization is 70%. The devices work with infrastructure related to Astra Linux.

SGD


Dell

Dell company

presented

the new PowerScale series SGS: F210 and F710. They are optimized for working with unstructured data. The storage units are made in 1U format and use the Dell PowerEdge R660 server platform. Based on the Intel hardware platform and PowerScale OneFS version 9.7 software.

The F210 model uses a single Intel Xeon Silver 4410Y processor with 12 cores and 128 GB of DDR5 memory. It is possible to use four NVMe SSD drives with a volume of up to 15.36 TB each.

The F710 model uses two Intel Xeon Gold 6442Y processors with a total of 48 cores. The SSD also supports the installation of up to ten NVMe SSD drives with a volume of up to 30.72 TB. DDR5 RAM is 512 GB.

Inferit

The Russian company “Inferit” presented three new models of data storage systems:

The manufacturer also presented a server

INFERIT RS208

, which can be used to create a SGD. Servers work with Intel Xeon Scalable processors of older generations: Skylake, Cascade Lake, Cascade Lake Refresh. 2U form factor with eight hot-swappable drives and support for up to four NVMe drives.

Dataru

Russian vendor DataRu

announced

four new lines of data storage systems

  • Dataru MSA. Entry-level DBMS for small businesses with database snapshots: instant copy and asynchronous replication.
  • DataRu PR. Mid-level DBS based on four controllers, supporting data deduplication, as well as synchronous replication.
  • Dataru SO. Disk backup with a deduplication ratio of about 20:1.
  • DateRu MSL. Backup tape libraries, configurations from 40 to 640 LTO cartridges and one to 48 LTO-9, LTO-8, LTO-7 and LTO-6 tape drives.

Server cabinets

ZTE

ZTE company at the MWC 2024 exhibition

presented

server cabinet for high-density placement of Ice Cube. The main feature is the possibility of placing equipment with a capacity of up to 100 kW per rack. The liquid cooling system used in the cabinet allows for greater power and equipment placement density.

The ZTE IceCube uses a hybrid approach where water circulates through cabinet doors and special units touching hot components. This provides more efficient cooling and allows you to place up to 40 single-unit servers without gaps. At the same time, liquid cooling is becoming increasingly popular in data centers, given the increasing performance needs of servers, especially with GPUs and processors with a large number of cores.

Conclusion


In February, the current trends in the production of iron were preserved before working with ML tasks. We are waiting for spring and already in April we will release a digest with the novelties of March. Until that happens, tell us in the comments which iron you are waiting for and why. If you’ve had the chance to work with any of the recent digests, we’d love to hear your thoughts.

You may also be interested in these texts:

→ Laser discs again: the Chinese presented a 200 TB blank. What kind of technology is this?
→ Good and different single-payers of the end of February 2024: 5 models for different purposes
→ Liknap on Data Governance, protection of LLM, rating of BI tools and other novelties in the world of ML and DA

Related posts