Hi. Thank you for joining us today for our GIGABYTE talk.
My name is Liam, and I am part of the GIGABYTE Marketing team for Enterprise products.
Today I want to share with you our GPU-accelerated servers that have an Arm based CPU,
as well these systems will be used in for HPC and AI applications.
And thanks to the Nvidia excellent level of hardware-software ecosystem of the Nvidia accelerators.
They are able to be used by data scientists, researchers,
and into institutes such as finance or even retail market.
So, because the hardware is such an important factor,
today I will spend time talking about three servers by GIGABYTE.
They all use a high core count CPU,
and they are used for diverse applications in AI and cloud.
As well they are known for a high level of parallel processing
and have support for Bluefield DPUs.
It might go without saying
but I need to mention GIGABYTE’s position in the enterprise market.
We are a hardware-based company so our solutions are always hardware based.
So, GIGABYTE has been manufacturing motherboards for 30 years
and has been in the server market for 20 years.
And has been a top manufacturer during the whole time.
As well, customers come to us for ODM direct data center solutions, and we have delivered.
And today I want to share with you three of our servers.
The first two are based on HPC and AI applications
as they use PCIe cards such as the NVIDIA A100 or A40.
And our third server
is our edge server that could be used for inference or other edge applications.
And it supports the Bluefield DPUs.
First, I want to talk about the design of these new servers.
They use Arm based processors,
namely the Ampere Altra processor that has proven successful in cloud services.
On the left is our G242-P32 that was chosen by NVIDIA
to support the NVIDIA Arm HPC Developer Kit
for evaluating and benchmarking HPC and AI applications.
And on the right, we have the E252-P30
that is a small form factor edge server
and can accommodate many low-profile T4 cards.
I trust by now you have heard of and may even be using the Ampere Altra processor
which leverages the high core count with cloud and edge applications.
Moving from x86 to Arm for the cloud is right with Ampere Altra.
Ampere has specifically designed the chip for cloud and edge.
The new chips have all the features one would expect and want in 2021,
PCIe Gen 4…100+ PCIe lanes…8 channel memory, support for 3200 DDR4 and so forth.
We say it has predictable performance because of the high core count, up to 80 cores,
the large cache available, and the PCIe gen 4 for throughput.
Second, it has scalability.
Adding more 1U or 2U servers will be easy and need less
thanks to the high core count giving Ampere a dense ratio of cores/rack.
And there are single or dual slot options.
Last is the power efficiency.
For our high end 250W range CPUs that have 40 or 64 cores,
Ampere outnumbers them and does so with the same amount of power.
Also, Altra has advanced power management to adjust to workloads and improve TCO.
Just recently NVIDIA announced the first Arm server validated by NVIDIA
to be used with NVIDIA GPU and DPUs.
It has been dubbed the NVIDIA Arm HPC Developer Kit
And it was done in this GIGABYTE G242 chassis.
The server comes with two NVIDIA A100 cards
and two Bluefield 2 cards for safe and efficient scaling.
And more importantly, at the heart of it all, the 80 core Ampere Altra processor.
This Dev Kit has support for NVDIA HPC SDK,
which is a suite of GPU accelerated compilers
and libraries for compute intensive applications.
The Ampere Altra platform is able to efficiently scale with high performance
and high level of instructions.
The two G242 models we have today are the G242-P31
that is for heterogeneous computing
and the G242-P32 that is tailored for the NVIDIA Arm HPC Dev Kit.
The G242-P31 was introduced earlier this year.
It is GPU centric and supports 4 x nvidia a100 accelerators
that are PCIe Gen4 x16 slots for impressive throughput with PCIe Gen 4.
And orchestrating the server is the Ampere Altra processor with 16 DIMMs for 8-channel memory.
For storage, there are four 3.5” HDD or 2.5” SSD hot-swap bays
for SATA/SAS drives to allow for high storage capacity
yet option for SSD speeds as well.
On the rear we can see 3 x low-profile Gen4 expansion slots for networking or storage.
And at the back are 2 x 80+ Platinum 1600W power supplies.
Next up we have the G242-P32.
However, I need to give some context first.
When nvidia needed a powerful computing platform for developers they came to GIGABYTE
as we were able to deliver a server quickly, all while checking off all the boxes.
For it, we adapted our G242 to accommodate the hardware for the nvidia arm hpc dev kit.
And that includes support for two full-height full-length nvidia A100 accelerators
using Gen4 x16 lanes
and although there are four slots
only two are operational and needed.
And again, we are seeing a single socket for the Ampere Altra CPU with 16 DIMMs.
For storage, there are again 4 SATA/SAS bays at the front for easy access.
And because of the initial launch by NVIDIA,
and consequent success of the Software Development Kit (SDK) ecosystem or suite,
NVIDIA made the kit more accessible.
So, GIGABYTE ushered out the G242-P32 specifically for the developer kit.
And one of the distinguishing bits is that the of the expansion slots,
two are for NVIDIA Bluefield-2 DPUs.
In one other slot is a HBA card and that leaves two low-profile slots for networking
as we expect customers to choose their own LAN cards.
Now, shifting gears, we are going to step away from the G242
that is purpose built for gpu accelerated workloads in AI and HPC, and look at an inference server,
E252-P30 that is designed for the nvidia T4 with GDDR6 memory.
This type of inference server can be found at the edge
and needs real-time data processing.
Here we are looking at an Intel server,
the E252-U70 that is used in the NVIDIA Aerial Developer Kit.
I point this out because it has the common design that we see in the E252-P30,
and Arm is using this server in the Arm 5G Solutions Lab
to evaluate technology needed for 5G base station deployment.
And now onto the specs of the E252-P30.
The E252-P30 has the same single socket support for Ampere Altra processor
and to accompany it are 16 DIMMs for up to 4TB of system memory.
For this edge server there are 6 x 2.5” SATA/SAS hot-swap bays.
And 2 x M.2 Gen4 slots.
As we said this server is perfect for inference work.
At the rear are six low-profile expansion slots with all being Gen4.
So its perfect to be populated with multiple T4 cards
which can handle content recognition to AI video applications.
And with low latency edge performance.
Simply put, GIGABYTE has servers ready for fast TTM
and GPU-accelerated workloads from HPC to AI.
So today I want to thank you again for your time learning about our servers
and have HPC and AI applications.
As well as I want to mention about the future
because we do have some dual socket Ampere Altra processor servers coming out
that support the new 128 core Ampere Altra Max cpu.
For more information you can reach us at gigabyte.com/enterprise.
Also, you can email us directly at server.grp@gigabyte.com.
Thank you very much.