Data center is the new unit of computing.
Modern data center workloads are diverse and not limited to monolithic applications running on single nodes.
AI and data analytics applications are distributed, running on multi-GPU and multi-node.
Cloud services are disaggregated and composed of microservices.
These new workloads put tremendous pressure on the network. East-west traffic has skyrocketed.
NVIDIA created the Magnum IO SDK to offload moving data from the CPU with Mellanox RDMA
and accelerate the networking, storage, and security processing on Mellanox NICs.
Magnum IO SDK includes acceleration for each computing domain.
Modern data centers are also software-defined.
The compute virtualization trend that enabled easier resource pooling and management has now extended to networking, storage, and security.
What used to be dedicated hardware appliances are now software services running on CPUs.
The entire data center is software programmable and can be provisioned as a service.
Virtual machines send packets across virtual switches and virtual routers.
Perimeter firewalls are virtualized and can protect every node.
Micro-segmentation secure east-west communications so attackers can't move laterally across the data center.
The software-defined data center is great for manageability, scalability, and security,
but all the data center infrastructure processing in software is a huge tax on CPUs.
As more users load the hyperscalers, each microservice comes with it the associated virtualization, networking, storage,
and security processing - all of it consuming CPU resources.
A new type of processor is needed that is designed for data movement and security processing. We call it the data processing unit.
The DPU consists of accelerators for networking, storage, and security, and programmable Arm CPUs to offload the hypervisor.
The DPU is a data center infrastructure processing chip.
It is estimated that at least 30% of the CPU cores can be consumed running the data center infrastructure.
Today we are announcing the BlueField-2 DPU.
It is a programmable processor with accelerators and engines for at-line-speed processing for networking, storage, and security.
The BlueField DPU is a data center infrastructure on a chip.
BlueField-2 has Arm CPUs and a whole host of state-of-the-art accelerators and hardware engines.
BlueField-2 does the security processing for private, public, and hybrid clouds.
BlueField air-gaps the application domain from the infrastructure domain, stores and accelerates encryption keys,
does SHA-256 authentication and encryption protocol processing.
It does regular expression and deep packet inspection processing for app recognition, intrusion protection,
web application firewall, and out-of-band malware detection.
BlueField-2 includes traffic-rate-controlled packet pacing for video streaming, SMPT-2110 broadcast, and 5G networks.
BlueField-2 is also an amazing NVMe storage processor. It's great for both compute as well as the storage server.
It does elastic block storage, block storage encryption, de-dup, and compression.
These are some of the examples of advanced functions that BlueField-2 offloads from the CPU and accelerates.
If done in software, the IPsec, regular expression processing, packet pacing, elastic storage
would consume some 125 CPU cores to run at 100Gbps.
And of course, BlueField-2 is amazing at high-performance networking.
It has the industry's best RDMA, ASAP2 accelerated switching and packet processing,
software-defined network acceleration for OpenStack and Kubernetes.
BlueField-2 is a 7 billion transistor marvel.
A programmable data center on-a-chip. One that we intend to support for as long as we shall live. Just like CUDA.
Today we are announcing DOCA - a programmable data center infrastructure processor architecture.
DOCA SDK lets developers write infrastructure apps for software-defined networking, software-defined storage, cyber security, telemetry, and
in-network computing applications yet-to-be-invented.
DOCA is built on open APIs such as P4 for packet processing, DPDK for networking, SPDK for storage, and CUDA and NVIDIA AI.
DOCA is fully compatible and seamlessly integrates into all major OS/hypervisors.
Applications written for DOCA will run on BlueField-2 and all future versions of BlueField.
Today we are thrilled to announce a major partnership with VMware.
VMware runs the world's enterprise. They're the OS platform in 70% of the world's companies. VMware pioneered the virtualized enterprise
and now driving the software-defined data center revolution.
Together, we are porting VMware onto BlueField.
BlueField is a data center infrastructure processor and VMware is the data center infrastructure OS.
Our partnership will redefine the data center.
We will offload virtualization, networking, storage, and security onto the BlueField and enable distributed, zero-trust security.
Our work will give the 30-40 million enterprise servers around the world a big boost in performance and security.
Let me show you the benefits of offloading, accelerating, and isolating with BlueField.
This demo is Volvo's actual design environment - a lot of technology is involved here.
This is a direct visualization from Volvo's PLM actual car CAD data. IP protection and security is paramount.
The amount of data being retrieved, streamed, and loaded to rendered is incredible.
Remember this is the entire car. This is the original CAD data of the car.
Security, storage, and networking is done on BlueField.
Omniverse on RTX GPU is doing the photorealistic path tracing.
VMware's doing virtualization, software-defined stacks, and virtual workstation.
The left is BlueField, and the right is a server running the entire stack on CPU.
With VMware on BlueField, the networking, storage, and security processing is offloaded, accelerated, and isolated.
Both systems are experiencing DDOS attack.
The designers on BlueField-2 servers carry on while those on CPU servers are throttled as the CPU fights hard to block the intruder.
We now have the pieces together for a programmable data center infrastructure platform.
The BlueField-2 DPU, the DOCA SDK, and the VMware OS platform.
BlueField-2 is just the start.
Our DPU roadmap is in full throttle.
BlueField-2 is sampling; BlueField-3 is finishing; and BlueField-4 is in high gear.
And BlueField-4 adds CUDA and NVIDIA AI - turbocharging the in-network computing vision.
Every BlueField is compatible. One architecture - DOCA.
Today we're also announcing the BlueField-2X.
Adding an Ampere GPU to BlueField-2 to do the in-networking computing with CUDA and NVIDIA AI.
State-of-the-art security functionality can now be done in software.
Like anomaly detection, traffic analytics at line-rate,
host introspection to identify malicious activity, dynamic security orchestration, online video analytics.
BlueField-2X is like having a BlueField-4 today.
We are going to bring a ton of technology to networking.
In just a couple of years, we'll span nearly 1,000 times in compute throughput,
and delivering date rates ranging from 200Gbps to 400Gbps.
This is super exciting - the beginning of the programmable data center infrastructure.