chat GPT the AI heard around the world
a new Computing platform has been
invented
the iPhone moment of AI has started
industrial companies are racing to
digitalize and reinvent into
software-driven tech companies
to be the disrupter
and not the disrupted three decades in
the making
several thousand applications are now
Nvidia accelerated
with libraries on almost every domain of
Science and Industry that span Ray
tracing and neural rendering physical
Earth and Life Sciences quantum physics
and chemistry computer vision data
processing machine learning and AI let
me highlight some acceleration libraries
that solve new challenges and open new
markets the auto and Aerospace
industries use cfd for turbulence and
aerodynamic simulation the electronics
Industry uses cfd for thermal management
design
Nvidia a100 is nine times the throughput
of CPU servers or add equivalent
simulation throughput Nvidia is nine
times lower cost or 17 times less energy
consumed Nvidia is partnering with the
global Quantum Computing research
community
the Nvidia Quantum platform consists of
libraries and systems for researchers to
advance Quantum programming models
system architectures and algorithms
today we're announcing a Quantum control
link developed in partnership with
Quantum machines that connects Nvidia
gpus to a quantum computer to do error
correction at extremely high speeds 22
years ago operations research scientist
Lee and Lim hosted a series of
challenging pickup and delivery problems
PDP shows up in manufacturing
Transportation retail and Logistics and
even disaster relief PDP is a
generalization of the traveling
salesperson problem and is MP hard
meaning there is no efficient algorithm
to find an exact solution
the solution time grows factorially as
the problem size increases
using an evolution algorithm an
accelerated Computing to analyze 30
billion moves per second Nvidia Co-op
has broken the world record and
discovered the best solution for Lee and
Lim's challenge 400 billion Parcels are
delivered to 377 billion stops each year
Deloitte capgemini soft serve Accenture
and quantify are using Nvidia co-opt to
help customers optimize operations
50 to 80 percent of cloud video
pipelines are processed on CPUs
consuming power and cost and adding
latency CV Cuda for computer vision and
vpf for video processing our new Cloud
scale acceleration libraries
CV Cuda includes 30 computer vision
operators for detection segmentation and
classification vpf is a python video
encode and decode acceleration Library
tencent uses CB Cuda and vpf to process
300 000 videos per day Microsoft uses CV
Cuda and vpf to process visual search
Runway is a super cool company that uses
CB Cuda and vpf to process video for
their Cloud generative AI video editing
service
already eighty percent of internet
traffic is video
user generated video content is driving
significant growth and consuming massive
amounts of power we should accelerate
all video processing and reclaim the
power
CV Cuda and vpf are in Early Access
Nvidia accelerated Computing helped
achieve a genomics milestone now doctors
can draw blood in sequence a patient's
DNA in the same visit
in another Milestone Nvidia powered
instruments reduce the cost of whole
genome sequencing to just one hundred
dollars
genomics is a critical tool in synthetic
biology with applications ranging from
drug Discovery and agriculture to energy
production
today we're announcing parabricks 4.1
and will run on Nvidia accelerated
genomics instruments from Pac bio Oxford
nanopore Altima singular bio Nano and
nanostring the world's 250 billion
dollar medical instruments Market is
being transformed medical instruments
will be software defined and AI powered
today Medtronic announced that its GI
genius system with AI for early
detection of colon cancer is built on
Nvidia holoscan and will ship around the
end of this year the chip industry is
the foundation of nearly every industry
chip manufacturing demands extreme
Precision producing features one
thousand times smaller than a bacterium
and on the order of a single gold atom
or a strand of human DNA lithography the
process of creating patterns on a wafer
is the beginning of the chip
manufacturing process and consists of
two stages photo mask making and pattern
projection
it is fundamentally an Imaging problem
at the limits of physics the photomask
is like a stencil of a chip light is
blocked or passed through the mask to
the wafer to create the pattern the
light is produced by the asml euv
extreme ultraviolet lithography system
each system is more than a quarter of a
billion dollars
asml euv uses a radical way to create
light laser pulses firing 50 000 times a
second at a drop of 10 vaporizing it
creating a plasma that emits 13 and a
half nanometer euv light nearly x-ray
multi-layer mirrors guide the light to
the mask the multi-layer reflectors in
The Mask reticle take advantage of
interference patterns of the 13 and a
half nanometer light to create finer
features down to three nanometers
Magic
the wafer is positioned within a quarter
of a nanometer and a line 20 000 times a
second to adjust for any vibration
the step before lithography is equally
miraculous computational lithography
applies inverse physics algorithms to
predict the patterns on the mask that
will produce the final patterns on the
wafer Nvidia today is announcing cool
litho a library for computational
lithography cool litho a massive body of
work that has taken nearly four years
and with close collaboration with tsmc
asml and synopsis accelerates
computational lithography by over 40
times
tsmc will be qualifying cool litho for
Productions starting in June every
industry needs to accelerate every
workload so that we can reclaim power
and do more with less
over the past 10 years cloud computing
has grown twenty percent annually into a
massive one trillion dollar industry
some 30 million CPU servers do the
majority of the processing
there are challenges on the horizon
cloud computing growth is power limited
first and foremost data centers must
accelerate every workload acceleration
will reclaim power the energy saved can
feel New Growth whatever is not
accelerated will be processed on CPUs
the CPU design point for Accelerated
cloud data centers differs fundamentally
from the past in Ai and cloud services
accelerated computing offloads
paralyzable workloads and CPUs process
other workloads like web RPC and
database queries we designed the gray
CPU for an AI and cloud-first world
where AI workloads are GPU accelerated
and Grace excels at single threaded
execution and memory processing it's not
just about the CPU chip
data center operators optimize for
throughput and total cost of ownership
of the entire data center we designed
Grace for High Energy Efficiency at
cloud data center scale the entire 144
core gray Superchip module with one
terabyte of memory is only five by eight
inches
it is so low power it can be air cooled
Grace is 1.3 times faster than the
average of the newest generation x86
CPUs and 1.2 times faster at data
processing and that higher performance
is achieved using only 60 percent of the
power measured at the full server node
Nvidia accelerated Computing starts with
dgx the world's AI supercomputer the
engine behind the large language model
breakthrough I hand delivered the
world's first dgx to open AI since then
half of the Fortune 100 companies have
installed dgx AI supercomputers dgx has
become the essential instrument of AI
the GPU of dgx is eight h100 modules
h100 has a Transformer engine designed
to process models like the amazing chat
GPT which stands for generative
pre-trained Transformers the eight h100
modules are Envy linked to each other
across mv-link switches to allow fully
non-blocking transactions the eight
h-100s work as one giant GPU the
Computing fabric is one of the most
vital systems of the AI supercomputer
400 gigabits per second ultra low
latency Nvidia Quantum infiniband within
Network processing connects hundreds and
thousands of dgx nodes into an AI
supercomputer
Nvidia dgx h100 is the blueprint for
customers building AI infrastructure
worldwide it is now in full production I
am thrilled that Microsoft announced
Azure is opening private previews to
their h100 AI supercomputer dgx
supercomputers are modern AI factories
we are at the iPhone moment of AI chat
GPT
stable diffusion Dolly and mid-journey
have awakened the world to generative AI
these applications ease of use and
impressive capabilities attracted over a
hundred million users in just a few
months
chat GPT is the fastest growing
application in history no training is
necessary just ask these models to do
something the prompts can be precise or
ambiguous
if not clear through conversation Chad
gbt learns your intentions the generated
text is beyond impressive chat GPT can
compose memos and poems
paraphrase a research paper solve math
problems highlight key points of a
contract and even code software programs
chat GPT is a computer that not only
runs software but writes software many
breakthroughs led to generative AI we
went from trying to recognize cats to
generating realistic images of a cat in
a spacesuit walking on the moon
generative AI is a new kind of computer
one that we program in human language
this ability has profound implications
everyone can direct a computer to solve
problems
this was a domain only for computer
programmers
now everyone is a programmer
generative AI is a new Computing
platform like PC internet mobile and
Cloud
and like in previous Computing eras
first movers are creating new
applications and founding new companies
to capitalize on generative ai's ability
to automate and co-create the build lets
users design and deploy web applications
just by explaining what they want Jasper
generates marketing material Jasper has
written nearly 5 billion words reducing
time to generate the first draft by 80
percent in silico uses AI to accelerate
drug design absci is using AI to predict
therapeutic antibodies generative AI
will reinvent nearly every industry
many companies can use one of the
excellent generative AI apis coming to
Market some companies
need to build custom models with their
proprietary data that are experts in
their domain
they need to set up usage guardrails and
refine their models to align with their
company's safety privacy and security
requirements
the industry needs a Foundry a tsmc for
custom large language models
today we announced the Nvidia AI
foundations a cloud service for
customers needing to build refine and
operate custom large language models and
generative AI trained with their
proprietary data and for their domain
specific tasks Picasso is a visual
language model making service for
customers who want to build custom
models train with licensed or
proprietary content let's take a look
generative AI is transforming how visual
content is created but to realize its
full potential Enterprises need massive
amounts of copyright cleared data AI
experts and an AI supercomputer Nvidia
Picasso is a cloud service for building
and deploying generative AI powered
image video and 3D applications these
models generate images videos and 3D
assets this can be a photorealistic
image
a high resolution video or a detailed 3D
geometry
generated assets can be imported into
editing tools or into Nvidia Omniverse
to build photorealistic Virtual Worlds
metaverse applications and digital twin
simulations Beyond video Picasso can
bring transformative generative AI
capabilities to your applications
we are delighted to announce a
significant expansion of our longtime
partnership with Adobe to build a set of
Next Generation AI capabilities for the
future of creativity integrating
generative AI into the everyday
workflows of marketers and creative
professionals the new generative AI
models will be optimized for image
creation video 3D and animation to
protect artist rights Adobe is
developing with a focus on Commercial
viability and proper content attribution
powered by adobe's content authenticity
initiative our third language domain is
biology drug Discovery is a nearly two
trillion dollar industry with 250
billion dollars dedicated to r d
nvidia's Clara is a healthcare
application framework for Imaging
instruments genomics and Drug Discovery
the industry is now jumping onto
generative AI to discover disease
targets
design novel molecules or protein-based
drugs and predict the behavior of the
medicines in the body let's take a look
there are three key stages to drug
Discovery discovering the biology that
causes disease designing new molecules
whether those are small molecules
proteins or antibodies and finally
screening how those molecules interact
with each other
today generative AI is transforming
every step of the drug Discovery process
generative models can now read a
protein's amino acid sequence and in
seconds accurately predict the structure
of a Target protein they can also
generate molecules with desirable admi
properties that optimize how a drug
behaves in the body
generative models can even predict the
3D interactions of a protein and
molecule accelerating the discovery of
optimal drug candidates the new AI drug
Discovery pipelines are here sign up now
for access to Nvidia bio Nemo service
net a decade ago deep learning has
opened giant new markets automated
driving robotics smart speakers and
reinvented how we shop consume news and
enjoy music that's just the tip of the
iceberg
AI is at an inflection point as
generative AI has started a new wave of
opportunities driving a step function
increase in inference workloads AI can
now generate diverse data spanning voice
text images video and 3D Graphics to
proteins and chemicals
designing a cloud data center the
process generative AI is a great
challenge
on the one hand
a single type of accelerator is ideal
because it allows the data center to be
elastic and handle the unpredictable
Peaks and valleys of traffic
on the other hand no one accelerator can
optimally process the diversity of
algorithms models data types and sizes
nvidia's one architecture platform
offers both acceleration and elasticity
today we are announcing our new
inference platform
for configurations one architecture one
software stack
each configuration is optimized for a
class of workloads for AI video
workloads we have L4 optimized for video
decoding and transcoding video content
moderation
and video call features like background
replacement relighting making eye
contact transcription and real-time
language translation for Omniverse
Graphics rendering and generative AI
like text to image and text to video we
are announcing l40 l40 is up to 10 times
the performance of nvidia's T4 the most
popular Cloud inference GPU
Runway is a Pioneer in generative AI the
research team was a key creator of
stable diffusion and its predecessor
latent diffusion Runway is inventing
generative AI models for creating and
editing content with over 30 AI magic
tools their service is revolutionizing
the creative process all from the cloud
let's take a look Runway is making
amazing AI powered video editing and
image creation tools accessible to
everyone powered by the latest
generation of Nvidia gpus running
locally or in the cloud Runway makes it
possible to remove an object from a
video with just a few brush Strokes
or apply different styles to video using
just an input image
or change the background or the
foreground of a video what used to take
hours using conventional tools can now
be completed with professional broadcast
quality results in just a few minutes
Runway does this by utilizing CV Cuda an
open source project that enables
developers to build highly efficient GPU
accelerated pre and post-processing
pipelines for computer vision workloads
and scale them into the cloud
with Nvidia technology Runway is able to
make impossible things to give the best
experience to content creators
what previously limited Pros can now be
done by you
in fact Runway is used in
oscar-nominated Hollywood films and we
are placing this technology in the hands
of the world's creators large language
models like chat GPT are a significant
new inference workload GPT models are
memory and computationally intensive
furthermore inference is a high volume
scale-out workload and requires standard
commodity servers for large language
model inference like chat GPT
we are announcing a new Hopper GPU
the PCI Express h100 with dual GPU
mv-link the new h100 has 94 gigabytes of
hbm3 memory
h100 can process the 175 billion
parameter gpt3 and supporting commodity
PCI Express servers make it easy to
scale out the only GPU in the cloud
today that can practically process chat
GPT is hgx a100 compared to hgx a100 for
gpt3 processing
a standard server with four pairs of
h100 with dual GPU mvlink is up to 10
times faster
h100 can reduce large language model
processing costs by an order of
magnitude
Grace Hopper is our new Superchip that
connects great CPU and Hopper GPU over a
high-speed 900 gigabytes per second
coherent ship to chip interface
Grace Hopper is ideal for processing
giant data sets like AI databases for
recommender systems and large language
models Grace Hopper is the ideal engine
this is nvidia's inference platform
one architecture
for diverse Ai workloads and maximum
data center acceleration and elasticity
the world's largest industries make
physical things
but they want to build them digitally
Omniverse is a platform for industrial
visualization that Bridges digital and
physical
it lets Industries design build operate
and optimize physical products and
factories digitally before making a
physical replica
digitalization is also transforming
Logistics moving Goods through billions
of square feet of warehouses worldwide
let's look at how Amazon uses Omniverse
to automate optimize and plan its
autonomous warehouses Amazon robotics
has manufactured and deployed the
largest Fleet of mobile industrial
robots in the world the newest member of
this robotic Fleet is proteus Amazon's
first fully autonomous Warehouse robot
produce is built to move through our
facilities using advanced Safety
perception and navigation technology
let's see how Nvidia Isaacson built on
Omniverse is creating physically
accurate photo real simulations to help
accelerate protease deployments
produce features multiple sensors that
include cameras lidars and ultrasonic
sensors to power its autonomy software
systems the produce team needed to
improve the performance of a neural
network that read fiducial markers and
helped the robot determine its location
on the map
it takes a lot of data and the right
kind to train the ml models that are
driven by the robot sensor input
with Omniverse replicator in Isaac's Sim
Amazon robotics was able to generate
large photoreal synthetic data sets that
improve the marker detection success
rate from 88.6 to 98 the use of
synthetic data generated by Omniverse
replicator also sped up development
times from months to days as we were
able to iteratively test and train our
models much faster than when only using
real data
to enable new autonomous capabilities
for the expanding Fleet of Proteus
robots Amazon robotics is working
towards closing the Gap from simulation
to reality building large-scale
multi-sensor multi-robot simulations
with Omniverse Amazon robotics will
optimize operations with full Fidelity
Warehouse digital twins
whether we're generating synthetic data
or developing new levels of autonomy
Isaac Simon Omniverse helps the Amazon
robotics team save time and money as we
deploy Proteus across our facilities
Omniverse has unique Technologies for
digitalization and Omniverse is the
Premier development platform for USD
which serves as a common language that
lets teams collaborate to create Virtual
Worlds and digital twins Omniverse is
physically based mirroring the laws of
physics
it can connect to robotic systems and
operate with Hardware in the loop it
features generative AI to accelerate the
creation of virtual worlds and Omniverse
can manage data sets of enormous scale
we've made significant updates to
omnivores in every area let's look at
the digitalization of the three trillion
dollar Auto industry and see how car
companies are evaluating Omniverse in
their workflows Volvo cars and GM use
Omniverse USD composer to connect and
unify their asset pipelines Engineers
use drivesim in Omniverse to generate
synthetic data to train AI models
validate the active safety system
against the virtual end cap driving test
and simulate real driving scenarios
Omniverse is generative AI reconstructs
previously driven routes into 3D
so past experiences can be reenacted or
modified
working with ideaworks BMW uses Isaac
Sim in Omniverse to generate synthetic
data and scenarios to train Factory
robots Lotus is using Omniverse to
virtually assemble welding stations
Toyota is using Omniverse to build
digital twins of their plants
Mercedes-Benz uses Omniverse to build
optimize and plan assembly lines for new
models re-mac and Lucid Motors use
Omniverse to build digital stores from
actual design data that Faithfully
represent their cars BMW is using
Omniverse to plan operations across
nearly three dozen factories worldwide
and they are building a new EV Factory
completely in Omniverse two years before
the physical plant opens
let's visit the bowls Industries are
accelerating digitalization with over
3.4 trillion dollars being invested in
the next three years we at BMW strive to
be Leading Edge in automotive
digitalization with Nvidia Omniverse and
AI we set up new factories faster and
produce more efficiently than ever this
results in significant savings for us it
all starts with planning a complex
process in which we need to connect many
tools data sets and specialists around
the world traditionally we are limited
since data is managed separately in a
variety of systems and tools
today we've changed all that we are
developing custom Omniverse applications
to connect our existing tools know-how
and teams all in a unified view
Omniverse is cloud native and Cloud
agnostic enabling teams to collaborate
across our virtual factories from
everywhere car companies employ nearly
14 million people digitalization will
enhance the industry's efficiency
productivity and speed Omniverse is the
digital to physical operating system to
realize Industrial digitalization
today we're announcing three systems
designed to run Omniverse first we're
launching a new generation of
workstations powered by Nvidia Ada RTX
gpus and Intel's newest CPUs the new
workstations are ideal for doing Ray
tracing physics simulation neural
graphics and generative AI
they will be available from box Dell HP
and Lenovo starting in March
second new Nvidia ovx servers optimized
for Omniverse ovx consists of l40 ADA
RTX server gpus and our new Bluefield 3.
ovx servers will be available from Dell
hpe quanta gigabyte Lenovo and super
micro each layer of the Omniverse stack
including the chips systems networking
and software are new inventions
building and operating the Omniverse
computer requires a sophisticated it
team we're going to make Omniverse fast
and easy to scale and engage let's take
a look
the world's largest Industries are
racing to digitalize their physical
processes today that's a complex
undertaking with Omniverse Cloud
Enterprises can Fast Track unified
digitalization and collaboration across
major industrial workflows increasing
efficiency reducing costs and waste and
accelerating the path to innovation
see you in Omniverse
today we announced the Nvidia Omniverse
Cloud a fully managed cloud service
we're partnering with Microsoft to bring
Omniverse Cloud to the world's
Industries we will host it in Azure
benefiting from Microsoft's Rich Storage
security applications and services
portfolio we are connecting Omniverse
Cloud to Microsoft 365 productivity
Suite including teams OneDrive
SharePoint and the Azure iot digital
twin services
Microsoft and Nvidia are bringing
Omniverse to hundreds of millions of
Microsoft 365 and Azure users
accelerated Computing and AI have
arrived
developers use Nvidia to speed up and
scale up to solve problems previously
impossible we are at the iPhone moment
for AI generative AI inference workloads
have gone into overdrive we launched our
new inference platform for
configurations one architecture L4 for
AI video l40 for Omniverse and Graphics
rendering h100 PCI Express for scaling
out large language model inference Grace
Hopper for recommender systems and
Vector databases nvidia's inference
platform enables maximum data center
acceleration and elasticity Nvidia and
Google Cloud are working together to
deploy a broad range of inference
workloads with this collaboration Google
gcp is a premier Nvidia AI Cloud Nvidia
AI foundations is a cloud service a
Foundry for building custom language
models and generative AI Nvidia AI
foundations comprises language Visual
and biology model making Services Getty
Images and Shutterstock are building
custom visual language models
and we're partnering with Adobe to build
a set of Next Generation AI capabilities
for the future of creativity Omniverse
is the digital to physical operating
system to realize Industrial
digitalization
Omniverse can unify the end-to-end
workflow and digitalize the three
trillion dollar 14 million employee
automotive industry
Omniverse is leaping to the cloud
hosted in azure
we partner with Microsoft to bring
Omniverse Cloud to the world's
Industries I thank our systems cloud and
software partners
researchers scientists and especially
our amazing employees for building the
Nvidia accelerated Computing ecosystem
together we are helping the world do the
impossible