Whether you know it or not, you use
artificial intelligence all the time.
Maybe you own a smart speaker
or you've seen a self-driving car
or you've used Google Photos to search
for images of your cat.
Now, there's also a good chance
you've played a video game that happens
to have some AI in it, like God of War
or Red Dead Redemption 2.
What may surprise you is that those
two types of AI are not the same thing.
The AI in digital systems and autonomous vehicles
is self-learning and really fast,
but it’s also really unpredictable.
Yet these two worlds are fast colliding,
and once game developers have the right tools
and the freedom to make games that really push
the limits of AI, the results are going
to be the stuff of science fiction.
(electronic music)
Over the years, AI has become really good
at playing certain games.
Try beating your computer at chess
on the hardest difficulty. It's pretty much impossible.
Or even if you're a pro StarCraft player,
DeepMind software can now crush you.
I'm here, in the shadows.
But the AI inside of a video game,
that's basically been building off
the same core set of principles for decades.
Take, for instance, a classic game like Pac-Man.
At different points, the ghosts evaluate
where you are in the map and where you might be going,
and then they either chase you, or they run away from you.
It's not exactly groundbreaking AI,
but it is video game AI nonetheless.
And what's remarkable is that the AI
you encounter in games today hasn't
really changed that much over the years.
Two of the core components of commercial game AI
are pathfinding and finite state machines.
Julian Togelius is a professor of computer science
at NYU who spent years studying the intersection
of gaming and artificial intelligence.
He walked us through the basic toolkit
that underpins a ton of video game AI.
Pathfinding is how to get from
point A to point B in a simple way,
and it’s used in all games all the time.
Finite state machine is a construct where an NPC
can be in different states and move between them.
Real AI in commercial games is more complex than that,
but those are some of the founding principles.
So using these basics, developers
have created ever-more realistic game worlds and characters,
but that software is not exactly intelligent.
That's because game developers have yet
to really utilize key advancements in the field
of artificial intelligence research, namely deep learning.
Through the deep learning revolution,
researchers at universities and tech companies
have made astounding progress at giving a machine
the means to improve itself over time.
But there's a reason game developers
aren't using that type of AI to develop games.
Typically, when you design a game,
you want to know what the player will experience.
And for that, if you go in to evolve any AI there,
you want the AI to be predictable.
Now, if you just went and tossed in a neural network
that was constantly adapting and learning
from all the feedback it got from you,
there's a very good chance something
unexpected might happen, and it could break the game.
And that's a problem for a designer.
Imagine if every single character
in Red Dead Redemption remembered all of your crimes,
and you couldn't even play anymore
because everyone just took you down on sight.
I'll put your brains all over you.
The way designers think today
when they're designing games, they want predictability.
And therefore, they want the relatively
anemic AI we have in games today.
What's more useful for game makers
is taking those traditional approaches,
and trying them at unprecedented scales.
If you play Red Dead Redemption 2,
you've probably seen this clip.
A player firing a warning shot,
which shoots a bird right out of the sky.
What makes it so interesting is that
it isn't a planned part of the game. It’s completely random.
What?
The individual systems here, the way that bullets
move through the sky, and where birds
are programmed to fly around,
those are not wildly different
than the pathfinding Pac-Man ghosts.
The difference in a game like Red Dead Redemption
is that all of its many, many systems
can overlap and run into one another.
The individual pieces aren't intelligent,
but when they come together, they trick you
into thinking they are.
Haven't you brought enough misery upon us?
Another game that's great at this
is The Legend of Zelda: Breath of the Wild.
It's a cohesive world where a few simple programming rules
around weather, gravity, and even heat
create endlessly surprising moments.
You can use a makeshift torch to bake an apple
while it's still on a tree, or drop a bunch
of these weird balloon things on a boat,
and it'll soar into the sky.
Now, is this really AI?
Well, that kind of depends on who you ask.
Some argue it's just automation or emergent gameplay
because these systems aren't intelligent, per se.
While others say game AI is less about
trying to pass off a machine as a human,
and more about creating a sense of wonder and mystery
that makes the game feel real.
So what would honest to goodness
AI-powered video games actually look like?
Well, in the Spike Jonze movie Her,
creator David O'Reilly conceived of a video game
in which a foul-mouthed character
could react dynamically to you and your personality.
It could even taunt and bully you into continuing to play.
Come on, follow me. (beep)
Games like this may seem far off, but we're getting there.
That's because cutting-edge AI research
is finally bleeding over into game development.
Today, researchers are using the kind of AI
that can actually learn to design entire games,
using a technique known as procedural generation.
It was popularized most recently
by the indie game No Man's Sky,
but now, AI researchers are using
the same technique to create software
that can design a game entirely from scratch.
So you can say that not only do I want to generate
a landscape, but I want to generate a landscape
where I know there will be choke points,
where we can hide my troops behind,
or I know there will be places to have a castle on,
and with no deep valleys you can fall into.
Building off that, game developers
could create games that don't just generate levels
all on their own, but also learn what you like as a player.
In the longer-term future, we're going to see
game directors that learn to adapt the game
as you are playing it, and learn to become game masters
that play the player as the player plays the game.
There are even ways that AI right now
can be used to create the art for games.
Take a look at Nvidia's research
generating game graphics using deep learning.
What you're seeing is not real,
an AI used a game engine and some video footage
to teach itself how to generate an imaginary city block.
One that you could see in a game.
The same technique can even create
all new, never-before-seen faces,
ones that look indistinguishable from real human beings.
Of course, that doesn't stop with faces.
You could do mountains, dogs, space ships, whatever.
But the Holy Grail of AI in games
would be a true self-learning character
that is complex and relatable, and it has
a realistic persona that could build you up.
Do you know how to get out of here?
Or tear you down.
(bleeping)
We're probably not going to have game characters
that sophisticated for a long time.
In the short term, big game companies
will likely use AI for testing games
and boring stuff like analytics.
But AI is really tricky, and it requires
a ton of tinkering and training. That's time and money
that game developers don't always have.
So Julian doesn't see the usual suspects
jumping on actual AI powered games anytime soon.
We need to take the AI capability,
and think about how can we design a game around that?
And I don't think that's going to happen
from the big AI companies. It’s too risky.
Instead, it might take smaller, scrappier gaming companies
to lean into AI's quirks and make something
unexpected and strange that feels entirely new.
So if something unexpected or weird happened to you
while you were playing Red Dead Redemption 2,
or even the new Zelda, describe it in the comments below.
And if you have one, leave us a link, too.
Thanks for watching.