[MUSIC].
>> Jambo, which is hello in Swahili.
I'm Martha Githui and I'm joining you from
our newest garage space here in Nairobi, Kenya.
In this demo, I'm going to show how Codex can create
new natural language experiences in
games using existing tools and APIs.
Let's get started.
We're playing Minecraft,
accompanied by an avatar that uses Codex to produce
code in language with the Minecraft Game Taste API.
The Codex model has never seen this API before.
At run-time, it's given the API spec along with
a few usage examples and it's able to extrapolate from there.
We'll start by having a simple conversation.
The model is tuned to produce code,
but it can also produce dialogue.
First I'll say Hello,
and the bot responds with Hello back.
What game are we playing today?
Indeed, we're playing Minecraft.
Night is coming soon,
so let's see if we can get some help from our friend.
I'll say, "What would be a good item to have at night?"
It suggests a torch,
which is a smart idea.
Codex understands when a message is conversational and can
answer with dialogue and keep track
of the context of the conversation.
It's been answering us with information it already knows,
which is not in our bot API code or examples.
Now let's use natural language prompts to
have it produce some basic code to move around the world.
I'll start by saying,
"Come here, and look at me."
The model is able to use
API primitives to navigate to the scene and to look at the player.
It can also produce more complex code to handle
more complex behaviors by extending
primitives with its own code and logic.
Since night will be coming soon,
and now we know that we could use a torch.
Let's see if our board can do that for us.
What items do I need to make a torch?
It correctly responds that you need one stick and one coal.
We already have the coal in the chest over here.
Let's go ask our bot to get that first and then craft the rest.
Go to the chest and open it.
The model is writing code on its
own to deliver the actions we've asked it to do.
Get the coal from the chest.
Get some logs and make some planks.
It's even able to take
imprecise language and turn it into precise actions.
Finally I'll say, make a stick,
and make a torch,
and equip the torch.
As you can see, the model was able to
take the conversation and turn it into
executable code in real time and
deliver the actions in context of what it was already doing.
We think Codex's ability to write code for games can open up
a whole new world for gamers and models to
create complex behaviors using natural language instruction,
and can enable game makers to create interactive,
natural language experiences for their players.
[MUSIC]