[electronic music]
Sandeep: Hi. My name is Sandeep,
a developer advocate on the Google Cloud platform.
Welcome to the Google Data Center
at the Dalles, Oregon.
Take a look around.
Before we go inside, we need to make sure
that we have the appropriate security clearance.
Most Google employees can't even get in here.
So let's go on a special behind-the-scenes tour.
[keypad beeps, door opens]
I'm here with Noah
from the Site Reliability Engineering Team.
Noah, can you tell us a little bit more
about the SRE role at Google?
Noah: Yeah, SREs write and maintain the software systems
designed to keep our services running.
Sandeep: So what happens if one of these systems goes down?
Noah: We've designed our systems from the ground up
to be able to handle any unexpected failures
that might occur.
We have highly redundant power, networking,
and serving domains so that even if we do lose
an entire cluster, we're able to re-direct those workloads
and live migrate data in order to minimize any impact.
In addition, we have a team of SREs on call 24/7
that can tackle any problems that might arise.
Sandeep: Thanks, Noah.
Now we've learned more about the systems
that manage our fleet at Google,
let's take a deeper look
at the data center infrastructure itself.
Before we can continue further,
we need to go through the biometric iris scan
and circle lock.
These only allow one person in at a time
and require dual authentication
to continue further.
I'll see you on the other side.
[control beeps]
computer voice: Please situate your eyes
to begin the procedure.
Please come a little closer to the camera.
[beep]
Sandeep: Welcome to the data center floor.
As you can tell, we have a lot of servers,
and this is a single cluster in a single floor
in a single building.
Managing all of these servers on a global scale
is quite a challenge.
To utilize our fleet, we use tools
such as Borg, Colossus, and Spanner.
You may be familiar with similar tools,
such as Kubernetes, Google Cloud storage,
and BigQuery.
These tools allow Google engineers
and Cloud customers
to more easily manage infrastructure,
allowing everyone to build
innovative and scalable applications.
Here at Google, a lot of our infrastructure is custom-made.
This gives us the flexibility and performance
we need to run all of our services at scale.
Oh, hey, it's Virginia, one of our network engineers.
Virginia: Hey, Sandeep.
Sandeep: Virginia, what are you working on today?
Virginia: Today I'm working with Hardware Ops
to expand this data center network
to deploy additional machines in this building.
Our fleet is constantly growing to support new capacity
for Google products and our Cloud customers.
Sandeep: That sounds like a lot of work,
to be constantly adding capacity around the globe.
Virginia: Well, we designed our network
so that this kind of capacity growth isn't very hard.
Jupiter, our current data center and network technology,
is a hierarchical design
using software-defined networking principles.
So just like with our servers,
we abstracted away the specific details of our network
and can manage them like they're software programs and data.
Sandeep: Abstracting seems to be a common theme here at Google.
I've also noticed there's a lot of fiber
running in our data centers. Virginia: That's right.
A single building can support 75,000 machines,
and carry over one petabit per second of bandwidth,
which is actually more than on the entire Internet.
Sandeep: Wow. Virginia: This allows us
to reliably access storage and compute resources
with low latency and high throughput.
Sandeep: So how is this data center connected to
all our other data centers around the globe?
Virginia: Google runs B4,
our own private, highly efficient backbone network,
which is actually growing faster
than our Internet-facing network.
It connects all our data centers together
and allows services to efficiently access resources
in any location. Sandeep: Nice.
I finally know what all this Google fiber is really used for.
Thanks, Virginia. Virginia: No problem.
Sandeep: So now you've seen
all the compute and networking horsepower
required to run your workloads in the Cloud,
let's take a look at where your data is
safely and securely stored.
Let's go.
Whether you're querying terabytes of data on BigQuery
or storing petabytes in Google Cloud Storage,
all of your data needs to be stored on a physical device.
Our data center infrastructure allows us
to access our storage quickly and securely.
At our scale, we need to handle hard drive and SSD failure
on a daily basis.
While your data is replicated and safe,
we need to destroy or recycle used hard drives
so no one can access your data.
From the time a disc is removed from the server
to the time it's decommissioned,
we maintain a very strict chain of custody.
The discs are completely wiped and then destroyed
in a huge shredder.
Let's go shred some hard drives.
[beeping]
We've looked at a lot of the hardware
that runs in our data centers, but it doesn't end there.
We need to cool and power our infrastructure
in an environmentally sustainable and reliable way.
Let's take a look at how we cool our servers.
Welcome to the mechanical equipment room.
Looks pretty cool, doesn't it?
Oh, hey, it's Brian, one of
our data center facilities technicians!
Brian: Hey, Sandeep. Sandeep: Hey, Brian.
Brian, can you tell us a little bit more about this room?
Brian: Sure. This is a cooling plant
for one of the data centers that we have on site.
So a lot of heat is generated on the server floor,
and it all has to be removed,
and that starts right here in the cooling plant.
So it's basically two loops.
We have the condenser water loop
and we have the process water loop.
The process water loop are these blue and red pipes over here.
So they take the heat off the server floor
and they transfer it to these heat exchangers here.
The condenser water loop are
these green and yellow pipes here.
They take the cold water from the basin underneath us,
they transfer it to these heat exchangers here,
and they send it up to the cooling towers up on the roof.
Sandeep: I notice our pipes are Google colors.
It's pretty cool.
So how efficient is our data center?
Brian: Well, Google has some of
the most efficient data centers in the world.
In fact, when we started reporting our power usage effectiveness
or P.U.E., in 2008,
most data centers were around 100% overhead.
At that point in time, Google was 20% overhead,
but since then, we've reduced it to just 12%,
and that even includes our cafeterias.
Sandeep: Whoa! That is so low!
Also what's this big green machine for?
Brian: Oh, well, this is a chiller.
We very rarely use them,
but it helps keep the process water temperature
in the desired temperature range
when it gets really hot outside,
basically helping the cooling tower do its job,
and some of our newer data centers,
they have no chillers at all.
Sandeep: I love how our new data centers are even more efficient.
By the way, can we go up and take a look at a cooling tower?
Brian: Sure. Let's go.
Sandeep: Wow, what a view up here!
Brian: So, Sandeep, this is a cooling tower.
It uses evaporation to rapidly cool the water
from the condenser loop and sends it back down to the basin.
You could say we're making actual clouds with the Cloud.
Sandeep: Clouds making actual clouds--welcome to Google!
So, Brian, how do we power the Cloud?
Brian: Well, that all starts at Google's power substation.
Let's go take a look.
So this is the Google-owned power substation.
This is where the high voltage power enters the site.
It's reduced and then sent
to multiple power distribution centers
such as this one right here.
Sandeep: What happens if a power distribution center
loses power?
Brian: If it loses power, we have
multiple generator and utility backup sources
available to maintain power to those servers.
Sandeep: And where does all the power come from?
Brian: It actually comes from
multiple hydroelectric power plants
that are nearby. Sandeep: I love how Google uses
reliable green energy whenever possible.
Brian: We are 100% carbon neutral actually.
Sandeep: That's pretty cool
You know, it seems like Google builds reliability
from the ground up, from the power and cooling
all the way to the software systems that manage our fleet.
Thanks for showing me around, Brian.
Brian: No problem. Have a great day.
Sandeep: Thank you for joining me on
this special behind-the-scenes tour.
Please check out cloud.google.com
to learn how you can build what's next.