I've now supplied you with two definitions of the state
variable entropy.
And it's S for entropy.
The thermodynamic definition said that the change in
entropy is equal to the heat added to the system divided by
the temperature at which the heat is added.
So obviously, if the temperature is changing while
we add the heat, which is normally the case, we're going
to have to do a little bit of calculus.
And then you can view this as the mathematical, or the
statistical, or the combinatorical
definition of entropy.
And this essentially says that entropy is equal to some
constant times the natural log of the number of states the
system can take on.
And this is the case when all the states are equally
probable, which is a pretty good assumption.
If you have just a gazillion molecules that could have a
gazillion gazillion states, you can assume they're all
roughly equally likely.
There's a slightly more involved definition if they
had different probabilities, but we won't
worry about that now.
So given that we've seen these two definitions, it's a good
time to introduce you to the second law of thermodynamics.
And that's this.
And it's a pretty simple law, but it explains a whole range
of phenomena.
It tells us that the change in entropy for the universe when
any process is undergone is always greater
than or equal to 0.
So that tells us that when anything ever happens in the
universe, the net effect is that there's more entropy in
the universe itself.
And this seems very deep, and it actually is.
So let's see if we can apply it to see why it explains, or
why it makes sense, relative to some examples.
So let's say I have two reservoirs that are in contact
with each other.
So I have T1.
And let's call this our hot reservoir.
And then I have T2.
I'll call this our cold reservoir.
Well, we know from experience.
What happens if I put a hot cup of water, and it's sharing
a wall with a cold glass of water, or cold cube of water,
what happens?
Well, their temperatures equalize.
If these are the same substance, we'll end up
roughly in between, if they're in the same phase.
So essentially, we have a transfer of heat from the
hotter substance to the colder substance.
So we have some heat, Q, that goes from the hotter substance
to the colder substance.
You don't see, in everyday reality, heat going from a
colder substance to a hotter substance.
If I put an ice cube in, let's say, some hot tea, you don't
see the ice cube getting colder and the
hot tea getting hotter.
You see them both getting to some equal temperature, which
essentially the tea is giving heat to the ice cube.
Now in this situation there are reservoirs, so I'm
assuming that their temperatures stay constant.
Which would only be the case if they were both infinite,
which we know doesn't exist in the real world.
In the real world, T1's temperature as it gave heat
would go down, and T2's temperature would go up.
But let's just see whether the second law of thermodynamics
says that this should happen.
So what's happening here?
What's the net change in entropy for T1?
So the second law of thermodynamics says that the
change in entropy for the universe is greater than 0.
But in this case, that's equal to the change in entropy for
T1 plus the change in entropy for-- oh, I shouldn't--
instead of T1, let me call it just 1.
For system 1, that's this hot system up here, plus the
change in entropy for system 2.
So what's the change in entropy for system 1?
It loses Q1 at a high temperature.
So this equals minus the heat given to the system is Q over
some hot temperature T1.
And then we have the heat being added to the system T2.
So plus Q over T2.
This is the change in entropy for the system 2, right?
This guy loses the heat, and is at temperature 1, which is
a higher temperature.
This guy gains the heat, and he is at a temperature 2,
which is a colder temperature.
Now, is this going to be greater than 0?
Let's think about it a little bit.
If I divide-- let me rewrite this.
So I can rearrange them, so that we can write this as Q
over T2 minus this one.
I'm just rearranging it.
Minus Q over T1.
Now, which number is bigger?
T2 to T1?
Well, T1 is bigger, right?
This is bigger.
Now, if I have a bigger number, bigger than this--
when we use the word bigger, you have to
compare it to something.
Now, T1 is bigger than this.
We have the same number in the numerator
in both cases, right?
So if I take, let's say, 1 over some, let's say, 1/2
minus 1/3, we're going to be bigger than 0.
This is a larger number than this number, because this has
a bigger denominator.
You're dividing by a larger number.
That's a good way to think about it.
You're dividing this Q by some number here to get something,
and then you're subtracting this Q
divided by a larger number.
So this fraction is going to be a smaller absolute number.
So this is going to be greater than 0.
So that tells us the second law of thermodynamics, it
verifies this observation we see in the real world, that
heat will flow from the hot body to the cold body.
Now, you might say, hey, Sal.
I have a case that will show you that you are wrong.
You could say, look.
If I put an air conditioner in a room-- Let's say this is the
room, and this is outside.
You'll say, look what the air conditioner does.
The room is already cold, and outside is already hot.
But what the air conditioner does, is it makes the cold
even colder, and it makes the hot even hotter.
It takes some Q and it goes in that direction.
Right?
It takes heat from the cold room, and puts it out
into the hot air.
And you're saying, this defies the second law of
thermodynamics.
You have just disproved it.
You deserve a Nobel Prize.
And I would say to you, you're forgetting one small fact.
This air conditioner inside here, it has some type of a
compressor, some type of an engine, that's
actively doing this.
It's putting in work to make this happen.
And this engine right here-- I'll do it in magenta-- it's
also expelling some more heat.
So let's call that Q of the engine.
So if you wanted to figure out the total entropy created for
the universe, it would be the entropy of the cold room plus
the change in entropy for outside-- I'll call it
outside, maybe I'll call this, for the room.
Right?
So you might say, OK.
This change in entropy for the room, it's giving away heat--
let's see the room is roughly at a constant temperature for
that one millisecond we're looking at it.
It's giving away some Q at some temperature T1.
And then-- so that's a minus.
And then this the outside is gaining some heat at some
temperature T2.
And so you'll immediately say, hey.
This number right here is a smaller number than this one.
Right?
Because the denominator is higher.
So if you just look at this, this would be negative
entropy, and you'd say hey, this defies the second law of
thermodynamics.
No!
But what you have to throw in here is another notion.
You have to throw in here the notion that the outside is
also getting this heat from the engine over the outside
temperature.
And this term, I can guarantee you-- I'm not giving you
numbers right now-- will make this
whole expression positive.
This term will turn the total net entropy to the universe to
be positive.
Now let's think a little bit how about what entropy is and
what entropy isn't in terms of words.
So when you take an intro chemistry class, the teacher
often says, entropy equals disorder.
Which is not incorrect.
It is disorder, but you have to be very careful what we
mean by disorder.
Because the very next example that's often given is that
they'll say, look.
A clean room-- let's say your bedroom is clean, and then it
becomes dirty.
And they'll say, look.
The universe became more disordered.
The dirty room has more disorder than the clean room.
And this is not a case of entropy increase.
So this is not a good example.
Why is that?
Because clean and dirty are just states of the room.
Remember, entropy is a macro state variable.
It's something you use to describe a system where you're
not in the mood to sit there and tell me what exactly every
particle is doing.
And this is a macro variable that actually tells me how
much time would it take for me to tell you what every
particle is doing.
It actually tells you how many states there are, or how much
information I would have to give you to tell
you the exact state.
Now, when you have a clean room and a dirty room, these
are two different states of the same room.
If the room has the same temperature, and it has the
same number of molecules in it and everything, then they have
the same entropy.
So clean to dirty, it's not more entropy.
Now, for example, I could have a dirty, cold room.
And let's say I were to go into that room and, you know,
I work really hard to clean it up.
And by doing so, I add a lot of heat to the system, and my
sweat molecules drop all over the place, and so there's just
more stuff in that room, and it's all warmed up to me-- so
to a hot, clean room with sweat in it-- so it's got more
stuff in here that can be configured in more ways, and
because it's hot, every molecule in the room can take
on more states, right?
Because the average kinetic energy is up, so they can kind
of explore the spaces of how many kinetic energies it can
have. There's more potential energies that each molecule
can take on.
This is actually an increase in entropy.
From a dirty, cold room to a hot, clean room.
And this actually goes well with what we know.
I mean, when I go into room and I start cleaning it, I am
in putting heat into the room.
And the universe is becoming more-- I guess we could say
it's the entropy is increasing.
So where does the term disorder apply?
Well, let's take a situation where I take a ball.
I take a ball, and it falls to the ground.
And then it hits the ground.
And there should have been a question that you've been
asking all the time, since the first law of thermodynamics.
So the ball hits the ground, right?
It got thrown up, it had some potential energy at the top,
then that all gets turned into kinetic energy and it hits the
ground, and then it stops.
And so your obvious question is, what happened to all that
energy, right?
Law of conservation of energy.
Where did all of it go?
It had all that kinetic energy right before it hit the
ground, then it stopped.
Right?
It seems like it disappeared.
But it didn't disappear.
So when the ball was falling, it had a bunch of-- you know,
everything had a little bit of heat.
But let's say the ground was reasonably ordered.
The ground molecules were vibrating with some kinetic
energy and potential energies.
And then our ball molecules were also
vibrating a little bit.
But most of their motion was downwards, right?
Most of the ball molecules' motion was downwards.
Now, when it hits the ground, what happens-- let me show you
the interface of the ball.
So the ball molecules at the front of the ball are going to
look like that.
And there's a bunch of them.
It's a solid.
It will maybe be some type of lattice.
And then it hits the ground.
And when it hits the ground-- so the ground is another solid
like that-- All right, we're looking at the microstate.
What's going to happen?
These guys are going to rub up against these guys, and
they're going to transfer their-- what was downward
kinetic energy, and a very ordered downward kinetic
energy-- they're going to transfer it to
these ground particles.
And they're going to bump into the ground particles.
And so when this guy bumps into that guy, he might start
moving in that direction.
This guy will start oscillating in that direction,
and go back and forth like that.
That guy might bounce off of this guy, and go in that
direction, and bump into that guy, and
go into that direction.
And then, because that guy bumped here, this guy bumps
here, and because this guy bumps here, this guy bumps
over there.
And so what you have is, what was relatively ordered motion,
especially from the ball's point of view, when it starts
rubbing up against these molecules of the ground, it
starts making the kinetic energy, or their movement, go
in all sorts of random directions.
Right?
This guy's going to make this guy go like that, and that guy
go like that.
And so when the movement is no longer ordered, if I have a
lot of molecules-- let me do it in a different color-- if I
have a lot of molecules, and they're all moving in the
exact same direction, then my micro state looks like my
macro state.
The whole thing moves in that direction.
Now, if I have a bunch of molecules, and they're all
moving in random directions, my ball as a whole will be
stationary.
I could have the exact same amount of kinetic energy at
the molecular level, but they're all going to be
bouncing into each other.
And in this case, we described the kinetic energy as internal
energy, or we describe it as temperature, where temperature
is the average kinetic energy.
So in this case, when we talk about, the world is becoming
more disordered, you think about the order of maybe the
velocities or the energies of the molecules.
Before they were reasonably ordered, the molecules-- they
might have been vibrating a little bit, but they were
mainly going down in the ball.
But when they bump into the ground, all of a sudden they
start vibrating in random directions a little bit more.
And they make the ground vibrate in more random
directions.
So it makes-- at the microstate-- everything became
just that much more disordered.
Now there's an interesting question here.
There is some probability you might think-- Look, this ball
came down and hit the ground.
Why doesn't the ball just-- isn't there some probability
that if I have a ground, that these molecules just rearrange
themselves in just the right way to just hit these ball
molecules in just the right way?
There's some probability, just from the random movement, that
at get some second, all the ground molecules just hit the
ball molecules just right to send the ball back up.
And the answer is yes.
There's actually some infinitesimally small chance
that that happens.
That you could have a ball that's sitting on the ground--
and this is interesting-- could have a ball that's
sitting on the ground, and while you're looking, you'll
probably have to wait a few gazillion years for it to
happen, if it happens at all-- it could just randomly pop up.
And there's some random, very small chance that these
molecules just randomly vibrate in just the right way
to be ordered for a second, and then the ball will pop up.
But the probability of this happening, relative to
everything else, is essentially 0.
So when people talk about order and disorder, the
disorder is increasing, because now these molecules
are going in more random directions, and they can take
on more potential states.
And we saw that here.
And you know, on some level, entropy seems something kind
of magical, but on some level, it seems
relatively common sense.
In that video-- I think was the last video-- I had a case
where I had a bunch of molecules, and then I had this
extra space here, and then I removed the wall.
And we saw that these molecules will-- we know,
there's always some modules that are bouncing off this
wall before, because we probably had some pressure
associated with it.
And then as soon as we remove that wall, the molecule that
would have bounced there just keeps going.
There's nothing to stop it from there.
In that direction, there's a lot of stuff.
It could bump into other molecules, and it could
bumping into these walls.
But in this direction, the odds of it bumping into
everything is, especially for these leading molecules, is
essentially 0.
So it's going to expand to fill the container.
So that's kind of common sense.
But the neat thing is that the second law of thermodynamics,
as we saw in that video, also says that this will happen.
That the molecules will all expand to fill the container.
And that the odds of this happening are very low.
That they all come back and go into a ordered state.
Now there is some chance, just from the random movements once
they fill, that they all just happen to come back here.
But it's a very, very small probability.
And even more-- and I want to make this very clear-- S is a
macro state.
We never talk about the entropy for
an individual molecule.
If we know what an individual molecule is doing, we
shouldn't be worrying about entropy.
We should be worrying about the system as a whole.
So even if we're looking at the system, if we're not
looking directly at the molecules, we won't even know
that this actually happened.
All we can do is look at the statistical
properties of the molecules.
How many molecules they are, what their temperature is, all
their macro dynamics, the pressure, and
say, you know what?
A box that has these molecules has more state than a smaller
box, than the box when we had the wall there.
Even if, by chance, all of the molecules happened to be
collecting over there, we wouldn't know that that
happened, because we're not looking at the micro states.
And that's a really important thing to consider.
When someone says that a dirty room has a higher entropy than
a clean room, they're looking at the micro states.
And entropy essentially is a macro state variable.
You could just say that a room has a
certain amount of entropy.
So entropy is associated with the room, and it's only useful
when you really don't know exactly what's
going on in the room.
You just have a general sense of how much stuff there is in
the room, what's the temperature of the room,
what's the pressure in the room.
Just the general macro properties.
And then entropy will essentially tell us how many
possible micro states that macro system can actually
have. Or how much information-- and there's a
notion of information entropy-- how much information
would I have to give you to tell you what the exact micro
state is of a system at that point in time.
Well anyway.
Hopefully you found this discussion a little bit
useful, and it clears up some misconceptions about entropy,
and gives you a little bit more intuition about what it
actually is.
See you in the next video.