Of all the words I know there’s no word that makes many of my colleagues more emotional
and prone to foam at the mouth than the one I’m just about to say: consciousness.
A lot of scientists dismiss this as complete BS and as totally irrelevant and a lot of
others think this is the central thing—you have to worry about machines getting conscious
and so on.
What do I think?
I think consciousness is both irrelevant and incredibly important.
Let me explain why.
First of all, if you are chased by a heat-seeking missile it’s completely irrelevant to you
whether this heat-seeking missile is conscious, whether it’s having a subjective experience,
whether it feels like anything to be that heat-seeking missile, because all you care
about is what the heat-seeking missile does, not how it feels.
That shows that it’s a complete red herring to think that you’re safe from future AI
if it’s not conscious.
It’s its behavior you want to make sure is aligned with your goals.
On the other hand there is a way in which consciousness is incredibly important, I feel,
and there’s also a way in which it’s absolutely fascinating.
If we rewind 400 years or so, Galileo, he could’ve told you that if you throw an apple
and a hazelnut they’re going to move exactly in this shape of a parabola and he can give
you all the math for it, but he would have no clue why the apple was red and the hazelnut
was brown or why the apple was soft and the hazelnut was hard.
That seemed to him beyond science, and science back 400 years ago could only really say sensible
things about this very limited domain of phenomenon to do with motion.
Then came Maxwell's equations which told us all about light and colors and that became
within the realm of science.
Then we got to quantum mechanics, which told us why the apple is softer than the hazelnut
and all the other properties of matter, and science has gradually conquered more and more
of the natural phenomenon.
And if you ask now what science can do it’s actually a lot faster to describe what little
it is that science cannot talk about sensibly.
And I think the final frontier actually is consciousness.
People mean a lot of different things by that word, I simply mean subjective experience,
the experience of colors, sounds, emotions and so on, that it feels like something to
be me, which is quite separate from my behavior, which I could have even if I were a zombie
and didn’t experience anything at all, potentially.
So why should you care about that?
I care about it first of all because fundamentally that’s the basic thing we know about the
world: my experiences, and I would love to understand scientifically why that is and
not just leave it to philosophers.
And second, it’s incredibly important also in terms of purpose and meaning.
In the laws of physics there is nothing about meaning, there’s no equation for it and
I feel that we shouldn’t look for our universe to give meaning to us because it’s us who
give meaning to our universe because we are conscious and experiencing things.
Our universe didn’t used to be conscious, it used to be just a bunch of stuff moving
around and gradually these incredibly complicated patterns got arranged into our brains and
we woke up and now our universe is aware of itself.
We have galaxies out there that are incredibly beautiful.
Why are they beautiful?
Because we are consciously aware of them.
We see them in our telescopes.
If in the future we screw up with technology and all life goes extinct, then our universe
will go back to being meaningless and just a giant waste of space, as far as I’m concerned.
And when a colleague tells me they think consciousness is BS, I challenge them to tell me what is
wrong with rape and torture, and I ask them to explain that to me without using the word
consciousness or the word experience.
Because if they can’t talk about that, it’s just the whole thing they are saying is so
bad is just a bunch of electrons and quarks moving around in some particular way rather
than some other particular way, and what’s so bad about that?
I feel the only way we can actually have any logical, scientific foundation of ethics,
morality, purpose and meaning is precisely in terms of experience, in terms of consciousness.
And this makes it really important, as we prepare for our future, to understand what
this is.
And I for one think that this is actually something that we can also ultimately understand
scientifically.
I don’t think that the difference between a living bug and a dead bug is that the living
bug has some sort of secret life source in it; I think of the bugs as mechanisms and
the dead bug is just a broken mechanism.
Similarly I think what makes my brain conscious, but the food I ate, which got rearranged into
my brain, wasn’t conscious, isn’t because they’re made of different kind of stuff;
it’s the same quarks, rearranged, right?
It’s the pattern into which they’re arranged.
And I think it’s a scientific question: what properties does this pattern of information
processing have to have for there to be a subjective experience there?
You could imagine building a brain scanner—actually we have a pretty good ones at MIT where I
work—and having some software in it which tests out whatever theory you have for consciousness
and makes predictions for what you experience.
And if I’m sitting in this machine and the computer screen tells me, okay right now I
see information processing in your brain indicating that you are consciously aware of the thought
of an apple.
I’m like, yeah that’s right, correct.
And then it says, I see information about your heartbeat in your brain and you’re
aware of this.
And I’m like, no I was not conscious of that.
Now I’ve ruled out the theory that was implemented in the software, so it’s falsifiable, that
means it was a scientific theory.
If we can one day find a theory like this, and there are some candidates on the market
like Giulio Tononi’s Integrated Information Theory, for example, if we ever find any theory
that keeps passing tests like that and we start taking it seriously and we can use it
to build a consciousness detector, that's first of all going to be really useful.
Physicians in the emergency room would love it if they get an unresponsive patient coming
in, put them in the consciousness scanner and figure out whether they have locked-in
syndrome and just can’t communicate but they're conscious, or whether there’s nobody
home.
And this will also let us understand whether future AI systems we build are conscious and
whether we should feel guilty or not about switching them off.
Some people might prefer that their future home-helper robot is an unconscious zombie
so they don't have to feel guilty about giving it boring chores or powering it down.
Some people might prefer that it’s conscious so that it can be a positive experience in
there and so that they don’t feel creeped out by this machine just faking it and pretending
to be conscious even though it’s a zombie.
And most importantly, in the longer-term future, if far from now we have life that spreads
out from Earth to other galaxies and the whole cosmos is alive and doing amazing things,
if this life becomes the descendants of humanity, wouldn’t it suck if it turns out that this
is all just zombies with no consciousness and the whole thing that we felt so good about
before we passed away was just a play for empty benches?
I feel that we should really, really tackle this final frontier of scientific ignorance,
the problem of consciousness, and get this stuff figured out so we can shape a future
which is truly awesome—not just from the outside that cool stuff seems to be happening,
but that there’s actually someone home to experience all this.