See all Lex Fridman transcripts on Youtube

youtube thumbnail

David Chalmers: The Hard Problem of Consciousness | Lex Fridman Podcast #69

1 hours 38 minutes 48 seconds

🇬🇧 English

S1

Speaker 1

00:00

The following is a conversation with David Chalmers. He's a philosopher and cognitive scientist specializing in areas of philosophy of mind, philosophy of language, and consciousness. He's perhaps best known for formulating the hard problem of consciousness, which could be stated as, why does the feeling which accompanies awareness of sensory information exist at all? Consciousness is almost entirely a mystery.

S1

Speaker 1

00:25

Many people who worry about AI safety and ethics believe that in some form consciousness can and should be engineered into AI systems of the future. So while there's much mystery, disagreement, and discoveries yet to be made about consciousness, these conversations, while fundamentally philosophical in nature, may nevertheless be very important for engineers of modern AI systems to engage in. This is the Artificial Intelligence Podcast. If you enjoy it, subscribe on YouTube, give it 5 stars on Apple Podcast, support it on Patreon, or simply connect with me on Twitter, at Lex Friedman, spelled F-R-I-D-M-A-N.

S1

Speaker 1

01:05

As usual, I'll do 1 or 2 minutes of ads now, and never any ads in the middle that can break the flow of the conversation. I hope that works for you, and doesn't hurt the listening experience. This show is presented by Cash App, the number 1 finance app in the App Store. When you get it, use code LEXPODCAST.

S1

Speaker 1

01:23

Cash App lets you send money to friends, buy Bitcoin, and invest in the stock market with as little as $1. Brokerage services are provided by Cash App Investing, subsidiary of Square, and member SIPC. Since Cash App does fractional share trading, let me mention that the order execution algorithm that works behind the scenes to create the abstraction of fractional orders is an algorithmic marvel. So big props to the Cash App engineers for solving a hard problem that in the end provides an easy interface that takes a step up to the next layer of abstraction over the stock market, making trading more accessible for new investors and diversification much easier.

S1

Speaker 1

02:02

If you get Cash App from the App Store or Google Play and use the code LEXPODCAST, you'll get $10 and Cash App will also donate $10 to FIRST, 1 of my favorite organizations that is helping to advance robotics and STEM education for young people around the world. And now, here's my conversation with David Chalmers.

S2

Speaker 2

02:23

Do you think we're living in a simulation?

S3

Speaker 3

02:25

I don't rule it out. There's probably gonna be a lot of simulations in the history of the cosmos. If the simulation is designed well enough, it'll be indistinguishable from a non-simulated reality.

S3

Speaker 3

02:40

And although we could keep searching for evidence that we're not in a simulation, any of that evidence in principle could be simulated. So I think it's a possibility.

S2

Speaker 2

02:50

But do you think the thought experiment is interesting or useful to calibrate how we think about the nature of reality?

S3

Speaker 3

02:58

Yeah, I definitely think it's interesting and useful. In fact, I'm actually writing a book about this right now, all about the simulation idea, using it to shed light on a whole bunch of philosophical questions. So, you know, the big 1 is how do we know anything about the external world?

S3

Speaker 3

03:15

Descartes said, you know, maybe you're being fooled by an evil demon who's stimulating your brain into thinking all this stuff is real when in fact it's all made up. Well, the modern version of that is how do you know you're not in a simulation? Then the thought is, if you're in a simulation, none of this is real. So that's teaching you something about knowledge.

S3

Speaker 3

03:37

How do you know about the external world? I think there's also really interesting questions about the nature of reality right here. If we are in a simulation, is all this real? Is there really a table here?

S3

Speaker 3

03:48

Is there really a microphone? Do I really have a body? The standard view would be, no, we don't. None of this would be real.

S3

Speaker 3

03:55

My view is actually that's wrong, and even if we are in a simulation, all of this is real. That's why I call this reality 2.0. New version of reality, different version of reality, still reality.

S2

Speaker 2

04:05

So what's the difference between quote unquote real world and the world that we perceive? So we interact with the world by perceiving it. It only really exists through the window of our perception system and in our mind.

S2

Speaker 2

04:25

So it's the difference between something that's quote unquote real, that exists perhaps without us being there and the world as you perceive it.

S3

Speaker 3

04:36

Well, the world as we perceive it is a very simplified and distorted version of what's going on underneath. We already know that from just thinking about science. You know, you don't see too many, obviously, quantum mechanical effects in what we perceive, but we still know quantum mechanics is going on under all things.

S3

Speaker 3

04:53

So I like to think the world we perceive is this very kind of simplified picture of colors and shapes existing in space and so on. And we know there's a, that's what the philosopher Wilfred Sellers called the manifest image, the world as it seems to us. We already know underneath all that is a very different scientific image with atoms or quantum wave functions or super strings or whatever the latest thing is. And that's the ultimate scientific reality.

S3

Speaker 3

05:24

So I think of the simulation idea as basically another hypothesis about what the ultimate, say quasi-scientific or metaphysical reality is going on underneath the world or the manifest image. The world of the manifest image is this very simple thing that we interact with that's neutral on the underlying stuff of reality science could help tell us about that. Maybe philosophy could help tell us about that too. And if we eventually take the red pill and find out we're in a simulation, my view is that's just another view about what reality is made of.

S3

Speaker 3

05:58

The philosopher Immanuel Kant said, what is the nature of the thing in itself? I've got a glass here and it's got all these, it appears to me a certain way, a certain shape, it's liquid, it's clear. And he said,

S4

Speaker 4

06:08

what is the nature of the thing in itself? You know, I've got a glass here and it's got all these, it appears to me a certain way, a certain shape, it's liquid, it's clear. And he said, what is the nature

S3

Speaker 3

06:11

of the thing in itself? Well, I think of the simulation idea, it's a hypothesis about the nature of the thing in itself. Turns out if we're in a simulation, the thing in itself, nature of this glass, it's okay, it's actually a bunch of data structures running on a computer in the next universe up.

S3

Speaker 3

06:28

Yeah,

S2

Speaker 2

06:28

that's what people tend to do when they think about simulation, they think about our modern computers and somehow trivially, crudely just scaled up in some sense. But do you think the simulation, I mean In order to actually simulate something as complicated as our universe that's made up of molecules and atoms and particles and quarks and maybe even strings, all of that requires something just infinitely many orders of magnitude more of scale and complexity. Do you think we're even able to even conceptualize what it would take to simulate our universe?

S2

Speaker 2

07:15

Or does it just slip into this idea that you basically have to build a universe, something so big to simulate it? Does it get into this fuzzy area that's not useful at all?

S3

Speaker 3

07:28

Yeah, I mean, our universe is obviously incredibly complicated. And for us within our universe to build a simulation of a universe as complicated as ours is gonna have obvious problems here. If the universe is finite, there's just no way that's gonna work.

S3

Speaker 3

07:45

Maybe there's some cute way to make it work if the universe is infinite. Maybe an infinite universe could somehow simulate a copy of itself, but that's going to be hard. Nonetheless, just that we are in a simulation, I think there's no particular reason why we have to think the simulating universe has to be anything like ours.

S2

Speaker 2

08:06

You've said before that it might be, so you could think of it in turtles all the way down. You could think of the simulating universe different than ours, but we ourselves could also create another simulating universe. So you said that there could be these kind of levels of universes, and you've also mentioned this hilarious idea, maybe tongue in cheek, maybe not, that there may be simulations within simulations, arbitrarily stacked levels, and that we may be in level 42.

S2

Speaker 2

08:38

Along those stacks, referencing Hitchhiker's Guide to the Universe. If we're indeed in a simulation within a simulation at level 42, what do you think level 0 looks like?

S3

Speaker 3

08:51

The originating place. I would expect that level 0 is truly enormous. I mean, not just, if it's finite, it's extraordinarily large finite capacity.

S3

Speaker 3

09:01

Much more likely, it's infinite. Maybe it's got some very high set There are 2 cardinalities that enables it to support just any number of any number of simulations. So high degree of infinity at level 0 slightly slightly smaller degree of infinity at level 1. So by the time you get down to us at level 42, maybe there's plenty of room for lots of simulations of finite capacity.

S3

Speaker 3

09:29

If the top universe is only a small finite capacity, then obviously that's going to put very, very serious limits on how many simulations you're going to be able to be able to get running. So I think we can certainly confidently say that if we're at level 42, then the top level is pretty, pretty damn big.

S2

Speaker 2

09:47

So it gets more and more constrained as we get down levels, more and more simplified and constrained and limited in resources.

S3

Speaker 3

09:54

We still have plenty of capacity here. What was it? Feynman said, he said, there's plenty of room at the bottom.

S3

Speaker 3

10:01

We're still a number of levels above the degree where there's room for fundamental computing, physical computing capacity, quantum computing capacity at the bottom level. So we've got plenty of room to play with and make, we probably have plenty of room for simulations of pretty sophisticated universes, perhaps none as complicated as our universe, unless our universe is infinite, but still at the very least for pretty serious finite universes, but maybe universes somewhat simpler than ours, unless of course, we're prepared to take certain shortcuts in the simulation, which might then increase the capacity significantly.

S2

Speaker 2

10:38

Do you think the human mind, us people, in terms of the complexity of simulation, is at the height of what the simulation might be able to achieve? Like if you look at incredible entities that could be created in this universe of ours, do you have an intuition about how incredible human beings are on that scale?

S3

Speaker 3

11:00

I think we're pretty impressive, but we're not that impressive.

S2

Speaker 2

11:03

Are we above average? I

S3

Speaker 3

11:06

mean, I think kind of human beings are at a certain point in the scale of Intelligence which made many things possible, you know you get through evolution through single-cell Organisms through fish and mammals and primates and something happens once you get to human beings. We've just reached that level where we get to develop language, we get to develop certain kinds of culture, and we get to develop certain kinds of collective thinking that has enabled all this amazing stuff to happen, science and literature and engineering and culture and, and so on. So we had just at the beginning of that on the evolutionary threshold.

S3

Speaker 3

11:47

It's kind of like we just got there, you know, who knows a few thousand or tens of thousands of years ago. So we're probably just at the very beginning for what's possible there. So I'm inclined to think among the scale of intelligent beings, we're somewhere very near the bottom. I would expect that, for example, if we're in a simulation, then the simulators who created us have got the capacity to be far more sophisticated.

S3

Speaker 3

12:13

If we're at level 42, Who knows what the ones at level 0 are like.

S2

Speaker 2

12:18

It's also possible that this is the epitome of what is possible to achieve. So we as human beings see ourselves maybe as flawed, see all the constraints, all the limitations, but Maybe that's the magical, the beautiful thing. Maybe those limitations are the essential elements for an interesting, sort of that edge of chaos, that interesting existence.

S2

Speaker 2

12:41

That if you make us much more intelligent, if you make us much more powerful in any kind of dimension of performance, maybe you lose something fundamental that makes life worth living. So you kind of have this optimistic view that we're this little baby that then there's so much growth and potential. But this could also be it. This is the most amazing thing is us.

S3

Speaker 3

13:09

Maybe what you're saying is consistent with what I'm saying. I mean, we could still have levels of intelligence far beyond us, but maybe those levels of intelligence on your view would be kind of boring. And we kind of get so good at everything that life suddenly becomes unidimensional.

S3

Speaker 3

13:24

So we're just inhabiting this 1 spot of maximal romanticism in the history of evolution. You get to humans and it's like, yeah, and then years to come, our super intelligent descendants are gonna look back at us and say, those were the days when they just hit the point of inflection and life was interesting. I am an optimist, so I'd like to think that, you know, If there is super intelligence somewhere in the future, they'll figure out how to make life super interesting and super romantic. Well, you know what they're

S2

Speaker 2

13:53

gonna do. So what they're gonna do is they realize how boring life is when you're super intelligent, so they create a new level of a simulation and sort of live through the things they've created by watching them stumble about in their flawed ways. So maybe that's, so you create a new level of a simulation and sort of live through the things they've created by watching them stumble about in their flawed ways.

S2

Speaker 2

14:11

So maybe that's, so you create a new level of a simulation every time you get really bored with how smart and-

S3

Speaker 3

14:17

This would be kind of sad though, because it would show the peak of their existence would be like watching simulations for entertainment. It's like saying the peak of our existence now is Netflix. No,

S2

Speaker 2

14:27

a flip side of that could be the peak of our existence for many people having children and watching them grow. That becomes very meaningful.

S3

Speaker 3

14:36

So. Okay, you create a simulation, it's like creating a family.

S2

Speaker 2

14:38

Creating like, well, any kind of creation is kind of a powerful act. Do you think it's easier to simulate the mind or the universe? So I've heard several people, including Nick Blossom, think about ideas of, you know, maybe you don't need to simulate the universe, you can just simulate the human mind.

S2

Speaker 2

14:57

Or in general, just the distinction between simulating the entirety of it, the entirety of the physical world, or just simulating the mind? Which 1 do you see as more challenging?

S3

Speaker 3

15:09

Well, I think in some sense the answer is obvious. It has to be simpler to simulate the mind than to simulate the universe, because the mind is part of the universe. And in order to fully simulate the universe, you're gonna have to simulate the mind.

S3

Speaker 3

15:22

So unless we're talking about partial simulations.

S2

Speaker 2

15:25

And I guess the question is which comes first? Does the mind come before the universe or does the universe come before the mind? So the mind could just be an emergent phenomena in this universe.

S2

Speaker 2

15:38

So simulation is an interesting thing. It's not like creating a simulation perhaps requires you to program every single thing that happens in it. It's just defining a set of initial conditions and rules based on which it behaves. Simulating the mind requires you to have a little bit more, we're now in a little bit of a crazy land, but it requires you to understand the fundamentals of cognition, perhaps of consciousness, of perception of everything like that, that's me, that's not created through some kind of emergence from basic physics laws, but more requires you to actually understand the fundamentals of the mind.

S3

Speaker 3

16:29

How about if we said to simulate the brain rather than the mind? The brain is just a big physical system. The universe is a giant physical system.

S3

Speaker 3

16:38

To simulate the universe, at the very least, you're gonna have to simulate the brains as well as all the other physical systems within it. And it's not obvious that the problems are any worse for the brain than for, it's a particularly complex physical system, but if we can simulate arbitrary physical systems, we can simulate brains. There is this further question of whether when you simulate a brain, will that bring along all the features of the mind with it? Like will you get consciousness?

S3

Speaker 3

17:08

Will you get thinking? Will you get free will? And so on. And that's something philosophers have argued over for years.

S3

Speaker 3

17:17

My own view is if you simulate the brain well enough, that will also simulate the mind. But yeah, there's plenty of people who would say no. You'd merely get like a zombie system, a simulation of a brain without any true consciousness.

S2

Speaker 2

17:31

But for you, you put together a brain, the consciousness comes with it, arise.

S3

Speaker 3

17:36

Yeah, I don't think it's obvious.

S2

Speaker 2

17:38

That's your intuition.

S3

Speaker 3

17:39

My view is roughly that, yeah, what is responsible for consciousness, it's in the patterns of information processing and so on, rather than say the biology that it's made of. There's certainly plenty of people out there who think consciousness has to be say biological. So if you merely replicate the patterns of information processing in a non-biological substrate, you'll miss what's crucial for consciousness.

S3

Speaker 3

18:02

I mean, I just don't think there's any particular reason to think that biology is special here. You can imagine substituting the biology for non-biological systems, say silicon circuits, that play the same role. The behavior will continue to be the same. And I think just thinking about what is the true, when I think about the connection, the isomorphisms between consciousness and the brain, the deepest connections to me seem to connect consciousness to patterns of information processing, not to specific biology.

S3

Speaker 3

18:32

So I at least adopted as my working hypothesis that basically it's the computation and the information that matters for consciousness. Same time, we don't understand consciousness, so all this could be wrong.

S2

Speaker 2

18:43

So the computation, the flow, the processing, manipulation of information, the process is where the consciousness, the software is where the consciousness comes from, not the hardware.

S3

Speaker 3

18:57

Roughly the software, yeah. The patterns of information processing, at least in the hardware, which we could view as software. It may not be something you can just like program and load and erase and so on in the way we can with ordinary software, but it's something at the level of information processing rather than at the level of implementation.

S3

Speaker 3

19:17

So on that, what do

S2

Speaker 2

19:19

you think of the experience of self, just the experience of the world in a virtual world, in virtual reality? Is it possible that we can create sort of offsprings of our consciousness by existing in a virtual world long enough? So yeah, can we be conscious in the same kind of deep way that we are in this real world by hanging out in a virtual world?

S3

Speaker 3

19:51

Yeah, well the kind of virtual worlds we have now are interesting but limited in certain ways. In particular, they rely on us having a brain and so on, which is outside the virtual world. Maybe I'll strap on my VR headset or just hang out in a virtual world on a screen, but my brain and then my physical environment might be simulated if I'm in a virtual world.

S3

Speaker 3

20:17

But right now, there's no attempt to simulate my brain. I might, there might be some non-player characters in these virtual worlds that have simulated cognitive systems of certain kinds that dictate their behavior. But you know, mostly they're pretty simple right now. I mean, some people are trying to combine, put a bit of AI in their non-player characters to make them smarter.

S3

Speaker 3

20:39

But for now, inside virtual worlds, the actual thinking is interestingly distinct from the physics of those virtual worlds. In a way, actually, I like to think this is kind of reminiscent of the way that Descartes thought our physical world was. There's physics and there's the mind and they're separate. Now we think the mind is somehow connected to physics pretty deeply, But in these virtual worlds, there's a physics of a virtual world.

S3

Speaker 3

21:02

And then there's this brain, which is totally outside the virtual world that controls it and interacts it. When anyone exercises agency in a video game, that's actually somebody outside the virtual world moving a controller, controlling the interaction of things inside the virtual world. So right now in virtual worlds, the mind is somehow outside the world. But you could imagine in the future, once we have developed serious AI, artificial general intelligence and so on, then we could come to virtual worlds which have enough sophistication, you could actually simulate a brain or have a genuine AGI, which would then presumably be able to act in equally sophisticated ways, maybe even more sophisticated ways inside the virtual world to how it might in the physical world.

S3

Speaker 3

21:51

And then the question's gonna come along, that'll be kind of a VR, a virtual world internal intelligence, and then the question is, could they have consciousness, experience, intelligence, free will, all the things that we have? And again, my view is I don't see why not.

S2

Speaker 2

22:08

To linger on it a little bit, I find virtual reality really incredibly powerful. Just even the crude virtual reality we have now. Perhaps there's psychological effects that make some people more amenable to virtual worlds than others, but I find myself wanting to stay in virtual worlds

S3

Speaker 3

22:28

for the

S2

Speaker 2

22:28

most part. Yes.

S3

Speaker 3

22:29

So I- With a headset or

S4

Speaker 4

22:31

on a desktop? No, with

S3

Speaker 3

22:32

a headset. Really interesting, because I am totally addicted to using the internet and things on a desktop. But when it comes to VR for the headset, I don't typically use it for more than 10 or 20 minutes.

S3

Speaker 3

22:45

There's something just slightly aversive about it I find. So I don't, right now, even though I have Oculus Rift and Oculus Quest and HTC Vive and Samsung this and that.

S2

Speaker 2

22:55

I wanna stay in that world. For extended periods,

S3

Speaker 3

22:58

you actually find yourself.

S2

Speaker 2

23:01

The something about it, it's a both a combination of just imagination and considering the possibilities of where this goes in the future. It feels like I want to almost prepare my brain for it. I want to explore sort of Disneyland when it's first being built in the early days.

S2

Speaker 2

23:23

And it feels like I'm walking around almost imagining the possibilities and something through that process allows my mind to really enter into that world. But you say that the brain's external to that virtual world.

S3

Speaker 3

23:41

It is, strictly speaking, true. But If you're in VR and you do brain surgery on an avatar, and you're gonna open up that skull, what are you gonna find? Sorry, nothing there.

S3

Speaker 3

23:53

Nothing. The brain is elsewhere.

S2

Speaker 2

23:55

You don't think it's possible to kind of separate them. And I don't mean in a sense like Descartes, like a hard separation, but basically, do you think it's possible with the brain outside of the virtual, when you're wearing a headset, create a new consciousness for prolonged periods of time. Really feel, like really experience, like forget that your brain is outside.

S3

Speaker 3

24:26

So this is, okay, this is gonna be the case where the brain is still outside. Still outside. But could living in the VR, I mean, we already find this, right, with video games.

S2

Speaker 2

24:35

Exactly.

S3

Speaker 3

24:35

They're completely immersive, and you get taken up by living in those worlds, and

S2

Speaker 2

24:40

it becomes your reality for a while. So they're not completely immersive, they're just very immersive.

S3

Speaker 3

24:46

Completely immersive. You don't forget the external world, no.

S2

Speaker 2

24:48

Exactly, so that's what I'm asking you. It's almost possible to really forget the external world, really, really immerse yourself.

S3

Speaker 3

24:58

To forget completely? Why would we forget? You know, We've got pretty good memories.

S3

Speaker 3

25:02

Maybe you can stop paying attention to the external world, but this already happens a lot. I go to work and maybe I'm not paying attention to my home life. I go to a movie and I'm immersed in that. So that degree of immersion, absolutely, but we still have the capacity to remember it, to completely forget the external world.

S3

Speaker 3

25:21

I'm thinking that would probably take some, I don't know, some pretty serious drugs or something to make your brain do that.

S2

Speaker 2

25:27

Is it possible? So, I mean, I guess I'm getting at, is consciousness truly a property that's tied to the physical brain? Or can you create sort of different offspring copies of consciousnesses based on the worlds that you enter?

S3

Speaker 3

25:49

Well, the way we're doing it now, at least with a standard VR, there's just 1 brain. Interacts with the physical world, plays a video game, puts on a video headset, interacts with this virtual world. And I think we'd typically say there's 1 consciousness here that nonetheless undergoes different environments, takes on different characters, in different environments.

S3

Speaker 3

26:11

This is already something that happens in the non-virtual world. I might interact 1 way in my home life, my work life, social life, and so on. So at the very least, that will happen in a virtual world very naturally. People sometimes adopt a character of avatars very different from themselves, maybe even a different gender, different race, different social background.

S3

Speaker 3

26:36

So that much is certainly possible. I would see that as a single consciousness as it's taking on different personas. If you want literal splitting of consciousness into multiple copies, I think it's gonna take something more radical than that. Like, maybe you can run different simulations of your brain in different realities and then expose them to different histories.

S3

Speaker 3

26:57

And then, you'd split yourself into 10 different simulated copies, which then undergo different environments and then ultimately do become 10 very different consciousnesses. Maybe that could happen, but now we're not talking about something that's possible in the near term. We're gonna have to have brain simulations and AGI for that to happen.

S2

Speaker 2

27:17

Got it, so before any of that happens, it's fundamentally, you see it as a singular consciousness, even though it's experiencing different environments, which are not, it's still connected to same set of memories, same set of experiences, and therefore, 1 sort of joint conscious system.

S3

Speaker 3

27:38

Yeah, or at least no more multiple than the kind of multiple consciousness that we get from inhabiting different environments

S2

Speaker 2

27:45

in a non-virtual world. So you said as a child, you were a music color... Synesthete.

S2

Speaker 2

27:52

Synesthete. So where songs had colors for you. So what songs had what colors?

S3

Speaker 3

27:59

You know, This is funny. I didn't pay much attention to this at the time, but I'd listen to a piece of music and I'd get some kind of imagery of a, of a kind of a, of a kind of, of color. The weird thing is mostly they were

S4

Speaker 4

28:14

kind of

S3

Speaker 3

28:15

murky, dark greens and olive browns and the colors weren't all that interesting. I don't know what the reason is. I mean my theory is that maybe it's like different chords and tones provided different colors and they all tended to get mixed together into these somewhat uninteresting browns and greens.

S3

Speaker 3

28:33

But every now and then, there'd be something that had a really pure color. So this is the few that I remember. There was a Here, There and Everywhere by the Beatles was bright red. It has this very distinctive tonality and it's called structure at the beginning.

S3

Speaker 3

28:49

So that was bright red. There was this song by the Alan Parsons project called Ammonia Avenue. That was kind of a pure blue. Anyway, I've got no idea how this happened.

S3

Speaker 3

29:01

I didn't even pay that much attention until it went away when I was about

S1

Speaker 1

29:04

20.

S3

Speaker 3

29:05

This synesthesia often goes away.

S2

Speaker 2

29:07

So is it purely just the perception of a particular color or was there a positive or negative experience with it? Like was blue associated with a positive and red with a negative? Or is it simply the perception of color associated with some characteristic of the song?

S3

Speaker 3

29:23

For me, I don't remember a lot of association with emotion or with value. It's just this kind of weird and Interesting fact. I mean, at the beginning, I thought this was something that happened to everyone.

S3

Speaker 3

29:33

Songs of colors, maybe I mentioned it once or twice and people said, nope. That's what it was like. I thought it was kind of cool when there was 1 that had 1 of these especially pure colors, but Only much later, once I became a grad student, thinking about the mind, did I read about this phenomenon called synesthesia. And it's like, hey, that's what I had.

S3

Speaker 3

29:53

And now I occasionally talk about it in my classes, in intro class, and it still happens sometimes. A student comes up and says, Hey, I have that. I never knew about that. I never knew it had a name.

S3

Speaker 3

30:04

You said

S2

Speaker 2

30:04

that it went away at age 20 or so. And that you have a journal entry from around then saying songs don't have colors anymore. What happened?

S3

Speaker 3

30:15

What happened? Yeah, it was definitely sad that it was gone, that in retrospect, it

S2

Speaker 2

30:19

was like, hey, that's cool, the colors have gone. Yeah, do you, can you think about that for a little bit? Do you miss those experiences?

S2

Speaker 2

30:26

Because it's a fundamentally different sets of experiences that you no longer have? Or is it just a nice thing to have had? You don't see them as that fundamentally different than you visiting a new country and experiencing new environments?

S3

Speaker 3

30:45

I guess for me, when I had these experiences, they were somewhat marginal. They were like a little bonus kind of experience. I know there are people who have much more serious forms of synesthesia than this, for whom it's absolutely central to their lives.

S3

Speaker 3

30:59

I know people who, when they experience new people, they have colors, maybe they have tastes, and so on. Every time they see writing, it has colors. Some people, whenever they hear music, it's got a certain really rich color pattern, and for some synesthetes, it's absolutely central. I think if they lost it, they'd be devastated.

S3

Speaker 3

31:20

Again, for me, it was a very, very mild form of synesthesia and it's like, yeah, it's like those interesting experiences you might get under different altered states of consciousness and so on, it's kind of cool, but not necessarily the single most important experiences in your life.

S2

Speaker 2

31:39

Got it, so let's try to go to the very simplest question that you've answered many times, but perhaps the simplest things can help us reveal, even in time, some new ideas. So what, in your view, is consciousness? What is qualia?

S2

Speaker 2

31:56

What is the hard problem of consciousness?

S3

Speaker 3

32:00

Consciousness, I mean, the word is used many ways, but the kind of consciousness that I'm interested in is basically subjective experience. What it feels like from the inside to be a human being or any other conscious being. I mean there's something it's like to be me right now.

S3

Speaker 3

32:19

I have visual images that I'm Experiencing I'm hearing my voice. I've got Maybe some emotional tone. I've got a stream of thoughts Running through my head. These are all things that I experience from the first person point of view.

S3

Speaker 3

32:36

I've sometimes called this the inner movie in the mind. It's not a perfect metaphor, it's not like a movie in every way and it's very rich. But yeah, it's just direct, subjective experience. And I call that consciousness, or sometimes philosophers use the word qualia, which you suggested.

S3

Speaker 3

32:55

People tend to use the word qualia for things like the qualities of things like colors, Redness, the experience of redness versus the experience of greenness. The experience of 1 taste or 1 smell versus another. The experience of the quality of pain. And yeah, a lot of consciousness is the experience of those qualities.

S2

Speaker 2

33:16

Well, consciousness is bigger, the entirety of any kind of experience.

S3

Speaker 3

33:20

Consciousness of thinking is not obviously qualia. It's not like specific qualities like redness or greenness, but still I'm thinking about my hometown, I'm thinking about what I'm gonna do later on. Maybe there's still something running through my head, which is subjective experience.

S3

Speaker 3

33:36

Maybe it goes beyond those qualities or qualia. Philosophers sometimes use the word phenomenal consciousness for consciousness in this sense. I mean, people also talk about access consciousness, being able to access information in your mind, reflective consciousness, being able to think about yourself. But it looks like the really mysterious 1, the 1 that really gets people going is phenomenal consciousness.

S3

Speaker 3

33:58

The fact that all this, the fact that there's subjective experience and all this feels like something at all. And then the hard problem is, how is it that, why is it that there is phenomenal consciousness at all? And how is it that physical processes in a brain could give you subjective experience? It looks like on the face of it, you'd have all this big complicated physical system in a brain running without it giving subjective experience at all.

S3

Speaker 3

34:28

And yet we do have subjective experience. So the hard problem is just explain that.

S2

Speaker 2

34:34

Explain how that comes about. We haven't been able to build machines where a red light goes on that says it's not conscious. So how do we actually create that?

S2

Speaker 2

34:45

Or how do humans do it and how do we ourselves do it? But- We

S3

Speaker 3

34:48

do every now and then create machines that can do this. You know, we create babies that are conscious. They've got these brains.

S3

Speaker 3

34:56

As best as we

S4

Speaker 4

34:57

can tell. That brain

S3

Speaker 3

34:57

does produce consciousness, but even though we can create it, we still don't understand why it happens. Maybe eventually we'll be able to create machines, which as a matter of fact, AI machines, which as a matter of fact are conscious, but that won't necessarily make the hard problem go away any more than it does with babies, because we still want to know how and why is it that these processes give you consciousness? You

S2

Speaker 2

35:19

know, you just made me realize for a second, maybe it's a totally dumb realization, but nevertheless, that it's a useful way to think about the creation of consciousness, is looking at a baby, so that there's a certain point at which that baby is not conscious. The baby starts from maybe, I don't know, from a few cells, right? There's a certain point at which it becomes consciousness arrives, it's conscious.

S2

Speaker 2

35:54

Of course, we can't know exactly that line, but it's a useful idea that we do create consciousness. Again, a really dumb thing for me to say, but not until now did I realize we do engineer consciousness.

S4

Speaker 4

36:09

We

S2

Speaker 2

36:09

get to watch the process happen. We don't know which point it happens or where it is, but we do see the birth of consciousness.

S3

Speaker 3

36:19

Yeah, I mean, there's a question, of course, is whether babies are conscious when they're born. And it used to be, it seems, at least some people thought they weren't, which is why they didn't give anesthetics to newborn babies when they circumcised them. And so now people think, oh, that's incredibly cruel.

S3

Speaker 3

36:37

Of course, babies feel pain. And now the dominant view is that the babies can feel pain. Actually, my partner Claudia works on this whole issue of whether there's consciousness in babies and of what kind. And she certainly thinks that newborn babies

S4

Speaker 4

36:53

come into

S3

Speaker 3

36:53

the world with some degree of consciousness. Of course, then you can just extend the question backwards to fetuses and suddenly you're into politically controversial territory. But the question also arises in the animal kingdom.

S3

Speaker 3

37:06

Where does consciousness start or stop? Is there a line in the animal kingdom where the first conscious organisms are? It's interesting, over time, people are becoming more and more liberal about ascribing consciousness to animals. People used to think, maybe only mammals could be conscious.

S3

Speaker 3

37:24

Now most people seem to think, sure, fish are conscious, they can feel pain, and now we're arguing over insects. You'll find people out there who say plants have some degree of consciousness. So you know, who knows where it's gonna end. The far end of this chain is the view that every physical system has some degree of consciousness.

S3

Speaker 3

37:43

Philosophers call that panpsychism. You know, I take that view.

S2

Speaker 2

37:48

I mean, that's a fascinating way to view reality. So if you could talk about, if you can linger on panpsychism for a little bit, what does it mean, so it's not just plants are conscious. I mean, it's that consciousness is a fundamental fabric of reality.

S2

Speaker 2

38:05

What does that mean to you? How do we supposed to think about that?

S3

Speaker 3

38:09

Well, we're used to the idea that some things in the world are fundamental, right? In physics like what We take things like space or time or space time, mass, charges, fundamental properties of the universe. You don't reduce them to something simpler.

S3

Speaker 3

38:25

You take those for granted. You've got some laws that connect them. Here is how mass and space and time evolve. Theories like relativity or quantum mechanics or some future theory that will unify them both.

S3

Speaker 3

38:39

But everyone says you gotta take some things as fundamental. And if you can't explain 1 thing in terms of the previous fundamental things, you have to expand. Maybe something like this happened with Maxwell. Ended up with fundamental principles of electromagnetism and took charge as fundamental, because it turned out that was the best way to explain it.

S3

Speaker 3

39:00

So I at least take seriously the possibility something like that could happen with consciousness. Take it as a fundamental property like space, time, and mass and instead of trying to explain consciousness wholly in terms of the evolution of space, time, and mass and so on, take it as a primitive and then connect it to everything else by some fundamental laws. I mean, there's basic, there's this basic problem that the physics we have now looks great for solving the easy problems of consciousness, which are all about behavior, right? Struct, They give us a complicated structure and dynamics, they tell us how things are going to behave, what kind of observable behavior they'll produce, which is great for the problems of explaining how we walk and how we talk and so on.

S3

Speaker 3

39:48

Those are the easy problems of consciousness. But the hard problem was this problem about subjective experience just doesn't look like that kind of problem about structure, dynamics, how things behave. So it's hard to see how existing physics is gonna give you a full explanation of that.

S2

Speaker 2

40:04

Certainly trying to get a physics view of consciousness, yes, there has to be a connecting point and it could be at the very axiomatic, at the very beginning level. But, I mean, first of all, there's a crazy idea that sort of everything has properties of consciousness. At that point, the word consciousness is already beyond the reach of our current understanding.

S2

Speaker 2

40:33

Like far, because it's so far from, at least for me, maybe you can correct me, it's far from the experiences that we have, that I have as a human being. To say that everything is conscious, that means that basically, another way to put that, if that's true, then we understand almost nothing about that fundamental aspect of the world.

S3

Speaker 3

41:00

How do you feel about saying an ant is conscious? Do you get the same reaction to that or is that something you can understand?

S2

Speaker 2

41:05

I can understand ant, I can't understand an atom.

S3

Speaker 3

41:10

A plant.

S2

Speaker 2

41:11

A particle. So I'm comfortable with living things on Earth being conscious because there's some kind of agency where they're similar size to me and they can be born and they can die, And that is understandable intuitively. Of course, you anthropomorphize, you put yourself in the place of the plant.

S2

Speaker 2

41:41

But I can understand it.

S4

Speaker 4

41:45

I mean, I'm not like,

S2

Speaker 2

41:45

I don't believe actually that plants are conscious or that plants suffer, but I can understand that kind of belief, that kind of idea.

S3

Speaker 3

41:53

How do you feel about robots? Like the kind of robots we have now? If I told you like that Arumba had some degree of consciousness.

S3

Speaker 3

42:02

Or some deep neural network.

S2

Speaker 2

42:05

I could understand that Arumba has consciousness. I just had spent all day at iRobot. And I mean, I personally love robots and have a deep connection with robots.

S2

Speaker 2

42:16

So I can, I also probably anthropomorphize them? There's something about the physical object. So there's a difference than a neural network, a neural network running a software. To me, the physical object, something about the human experience allows me to really see that physical object as an entity.

S2

Speaker 2

42:36

And if it moves, and moves in a way that it, there's a, like I didn't program it, where it feels that it's acting based on its own perception and yes, self-awareness and consciousness, even if it's a Roomba, then you start to assign it to some agency, some consciousness. So, but to say that panpsychism, that consciousness is a fundamental property of reality is a much bigger statement. That it's like turtles all the way, it's like every, it doesn't end, the whole thing is, so like how, I know it's full of mystery, but if you can linger on it, like how would it, how do you think about reality if consciousness is a fundamental part of its fabric?

S3

Speaker 3

43:31

The way you get there is from thinking, can we explain consciousness given the existing fundamentals and then if you can't, as at least right now it looks like, then you've got to add something. It doesn't follow that you have to add consciousness. Here's another interesting possibility is, well, we'll add something else.

S3

Speaker 3

43:47

Let's call it proto-consciousness or X. And then it turns out space, time, mass, plus X will somehow collectively give you the possibility for consciousness. Why don't we allow that view? Either I call that pan-proto-psychism because maybe there's some other property, proto-consciousness at the bottom level.

S3

Speaker 3

44:08

And if you can't imagine there's actually genuine consciousness at the bottom level, I think we should be open to the idea there's this other thing, X. Maybe we can't imagine that somehow gives you consciousness. But if we are playing along with the idea that there really is genuine consciousness at the bottom level, of course, this is going to be way out and speculative, but at least in, say, If it was classical physics, then you'd end up saying, well, every little atom, with a bunch of particles in space-time, each of these particles has some kind of consciousness whose structure mirrors maybe their physical properties, like its mass, its charge, its velocity, and so on. The structure of its consciousness would roughly correspond to that.

S3

Speaker 3

44:52

And the physical interactions between particles. There's this old worry about physics, I mentioned this before in this issue about the manifest image, we don't really find out about the intrinsic nature of things. Physics tells us about how a particle relates to other particles and interacts. It doesn't tell us about what the particle is in itself.

S3

Speaker 3

45:12

That was Kant's thing in itself. So here's a view. The nature in itself of a particle is something mental. A particle is actually a little conscious subject with properties of its consciousness that correspond to its physical properties.

S3

Speaker 3

45:29

The laws of physics are actually ultimately relating these properties of conscious subjects. So in this view, a Newtonian world would actually be a vast collection of little conscious subjects at the bottom level, way, way simpler than we are without free will or rationality or anything like that. But that's what the universe would be like. Of course, that's a vastly speculative view.

S3

Speaker 3

45:51

No particular reason to think it's correct. Furthermore, non-Newtonian physics, say quantum mechanical wave function, suddenly it starts to look different. It's not a vast collection of conscious subjects. Maybe there's ultimately 1 big wave function for the whole universe.

S3

Speaker 3

46:06

Corresponding to that might be something more like a single conscious mind whose structure corresponds to the structure of the wave function. People sometimes call this cosmo-psychism. And now, of course, we're in the realm of extremely speculative philosophy, there's no direct evidence for this, but if you want a picture of what that universe would be like, think yeah, giant cosmic mind with enough richness and structure among it to replicate all the structure of physics.

S2

Speaker 2

46:36

I think therefore I am at the level of particles and with quantum mechanics at the level of the wave function. It's kind of an exciting, beautiful possibility, of course, way out of reach of physics currently.

S3

Speaker 3

46:51

It is interesting that some neuroscientists are beginning to take panpsychism seriously. You find consciousness even in very simple systems. So for example, the integrated information theory of consciousness, a lot of neuroscientists are taking seriously.

S3

Speaker 3

47:08

Actually, I just got this new book by Christoph Koch, just came in, The Feeling of Life Itself, Why Consciousness is Widespread but can't be computed. He basically endorses a panpsychist view where you get consciousness with the degree of information processing or integrated information processing in a system, and even very, very simple systems, like a couple of particles, will have some degree of this. So he ends up with some degree of consciousness in all matter and the claim is that this theory can actually explain a bunch of stuff about the connection between the brain and consciousness. Now that's very controversial, I think it's very, very early days in the science of consciousness.

S3

Speaker 3

47:47

It's interesting that it's not just philosophy that might lead you in this direction, but there are ways of thinking quasi-scientifically that lead you there too.

S2

Speaker 2

47:57

But maybe it's different than panpsychism. What do you think? So Alan Watts has this quote that I'd like to ask you about.

S2

Speaker 2

48:06

The quote is, through our eyes, the universe is perceiving itself. Through our ears, the universe is listening to its harmonies. We are the witnesses to which the universe becomes conscious of its glory, of its magnificence. So that's not panpsychism.

S2

Speaker 2

48:24

Do you think that we are essentially the tools, the senses the universe created to be conscious of itself.

S3

Speaker 3

48:35

It's an interesting idea. Of course, if you went for the giant cosmic mind view, then the universe was conscious all along. It didn't need us, we're just little components of the universal consciousness.

S3

Speaker 3

48:48

Likewise, if you believe in panpsychism, then there was some little degree of consciousness at the bottom level all along, and we were just a more complex form of consciousness. So I think maybe the quote you mentioned works better. If you're not a panpsychist, you're not a cosmopsychist, you think consciousness just exists at this intermediate level, and

S2

Speaker 2

49:09

of course that's the orthodox view. That you would say is the common view, so Is your own view of panpsychism a rarer view?

S3

Speaker 3

49:19

I think it's generally regarded, certainly, as a speculative view held by a fairly small minority of at least theorists, philosophers, most philosophers and most scientists who think about consciousness are not panpsychics. There's been a bit of a movement in that direction the last 10 years or so. Seems to be quite popular, especially among the younger generation, but it's still very definitely a minority view.

S3

Speaker 3

49:43

Many people think it's totally bat shit crazy to use the technical term. But- It's

S2

Speaker 2

49:50

a philosophical term.

S3

Speaker 3

49:51

So the orthodox view I think is still consciousness is something that humans have and some good number of non-human animals have and maybe AIs might have 1 day, but it's restricted. On that view, then there was no consciousness at the start of the universe. There may be none at the end, but it is this thing which happened at some point in the history of the universe, consciousness developed.

S3

Speaker 3

50:13

And yes, that's a very amazing event on this view because many people are inclined to think consciousness is what somehow gives meaning to our lives. Without consciousness, there'd be no meaning, no true value, no good versus bad, and so on. So with the advent of consciousness, suddenly the universe went from meaningless to somehow meaningful. Why did this happen?

S3

Speaker 3

50:39

I guess the quote you mentioned was somehow, this was somehow destined to happen because the universe needed to have consciousness within it, to have value and have meaning. And maybe you could combine that with a theistic view or a teleological view. The universe was inexorably evolving towards consciousness. Actually, my colleague here at NYU, Tom Nagel, wrote a book called Mind and Cosmos

S4

Speaker 4

51:03

a few

S3

Speaker 3

51:03

years ago where he argued for this teleological view of evolution toward consciousness, saying this led to problems for Darwinism. It's got him on, you know, this is very, very controversial. Most people didn't agree.

S3

Speaker 3

51:16

I don't myself agree with this teleological view, but it is at least a beautiful speculative view of the cosmos. What do you think people

S2

Speaker 2

51:28

experience, What do they seek when they believe in God from this kind of perspective?

S3

Speaker 3

51:35

I'm not an expert on thinking about God and religion. I'm not myself religious at all. When people sort

S2

Speaker 2

51:44

of pray, communicate with God, which whatever form, I'm not speaking to sort of the practices and the rituals of religion. I mean the actual experience of that people really have a deep connection with God in some cases. What do you think that experience is?

S2

Speaker 2

52:06

It's so common, at least throughout the history of civilization, that it seems like we seek that.

S3

Speaker 3

52:16

At the very least, it's an interesting conscious experience that people have when they experience religious awe or prayer and so on. Neuroscientists have tried to examine what bits of the brain are active and so on. But yeah, there's this deeper question of what are people looking for when they're doing this?

S3

Speaker 3

52:36

And like I said, I've got no real expertise on this, but it does seem that 1 thing people are after is a sense of meaning and value, a sense of connection to something greater than themselves that will give their lives meaning and value. And maybe the thought is if there is a God, then God somehow is a universal consciousness who has invested this universe with meaning and somehow connection to God might give your life meaning. I think that's a, I can kind of see the attractions of that but still makes me wonder why is it exactly that a universal consciousness, God, would be needed to give the world meaning. If universal consciousness can give the world meaning, why can't local consciousness give the world meaning too?

S3

Speaker 3

53:25

So I think my consciousness

S2

Speaker 2

53:26

gives my world meaning. Is the origin of meaning for your world.

S3

Speaker 3

53:30

Yeah, I experience things as good or bad, happy, sad, interesting, important. So my consciousness invests this world with meaning. Without any consciousness, maybe it would be a bleak, meaningless universe.

S3

Speaker 3

53:45

But I don't see why I need someone else's consciousness or even God's consciousness to give this universe meaning. Here we are, local creatures with our own subjective experiences. I think we can give the universe meaning ourselves. So, I mean, maybe to some people that feels inadequate.

S3

Speaker 3

54:01

Yeah, our own local consciousness is somehow too puny and insignificant to invest any of this with cosmic significance and maybe God gives you a sense of cosmic significance, but I'm just speculating here.

S2

Speaker 2

54:15

So the, you know, it's a really interesting idea that consciousness is the thing that makes life meaningful. If you could maybe just briefly explore that for a second. So I suspect just from listening to you now, you mean in an almost trivial sense, just the day-to-day experiences of life have, because of you attach identity to it, they become, well, I guess I want to ask something I would always wanted to ask a legit world renowned philosopher, what is the meaning of life?

S2

Speaker 2

55:04

So I suspect you don't mean consciousness gives any kind of greater meaning to it all. And more to day to day. But is there greater meaning to it all?

S3

Speaker 3

55:16

I think life has meaning for us because we are conscious. So without consciousness, no meaning. Consciousness invests our life with meaning.

S3

Speaker 3

55:27

So consciousness is the source of the meaning of life. But I wouldn't say consciousness itself is the meaning of life. I'd say what's meaningful in life is basically what we find meaningful, what we experience as meaningful. So if you find meaning and fulfillment and value in say intellectual work, like understanding, then that's a very significant part of the meaning of life for you.

S3

Speaker 3

55:53

If you find it in social connections or in raising a family, then that's the meaning of life for you. The meaning kind of comes from what you value as a conscious creature. So I think there's no, on this view, there's no universal solution. You'd know universal answer to the question, what is the meaning of life?

S3

Speaker 3

56:11

The meaning of life is where you find it as a conscious creature. But it's consciousness that somehow makes value possible. Experiencing some things as good or as bad or as meaningful, somehow comes from within consciousness.

S2

Speaker 2

56:24

So you think consciousness is a crucial component, ingredient of assigning value to things?

S3

Speaker 3

56:33

I mean, it's kind of a fairly strong intuition that without consciousness, there wouldn't really be any value if we just had a purely universe of unconscious creatures. Would anything be better or worse than anything else? Certainly when it comes to ethical dilemmas, you know about the old trolley problem.

S3

Speaker 3

56:54

Do you kill 1 person or do you switch to the other track to kill 5? Well, I've got a variant on this, the zombie trolley problem, where there's 1 conscious being on 1 track and 5 humanoid zombies, let's make them robots, who are not conscious on the other track. Do you, given that choice, do you kill the 1 conscious being or the 5 unconscious robots? Most people have a fairly clear intuition here.

S3

Speaker 3

57:23

Kill the unconscious beings, because they basically, they don't have a meaningful life. They're not really persons, conscious beings at all. Of course,

S2

Speaker 2

57:33

we don't have good intuition about something like an unconscious being. So in philosophical terms, you refer to it as a zombie. It's a useful thought experiment, construction in philosophical terms, but we don't yet have them.

S2

Speaker 2

57:55

So that's kind of what we may be able to create with robots. And I don't necessarily know what that even means.

S3

Speaker 3

58:05

Yeah, they're merely hypothetical for now. They're just a thought experiment. They may never be possible.

S3

Speaker 3

58:10

I mean, the extreme case of a zombie is a being which is physically, functionally, behaviorally identical to me, but not conscious. That's a mere, I don't think that could ever be built in this universe. The question is just, does that hypothetically make sense? That's kind of a useful contrast class to raise questions like, why aren't we zombies?

S3

Speaker 3

58:31

How does it come about that we're conscious? And we're not like that. But there are less extreme versions of this, like robots, which are maybe not physically identical to us, maybe not even functionally identical to us. Maybe they've got a different architecture, but they can do a lot of sophisticated things, maybe carry on a conversation, but they're not conscious.

S3

Speaker 3

58:50

That's not so far out. We've got simple computer systems, at least tending in that direction now. And presumably, this is going to get more and more sophisticated over years to come, where we may have some pretty, at least quite straightforward to conceive of some pretty sophisticated robot systems that can use language and be fairly high functioning without consciousness at all. Then I stipulate that.

S3

Speaker 3

59:17

I mean, we call, there's this tricky question of how you would know whether they're conscious. But let's say we somehow solve that, and we know that these high-functioning robots aren't conscious, then the question is, do they have moral status? Does it matter how we treat them? You know, what does moral

S2

Speaker 2

59:33

status mean, say?

S3

Speaker 3

59:35

Does, basically, it's that question.

S4

Speaker 4

59:37

Can they suffer? Does it matter how we treat them? What does moral status mean, sir?

S4

Speaker 4

59:37

Does basically

S3

Speaker 3

59:37

that question, can they suffer? Does it matter how we treat them? For example, if I mistreat this glass, this cup by shattering it, Then that's bad.

S3

Speaker 3

59:49

Why is it bad? It's gonna make a mess, it's gonna be annoying for me and my partner. And so it's not bad for the cup. No 1 would say the cup itself has moral status.

S3

Speaker 3

59:59

Hey, you.