3 hours 16 minutes 15 seconds
🇬🇧 English
Speaker 1
00:00
Whatever reality is, it's not what you see. What you see is just an adaptive fiction.
Speaker 2
00:12
The following is a conversation with Donald Hoffman, professor of cognitive sciences at UC Irvine, focusing his research on evolutionary psychology, visual perception, and consciousness. He's the author of over 120 scientific papers on these topics, and his most recent book titled, "'The Case Against Reality', "'Why Evolution Hid the Truth from Our Eyes. I think some of the most interesting ideas in this world, like those of Donald Hoffman's, attempt to shake the foundation of our understanding of reality, and thus, they take a long time to internalize deeply.
Speaker 2
00:50
So proceed with caution. Questioning the fabric of reality can lead you to either madness or to truth. And the funny thing is, you won't know which is which. This is the Lex Friedman Podcast.
Speaker 2
01:04
To support it, please check out our sponsors in the description. And now, dear friends, here's Donald Hoffman.
Speaker 1
01:11
In your book, The Case Against Reality, Why Evolution Hid the Truth from Our Eyes, You make the bold claim that the world we see with our eyes is not real. It's not even an abstraction of objective reality. It is completely detached from objective reality.
Speaker 1
01:29
Can you explain this idea? Right, so this is a theorem from evolution of a natural selection. So the technical question that I and my team asked was, what is the probability that natural selection would shape sensory systems to see true properties of objective reality? And to our surprise, we found that the answer is precisely 0, except for 1 kind of structure that we can go into if you want to.
Speaker 1
01:52
But for any generic structure that you might think the world might have, a total order, a topology, metric, the probability is precisely 0 that natural selection would shape any sensory system of any organism to see any aspect of objective reality. So in that sense, what we're seeing is what we need to see to stay alive long enough to reproduce. So in other words, we're seeing what we need to guide adaptive behavior, full stop.
Speaker 2
02:23
So the evolutionary process, the process that took us from the origin of life on Earth to the humans that we are today, that process does not maximize for truth, it maximizes for fitness, as you say. Fitness beats truth. And fitness does not have to be connected to truth, is the claim.
Speaker 2
02:46
And that's where you have an approach towards 0 of probability that we have evolved human cognition, human consciousness, whatever it is, the magic that makes our mind work, evolved not for its ability to see the truth of reality but its ability to survive in the environment.
Speaker 1
03:09
That's exactly right. So most of us intuitively think that surely the way that evolution will make our senses more fit is to make them tell us more truths, or at least the truths we need to know about objective reality, the truths we need in our niche. That's the standard view, and it was the view I took.
Speaker 1
03:28
I mean, that's sort of what we're taught, or just even assume, it's just sort of like the intelligent assumption that we would all make. But we don't have to just wave our hands. Evolution of a natural selection is a mathematically precise theory. John Maynard Smith in the 70s created evolutionary game theory.
Speaker 1
03:45
And we have evolutionary graph theory and even genetic algorithms that we can use to study this. And so we don't have to wave our hands. It's a matter of theorem and proof and or simulation before you get the theorems and proofs. And a couple of graduate students of mine, Chester Mark and Brian Marion, did some wonderful simulations that tipped me off that there was something going on here.
Speaker 1
04:06
And then I went to a mathematician, Chetan Prakash and Manish Singh and some other friends of mine, Chris Fields, but Chetan was the real mathematician behind all this and he's proved several theorems that uniformly indicate that with 1 exception, which has to do with probability measures, there's no, the probability is 0. The reason there's an exception for probability measures, so-called sigma algebras or sigma additive classes, is that for any scientific theory, there is the assumption that needs to be made that whatever probabilistic structure the world may have is not unrelated to the probabilistic structure of our perceptions. If they were completely unrelated, then no science would be possible. So this is technically, the map from reality to our senses has to be a so-called measurable map, has to preserve sigma algebras.
Speaker 1
05:08
But that means it could be infinite to 1, and it could collapse all sorts of event information. But other than that, there's no requirement in standard evolutionary theory for fitness payoff functions, for example, to preserve any specific structures of objective reality. So you can ask the technical question. This is 1 of the avenues we took.
Speaker 1
05:30
If you look at all the fitness payoffs from whatever world structure you might want to imagine, so a world with say a total order on it. So it's got end states and they're totally ordered. And then you can have a set of maps from that world into a set of payoffs, say from 0 to a thousand or whatever you want your payoffs to be. And you can just literally count all the payoff functions and just do the combinatorics and count them.
Speaker 1
05:57
And then you can ask a precise question, how many of those payoff functions preserve the total order, if that's what you're looking for, or how many preserve the topology. And you just count them and divide. So the number that are homomorphisms versus the total number, and then take the limit as the number of states in the world and the number of payoff values goes very large. And when you do that, you get 0 every time.
Speaker 2
06:21
Okay, there's a million things to ask here, but first of all, just in case people are not familiar with your work, let's sort of linger on the big, bold statement here. Which is, the thing we see with our eyes is not some kind of limited window into reality. It is completely detached from reality.
Speaker 2
06:47
Likely completely detached from reality. You're saying 100% likely. Okay, so none of this is real in the way we think is real. In the way we have this intuition, There's like this table is some kind of abstraction, but underneath it all, there's atoms.
Speaker 2
07:07
And there's an entire century of physics that describes the functioning of those atoms and the quarks that make them up. There's many Nobel prizes about particles and fields and all that kind of stuff that slowly builds up to something that's perceivable to us, both with our eyes, with our different senses, as this table. Then there's also ideas of chemistry that over layers of abstraction from DNA to embryos, to cells that make the human body. So all of that
Speaker 1
07:45
is not real. It's a real experience and it's a real adaptive set of perceptions. So it's an adaptive set of perceptions, full stop.
Speaker 1
07:56
We want to think that the perceptions are real. So their perceptions are real as perceptions, right? We are having our perceptions, but we've assumed that there's a pretty tight relationship between our perceptions and reality. If I look up and see the Moon, then there is something that exists in space and time that matches what I perceive.
Speaker 1
08:18
And all I'm saying is that if you take evolution by natural selection seriously, then that is precluded. Our perceptions are there, they're there to guide adaptive behavior full stop. They're not there to show you the truth. In fact, the way I think about it is they're there to hide the truth because the truth is too complicated.
Speaker 1
08:42
It's just like if you're trying to, you know, use your laptop to write an email, right? What you're doing is toggling voltages in the computer. But good luck trying to do it that way. The reason why we have a user interface is because we don't wanna know that quote unquote truth, the diodes and resistors and all that terrible hardware.
Speaker 1
08:59
If you had to know all that truth, your friends wouldn't hear from you. So what evolution gave us was perceptions that guide adaptive behavior, and part of that process, it turns out, means hiding the truth and giving you eye candy.
Speaker 2
09:16
So what's the difference between hiding the truth and forming abstractions, layers upon layers of abstractions over these, over low level voltages and transistors and chips and programming languages from assembly to Python that then leads you to be able to have an interface like Chrome where you open up another set of JavaScript and HTML programming languages that leads you to have a graphical user interface on which you can then send your friends an email. Is that completely detached from the zeros and ones that are firing away inside the computer?
Speaker 1
10:01
It's not. Of course, when I talk about the user interface on your desktop, there's this whole sophisticated backstory to it, right? The hardware and the software that's allowing that to happen.
Speaker 1
10:15
Evolution doesn't tell us the backstory, right? So the theory of evolution is not going to be adequate to tell you what is that backstory. It's gonna say that whatever reality is, and that's the interesting thing, it says whatever reality is, you don't see it. You see a user interface, but it doesn't tell you what that user interface is, how it's built, right?
Speaker 1
10:38
Now we can try to look at certain aspects of the interface, but already we're gonna look at that and go, okay, before I would look at neurons and I was assuming that I was seeing something that was at least partially true. And now I'm realizing it could be like looking at the pixels on my desktop or icons on my desktop and good luck going from that to the data structures and then the voltages and I mean, good luck. There's just no way. So what's interesting about this is that our scientific theories are precise enough and rigorous enough to tell us certain limits.
Speaker 1
11:17
But, and even the limits of the theories themselves. But they're not going to tell us what the next move is, and that's where scientific creativity comes in. So the stuff that I'm saying here, for example, is not alien to physicists. The physicists are saying precisely the same thing, that space-time is doomed.
Speaker 1
11:35
We've assumed that space-time is fundamental. We've assumed that for several centuries and it's been very useful. So all the things that you were mentioning, the particles and all the work that's been done, that's all been done in space-time, but now physicists are saying space-time is doomed. There's no such thing as space-time fundamentally in the laws of physics.
Speaker 1
11:54
And that comes actually out of gravity together with quantum field theory. It just comes right out of it. It's a theorem of those 2 theories put together. But it doesn't tell you what's behind it.
Speaker 1
12:08
So the physicists know that their best theories, Einstein's gravity and quantum field theory put together, entail that space-time cannot be fundamental and therefore particles in space-time cannot be fundamental. They're just irreducible representations of the symmetries of space-time. That's what they are. So we have, so space-time, so we put the 2 together.
Speaker 1
12:27
We put together what the physicists are discovering, and we can talk about how they do that. And then the new discoveries from evolution of natural selection, both of these discoveries are really in the last 20 years. And what both are saying is space-time has had a good ride. It's been very useful, reductionism has been useful, but it's over, And it's time for us to go beyond.
Speaker 2
12:48
When you say space-time is doomed, is it the space, is it the time, is it the very hard-coded specification of 4 dimensions? Or are you specifically referring to the kind of perceptual domain that humans operate in, which is space-time? You think like there's a 3D, like our world is three-dimensional and time progresses forward, therefore 3 dimensions plus 1, 4D.
Speaker 2
13:18
What exactly do you mean by space-time? What do you mean by space-time is doomed?
Speaker 1
13:24
Great, great. So this is, by the way, not my quote. This is from, for example, Nima Arkani-Hamed at the Institute for Advanced Study at Princeton.
Speaker 1
13:31
Ed Witten, also there. David Gross, Nobel Prize winner. So this is not just something that cognitive scientists, this is what the physicists are saying.
Speaker 2
13:40
LRS Yeah, the physicists are space-time
Speaker 1
13:43
skeptics. LRS Yeah, they're saying that, and I can say exactly why they think it's doomed, but what they're saying is that, because your question was, what aspect of space-time, what are we talking about here? It's both space and time, their union into space-time as in Einstein's theory, that's doomed. And they're basically saying that even quantum theory, this is with Neemar Kani Hamed especially, so Hilbert spaces will not be fundamental either.
Speaker 1
14:12
So that the notion of Hilbert space, which is really critical to quantum field theory, quantum information theory, that's not going to figure in the fundamental new laws of physics. So what they're looking for is some new mathematical structures beyond space-time, beyond Einstein's four-dimensional space-time or supersymmetric version, geometric algebra signature, 2 comma 4. There are different ways that you can represent it, but they're finding new structures. And by the way, they're succeeding now.
Speaker 1
14:47
They're finding, they found something called the amplituhedron. This is Nima and his colleagues, the cosmological polytope. These are, so there are these like polytopes, these polyhedra in multi dimensions, generalizations of simplices that are coding for, for example, the scattering amplitudes of processes in the Large Hadron Collider and other colliders. So they're finding that if they let go of space-time completely, They're finding new ways of computing these scattering amplitudes that turn literally billions of terms into 1 term.
Speaker 1
15:23
When you do it in space and time, because it's the wrong framework, it's just a user interface from that's now from the evolutionary point of view, it's just user interface, it's not a deep insight into the nature of reality. So it's missing deep symmetry, it's something called a dual conformal symmetry, which turns out to be true of the scattering data, but you can't see it in space-time, and it's making the computations way too complicated because you're trying to compute all the loops and Feynman diagrams and all the Feynman integrals. So see the Feynman approach to the scattering amplitudes is trying to enforce 2 critical properties of space-time, locality and unitarity. And so by, when you enforce those, you get all these loops and multiple different levels of loops.
Speaker 1
16:04
And for each of those, you have to add new terms to your computation. But when you do it outside of space-time, you don't have the notion of unitarity. You don't have the notion of locality. You have something deeper and it's capturing some symmetries that are actually true of the data.
Speaker 1
16:21
But then when you look at the geometry of the facets of these polytopes, then certain of them will code for unitarity and locality. So it actually comes out of the structure of these deep polytopes. So what we're finding is there's this whole new world now beyond space-time that is making explicit symmetries that are true of the data that cannot be seen in space-time. And that is turning the computations from billions of terms to 1 or 2 or a handful of terms.
Speaker 1
16:50
So we're getting insights into symmetries and all of a sudden the math is becoming simple because we're not doing something silly. We're not adding up all these loops in space time. We're doing something far deeper. But they don't know what this world is about.
Speaker 1
17:04
So they're in an interesting position where we know that space-time is doomed and I should probably tell you why it's doomed, what they're saying about why it's doomed, but they need a flashlight to look beyond space-time. What flashlight are we going to use to look into the dark beyond space-time? Because Einstein's theory and quantum theory can't tell us what's beyond them. All they can do is tell us that when you put us together, space-time is doomed at 10 to the minus 33 centimeters, 10 to the minus 43 seconds.
Speaker 1
17:31
Beyond that, space-time doesn't even make sense. It just has no operational definition. But it doesn't tell you what's beyond. And so they're just looking for deep structures like guessing is really fun.
Speaker 1
17:43
So these really brilliant guys, generic, brilliant men and women who are doing this work, physicists, are making guesses about these structures, informed guesses, because they're trying to ask, well, okay, what deeper structure could give us the stuff that we're seeing in space-time, but without certain commitments that we have to make in space time, like locality. So they make these brilliant guesses, and of course, most of the time you're gonna be wrong, but once you get 1 or 2 that start to pay off, and then you get some lucky breaks. So they got a lucky break back in 1986. Couple of mathematicians named Park and Taylor took the scattering amplitude for 2 gluons coming in at high energy and 4 gluons going out at low energy.
Speaker 1
18:25
So that kind of scattering thing. So apparently for people who are into this, That's sort of something that happens so often, you need to be able to find it and get rid of those because you already know about that and you need to. So you needed to compute them. It was billions of terms and they couldn't do it, even for the supercomputers couldn't do that for the many billions or millions of times per second they needed to do it.
Speaker 1
18:45
So they begged, the experimentalists begged the theorists, please, you got to... So Park and Taylor took the billions of terms, hundreds of pages, and miraculously turned it into 9. And then a little bit later, they guessed 1 term expression that turned out to be equivalent. So billions of terms reduced to 1 term, that so-called famous Park-Taylor formula, 1986.
Speaker 1
19:10
And that was like, okay, where did that come from? This is a pointer into a deep realm beyond space and time, but no 1, I mean, what can you do with it? And they thought maybe it was a one-off, but then other formulas started coming up. And then eventually, Neemar Kani Hamad and his team found this thing called the Amplituhedron, which really sort of captures a big part of the whole ball of wax.
Speaker 1
19:35
I'm sure they would say, no, there's plenty more to do. So I won't say they did it all by any means. They're looking at the cosmological polytope as well. So what's remarkable to me is that 2 pillars of modern science, quantum field theory with gravity on the 1 hand and evolution by natural selection on the other, just in the last 20 years have very clearly said, space-time has had a good run, reductionism has been a fantastic methodology.
Speaker 1
20:03
So we had a great ontology of space-time, a great methodology of reductionism. Now it's time for a new trick. Now you need to go deeper and show, but by the way, this doesn't mean we throw away everything we've done, not by a long shot. Every new idea that we come up with beyond space-time must project precisely into space-time and it better give us back everything that we know and love in space-time or generalizations, or it's not gonna be taken seriously and it shouldn't be.
Speaker 1
20:31
So we have a strong constraint on whatever we're going to do beyond space-time. It needs to project into space-time. And whatever this deeper theory is, it may not itself have evolution by natural selection. This may not be part of this deeper realm.
Speaker 1
20:44
But when we take whatever that thing is beyond space-time and project it into space-time, it has to look like evolution by natural selection, or it's wrong. So that's a strong constraint on this work. LUIS
Speaker 2
20:57
So even the evolution by natural selection and quantum field theory could be interfaces into something that doesn't look anything like, like you mentioned, I mean it's interesting to think that evolution might be a very crappy interface into something much deeper.
Speaker 1
21:18
That's right. They're both telling us that the framework that you've had can only go so far and it has to stop and there's something beyond. And that framework, the very framework that is space and time itself.
Speaker 1
21:29
Now of course, evolution by natural selection is not telling us about like Einstein's relativistic space-time. So that was another question you asked a little bit earlier. It's telling us more about our perceptual space and time, which we have used as the basis for creating first a Newtonian space versus time as a mathematical extension of our perceptions. And then Einstein then took that and extended it even further.
Speaker 1
21:56
So the relationship between what evolution is telling us and what the physicists are telling us is that in some sense, the Newton and Einstein space time are formulated as rigorous extensions of our perceptual space, making it mathematically rigorous and laying out the symmetries that they find there. So that's sort of the relationship between them. So it's the perceptual space time that evolution is telling us is just a user interface effectively. And then the physicists are finding that even the mathematical extension of that into the Einsteinian formulation has to be as well, not the final story, there's something deeper.
Speaker 1
22:37
LR.
Speaker 2
22:38
So let me ask you about reductionism and interfaces. As we march forward from Newtonian physics to quantum mechanics, These are all, in your view, interfaces. Are we getting closer to objective reality?
Speaker 2
22:59
How do we know, if these interfaces in the process of science, the reason we like those interfaces is because they're predictive of some aspects, strongly predictive about some aspects of our reality. Is that completely deviating from our understanding of that reality or is it helping us get closer and closer and closer?
Speaker 1
23:22
Well, of course, 1 critical constraint on all of our theories is that they are empirically tested and pass the experiments that we have for them. So no one's arguing against experiments being important and wanting to test all of our current theories and any new theories on that. So that's all there.
Speaker 1
23:44
But we have good reason to believe that science will never get a theory of everything. You know what I'm saying? Everything, everything. Everything, everything, right.
Speaker 1
23:54
A final theory of everything, right. I think that my own take is, for what it's worth, is that Gerdl's incompleteness theorem sort of points us in that direction. That even with mathematics, any finite axiomatization that's sophisticated enough to be able to do arithmetic, it's easy to show that there'll be statements that are true, that can't be proven, can't be deduced from within that framework. And if you add the new statements to your axioms, then there'll be always new statements that are true but can't be proven with a new axiom system.
Speaker 1
24:27
And the best scientific theories in physics, for example, and also now evolution, are mathematical. So our theories are gonna be, they're gonna have their own assumptions, and they'll be mathematically precise. And there'll be theories perhaps of everything except those assumptions, because the assumptions are, we say, please grant me these assumptions. If you grant me these assumptions, then I can explain this other stuff.
Speaker 1
24:51
So you have the assumptions that are like miracles as far as the theory is concerned, they're not explained, they're the starting points for explanation. And then you have the mathematical structure of the theory itself, which will have the girdle limits. And so my take is that reality, whatever it is, is always going to transcend any conceptual theory that we can come up with.
Speaker 2
25:22
There's always gonna be mystery at the edges. Right. Contradictions and all that kind of stuff.
Speaker 2
25:29
Okay. And truths. So there's this idea that is brought up in the financial space of settlement of transactions. It's often talked about in cryptocurrency especially.
Speaker 2
25:42
So you could do, you know, money, cash is not connected to anything. It used to be connected to gold, to physical reality, but then you can use money to exchange value, to transact. So when it was on the gold standard, the money would represent some stable component of reality. Isn't it more effective to avoid things like hyperinflation if we generalize that idea?
Speaker 2
26:14
Isn't it better to connect your, whatever we humans are doing in the social interaction space with each other? Isn't it better from an evolutionary perspective to connect it to some degree to reality so that the transactions are settled with something that's universal, as opposed to us constantly operating in something that's a complete illusion. Isn't it easy to hyperinflate that? Like where you really deviate very, very far away from the underlying reality, Or do you never get in trouble for this?
Speaker 2
26:53
Can you just completely drift far, far away from the underlying reality and never get in trouble?
Speaker 1
27:01
That's a great question. On the financial side, there's 2 levels at least that we could take your question. 1 is strictly evolutionary psychology of financial systems.
Speaker 1
27:11
And that's pretty interesting. And there, the decentralized idea, the DeFi kind of idea in cryptocurrencies, may make good sense from just an evolutionary psychology point of view. Having, you know, human nature being what it is, putting a lot of faith in a few central controllers depends a lot on the veracity of those and trustworthiness of those few central controllers. And we have ample evidence time and again that that's often betrayed.
Speaker 1
27:41
So it makes good evolutionary sense, I would say, to have a decentralized, I mean, democracy is a step in that direction, right? We don't have a monarch now telling us what to do. We decentralize things, right? Because if you have Marcus Aurelius as your emperor, you're great.
Speaker 1
27:58
If you have Nero, it's not so great. And so we don't want that. So democracy is a step in that direction, but I think the DeFi thing is an even bigger step and is going to even make the democratization even greater. So that's 1 level of it.
Speaker 2
28:14
Also, the fact that power corrupts and absolute power corrupts absolutely is also a consequence of evolution. That's also a feature, I think, right? You can argue from the long span of living organisms, it's nice for power to corrupt for you to, so mad men and women throughout history might be useful to teach us a lesson.
Speaker 2
28:41
About ourselves. We can learn from
Speaker 1
28:43
our negative example, right? Exactly. Right, right.
Speaker 1
28:47
Right, so power does corrupt, and I think that you can think about that again from an evolutionary point of view. But I think that your question was a little deeper when that was, does the evolutionary interface idea sort of unhinge science from some kind of important test for the theories, right? It doesn't mean that anything goes in scientific theory, but if we don't see the truth, is there no way to tether our theories and test them? And I think there's no problem there.
Speaker 1
29:24
We can only test things in terms of what we can measure with our senses in space and time. So we're going to have to continue to do experiments, but we're gonna understand a little bit differently what those experiments are. We had thought that when we see a pointer on some machine in an experiment, that the machine exists, the pointer exists, and the values exist even when no 1 is looking at them, and that they're an object of truth. And our best theorists are telling us, no, the pointers are just pointers, and that's what you have to rely on for making your judgments.
Speaker 1
30:02
But even the pointers themselves are not the objective reality. So, and I think Gödel is telling us that, not that anything goes, but as you develop new axiom systems, you will find out what goes within that axiom system and what testable predictions you can make. So I don't think we're untethered. We continue to do experiments.
Speaker 1
30:27
What I think we won't have that we want is a conceptual understanding that gives us a theory of everything that's final and complete. I think that this is, to put it another way, this is job security for scientists. Our job will never be done, it's job security for neuroscience. Because before we thought that when we looked in the brain, we saw neurons and neural networks and action potentials and synapses and so forth.
Speaker 1
30:58
And that was it, that was the reality. Now we have to reverse engineer that. We have to say, what is beyond space-time? What is going on?
Speaker 1
31:05
What is a dynamical system beyond space-time? That when we project it into Einstein's space-time, gives us things that look like neurons and neural networks and synapses. So we have to reverse engineer it. So there's going to be lots more work for neuroscience.
Speaker 1
31:18
It's going to be far more complicated and difficult and challenging, but that's wonderful. That's what we need to do. We thought neurons exist when they are perceived and they don't. In the same way that if I show you, when I say they don't exist, I should be very, very concrete.
Speaker 1
31:34
If I draw on a piece of paper, a little sketch of something that is called the Necker cube, it's just a little line drawing of a cube, right? It's on a flat piece of paper. If I execute it well and I show it to you, you'll see a 3D cube and you'll see it flip. Sometimes you'll see 1 face in front, sometimes you'll see the other face in front.
Speaker 1
31:51
But if I ask you, which face is in front when you don't look? The answer is, well, neither face is in front because there's no cube. There's just a flat piece of paper. So when you look at the piece of paper, you perceptually create the cube.
Speaker 1
32:08
And when you look at it, then you fix 1 face to be in front and 1 face to be at. So that's what I mean when I say it doesn't exist. Space-time itself is like the cube. It's a data structure that your sensory systems construct, whatever your sensory systems mean now, because we now have to even take that for granted.
Speaker 1
32:27
But there are perceptions that you construct on the fly, and they're data structures in a computer science sense, and you garbage collect them when you don't need them. So you create them and garbage collect them.
Speaker 2
32:37
But is it possible that it's mapped well in some concrete, predictable way to objective reality? The sheet of paper, this two-dimensional space, or we can talk about space-time, maps in some way that we maybe don't yet understand, but will 1 day understand what that mapping is, but it maps reliably, it is tethered
Speaker 1
33:01
in that way. RL So the new theories that the physicists are finding beyond space-time have that kind of tethering. So they show precisely how you start with an epilepsy hedron and how you project this high dimensional structure into the 4 dimensions of space-time.
Speaker 1
33:18
So there's a precise procedure that relates the 2. And they're doing the same thing with the cosmological polytopes. So they're the ones that are making the most concrete and fun advances going beyond space-time. And they're tethering it, right?
Speaker 1
33:35
They say this is precisely the mathematical projection from this deeper structure into space-time. 1 thing I'll say about as a non-physicist, what I find interesting is that they're finding just geometry, but there's no notion of dynamics. Right now, they're just finding these static geometric structures, which is impressive. So I'm not putting them down.
Speaker 1
33:58
This is what they're doing is unbelievably complicated and brilliant and adventurous. All those things. And beautiful.
Speaker 2
34:08
And beautiful, yeah. From a human aesthetic perspective because geometry is beautiful.
Speaker 1
34:13
It's absolutely. And they're finding symmetries that are true of the data that can't be seen in space-time. But I'm looking for a theory beyond space-time that's a dynamical theory.
Speaker 1
34:25
I would love to find, and we can talk about that at some point, a theory of consciousness in which the dynamics of consciousness itself will give rise to the geometry that the physicists are finding beyond space-time. If we can do that, then we'd have a completely different way of looking at how consciousness is related to what we call the brain or the physical world more generally. Right now, all of my brilliant colleagues, 99% of them are trying to... They're assuming space-time is fundamental.
Speaker 1
34:56
They're assuming that particles are fundamental, quarks, gluons, leptons, and so forth. Elements, atoms, and so forth are fundamental and that therefore neurons and brains are part of objective reality. And that somehow when you get matter that's complicated enough, it will somehow generate conscious experiences by its functional properties. Or if you're panpsychist, maybe you, in addition to the physical properties of particles, you add consciousness property as well.
Speaker 1
35:27
And then you have, you combine these physical and conscious properties to get more complicated ones. But they're all doing it within space-time. All of the work that's being done on consciousness and its relationship to the brain is all assumed something that our best theories are telling us is doomed, space-time.
Speaker 2
35:46
Why does that particular assumption bother you the most? So you bring up space-time. I mean, that's just 1 useful interface we've used for a long time.
Speaker 2
35:59
Surely there's other interfaces. Is space-time just 1 of the big ones to build up people's intuition about the fact that they do assume a lot of things strongly? Or is it in fact a fundamental flaw in the way we see the world?
Speaker 1
36:17
Well, everything else that we think we know are things in space-time. And so, when you say space-time is doomed, this is a shot to the heart of the whole framework, the whole conceptual framework that we've had in science. Not to the scientific method, but to the fundamental ontology and also the fundamental methodology, the ontology of space-time and its contents And the methodology of reductionism, which is that as we go to smaller scales in space time, we will find more and more fundamental laws.
Speaker 1
36:54
And that's been very useful for space and time for centuries, reductionism for centuries, but now we realize that that's over. Reductionism is in fact dead as is space-time.
Speaker 2
37:08
What exactly is reductionism? What is the process of reductionism that is different than some of the physicists that you mentioned that are trying to think, trying to let go of the assumption of space-time. Looking beyond, isn't that still trying to come up with a simple model that explains this whole thing?
Speaker 2
37:27
Isn't it still reducing?
Speaker 1
37:29
It's a wonderful question because it really helps to clarify 2 different notions, which is scientific explanation on the 1 hand and a particular kind of scientific explanation on the other, which is the reductionist. So the reductionist explanation is saying, I will start with things that are smaller in space-time and therefore more fundamental, where the laws are more fundamental. So we go to just smaller and smaller scales.
Speaker 1
37:54
Whereas in science more generally, we just say like when Einstein did the special theory of relativity, He's saying, let me have a couple postulates. I will assume that the speed of light is universal for all observers in uniform motion and that the laws of physics so if you're for uniform motion are That's not a reductionist. Those are saying, grant me these assumptions, I can build this entire concept of space time out of it. It's not a reductionist thing.
Speaker 1
38:24
You're not going to smaller and smaller scales of space. You're coming up with these deep, deep principles. Same thing with this theory of gravity, right? It's the falling elevator idea, right?
Speaker 1
38:35
So this is not a reductionist kind of thing. It's something different.
Speaker 2
38:39
So simplification is a bigger thing than just reductionism.
Speaker 1
38:45
Reductionism has been a particularly useful kind of scientific explanation, for example, in thermodynamics, right? The notion that we have of heat, some macroscopic thing like temperature and heat. It turns out that Neil Boltzmann and others discovered, well, hey, if we go to smaller and smaller scales, we find these things called molecules or atoms.
Speaker 1
39:04
And if we think of them as bouncing around having some kind of energy, then what we call heat really can be reduced to that. And so that's a particularly useful kind of reduction is a useful kind of scientific explanation that works within a range of scales within space time. But we know now precisely where that has to stop at 10 to the minus 33 centimeters and 10 to the minus 43 seconds. And I would be impressed if it was 10 to the minus 33 trillion centimeters.
Speaker 1
39:37
I'm not terribly impressed at 10 to the minus 33 centimeters.
Speaker 2
39:43
I don't even know how to comprehend either of those numbers, frankly. Just a small aside, because I am a computer science person, I also find cellular automata beautiful. And so you have somebody like Stephen Wolfram, who recently has been very excitedly exploring a proposal for a data structure that could be the numbers that would make you a little bit happier in terms of scale, because they're very, very, very, very tiny.
Speaker 2
40:12
So do you like this space of exploration, of really thinking, letting go of space time, letting go of everything and trying to think what kind of data structures could be underneath this whole mess.
Speaker 1
40:23
That's right. So if they're thinking about these as outside of space time, then that's what we have to do. That's what our best theories are telling us.
Speaker 1
40:30
You now have to think outside of space time. Now, of course, I should back up and say, we know that Einstein surpassed Newton, right? But that doesn't mean that there's not good work to do at Newton. There's all sorts of Newtonian physics that takes us to the Moon and so forth.
Speaker 1
40:46
There's lots of good problems that we want to solve with Newtonian physics. The same thing will be true of space time. It's not like we're going to stop using space time. We'll continue to do all sorts of good work there.
Speaker 1
40:56
But for those scientists who are really looking to go deeper, to actually find the next, you know, just like what Einstein did to Newton, what are we going to do to Einstein? How do we get beyond Einstein and quantum theory to something deeper? Then we have to actually let go. And if we're going to do like this automata kind of approach, It's critical that it's not automata in space-time, it's automata prior to space-time, from which we're going to show how space-time emerges.
Speaker 1
41:25
If you're doing automata within space-time, well, that might be a fun model, but it's not the radical new step that we need?
Speaker 2
41:33
Yeah, so the space-time emerges from that whatever system. Like you're saying, it's a dynamical system. Do we even have an understanding what dynamical means when we go beyond?
Speaker 2
41:45
When you start to think about dynamics, it could mean a lot of things. Even causality could mean a lot of things if we realize that everything's an interface. Like how much do we really know is an interesting question. Because you brought up neurons, I gotta ask you yet another tangent.
Speaker 2
42:05
There's a paper, I remember a while ago looking at it, called Could a Neuroscientist Understand a Microprocessor? And I just enjoyed that thought experiment that they provided, which is, they basically, it's a couple of neuroscientists, Eric Jonas and Conrad Kording, who use the tools of neuroscience to analyze a microprocessor, so a computer chip. Yeah, If
Speaker 1
42:30
we lesion it here, what happens and so forth. And if you go and lesion a computer, it's very, very clear that lesion experiments on computers are not gonna give you a lot of insight into how it works.
Speaker 2
42:40
And also the measurement devices and the kind of, just using the basic approaches of neuroscience, collecting the data, trying to intuit about the underlying function of it. And that helps you understand that our scientific exploration of concepts, depending on the field, are maybe in the very, very early stages. I wouldn't say it leads us astray.
Speaker 2
43:08
Perhaps it does sometimes, but it's not a, it's not anywhere close to some fundamental mechanism that actually makes a thing work. I don't know if you can sort of comment on that in terms of using neuroscience to understand the human mind and neurons. Are we really far away potentially from understanding in the way we understand the transistors enough to be able to build a computer. So 1 thing about understanding is you can understand for fun.
Speaker 2
43:40
The other 1 is to understand so you could build things. And that's when you really have to understand. Exactly.
Speaker 1
43:49
In fact, what got me into the field at MIT was work by David Marr on this very topic. So David Marr was a professor at MIT, but he'd done his PhD in neuroscience, studying just the architectures of the brain, but he realized that his work, it was on the cerebellum, he realized that his work, as rigorous as it was, left him unsatisfied, because he didn't know what the cerebellum was for. And why it had that architecture.
Speaker 1
44:21
And so he went to MIT and he was in the AI lab there. And he said he had this 3 level approach that really grabbed my attention. So when I was an undergrad at UCLA, I read 1 of his papers in a class and said, who is this guy? Because he said, you have to have a computational theory.
Speaker 1
44:37
What is being computed and why? An algorithm, how is it being computed? What are the precise algorithms? And then the hardware, how does it get instantiated in the hardware?
Speaker 1
44:47
So to really do neuroscience, he argued, we needed to have understanding at all those levels. And that really got me. I loved the neuroscience, but I realized this guy was saying, if you can't build it, you don't understand it effectively. And so that's why I went to MIT.
Speaker 1
45:01
And I had the pleasure of working with David until he died just a year and a half later. So there's been that idea that with neuroscience, we have to have, in some sense, a top-down model of what's being computed and why that we would then go after. And same thing with the trying to reverse engineer a computing system like your laptop. We really need to understand what the user interface is about and what are keys on the keyboard for and so forth.
Speaker 1
45:34
You need to know why to really understand all the circuitry and what it's for. Now, evolution of natural selection does not tell us the deeper question that we're asking, the answer to the deeper question, which is why. What's this deeper reality and what's it up to and why? All it tells us is that whatever reality is, it's not what you see.
Speaker 1
46:06
What you see is just an adaptive fiction. So just to linger on this fascinating bold question that shakes you out of your dream state. Does this fiction still help you
Speaker 2
46:21
in building intuitions as literary fiction does about reality? The reason we read literary fiction is it helps us build intuitions and understanding in indirect ways, sneak up to the difficult questions of human nature. Great fiction.
Speaker 2
46:41
Same with this observed reality. Does this interface that we get, this fictional interface, help us build intuition about deeper truths of how this whole mess works?
Speaker 1
46:54
Well, I think that each theory that we propose will give its own answer to that question, right? So when the physicists are proposing these structures like the amplitude hedron and cosmological polytope, associahedron and so forth, beyond space time, we can then ask your question for those specific structures and say, how much information, for example, does evolution by natural selection and the kinds of sensory systems that we have right now give us about this deeper reality and why did we evolve this way? We can try to answer that question from within the deep.
Speaker 1
47:32
So there's not going to be a general answer. I think what we'll have to do is posit these new deeper theories and then try to answer your question within the framework of those deeper theories knowing full well that there'll be an even deeper theory.
Speaker 2
47:47
So is this paralyzing though? Because how do we know we're not completely adrift out to sea, lost forever from, so like that our theory is completely lost. So if it's all, if we can never truly, deeply introspect to the bottom, if it's always just turtles on top of turtles infinitely,
Speaker 1
48:14
isn't that paralyzing for a scientific mind? Well, it's interesting that you say introspect to the bottom. Because there is that, there is 1, I mean, again, this is in the same spirit of what I said before, which is, it depends on what answer you give to what's beyond space-time, what answer we would give to your question, right?
Speaker 1
48:35
So, but 1 answer that is interesting to explore is something that spiritual traditions have said for thousands of years, but haven't said precisely. So, we can't take it seriously in science until it's made precise, but we might be able to make it precise. And that is that they've also said something like space and time aren't fundamental, they're Maya, they're illusion. But if you look inside, if you introspect and let go of all of your particular perceptions, you will come to something that's beyond conceptual thought.
Speaker 1
49:11
And that is, they claim, being in contact with the deep ground of being that transcends any particular conceptual understanding. If that is correct, and I'm not saying it's correct, and I'm not saying it's not correct, I'm just saying if that's correct, then it would be the case that as scientists, because we also are in touch with this ground of being, we would then not be able to conceptually understand ourselves all the way, but we could know ourselves just by being ourselves. And so there would be a sense in which there is a fundamental grounding to the whole enterprise because we're not separate from the enterprise. This is the opposite of the impersonal third-person science.
Speaker 1
49:57
This would make science go personal all the way down. But nevertheless, scientific, because the scientific method would still be what we would use all the way down for the conceptual understanding.
Speaker 2
50:10
Unfortunately, you still don't know if you went all the way down. It's possible that this kind of whatever consciousness is, and we'll talk about it, is getting the cliche statement of be yourself. It is somehow digging at a deeper truth of reality, but you still don't know when you get to the bottom.
Speaker 2
50:31
You know, a lot of people, they'll take psychedelic drugs and they'll say, well, that takes my mind to certain places where it feels like that is revealing some deeper truth of reality. But you still, it could be interfaces on top of interfaces. That's, in your view of this, you really don't know. I mean, Gato's incompleteness is that you really don't know.
Speaker 1
50:55
My own view on it, for what it's worth, because I don't know the right answer, but my own view on it right now is that it's never ending. I think that this is great, as I said before, great job security for science. And that if this is true, and if consciousness is somehow important or fundamental in the universe, this may be an important fundamental fact about consciousness itself, that it's a never-ending exploration that's going on in some sense.
Speaker 2
51:27
Well, that's interesting. Push back on the job security. Okay.
Speaker 2
51:34
So maybe as we understand this kind of idea deeper and deeper, we understand that the pursuit is not a fruitful 1. Then maybe we need to, maybe that's why we don't see aliens everywhere, is you get smarter and smarter and smarter, you realize that like exploration is, there's other fun ways to spend your time than exploring. You could be sort of living maximally in some way that's not exploration. There's all kinds of video games you can construct and put yourself inside of them that don't involve you going outside of the game world.
Speaker 2
52:15
Feeling, from my human perspective, what seems to be fun is challenging yourself and overcoming those challenges. So you can constantly artificially generate challenges for yourself, like Sisyphus and his boulder. And that's it. So the scientific method that's always reaching out to the stars, that's always trying to figure out the puzzle upon a puzzle, the trick, always trying to get to the bottom turtle.
Speaker 2
52:40
Maybe if we can build more and more the intuition that that's an infinite pursuit, we agree to start deviating from that pursuit, start enjoying the here and now versus the looking out into the unknown always. Maybe that's looking out into the unknown as a early activity for a species that's evolved. I'm just sort of saying, pushing back as you probably got a lot of scientists excited in terms of job security, I could envision where it's not job security, where scientists become more and more useless. Maybe they're like the holders of the ancient wisdom that allows us to study our own history, but not much more than that.
Speaker 2
53:32
Just a
Speaker 1
53:33
fun pushback. That's good pushback. I'll put 1 in there for the scientists again.
Speaker 1
53:39
But sure, but then I'll take the other side too. So when Faraday did all of his experiments with magnets and electricity and so forth. He came with all this wonderful empirical data and James Clerk Maxwell looked at it and wrote down a few equations which we can now write down in a single equation, the Maxwell equation if we use geometric algebra, just 1 equation. That opened up unbelievable technologies where people are Zooming and talking to each other around the world, the whole electronics industry.
Speaker 1
54:13
There was something that transformed our lives in a very positive way. With the theories beyond space-time, here's 1 potential. Right now, most of the galaxies that we see, we can see them, but we know that we could never get to them no matter how fast we traveled. They're going away from us at the speed of light or beyond, so we can't ever get to them.
Speaker 1
54:39
So there's all this beautiful real estate that's just smiling and waving at us and we can never get to it. But that's if we go through space-time. But if we recognize that space-time is just a data structure, it's not fundamental. We're not little things inside space-time.
Speaker 1
54:56
Space-time is a little data structure in our perceptions. It's just the other way around. Once we understand that and we get equations for the stuff that's beyond space-time, maybe we won't have to go through space-time, maybe we can go around it. Maybe I can go to Proxima Centauri and not go through space, I can just go right there directly.
Speaker 1
55:16
It's a data structure, we can start to play with it. So I think that for what it's worth, my take would be that the endless sequence of theories that we could contemplate building will lead to an endless sequence of new remarkable insights into the potentialities, the possibilities, that would seem miraculous to us, and that we will be motivated to continue the exploration, partly just for the technological innovations that come out. But the other thing that you mentioned though, what about just being? What if we decide instead of all this doing and exploring, what about being?
Speaker 1
56:02
My guess is that the best scientists will do both and that the act of being will be a place where they get many of their ideas and that they then pull into the conceptual realm. And I think many of the best scientists, Einstein comes to mind, where these guys say, look, I didn't come up with these ideas by a conceptual analysis. I was thinking in vague images and it was just something non-conceptual. And then it took me a long, long time to pull it out into concepts and then longer to put it into math.
Speaker 1
56:40
But the real insights didn't come from just slavishly playing with equations, they came from a deeper place. And so there may be this going back and forth between the complete non-conceptual, where there's essentially no end to the wisdom, and then conceptual systems where there's the girdle limits that we have to that. And that may be, if consciousness is important and fundamental, that may be what consciousness, at least part of what consciousness is about, is this discovering itself, discovering its possibilities, so to speak, and we can talk about what that might mean, by going from the non-conceptual to the conceptual and back and forth.
Speaker 2
57:23
To get better and better and better at being. Right. Let me ask you, just to linger on the evolutionary, Because you mentioned evolutionary game theory and that's really where you, the perspective from which you come to form the case against reality.
Speaker 2
57:41
At which point in our evolutionary history do we start to deviate the most from reality? Is it way before life even originated on Earth? Is it in the early development from bacteria and so on? Or is it when some inklings of what we think of as intelligence or maybe even complex consciousness started to emerge?
Speaker 2
58:12
So where did this deviation, Just like with the interfaces in a computer, you start with transistors and then you have assembly and then you have C, C++, then you have Python, then you have GUIs, all that kind, you have layers upon layers. When do we start to deviate?
Speaker 1
58:33
Well, David Marr, again, my advisor at MIT, in his book, Vision, suggested that the more primitive sensory systems were less realistic, less veridical, But that by the time you got to something as complicated as the humans, we were actually estimating the true shapes and distances to objects and so forth. So his point of view, and I think it was probably, it's not an uncommon view among my colleagues, that yeah, the sensory systems of lower creatures may just not be complicated enough to give them much truth. But as you get to 86 billion neurons, you can now compute the truth, or at least the parts of the truth that we need.
Speaker 1
59:17
When I look at evolutionary game theory, 1 of my graduate students, Justin Mark, did some simulations using genetic algorithms. So there he was just exploring, we start off with random organisms, random sensory genetics and random actions. And the first generation was unbelievably, it was a foraging situation. They were foraging for resources.
Speaker 1
59:41
Most of them stayed in 1 place, didn't do anything important. But we could then just look at how the genes evolved. And what we found was, what he found, was that basically you never even saw the...
Omnivision Solutions Ltd