161 | W. Brian Arthur on Complexity Economics

Economies in the modern world are incredibly complex systems. But when we sit down to think about them in quantitative ways, it’s natural to keep things simple at first. We look for reliable relations between small numbers of variables, seek equilibrium configurations, and so forth. But those approaches don’t always work in complex systems, and sometimes we have to use methods that are specifically adapted to the challenges of complexity. That’s the perspective of W. Brian Arthur, a pioneer in the field of complexity economics, according to which economies are typically not in equilibrium, not made of homogeneous agents, and are being constantly updated. We talk about the basic ideas of complexity economics, how it differs from more standard approaches, and what it teaches us about the operation of real economies.

Support Mindscape on Patreon.

W. Brian Arthur received his Ph.D. in operations research from the University of California, Berkeley. He is currently an External Faculty Member at the Santa Fe Institute, IBM Faculty Fellow, and Visiting Researcher in the Intelligent Systems Lab at PARC. He was formerly the Morrison Professor of Economics and Population Studies and Professor of Biology at Stanford. He is known for developing the theory of increasing returns in economics. Among his awards are a Guggenheim Fellowship, the Schumpeter Prize in economics, and the Lagrange Prize for complexity.

[accordion clicktoclose=”true”][accordion-item tag=”p” state=closed title=”Click to Show Episode Transcript”]Click above to close.

0:00:00.2 Sean Carroll: Hello, everyone. Welcome to the Mindscape Podcast. I’m your host, Sean Carroll. Long time listeners will know that one of my areas of interest is complex systems, the study of complexity, the kind of thing that the Santa Fe Institute does and was founded to do. And if there is any system we can imagine that you would characterize as complex, it would be an economy, right? Economy of a large industrialized country, there are a lot of moving parts related to each other in different ways. It seems as if a priori economics and complexity theory would go hand in hand. But in fact, when you actually sit down to do economics, just like when you sit down to do any other science, you look for simplifications, right? You look for things you don’t need to pay attention to, simple versions of the problem that you can really get a lot of insight into. And in economics, this takes a lot of different forms. We assume that the different people in an economy are more or less rational, that they have complete information, that they’re more or less all the same kind of people, and most of all, that the economy is basically in equilibrium, right?

0:01:02.7 SC: Think of supply and demand, if given a certain supply curve and a certain demand curve, the price will adjust to a certain point relatively rapidly and then you’ll be in equilibrium. So complex systems research is all about things where you cannot assume that all the parts are the same, you cannot treat things as if they were in equilibrium, you can imagine the different parts of the system have different amounts of information, and so forth. So this opens the idea that economics is actually not taking full advantage of the insights gained from Complex Systems Research, and we should study something called Complexity Economics.

0:01:40.2 SC: That’s what we’re gonna talk about today with W. Brian Arthur, who’s one of the founders of this field. Now, I should say, Brian is not a quirky outsider. He was a professor at Stanford for a long time, the youngest person ever to be given an endowed chair at Stanford. But he’s one of the founders of this field of complexity economics dating back to the time when the Santa Fe Institute was founded in the 1980s. He invented several of the foundational puzzles and methods in this field, and he thinks that to this day, the economics profession as a whole hasn’t quite taken on the lessons of complexity theory. We’re still largely in a certain neo-classical paradigm that treats the world as a much simpler, much less dynamic thing than it really is. So this is a fun conversation, both for the economic insights, but also for the way of thinking that you become imbued with when you start thinking about the world as a complex system, getting rid of simplifications that simplify over-much thinking of the different layers of the world interacting with each other, thinking of the evolution and the dynamical aspects of the problem as built-in rather than things that we can try to ignore, right?

0:02:52.6 SC: Real economies have crashes and bubbles and you can predict the probability of different things, but if you just look at the equilibrium, you’ll never find that kind of behavior. So it’ll be useful for anyone interested in society, economics, science or complexity, which I hope is everyone out there listening to this podcast. So let’s go.

[music]

0:03:29.1 SC: Brian Arthur, welcome to the Mindscape Podcast.

0:03:31.1 Brian Arthur: Yeah, hi.

0:03:32.1 SC: So I wanted to start, actually, we had Neil Johnson on the podcast about a year ago. I don’t know if you know Neil, but he’s another complexity person, and he told us about the El Farol problem.

0:03:41.5 BA: Right.

0:03:43.4 SC: But I’m gonna presume that maybe people have forgotten what it is, and I think that you’re at least one of, if not the originator, of the El Farol problem, and it’s a nice set up for what we’re gonna be talking about here. So why don’t you remind us what that is all about?

0:03:56.1 BA: Okay. [chuckle] I usually like to flex a few muscles before I jump in here.

0:04:02.2 SC: Oh. No, we dive right in.

0:04:05.0 BA: Anyway, yeah, I am the original… I guess I cooked up the El Farol problem sometime in the early ’90s. El Farol is a bar in Canyon Road in Santa Fe. And on Thursday nights, they used to have Irish music and I would show up. It’s a pretty cramped place, and so it began to occur to me, “Should I go to El Farol this Thursday or not?” And I realized that a lot of other people would think that too. So if you start to look at that as a logical problem, say of a 100 people thinking independently, maybe I’ll go to El Farol tonight, but if there’s more than, let’s say, 60 there, it’s gonna be awful crowded and smokey and horrible, I don’t want to go. If I think there’d be less than 60, I will go. And I realized that posed a kind of strange logical problem for forecasting. Economics is very fond of forecasting and we call it expectations. If everybody had the same forecaster sitting on their desks, say a little plastic device and it forecasted that 74 people would go this Thursday, then nobody would go. If it said that it thinks 15 will go, everybody would go. So it was a strange situation where whatever people jointly forecasted would be negated.

0:05:53.0 BA: If many people think… If everybody thinks many people will go, and nobody will go. If they think few will go, everybody will go. So forecasts are automatically negated and it’s a kind of liar’s paradox for economics. I posed the problem, I came up with my own solution to it, which was to throw overboard any attempt to be deductive that wasn’t working very well.

0:06:24.9 BA: You can’t really come up with a solution that everybody shares. So I began to think, and this is with the inspiration of John Holland, he wasn’t part of this problem, but he certainly inspired my answer, what if everybody had their own collection of forecasts? So I might have maybe 15, 20 different ways to forecast, and the guy down the street might have a similar number but different forecasts. So you have a whole ecology of forecasts. And how would that work? Each… I could track which forecasting methods worked well for me, think of people doing this on the stock market, which they pretty much do all the time. I could see what didn’t work, throw those overboard and gradually find what does work. And so I programmed this to see what would happen, lo and behold, forecasts came out, forecasting methods formed a little ecology, because whether my method is reasonably accurate or not depends on everybody else’s method that I’m in there with. And so it was my strategy or my forecasts trying to survive in a little ecology or a sea of other people’s forecasts. The whole thing settled down to about 60, there was lot of chaotic noise around that, and it was a weird thing.

0:08:08.8 BA: Physicists got this right away, and my good friend at the time, Pare Back, took this problem, faxed it to all his physics friends and suddenly the problem became famous in physics. Economists didn’t quite know what to make of it. They walked around it and looked at it and said, “You know… ” Their usual solution was to say everybody’s identical by assumption, let’s say, therefore, they have identical methods of forecasting. But as I said, that doesn’t work in this problem. What does work is an inductive approach. I think maybe these possibilities for forecasting might work, somebody else might think other possibilities work. And the solution never quite settles down because as people keep trying these and different people show up as a result, the situation keeps changing. So it never quite settles, but it is attracted into this comfort zone of about 60, simply because if a lot of people are forecasting high numbers for quite a while, those forecasts won’t be validated. They won’t show up. If people are forecasting low numbers for a long time, and they’ll all show up and the high forecasts would be validated.

0:09:44.0 SC: So I…

0:09:45.7 BA: So there’s a kind of tendency to the middle.

0:09:47.9 SC: I can see why complexity is arising in this, right? You’re allowing the different agents to use different set of strategies, and there’s some obvious notion of complexity there. But one of the interesting things about it, though, is you use this to illustrate an issue in economics and… But there’s no mention of money, or prices, or goods or anything like that. So it makes me wonder, how are you even defining the word economics, which presumably, is the easy word in this phrase, complexity economics?

0:10:20.3 BA: [laughter] I wish. Yeah. What I… I think of the economy as the set of ongoing arrangements we make, I threw in the word ongoing, because this keeps changing. It’s the arrangements and actions we make to try to fulfil our needs. So you could say it’s a market, it’s got goods, it’s got prices, but what I just said is much more general, it could be Barter or it could be Robinson Crusoe living alone. It’s how we organise ourselves to try to fulfil our needs. And that often might mean we might have a need to hear Irish music every Thursday night.

0:11:12.0 SC: Got it.

0:11:12.3 BA: And so this is very much… Economists immediately recognise what I just said as an economic problem. There’s incentives to do something, but the space in which you’re trying to do it is a function of what other people are… The way other people are trying to solve the same problem. So the essence of economics, I think, is not… The essence of economics is not markets and prices and things being produced. In a real economy that’s very important, but the essence of economics is trying to make decisions in a situation where other people are trying to make decisions as well. And for me, that’s very much complexity.

0:12:02.9 BA: I’ll give you an example of that that I think is totally trivial. You might be on a freeway here in California. Let’s say the traffic’s quite dense for some reason, a lot of cars packed in. I’m trying to make decisions about my speed and the lane I’m using based upon the traffic. But the traffic consists of other people trying to make decisions independently in different cars in the traffic. And if you look at that formally… I sometimes use this as an example and I once shocked audiences. I said, “If you think about that formally, there’s no such thing as traffic.” Traffic doesn’t exist. Cars exist. The local cars surrounding you, we tend to call traffic, but it doesn’t quite exist. So it’s basically individuals trying to make decisions in a situation where other individuals are trying to make decisions. I got a lovely comment after saying that one time. “God, I would not like to be in a car if Arthur’s driving if he doesn’t believe in traffic.”

0:13:25.4 SC: No, but I like that, actually, this is great. I’ve already learned something, ’cause that’s the best definition of economics I’ve ever heard that we have desires, right? We have goals, we have incentives, and there’s a bunch of agents with different ones. And they’re sort of jostling up against each other, and how do they organise that? How do they make things happen? So to, hopefully, everyone’s mutual benefit, I suppose.

0:13:45.3 BA: Oh, well, to be very Western about it, we would say, or to be very economist about it, we’d say to our own benefit.

0:13:55.8 SC: Fair enough.

0:13:57.1 BA: And hopefully, hopefully, that spreads out and benefits other people. But at the centre of economics, at least, the centre of what’s interesting in economics is individuals, we call them agents, sometimes players, sometimes investors, sometimes consumers. And so individuals trying to make decisions in a situation, I would call it an ecology of other people trying to make decisions, maybe in the same milieu, or the same situation.

0:14:30.5 SC: And…

0:14:31.0 BA: And that’s what’s interesting, because people’s behaviour is not predictable. It’s not like ions and… This is maybe not the right jargon, ions in the spin glass, apparently are a lot more predictable than human beings.

0:14:50.0 SC: They are, yes, but I do like this because it casts economics in a light where the complexity aspects of it are right there front and centre. And I guess, therefore, for the audience, which might not be trained in ordinary economics, let’s contrast this, there’s this sort of the standard neoclassical economic picture, which you contrast with the complexity economics picture. And I think that you try to make the argument that standard economics is a subset of complexity economics, right? Complexity economics is not a subset of classical, it’s that, complexity economics is letting a lot more freedom into the way we think about things.

0:15:30.4 BA: Yes, I think standard economics, it’s called neoclassical economics. We’ve had this for the last 150 years or so, albeit in different forms. And the way economics is done… Or let me back up a bit. Around the 1870s, it began to seem a good idea to many economists, in England actually, Germany and Austria largely, France too and Europe, to think that they could use algebra and calculus to really look more formally and more rigorously at problems in economics. And that meant the price of doing that, I think that was successful and we’ve… It’s lasted for quite a long time and will still continue no doubt, but the price of doing that was, like in physics, which was emulating to quite some degree, you had to make certain assumptions. And the assumptions that economists came up with to solve problems in different settings in economics was to assume individual players that were very often identical, so that were rational, meaning they could solve any logical problem, or they could optimise in any setting.

0:17:07.6 BA: So they were supposed to, by assumption, be super bright, that they were well informed, they knew that everybody else was just like them. They knew everybody else’s preferences. And sometimes you could say, “Well, they’re a bit blurred, but they know the probabilities of how other people would react,” and so on. So they’re well informed. And then the whole thing is supposed to happen at equilibrium. So let me give my version of that. And what you’re interested in, in economics is how individual behaviour leads to an overall outcome. And of course, an overall outcome would feed back to individual behaviour just like the cars in traffic. So how do the individual agents together act so that some overall outcome may be in the market forms? And we want to look at situations that are in balance or consistent, just to keep the mathematics simple. So really, let’s look for a solution in which everybody’s identical. They’re all hyper rational, they’re solving an optimization problem, they’ll be under constraints, and you’re looking for an outcome that causes the individuals not to need to or want to change. So it’s a bit like saying, and forgive me here for being slightly mean about this, but it’s a bit like asking, “How do butterflies fly?”

0:18:52.0 BA: And, okay, well, we’ll figure that out by chloroforming them and nailing them to a board and examining the wings. I think that, that’s rather extreme to say, but we’re looking at consistency in standard economics, what behaviour is consistent with the outcome it mutually creates. And in complexity economics, the whole idea is to drop those assumptions, or at least, things didn’t come out that way. That’s not the way it started. But it now amounts to saying, what if individuals differ? What if they’re not hyper rational? What if they’re not well informed? And what if they’re just reacting to the outcome and the outcome never settles down? And they keep reacting at infinitum? And what would economics look like? So it’s not that anybody said we’re looking to have a more general economics. But if you start to say we’ll do away with the assumptions, it is more general. It’s like in mathematics, you can say, “Well we’re not quite sure we want to include Euclid’s fifth axiom here. So let’s drop that and have a non-Euclidian geometry, and let’s examine that.” And I don’t want to make complexity sound any more difficult or highfalutin than it is, but it’s essentially looking at economics under more realistic conditions.

0:20:33.9 BA: And what you find is the economy or the system you’re looking at starts to look much less ordered and perfect and mechanical and much more like changing ecology, where things change and may never settle down.

0:20:50.8 SC: You know, it’s funny because there clearly is some level of parallelism with physics. Number one, you mentioned the 1870s as the beginning of the mathematization of economics. And to my mind, when you say 1870s, I’m thinking the beginning of statistical mechanics and Boltzmann and Maxwell and thinking of thermodynamics coming out of all these motions of atoms and using similar techniques, but also the idea of equilibrium versus non-equilibrium. To my chagrin, most thermodynamics and statistical mechanics over the history of physics has also been in this equilibrium context where you sort of imagine that everything quickly reaches a more or less steady state and you can study things then, it’s only in the last 15 or 20 years that we’ve really made important progress in non-equilibrium statistical mechanics.

0:21:40.3 BA: Right. It’s not a coincidence at all. One of the founders of the field, in those days, Alfred Marshall, really important economist, at Cambridge, England was very highly trained in mathematical physics, I think he was second wrangler in physics, the year he graduated, so… And subsequently between 1870, roughly and 1900s economists did study statistical mechanics. They were studying people like Boltzmann, and others, who had brought in this point of view, and I wouldn’t say they lifted it wholesale, but they thought this was probably a similarly a very good approach. What I’m finding at the moment is that people sometimes say to me is, “Aren’t you trying to shoehorn economics into a new approach called complexity?” And I say, “No, not at all.” There is a whole movement in sciences away from looking at things totally mechanistically in some sort of Newtonian framework or some kind of statistical mechanics framework at equilibrium and looking at questions of how solutions form over time, not how they persist over time, which may not at all give you equilibrium, in fact, almost by definition it wouldn’t.

0:23:36.8 BA: And so we’re looking more at formation, we’re looking at how things form, be they a species or be they whatever galaxies or larger complexes in the universe. How do things change over time? Will they ever settle down? And so in some way, it’s not surprising that that emphasis in formation is also coming into the social sciences, economics in particular, and I think that it’s inevitable. One of the questions I’ve been asking myself is why have we switched from looking at order equilibrium perfection, like perfect rationality, why have we switched from that? In general, and I think that certainly with the rise of molecular biology and genomics, proteomics and other aspects of biology, we see much more complex or complicated in this case, we see more complicated structures that may never settle down, those structures evolve and change and reform depending on what is already there, so they don’t settle down necessarily, even at the molecular level or at a more metaxological level. They don’t settle down. We are starting to see cosmology, I think much more that way, and also, I would say computer science has come in. And since the 1950s, ’60s, we’re now much more aware that if you take a method and computation Alan Turing, now we call them an algorithm, your average algorithm doesn’t necessarily as a dynamic system, how something works out in a well-codified series of rules or steps that’s an algorithm, that doesn’t necessarily settle down at all.

0:26:05.4 SC: No.

0:26:05.9 BA: In fact, I like the work of Stephen Wolfram, who shows very, very simple systems cellular automata in general don’t settle into anything you can easily predict.

0:26:20.8 SC: Right.

0:26:22.3 BA: The highly ordered and simple ones are the exceptions. So overall science is starting to see order and perfection and equilibrium more as fortuitous exceptions, and thank God there is some order, and it’s looking to formation. And accepting that change is constant. In fact, we don’t have to rule it out precisely because we have computation and we can start to track this sort of thing, you don’t have to reduce it to algebra on a few sheets of paper. So science is changing. Economics, I think is following or will follow the zeitgeist and change itself.

0:27:10.5 SC: So as an observer who is not at all an expert in economics, I am wondering if we conjured up here a establishmentarian neoclassical economist, would they agree with this idea that these represent shifts away from the neoclassical paradigm. I know that at least in the realm of allowing agents to not be perfectly rational, isn’t that something where economists have sort of caught on to that already.

0:27:42.1 BA: Yeah, the answer to this I think is a bit complicated, but you could have two answers, one is nothing new here, move on. Or the other answer is, yeah, there’s a definite shift in the way we’re looking at things. So let me speak for both sides, I think in the standard neoclassical economics with these very stringent conditions that are there mostly to allow us to mathematize economics problems and look at them analytically, which is something I would certainly cheer on that sort of economics… Yeah, it’s been able to relax one condition here and one condition there, and you’re kind of holding on to the rest.

0:28:32.3 SC: Yeah.

0:28:33.6 BA: So let’s assume, for example, that people are not quite perfectly informed, but we’re still dealing however, with probabilities and we’ll still allow equilibrium and so on. So economics, I would say in that regard, yes, has relaxed stringent conditions here and then possibly somewhere else, and looked at the strangeness or interesting things that happen. So I’m not saying any of this is completely new, things I think in science are rarely completely new, but I think that’s… To go back to Thomas Kuhn version of things. Yeah, if you want to hold on to the older way of looking at things, you can hang on to the cliff edge by your fingertips and say, “Well, you just relaxed two conditions here.”

0:29:38.3 SC: Right.

0:29:38.8 BA: It’s still neoclassical. I don’t know, it’s like saying, how many conditions do you need to relax before you’re doing economics a different way.

0:29:50.3 SC: That’s fair, I just wanted to let the audience know that there would be the occasional neoclassical economist who would raise their hackles a little bit, but the point is, who cares, who cares what the label is, what matters is what we’re doing scientifically.

0:30:05.5 BA: I wouldn’t set up the question saying, what would a neoclassical economists make of this? You could say what… I was around academia in Stanford, when molecular biology was coming in big time in the ’70s, actually in the ’80s, and people… It was supposed to be revolutionizing this and revolutionizing that, and the people doing molecular biology, were very happy with discovering new things and the more standard folks were really annoyed that funding and so on, was going to this new version of the field. What I’d like to see is all types, a wider approach to economics, it doesn’t say any different set of assumptions or relaxing an assumption is a travesty and should not be published and should not be allowed. I’ve got a different way of looking at things than sort of saying, what would the old guard make of this? In fact, standard neoclassical economists don’t pay much heed to non-standard ideas, that’s in my experience, they’ve had to because there’s been a wonderful development in economics where behavioral economics has come along saying, “Okay, we accept people aren’t infinitely smart, what do they do in reality?”

0:31:41.1 SC: Right.

0:31:41.2 BA: And that’s now accepted. And then we’re saying equally, that it’s not that agents or people in the economy are all like, there might be multiple firms doing slightly different things, and we can allow them to have well-specified strategies that may differ. And so you get something like game theory, and eventually after 40, 50 years, that was accepted in economics, what I find, or actually a colleague of mine, Rob Axtell, has found it takes 40-50 years for a new version of economics to come in, game theory or behavioral economics, possibly this form of economics, complexity economics, it takes several decades before people get comfortable.

0:32:36.9 SC: Yeah.

0:32:38.0 BA: Textbooks have to change and editors have to loosen their thinking a bit, so I think it’s a matter of time before this version of economics, which is saying, what if you have more realistic conditions that people aren’t solving perfectly well-defined problems, that there’s an awful lot of what economists call fundamental uncertainty, you just don’t know how to forecast fundamentally, and the L for all problem. What you’re trying to do is to explore, to cope, to come up with new strategies and therefore things may always change, so that way of thinking is new in economics, it was not that new 200 years ago, people did think in these terms, but they couldn’t mathematize it.

0:33:34.1 SC: Yeah.

0:33:35.8 BA: And what has happened, I believe, and what’s driving this change, you can say it’s a bunch of people at the Santa Fe Institute or something. What’s really driving the change is that in the early 1980s, we all got computers, we got what we then called desktop workstations.

0:33:58.9 SC: Yeah.

0:34:00.0 BA: And that meant that we could set up models, be they in physics or in cellular automata or traffic formation, or indeed in economics, where we could write the rules differently and relax some of these incredibly tight constraints and still track what happens. And when we track what happens, we find things that are much more realistic. So my commentary, in all of this is that from my observation of science, the history of science in particular history of technology and economics, and whole fields tend to change when they use different instruments. The classic example is 1610 Galileo develops his own telescope points at a Jupiter, apparently Jupiter was going retrograde. The moment astrology and astronomy overlapped to some degree and lo and behold the better resolution meant that Galileo could see some fixed stars nobody had seen behind Jupiter. And as he looked in successive nights, he thought he could measure Jupiter’s transition against these fixed stars, but amazingly the stars were not so fixed.

0:35:40.0 SC: Not so fixed.

0:35:41.5 BA: And after about five nights he sort of says, “Holy shmoly.” I don’t know what he would have said In 1610, mamma mia or whatever. “Oh my God, these are moons around Jupiter.” So classically, when new instruments, new methods come into science, there’s a shift in what can be seen, and so when standard mathematics comes into economics, big time in the 1870s and on, you could see things more exactly, more rigorously with algebra and calculus just as you could in physical systems, but now we have computation, and computation is extraordinarily important in molecular biology, in genomics, in astronomy, in physics, itself in mathematics increasingly, and now in economics, it’s changing what we can see. We can look at more complicated systems, we can relax assumptions. And this is showing us a new world, and it’s showing us a different world and a world that’s looking far more ecological and far more biological and far more realistic, if you ask me.

0:37:12.9 BA: And any field that’s done that there’s a lot of skepticism. Galileo I wasn’t there at the time but Galileo, I believe, invited luminaries up to the top of his house in the evenings to look at the moons of Jupiter, many of them didn’t have decent eyesight, couldn’t see it. Young people could see it. Some accepted Galileo was right. But many said, “Look, this isn’t real astronomy, real astronomy is seeing something with your own eyes. How do I know that these little specs aren’t part of your instrument, and we all get moults in our eyes, so give me a break, you really haven’t discovered anything new here.” So I think this is… What’s happening in economics is a mixture of with these new methods with computation in particular. “Wow, look at this, look at that.” And on the other side, “Well, come on.”

[laughter]

0:38:23.1 SC: Let me just dig in a little bit more to this non-equilibrium aspect of things, on the one hand, it wasn’t crazy for neoclassical economists to focus on the equilibrium case, just like it wasn’t crazy for Maxwell and Boltzmann to focus on equilibrium thermodynamics. There are things that are more or less in equilibrium for a while, but there is in some case in the real world, in some sense, there’s a competition of time scales, right?

0:38:52.7 BA: Yes.

0:38:53.0 SC: In physical systems, things equilibrate when the microscopic processes are going on much faster than the sort of big macroscopic constraints that fix them, and presumably an economy has many different time scales, many different layers of organization going on, and they’re all sort of talking to each other. And so sometimes that equilibrium assumption or the conditions under which that’s a good way of thinking about things break down. Can we say anything in general about when that happens? Has complexity economics taught us something about that?

0:39:29.9 BA: I would say so, I think you are absolutely right. By the way, I’m not saying that complexity economics… The way it’s done applies to everything in the economy. There are many parts of the economy, say oil markets, for example, that reach equilibrium possibly after a day and a half [chuckle] something happens with OPEC, and then within half a day markets have equilibrated and there’s a new price formed and people have adjusted to that. So certainly in shorter time scales, equilibrium is warranted. And I also think that if you’re teaching economics, it’s a really wonderful benchmark, there’s a lot of deep thinking behind equilibrium in economics, people’s behavior is somehow in equilibrium or consistent with the incentives that are posed by the outcome. And I think that’s a wonderful insight, and it takes a year or two when you learn economics before that fully gets under your skin.

0:40:46.8 BA: On the other hand, I think there are short-term and long-term situations that are not subject to equilibrium. I’m trained as an engineer originally and a mathematician, and I wrote a book, in fact, spent many years looking at the evolution of technology. And at first I might have said, “Well, new methods come along say in steel making maybe once every decade or two.” Bessemer process arrives whenever 1875 or there about, the open-hearth process or other processes, Thomas process, these arrive and in between, you could say there’s equilibrium, but when I started to get into it, I realized that new technologies, think of computational technologies don’t change in bursts, that’s what we were trained to think from an equilibrium point of view. They change, if I may use the term, fractally, technologies are made out of other technologies, that they’re made out of yet other technologies. [chuckle] And all these are changing all the time, so even the digital technologies or the computer technologies are morphing and changing.

0:42:22.7 BA: The cloud becomes available or really good photonic transmission becomes available in the early ’90s, suddenly we’ve satellites and fiber optic cable all over the place. And so for technologies themselves, for the structure of the economy, it’s changing at all levels all the time. Now we could sort of freeze frame it and say, “Okay, let’s stop it here,” it might be a very old system, like whatever, fishing for lobsters and lobster pots haven’t changed, but in realistic parts of the economy, I’m standing here in Silicon Valley, [chuckle] Xerox Parc and things change here by the month or by the week, and new things come along at all levels, not just at an overall level, it’s not just that we got erbium-doped photonic amplifiers in 1987, all sorts of small changes, incremental and almost fractal, used metaphorically are coming in all the time, so the economy is always changing.

0:43:46.1 BA: And that changes the social structure that when automobiles came along, we got the suburbs, people could drive out of cities easily, daily, social structures change. History itself changes, what we can do changes, we can now fly across the Pacific or the Atlantic in just a matter of hours, social arrangements change, economic possibilities change, and all of that. If you look at equilibrium, has to be either frozen or ruled out of the picture. So the observation I would make in all of that is that economics, equilibrium economics is wonderful at looking at the logic of markets and incentives, and what I call, what economists call questions of allocation, how many widgets, how many grand pianos are produced versus how many computer screens are produced. Economics is wonderful at these questions of allocation of time or effort or allocation of budgets, and we’ve had 150 years of mathematizing that. Questions of where new technologies come from, how that reforms the economy, how that forms history itself? Once we got textile machinery and steam engines, history in some sense changed. And so those questions can’t be and haven’t been looked at formally, simply because they’re not equilibrium questions, so.

0:45:41.9 SC: Right. And as I… Sorry, as I understand it, one of the sales pitches for complexity economics is that it gives us a better understanding of bubbles and crashes, because these are inherently out of equilibrium phenomena. What kind of understanding does it give us is it not… Is it we’re able to predict that they will happen, or can these methods of reasoning actually help us predict when these dramatic phase transitions occur?

0:46:09.4 BA: I think it’s more… This would also apply in physics, I think it’s more of the former. We can predict that certain things will happen, we can’t usually predict when they’ll happen.

0:46:24.0 BA: To go back to my traffic example, if cars are very dense on a highway and they’re moving along but quiet then some small anomaly happens along the way, a dog runs out or somebody spills coffee [chuckle] over themselves, then some car might slow down, that might slow down the ones behind and suddenly that slow down or a jam starts to form. Now, complexity will show us in general that, that’s possible. You can theorize about it very often with equations, it’s not all computation, and you can do the statistics on it, you… But just like anything statistical, you can’t predict exactly when that will happen. So it’s like you might know a pandemic is possible, and likely to happen say in 2015, but you don’t know exactly when it will hit and how it will start. Same in economics.

0:47:30.7 SC: And along those lines, this is not really a question, but let me make a comment then you can re-comment on it. The idea that there are fluctuations is a pretty common one, right? There… I mean probably many people have heard, at least if they listen to me a lot that if you have a box of gas and you just wait long enough, eventually all the atoms or the molecules in the gas will fluctuate into one corner of the box or something like that. But in those kinds of situations where there is this huge disparity between the molecular scale and the macroscopic scale, those fluctuations are really, really rare. They’re very, very unlikely. We don’t need to worry about that happening in the room where we’re breathing the air, but in these economic or social situations where you have a multiplicity of scales and something interesting happening at every scale, that’s exactly when fluctuations become just inevitable part of your everyday life. Is that a fair way of thinking about it?

0:48:25.6 BA: Yes, I think so. In fact, the research that brought me into thinking about the economy is a complex system, is very much looking at systems that had positive feedback, we call them increasing returns in economics as opposed to diminishing returns. So under standard economics, we very often have some diminishing returns. If oil gets too pricey in the world market, then we will use maybe local natural gas or we will switch into hydroelectric over some time, and there’s a balance reached. But if there’s increasing returns or positive feedbacks, say if in 19 whatever, 90 or 2001. There’s small firms competing in the search engine business, AltaVista [chuckle] and a small company called Google and so on, if one of those gets ahead, then other people latch on to that and it’s a bit like a language, there’s no reason that English, which was spoken in the 1700s, 1500s should now be a world language, but if something gets ahead, it often pays you to go along with the system that gets ahead. So if something gets ahead by chance, it’ll grow, and the economy is full of such systems and small events in cases like that.

0:50:07.4 BA: I think in physics we call those nucleation or something, so these small events get magnified and form new structures, and it’s certainly true that tech, high technology, advanced technology works that way. If enough people are using, say, PayPal platform to pay off their friends or bills, then somebody else coming along, a friend of mine would want to adopt PayPal versus some other competitor and suddenly PayPal blooms and dominates the market. Economists before we started to look at such questions formally, economists would say, “Yeah, there are multiple outcomes,” but what can you do, [chuckle] there isn’t a solution we can agree on. Now with this new way of looking at things, and I think this would be true on physics, to say, “Oh there’ multiple,” whatever you call them, metastable states, where there’s multiple possible outcomes, and those lock in for a while, and then after a while, you go to something else that because some new structure comes along. And so in that sense, there are lots of phenomena that makes sense in this different form of economics, ’cause we’re allowing positive feedbacks, not just negative ones, we’re allowing formation, and we can examine those actually, not necessarily computationally, we can use non-linear stochastic methods or stochastic process theory to look at things like that.

0:52:01.3 SC: It makes me wonder about the… One of the very common ideas in complex systems is the idea that there is something happening at all scales, there are power laws in the structure of the system and so forth. Is this too much of a leap? Or does this have something to say about the almost inevitable nature of inequality in a society, like will it be the case that as long as economies are complex, that there will be really, really rich people and really, really poor people because they’re structured at all scales?

0:52:37.7 BA: [chuckle] Yeah, again, inequality is fairly complicated question, there are many answers any good economist could give you. I would say, here I would go back to looking at positive feedbacks that if one class of people gets ahead and they rig the system to some degree, politically. I’m not saying there’s any great conspiracies, but if some class gets ahead then they can educate their children better, get them off to a better start and… So it’s anomalies and inequalities. And even if you started off with everything equal in some perfect society, come about in the Soviet system changing into what’s now Russia in the early ’90s, it didn’t take very long for a fairly flat and reasonably even distribution, I just say reasonably of wealth and income, to turn into what amounted to an oligopoly and very uneven set of distributions. So I think that there are inevitably positive feedbacks that make it difficult to have reasonable equality all over the place, but that doesn’t mean we shouldn’t try.

0:54:15.8 SC: [chuckle] Fair enough. Okay, I just had to get that out there ’cause I’ve been wondering about that myself. But in happier news, let’s switch back to this idea that part of the toolkit in complexity economics is that agents are different. They have different information, they have different strategies and so forth, and that’s actually a feature in some sense. It allows the economy to evolve in ways that wouldn’t be possible if everyone moved in lock step. And I love the example that you show in one of your papers, which we’ll link to in the show notes of this prisoner’s dilemma tournament, right? The prisoner’s dilemma is this famous game theory problem, and there’s this idea that he had different algorithms for approaching it and they compete against each other. But surprisingly to me, I don’t know how long I’ve made it this far in my life without understanding this, but at least in the example you showed, there wasn’t an equilibrium reached. It wasn’t that there was a winner and eventually you found it, it’s that if you just keep running the tournament, different strategies seem to win at different times.

0:55:23.7 BA: Yes, I love that example. It’s actually due to a Swedish physicist called Kristian Lindgren, working around 1990, so this is not particularly new.

0:55:41.2 SC: No.

0:55:41.8 BA: He did a lovely piece of work imagining that there was a prisoner’s dilemma tournament. You don’t need to understand much about prisoner’s dilemma, just think of it as a collection of strategies that may differ. Let’s say there’s a 100 different strategies possible and they compete against each other one-on-one repeatedly at random, and if a strategy does well, it can replicate, it can reproduce itself if it continually does badly there’s a kind of trapdoor, and it falls out and isn’t seen again. What Lindgren did, I think was brilliant. Lovely, lovely work. He not only set up this computerized prisoner’s dilemma tournament, but he allowed that given strategies, say you might be playing tit for tat consistently, strategies could mutate. He had a way of coding so that a strategy could mutate into some neighboring strategy. And then he did something that I thought was profoundly interesting. He said, “Not only can they mutate, but they can randomly deepen.” So normally, I’m playing this prisoner’s dilemma against similar strategies that are a bit different, and I’m looking back, say one move, and suddenly I’m faced with a strategy that’s deepened. It’s mutated, it can look two moves back, two of its own moves, and two of my moves, and it’s playing me a 100 times.

0:57:35.4 BA: So this sort of history is good because you can start to figure out what the other person’s strategy is gonna be and act accordingly. So what Lindgren had done was to not just have mutation of strategies, but deepening strategies could notice more and get smarter. And then he sets all this thing up on his computer, hits the return button, and allows the strategies to interact and play each other. And he starts from just four simple strategies that can look back one move and, lo and behold, tit for tat starts to dominate and some other thing. Anti tit for tat details don’t matter, but certain strategies do quite well. And what fascinates me about Lindgren’s experiment is that you could stop it at any stage and say, “Oh, the solution’s being reached.” So after maybe 10, 20,000 such tournaments with these four strategies, one of them dominates, replicates, and you can say, “Oh, that’s the solution. This is the best strategy.” But then some strategy deepens and it enters randomly, and suddenly everything gets complicated. System goes wild, that strategy may or may not take over, but other similar strategies deepen and the whole thing gets far more complicated and goes wild for a while.

0:59:19.8 BA: It’s almost like a stock market that hasn’t settled this enormous amount of variation. And then things settle down again. And then at some future period, things might deepen again, and so on. And you’re tempted to say that strategies at each time you would stop the whole experiment, which might have taken days on some computer, in Sweden. You’re tempted to stop and say a solution has been reached. But a solution I believe, is never quite reached, because you can always deepen further and further and further, and get more and more information, more and more smartness. What this tells me it’s a bit like saying, technology keeps changing. You might think, well, we’ve got ships that will transport people in the 1940’s, ’50’s, across the Atlantic, and suddenly the Boeing 707 comes along, [laughter] and the game changes and then many such aircraft come along.

1:00:26.7 BA: What fascinated me about Lindgren’s experiment was that the strategies, wherever you looked at them formed an ecology. Strategies appeared that mutually fed off each other as strategy A supports strategy K, which also supports strategy A, and that dominates for a while. Strategies that are parasitic appear, they only work if they can exploit some other strategy, but then that might die out. So they die out, strategies there are times of great volatility, where you see an enormous amount of change and times of quiescence, where everything looks terribly stable. And as I looked at this, he’s got a graph of the outcome over a quarter of a million trials, or such tournaments, one leading to the next. When I looked at the graph, I thought, “Oh, my God, this reminds me very much of Paleobiology.”

1:01:39.5 SC: Right. Evolution, yeah.

1:01:41.5 BA: Yes. You have so many species of dinosaurs, this one depends on that one. They depend on dinosaurs that maybe are grazing, which depend on something else. So there are many food webs. And there’s mutualism, there’s competition, there’s periods of enormous change, periods of quiescence, the whole thing looked biological. Yet it was coming out of an extremely simple, well-defined system. And for me, it was kind of a shocker and a wake up call. It was done in 1990. It’s a very early version of what we now call Agent-based Model. The agents would be the strategies themselves.

1:02:28.0 SC: And, yeah, the parallel with evolution is very, very clear, and very, very provocative in some way. And it makes me think back again, to this timescale question, even if there were a single best strategy for the prisoner’s dilemma. You can imagine that the space of possible strategies is so large. Just like the space of possible genomes for a population of species is so large, that, who cares if there is a best one. You’ll never find it, what you can do is just spend a long, long, long time getting better and better, depending on what your environment is.

1:03:07.1 BA: Yeah. And if you might be a very, very smart strategy and be faced suddenly, maybe artificially by simple strategies. Maybe a meteorite hits the computer or something at the Tertiary-Cretaceous boundary, something changes, and then you’ll get a different system, growing up a different system entirely. So I think the biological metaphor is very good. And I would say in that case, very simple setups, which just consist of given strategies at the start. And some rules for how they might mutate or change or deepen, can give you not just complicated outcomes, but ones that appear biological or zoological. And for me, that is a more organic way to look at the economy. Yeah, there’s an architect wrote a book in the 1960’s Robert Venturi, very well known, about complexity in architecture. Now, he didn’t mean complex systems or scientific, he was looking more at really a reaction to the simplicity of the Bauhaus people.

1:04:35.0 SC: Yeah.

1:04:36.9 BA: The order that they wanted to bring in a Le Corbusier and others and he was rebelling against that. And he used this term that I like or two phrases to sum it all up. He said, [chuckle] in architecture recently, this isn’t a perfect quote, “We have been subject to prim dreams of pure order.” [chuckle] And I think that, that was true and that came out of a kind of… Possibly that come out of an enlightenment view of what Newton had really done. He showed that something quite complicated certainly in the solar system was actually a pure order, if you could start with…

1:05:29.0 BA: More equations, inverse law of gravity and all, and get something where the complications suddenly became ordered. And we began to think in the 1700’s, that science is like that, should be like that. And we got these prim dreams of pure order what Venturi was on about, and I love this, he said, “We need to allow for things that are, contradictory things that may even look out of place, things that look more organic and biological.” I can’t remember the exact words here. And what we want is to allow for messy vitality. And so what we’re finding and certainly this is my point of view. We’re finding that the world is a lovely mixture of pure order, and things changing, and things changing in a way that might never repeat. And I like the phrase messy vitality for that. [laughter] So I’m cheering economics on if it’s getting out of just purity of pure order, and equilibrium and perfection, and entering a time phase of looking at the economy as vital, alive, changing. Changing its structure all the time, with equilibrium, being part of the mix, but not dominating. So, this is an economics of what I would call messy vitality.

1:07:16.5 SC: One of the things that I really was struck by, in your article that I read was the idea that not only by starting with these agents that we can allow to have different strategies. Not only do we learn how the economy gets put together, the collective behaviour gets put together, but we learn about how agents reason, right? [chuckle] We try out different things, and we realise, “Oh, that’s what they were thinking all along. We never even knew that.” [chuckle]

1:07:44.1 BA: Well, there’s a lovely move in economics that I mentioned… A little behavioural economics and it’s basically showing… Or let me back up on that, in the standard way of thinking, if you think that’s perfect rationality, that all agents are facing well-defined problems and solving those perfectly, rationally, optimising and so on. Then any deviation from that appears to be stupidity. Rationality is bounded. They’re just not that smart. The way I would say it is otherwise and say that agents in the economy, the players, just simply, most of the time don’t know what the rivals will be doing. They don’t know what to do. It’s a bit like a year ago, a year and a half ago, in March 2020, we had a new thing. We had a pandemic, and we didn’t know how it would work out, how infectious it was, what strategies, what mutations were possible, and so on. So in the economy, most of the time, we don’t know. There’s what economists call fundamental uncertainty, you can’t even put decent probabilities on outcomes.

1:09:13.7 BA: You don’t know what… This is true in Silicon Valley, you might be entering some space, we’re going to dominate the space of driverless convoys of vehicles in Los Angeles or something. There might be 10 different companies trying to do that. But you don’t know what the technologies are for the others, or the resources or the regulations, or the insurance procedures and so on, you don’t know. And this is where standard economics would come to a halt and say, “Okay, problem isn’t well defined. Therefore, optimal behaviour is not well defined. Therefore, rationality isn’t well defined in this case.” And I remember one very prominent economist telling me that, he recognised that was very much part of the world and he had a Nobel Prize in Economics. He threw up his hands and he says, “I get it.” He said, “I believe that world’s like that, but what can you do?” [chuckle]

1:10:22.3 BA: And it was in Santa Fe that we started to think this was in 1988, when we started this program I was in charge of. And the economy is an evolving complex system that we began to think, “Yeah, people do make moves in ill-defined problems they explore. They try different options. They cook up different beliefs, they explore different strategies, they explore different means of forecasting. What if we allowed them to do this, at least on a computer? What would come out?” And I must say, we were very heavily influenced by the ideas of John Holland, who was one of the pioneers of how do you teach computers to play decent game of checkers, and then chess, all the way down now to Go and AlphaGo Zero, etcetera. There’s a lineage of thinking and basically saying, “Okay, we can try this, try that and learn what works.” But other agents are learning too, [chuckle] so the situation keeps changing. And there’s no point at which you say, you’ve optimised because the situation will change as other people make new discoveries.

1:11:46.6 SC: Yes. Seems to me that the lesson from the more recent experimentations with AlphaGo, AlphaZero, etcetera, is just, don’t try to teach them at all, let the algorithm learn. They’re much better at it than we are at teaching them and am I correct? Do I remember correctly that somewhere, you mentioned that there was a kind of a phase transition as a function of how much experimentation you allowed the algorithms to do? If they were only allowed to do a little bit, they never found a better solution. But if you let all the algorithms experiment a lot, a whole bunch of new things could happen.

1:12:23.4 BA: Yes, and we started to look at financial markets, at the problem of asset pricing. What you’d call a theory of the stock market, and we cooked up… There was a neoclassical solution to that, and it says, “If all investors were identical and operated with a single company, single stock, and that stock gave you varying random earnings, what prices would develop to reflect those random earnings what would the stock be worth stock price? How would it move over time?” Looks quite realistic is beautiful work done by Robert Lucas in the late 1970’s that became a kind of standard in economics. What we did was to say, “Well, hang on,” this was in Santa Fe, we are going to set up a stock market in the computer… This was in 1988, and the investors will be artificially intelligent computer programs, so and they will work by testing out forecasts and making bets and figuring out what’s working. But they are all doing this and they are all mutually presumably getting smarter, at least more experienced. And we’ll allow them to do that, exploring of new ideas, new strategies, all different, of course, among different players. We’ll allow them to do that at a certain rate, so what I would call a twiddle parameter physicists do this routinely I notice. We called it lambda. If lambda was low meaning they didn’t explore very often, then you were attracted…

1:14:30.5 BA: The whole system then is like a bunch of stars, all these different strategies start to be attracted towards Robert Lucas’s standard outcome. And the market settles down, and it’s almost as if there is a gravitational attraction towards this… So called rational expectations equilibrium, the neoclassical solution, and we saw that and the computer output showed that and I was terribly disappointed. I thought something more interesting would happen. When we turned the parameter up so they could explore a bit more often and indeed into a realistic mode of exploring. Because we had data on how humans changed their minds and so on. We found that there was phase transition. Suddenly, the standard theory, by the way, shows that there can be no such thing as a market psychology. Why? Because all agents are identical, there is actually no trading because the one agent wants to sell, the all other agents are the same and they want to sell and there’s no buyers, so the price adjusts until people are indifferent.

1:15:58.5 BA: There’s no technical trading, you can’t look at past history and predict in any way, there is no bubbles and crashes. When we turned our knob up a little bit and allowed people to explore more realistically often. Suddenly all those phenomena appeared, there was a market psychology trivially technical trading appeared. And it wasn’t because people were using these strategies to say “I’m optimizing,” they found that worked in a market for other artificial agents, were doing the same thing. So we got all these emergent strategies and lo and behold, these are phenomena that real markets show.

1:16:49.0 BA: So what we were looking for, can we find a problem where our apparatus our methodology, complex systems comes up with something that standard… That’s in the real word, but standard neoclassical economics can’t see. So suddenly our little telescope, it was on a Mac plus on my desk was able to show moons of Jupiter that were actually there. I’m exaggerating here, but for me, it was a break-through moment, we were showing actual phenomena that are statistically present in real markets, and I remember I’d gone back to Stanford then. I used to call the guy in charge of this in Santa Fe every two or three days, and I’d say, “What’s the market doing today?” And he says, “Oh it’s highly volatile at the moment, somebody has discovered new strategy and everybody else has to adjust.” Or, “Nah nothing’s happening, it’s quiet.” So it began to feel like a real market. There’s not been a lot of work done on this, and I think those findings hold that complexity economics can actually see realistic phenomena bubbles and crashes, periods of high volatility and periods of quiescence that you see in real markets, and for me, that was a breakthrough moment. It was remarkable.

1:18:25.4 SC: So, okay, I have two more questions, I’m just giving you a warning because they are easy questions to ask, but they’re very broad, so I’m gonna let you choose in what detail to answer them. The first one is, is there a worry that with this computational approach, like you just described, where you have the simulation running. That somehow, if that’s the right tool for this question, then we’ll never be able to get an understanding at the deeper level that we could get with an explicitly equation, analytic-based way of thinking about things, like we can study different systems on a system by system basis, but it’s harder to find the general laws is that a true worry?

1:19:10.6 BA: I think it’s… I wouldn’t call it a worry, but it’s definitely a concern. I don’t want to say computation is the answer to everything. And a great deal of the early work we did on what’s now called Complex Systems and Economics was equation-based, and I’m very much a trained and user of Nonlinear stochastic process theories. So we did an awful lot of that. But definitely, computation is here and it’s here to stay. What I would say is that when you set up an equation-based system, you’re basically setting up how individual agents usually behave, you’re well defining that there’s many assumptions you’re making and you can follow the logic via mathematical deduction from line to line to see how some outcome is formed. And that the outcome itself you can analyze analytically as well, it’s all there in equation form, but I… It seems clear to me that you’re not doing anything terribly different when you compute. You usually start off with a lot of equations in the algorithm you set up. You design your algorithm, the equations might differ because each agent maybe differs, and there’s a lot of exploration and discovery and mutations and finding new things, just as there would be in AlphaGo Zero, you’re not starting your equation, your agents off of sub Oz insights, you’re just starting them from zero and watching them get smart.

1:21:12.6 BA: And is this kind of a hodgepodge, is that just sort of… We can compute and then I can twiddle the assumptions and get something different out. I’ll say maybe in the wrong hands, things can go like that, but I think if you’re doing rigorous honest science, you are tracking your assumptions versus what it shows you when you’re doing that rigorously, just as you were in Kristian Lindgren set up or on the El Farol problem, you’re watching how things come out. You have a record, a detailed record step by step of how that came out, you can make arguments. Greg Chaitin does this that computational descriptions are every bit as theoretical as equation-based descriptions, that’s a side observation. I like it, and I’ve always admired his work, this comes out of algorithmic information theory, and that’s an aside, but what you can do is once you see something… Oh my God, our agents are getting into little bubbles and crashes, we are seeing periods of high volatility and low volatility, then you can go back and find deeper explanations, qualitative ones and test those out, isolate the phenomenon in question. So again, if you said, “We have equilibrium of full traffic and we’re not seeing anything but the equilibrium,” and we can see how the traffic forms and so on, yeah but with a computational system that’s open to new behaviors, you might see traffic jams forming, once you see traffic jams forming, you can slow that down and ask how that forms.

1:23:20.3 BA: You can refine the models, you can make toy models of that, you can reduce that into simple equations often, and you see this, I believe, again, and again in physics where some anomaly appears and then there’s a theory it… The anomaly might appear experimentally or it might appear computationally, or it might be at the level of cosmology, or it might be at the level of particle physics, but you see something happening in your experiments and computers are performing experiments, and then you try to isolate it, you look back through your data. How did that form? So I’m not too worried. I think that there’s an awful lot of very bad mathematics in every field and there’s rigorous and beautiful mathematics. Similarly, there could be a lot of bad simulation, but there could be beautifully formed and beautifully studied and beautifully analyzed simulation. I’m not against standard mathematics that’s nearly all my training, but I think it can sit alongside computation. We used to have geometry in the 1600s that was mathematics and Algebra was spurned and scoffed at by Kepler, and even by Newton until quite late in his career, and now we have… Then algebra came in and suddenly by 1750, that was kosher, and then we began to think that science meant reducing things to mathematics and mathematics was algebra.

1:25:12.1 BA: I’d say there’s a different form of mathematics, could be rigorous algorithmic mathematics, and we can study that as people like Wolfram have done or Greg Chaitin, and we can look at the reasons certain anomalies or outcomes, not even anomalies… Certain outcomes can occur. It’s very much like the controversy, in the four-color problem. That might’ve been the ’70s, or early ’80s…

1:25:41.4 SC: ’80s, yeah.

1:25:42.7 BA: The four-color problem, if you recall, in mathematics was solved by computation. Standard mathematicians said, “Oh my God, this isn’t mathematics. Where’s the reasoning and so on?” The computational people say, “Well, we have settled the problem.” [laughter] And it was as if the astronomers in 1610, many of them were saying, “Astronomy means looking closely at the heavens maybe with good instruments, but not with these new fangled telescopes.” So computer people were saying the computer gives you a new instrument, a new telescope. And I’m on the side of, not thoughtless computation, I just think we have a new instrument. Computation or algorithmic mathematics, we should treat it very carefully, very rigorously, and we should know what we’re doing. And it stands alongside earlier forms of mathematics as valid as ever, but it’s allowing us to see more deeply and allowing us to see new things.

1:26:55.7 SC: Yeah, that sounds perfectly fair. And then the last question, which is maybe implicit a little bit in things you’ve already said, but the obvious one is, what are the policy implications of this way of thinking? Do you have a way of summarizing for people who are out there pulling levers on our economy, how thinking about complexity is gonna help them out?

1:27:17.7 BA: Well, if you… Yes, I would say that what you can think of is something that economists now routinely call policy labs. You can take, for example… Just… Excuse me. To give a recent example, we are faced with a pandemic, and as recently as maybe three, four months ago, we were wondering if different types of vaccines come along, who should they be distributed to and why. So standard economics or standard decision thinking would make that somewhat difficult to solve in a conventional way, not totally difficult, set up equations and so on. But what people were able to do was to put questions like that on a computer, and if it was done carefully, you could get good answers. You’re basically setting up what John Holland would have called a flight simulator for the mind. He was saying, “Okay, the obvious thing would be to give vaccines to old people, and they won’t… If the vaccines are effective, they won’t die.” But that is just obvious. A more subtle approach, say, “Let’s give vaccines to younger people, the ones who are out partying and drinking in bars and so on, and that might cut the transmission way down, so eventually old people will benefit.”

1:29:00.1 BA: Of course, we want a combination of both. But what we can do for policy is to set up detailed models, possibly computationally, in an experimental lab and really start to understand the system, vary this, vary that until we get really good intuition, learn what you can from the real world and make your models accurate. I want to add one other thing about policy that fascinated me. If you assume any outcome is at equilibrium, that implies that there is no group of people, no agents who can game the system or exploit it to their advantage. And why? If they could in an equilibrium economics, they would already have done that. And so the system wouldn’t be at equilibrium if someone can come in and make a change, or would want to make a change. If we relax this equilibrium assumption, we might say something like, “Oh, Russia’s going to make capital markets free in the years 1990,” you could assume it’s gonna find a conventional equilibrium quickly. But we could also make the assumption there might be coteries of players, small groups, who exploit the system to their own advantage, which is exactly what happened. And you can see this again and again, so I think with this, if you drop the idea of equilibrium, then you are open to the view that systems can be exploited or gamed, and we’re always surprised when that happens.

1:30:53.0 BA: Under this new way of thinking, we shouldn’t be surprised. In fact, we can possibly anticipate how that might happen. It’s a bit like saying, “The US Navy has a very good code encryption system. It’s wonderful and It’s not gonna be broken,” and that would be the equilibrium standard. We could also say, “We have a new encryption system for the US Navy. We’re going to invite people to try to break it.” And I think that’s a very different outlook. And when you assume equilibrium, you’re basically assuming the system, nobody can beat the system. And that’s patently untrue.

1:31:40.9 SC: It’s a good lesson. It’s a good lesson that I think that we are getting over a few of our recent podcast episodes here that we need to complexify our world view and the way that we think about things. And that’s true whether we’re in policy, or just trying to be abstractly thinking about how the world works. So you pushed us in that direction very effectively. Thanks so much, Brian Arthur, for being on the Mindscape Podcast.

1:32:00.7 BA: And I am delighted, and thank you as well, Sean.

[music][/accordion-item][/accordion]

10 thoughts on “161 | W. Brian Arthur on Complexity Economics”

  1. I love this! A well spoken guest, a consummate scientist interviewer, and compelling science far out of my experience, presented in a graspable way. Thx!

  2. I love this. I distributed it to 30-40 economist colleagues before it was even finished … wonderful stuff.
    Keep Going Sean!!

  3. All these years I thought Economics was a boring subject, just for number crunching nerds – wrong again!

    BTW, W. Brian Arthur’s economic forecasting problem, which he calls the EI Farol problem, where EI Farol was a ’90s’ bar in Santa Fe where people didn’t want to go because it was so popular, reminded me of the similar quote:

    ‘Nobody goes there it’s too crowed.’
    – Yogi Berra

  4. Pingback: Sean Carroll's Mindscape Podcast: W. Brian Arthur on Complexity Economics | 3 Quarks Daily

  5. Sean, you didn’t discuss with Brian the fundamentals of all economy: the sun and our climate. And Brian didn’t bring it up himself. What’ s up?

  6. A ‘complex system’ is a system composed of many components which may interact with each other. Examples of complex systems are Earth’s global climate, organisms, the human brain, infrastructure such as power grid, transportation or communication systems, social and economic organizations (like cities), an ecosystem, a living cell, and ultimately the entire universe.
    – Ref: Wikipedia ‘Complex system’

    The You Tube video ‘What is a Complex System?’ gives a good explanation of what distinguishes a complex system from a simple system, how complex systems are formed from individual parts, which interact with each other, in either constructive or destructive ways, and how these systems can evolve over time.

  7. Thank you. I enjoyed every minute of the conversation and it convinced me once again that studying economic history was a good choice all those years ago.
    My question is on the manifestation of inequality in society. First, I paraphrase Prof. Arthur freely on the nature of the field of economics as the study of how individuals organize activities to satisfy their various needs in a world of scarcity (please correct me if I misrepresented his definition). Secondly, using the sudden growth of financial inequality in post-Soviet Russia in the early 90’s as an example, raises a question. Was the sudden financial inequality in society new or was it another manifestation of pre-existing privileges?
    The argument for it being a new manifestation of pre-existing conditions is the following. Soviet citizens organized their lives differently in a restricted economy to satisfy their needs. State and party rationing was the way supply and demand were organized. A more prominent role in the communist party and/or society translated in a better position to acquire products and services. Communist cadre shops also know as dollar shops were the way the ‘rich’ obtained luxury goods, the masses had no access to these shops. To test the statement ‘power becomes money’, it could be interesting to track a the lineage of prominent Soviet party and state officials (in particular from the KGB and affiliated institutions) to the current oligarchs of today’s Russia.

  8. Pingback: a história de Marte, falar com alienígenas #ounão, economia da complexidade, tipografia x inclusão – radinho de pilha

  9. Pingback: Daily Bookmarks to GAVNet 08/28/2021 | Greener Acres Value Network News

  10. I love this podcast, but must register my own personal, grave reservations about the nature and potential usage of Prof. Arthur’s work. I do not do this lightly: I read his book The Nature of Technology, over a decade ago, and have followed his research trajectory even longer ago than that, when he was working on the increasing returns stuff in the ‘nineties. At the time I entertained objections of the sort I will elucidate below, but never had a chance to air those concerns publicly. After listening to this podcast carefully, stopping its progress to take notes (and this after hearing Prof. Arthur on Bloomberg’s Odd Lots podcast–22d July edition), I have decided to put my concerns out there, if only to see what kind of objections others may have to my criticisms. For I anticipated that Prof. Arthur, for reasons I hope will become crystal clear in what follows, would receive a favorable response on this podcast. So here goes. I thank Prof. Carroll and all the Mindscape community for hearing me out on ideas I have been keeping to myself for over a decade, but have been unable to cast off.
    I will admit at the outset that, although a nonprofessional in economics, I have studied in some depth the classical, neoclassical and heterodox strands of economics and the history of economic thought, and consider myself of the Marxian tradition where my own convictions, such as they are, are concerned. I am not much of a mathematician. But I really don’t think these admissions have much to do with the subject matter I will put forth; I leave it to others to demonstrate how I may be wrong about this, and welcome attempts to do so.
    My chief objection to the complexity economics project concerns the fact that it looks to me to be an attempt to graft a veneer of respectability on to an approach to economics that has been a complete failure where accounting for the massive social shifts that have characterized the development of the economic system, which I am happy to call, in a continuous sense, capitalism, since its inception in the sixteenth or seventeenth century, and of extremely limited use when accounting even for predictions pertaining to very limited phenomena, like developments in small or isolated markets, over long periods. And It does so in a very peculiar manner: after noting the failure of the historical quest to apply algebraic and calculus-derived equations to predict–not even describe, according to people like Milton Friedman–economic phenomena without employing clearly unrealistic assumptions, the complexity approach allows for a relaxation of certain assumptions (whilst retaining a general attitude that the larger economic domain is pretty strictly circumscribed by individual behaviors pertaining to intention formation and execution), like requirements about perfect knowledge on the part of all market participants that, make market exchanges such as we know them in the real world, well, simply impossible in the first place. With this relaxation, complexity theorists “notice” that explanations can be derived using extremely circumscribed conceptions of behaviors derived from game theory and the like (tit-for-tat responses and so on), which are of exceptionally limited use in accounting for real economic events most of us care about (like poverty)–i.e. developing a computer program that runs simulations of stock trades on the basis of such patently simplified behaviors–that are not as clearly false as neoclassical accounts. So it is not like complexity economists start out trying to explain behavior in all its complexity; instead, they try to dress up behaviors that can only be classified as bearing economic significance by limiting the realm of the economic to a ridiculously circumscribed extent, presumably to allow for a liberation from other unrealistic assumptions, add some fancy mathematics and computer simulations, come up with a result that, although of no use when it comes to describing the kind of economics most of the rest of us are interested in, at least is not false on its face, and, in yet another sneaky step, suggests a mimicry of biological or ecological systems.
    To me, this is crazy: using techniques derived from computation to breathe life into behaviors strictly circumscribed to allow for incorporation into equations derived from calculus and algebra, but only if the behaviors are turned, by the employment of assumptions, into what can only be called non-behaviors (markets that. would be transaction-less otherwise are transformed, only through assumption of perfect knowledge, etc. into markets we are supposed to compare to the ones we encounter in the world) in order to simplify the assumptions, not to explain actual behavior, but to demonstrate this technique isn’t false on its face.
    But it gets worse: the talk of ecosystems and such sounds nice, and no doubt appeals to a lot of educated people these days, but, I ask, what on earth kind of ecosystem are we talking about? The real economy in the last 20 years alone has endured a number of catastrophes many have characterized as one-in-a-lifetime events, at least, and the authorities have been forced to adopt measures no one in such elevated positions considered imaginable only a few years-or even months–beforehand, simply to keep the whole complex mess ticking over in some recognizable form for a little while longer. Some ecosystem: to me, any imaginable “ecosystem” functioning under these conditions would have been blown to smithereens in short order: it is like imagining ecosystems on earth surviving not one, but a couple of malfunctions of the sun in a decidedly short stretch of geological time. The ecosystem metaphor is wholly inadequate to apply to an economy.
    And the effect of all this? Well, I believe it plays no small role in diverting intelligent, educated people, including many Mindscape listeners, from trusting their own intuitions regarding phenomena like poverty, especially things we actually have to become active politically to begin to address, and leave such matters to experts who failed completely to even see the most devastating crises coming; indeed, many conventional economists were saying just a little over ten years ago that financial crises had become impossible. I am not accusing Prof. Arthur of doing this intentionally. But I wonder at a kind of bias that follows his approach, and find it telling that when he spoke of poverty in the Minscape episode, he could only do so by using Russia in the ‘nineties to explain how his approach might be applied to such a thing. We have encountered two devastating economic crises in less that fifteen years; one would have thought, perhaps if one’s mind weren’t laser-focused on game theory and ecosystem analogies, that he would;dn’t have to reach so far to illustrate the pertinence of his approach to what concerns most of us, and is ruining all too many of us.
    Anyway, thanks for hearing me out. And thanks to Prof. Carroll for a terrific podcast.

Comments are closed.

Scroll to Top