The Black Swan Problem. Håkan Jankensgård
Чтение книги онлайн.
Читать онлайн книгу The Black Swan Problem - Håkan Jankensgård страница 9
Unless we are talking about a truly truncated distribution, like income having zero as the lower limit, it is a potential mistake to think that the ‘true’ underlying data‐generating process is somehow capped by the observed minimum and maximum values. If we feed all the observations we have into a statistical software, we can ask it to analyse which random process that most plausibly generated the patterns in the data. Now, if we immediately take the process identified by the programme and draw random values based on it in a simulation, it will come up with a distribution that contains outcomes that go beyond the lowest/highest observed values in the dataset without the probability of that dropping to virtually zero. This will always happen as long as the approach is to assume that there is some underlying random process generating the data and use real data to approximate it. It is as if the software doing the fitting ‘gets it’ that if we have observed certain extreme values, even more extreme observations cannot be ruled out. If we have observed a drop in the S&P 500 of minus 58% over a certain period of time, who would say that a drop of minus 60% is outside the realm of possibilities? The simulated extremes will lie somewhere to the left (right) of the minimum (maximum) observed in the data. The tail we model in this way will encompass the observed tail and then some.
The upshot of this discussion is that experiencing an outlier that is only somewhat more extreme than the hitherto observed minimum/maximum should fall within the realm of benign uncertainty. We should not be surprised or taken aback by it. There is an implied probability of that, meaningfully separate from zero, being handed to us by the fitted distribution. We have to add ‘by a lot’ for it to count as wild uncertainty, because then the tail has shifted dramatically and in a way that was by no means implied by the historical track record. It is an outlier so extreme that it has a probability of effectively zero, even when the underlying random process we use to form a view of the future has been fitted to all the tail events in the historical track record.
Under conditions of wild uncertainty, it is clear that the concept of probability starts looking increasingly subjective and unverifiable. Indeed, Taleb calls probability ‘the mother of all abstract concepts’ (Taleb, 2007, p. 133) and maintains that we cannot calculate probabilities of shocks (Taleb, 2012, p. 8).8 It is important to see, though, that his scorn is reserved mostly for those who insist on using the symmetric normal distributions and its close relatives. The properties of the normal are seductive because we can derive, with relative ease, all sorts of interesting results, but it is, Taleb maintains, positively dangerous as a guide to decision‐making in a world of wild uncertainty. Why? Primarily because of how it rules out extreme outliers and blinds us to them. A key feature of the normal distribution is that its tails quickly get thinner the further removed from the mean you move, which implies that their likelihood of happening gets lower and lower. In fact, as we move away from the mean, the assigned probabilities drop very fast – much too fast, in Taleb's view (Taleb, 2007, p. 234). The stock market crash in October 1987, for example, saw a return of minus 20.5%. The odds of a drop of at least that magnitude would have been roughly one in a trillion according to the normal. In other words, anyone going by that distribution would have considered it, for practical purposes, an impossible event.
The first priority, therefore, is to avoid the normal distribution like the plague. In its place, if we still feel compelled to work with probabilities, Taleb offers the idea of fractals. Fractals refer to a geometrical pattern in which the structure and shape of an object remains similar across different scales. The practical implication is that the likelihood of extreme events decreases at a much slower rate. If one subscribes to this view, the probability of finding an exceptionally large oil field is not materially lower than a large or medium‐sized one because the geological processes that generate them are scale‐independent. This relation between frequency and size is associated with the so‐called power law distributions, which we will relate to socio‐economic processes in Chapter 7. According to Taleb, the idea of fractals should be our default, the baseline mental model for how probabilities change as we move further out on the tail (Taleb, 2007, p. 262).
In many cases, we lack data that we can explore for mapping out the tail of a random process. In this kind of setting, uncertainty tends to be wildly out of the gate. Technological innovation fits right into this picture, because it brings novelty and injects it into the existing, already volatile, world order. New dynamics are set in motion, triggering unintended consequences and side effects that ripple through the system in an unpredictable fashion. Because we keep innovating, we also keep changing the rules of the game, forever adding to the complexity. Two Black Swans that have sprung from the onward march of technology are the emergence of the internet and the more recent invasion of social media and mobile phones into our lives. There was no existing dataset that we could have studied prior to them that might have suggested that such transformations of our reality were about to happen. Or, more importantly, that they were even possibilities at all. To appreciate how technologies that we are completely immersed in today and take for granted are actually Black Swans, cases of wild uncertainty, consider the words of Professor Adam Alter of New York University:
‘Just go back twenty years [to 2000] … imagine you could speak to people and say, hey, you are going to go to the restaurant and everyone's going to be sitting isolated and looking at a small device, and then they're going to go back home and spend four hours looking at that device, and then you're going to wake up in the morning and look at that device … and people are going to be willing to have body parts broken to preserve the integrity of that device … people would say that is crazy'9
Alter's thought experiment of going back 20 years in time and imagining talking to people about something highly consequential that later happened is a useful one for deciding whether something is to be considered a Black Swan. If you imagine their reaction to what you describe would be that it is ridiculous or inconceivable, chances are that you have found one.
THE ROLE OF EXPECTATIONS
To continue our story, it becomes clear that any characterizations of random processes will be increasingly subjective as we move away from data‐driven approaches. We leave the world of inference from data and enter the realm of the imagination. Our faculties for reasoning and logic can partly make up for a lack of data – we can figure certain stuff out. When the imagination fails us, we have those truest of Black Swans, the inconceivable ones, the ‘unknown unknowns’. We have already mentioned the 9/11 attack as being in this category. In a similar way, the collapse of the Soviet Union was utterly unthinkable to the Western intelligentsia and political establishment at the time. George Kennan, an American diplomat and historian, commented as follows, based on a review of the history of international affairs in the modern era:
‘[It is] hard to think of any event more strange and startling, and at first glance inexplicable, than the sudden and total disintegration and disappearance … of the great power known successively as the Russian Empire and then the Soviet Union.’10
That is, nobody expected the Soviet Union to crumble at this point in time. One of the most crucial aspects of Black Swans is that they are always measured against expectations and prior knowledge. This is an underappreciated point. As noted, most people use the term loosely, largely equating it with high‐impact outcomes that were somehow shocking to us. With the considerable difference, perhaps, that calling it a Black Swan