The Fallacy of Forecasting
"It's tough to make predictions, especially about the future."
Physicist Neils Bohr (1)
For all of human history man has longed to know the future. We Jews had our prophets, the ancient Greeks had their oracles, Renaissance people had their Nostradamus. Modern Man has astrology, Tarot cards and.......forecasters.
With modern astrophysics we can forecast astronomic events such as eclipses and appearances of known comets with exceptional accuracy decades in advance. Meteorologists have become adept at forecasting major weather events up to a week in advance.
But forecasting events in human history, such as wars, revolutions, and economic catastrophes is still no better than guesswork , according to a remarkable new book entitled "The Black Swan: The Impact of the Highly Improbable" by Nassim Nicholas Taleb. (2) The term "Black Swan" used in the book is a metaphor for an event (such as the 9/11 attacks) that is totally unexpected and has a major impact, either good or bad.
It is characteristic of the human mind to see events as part of a pattern, so that after a Black Swan event has occurred we try to fit it into a historical narrative that makes sense. According to Taleb, people strive to find a logical cause and pattern to even the most random incidences, which may explain the popularity of conspiracy theories (3). Evidence that confirms an accepted theory is welcomed, while equally valid evidence that points the other way is ignored.
Here are some myths blown away by The Black Swan:
1. The past is a good guide to the future.
In July of 1914 Europe had enjoyed over 40 years of peace, and many believed the age of war in the heartland of Europe was over. Within weeks, western Europe was the scene of the most destructive war in the history of the world at that time.
Remarks such as "The stock market goes up about 10% per year" and "Real estate prices always increase over time" indicate that the same tendency to extrapolate from the recent past holds sway today.
2. Experts can forecast economic trends.
In 1970 an official US government estimate, signed by the Secretaries of Interior, Treasury, State and Defense, predicted that the price of foreign oil in 1980 would not "experience a substantial increase." It went up tenfold!
On October 19, 1987, the Dow Jones Industrial Average dropped over 500 points. How many Wall Street analysts predicted that "Black Swan"? None-----all the charts and financial data they had failed to anticipate the historic plunge.
In January, 2006, The Wall Street Journal forecast that 2006 would be a bad year for stocks; the Dow went up 16% over the next 12 months.
Psychologist Philip Tetlock (4) asked 300 credentialed experts in economics and politics to judge the likelihood of a number of specific world events in the coming five years and to estimate the "error rate" of their predictions. The actual error rates were many times higher than the estimates; the predictions of the best-known experts were the worst of all! They thought they knew much more about the future than they really did.
3. The Theory of Games can be applied to the real world.
If you flip a coin 99 times and get heads each time, what is the probability of getting another head on the 100th trial?
Any mathematician will tell you that the probability of heads is 50%, since the coin has no memory. But a gambler will tell you that it is nearly 100%,, since a coin that did that is bound to be loaded to land heads-up. This is a paradigm of the difference between a theorist and a practitioner----- in the real world, believe the practitioner!
Unlike the world of mathematical games with their simple and fair rules, the real world is full of cheaters, liars, charlatans and the like. Just ask anyone who ever bought Enron stock!
According to Mr Taleb, the world is much more complicated and less predictable than we think it is. The main reason is that people, unlike planets and comets, have free will, so events dependent upon human actions can never really be determined in advance. This is a lesson we all can use!
--------------------------------------------------------------------------
(1) Quoted in The Black Swan, p.136. According to the book, Yogi Berra often said this, but Bohr originated the saying.
(2) Random House, New York, 2006. The name of the publisher is too appropriate to be true!
(3) See the Feb.19, 2008, Glazerbeam on conspiracy theories.
(4) "Expert Political Judgment" by Philip E Tetlock, 2005.
Physicist Neils Bohr (1)
For all of human history man has longed to know the future. We Jews had our prophets, the ancient Greeks had their oracles, Renaissance people had their Nostradamus. Modern Man has astrology, Tarot cards and.......forecasters.
With modern astrophysics we can forecast astronomic events such as eclipses and appearances of known comets with exceptional accuracy decades in advance. Meteorologists have become adept at forecasting major weather events up to a week in advance.
But forecasting events in human history, such as wars, revolutions, and economic catastrophes is still no better than guesswork , according to a remarkable new book entitled "The Black Swan: The Impact of the Highly Improbable" by Nassim Nicholas Taleb. (2) The term "Black Swan" used in the book is a metaphor for an event (such as the 9/11 attacks) that is totally unexpected and has a major impact, either good or bad.
It is characteristic of the human mind to see events as part of a pattern, so that after a Black Swan event has occurred we try to fit it into a historical narrative that makes sense. According to Taleb, people strive to find a logical cause and pattern to even the most random incidences, which may explain the popularity of conspiracy theories (3). Evidence that confirms an accepted theory is welcomed, while equally valid evidence that points the other way is ignored.
Here are some myths blown away by The Black Swan:
1. The past is a good guide to the future.
In July of 1914 Europe had enjoyed over 40 years of peace, and many believed the age of war in the heartland of Europe was over. Within weeks, western Europe was the scene of the most destructive war in the history of the world at that time.
Remarks such as "The stock market goes up about 10% per year" and "Real estate prices always increase over time" indicate that the same tendency to extrapolate from the recent past holds sway today.
2. Experts can forecast economic trends.
In 1970 an official US government estimate, signed by the Secretaries of Interior, Treasury, State and Defense, predicted that the price of foreign oil in 1980 would not "experience a substantial increase." It went up tenfold!
On October 19, 1987, the Dow Jones Industrial Average dropped over 500 points. How many Wall Street analysts predicted that "Black Swan"? None-----all the charts and financial data they had failed to anticipate the historic plunge.
In January, 2006, The Wall Street Journal forecast that 2006 would be a bad year for stocks; the Dow went up 16% over the next 12 months.
Psychologist Philip Tetlock (4) asked 300 credentialed experts in economics and politics to judge the likelihood of a number of specific world events in the coming five years and to estimate the "error rate" of their predictions. The actual error rates were many times higher than the estimates; the predictions of the best-known experts were the worst of all! They thought they knew much more about the future than they really did.
3. The Theory of Games can be applied to the real world.
If you flip a coin 99 times and get heads each time, what is the probability of getting another head on the 100th trial?
Any mathematician will tell you that the probability of heads is 50%, since the coin has no memory. But a gambler will tell you that it is nearly 100%,, since a coin that did that is bound to be loaded to land heads-up. This is a paradigm of the difference between a theorist and a practitioner----- in the real world, believe the practitioner!
Unlike the world of mathematical games with their simple and fair rules, the real world is full of cheaters, liars, charlatans and the like. Just ask anyone who ever bought Enron stock!
According to Mr Taleb, the world is much more complicated and less predictable than we think it is. The main reason is that people, unlike planets and comets, have free will, so events dependent upon human actions can never really be determined in advance. This is a lesson we all can use!
--------------------------------------------------------------------------
(1) Quoted in The Black Swan, p.136. According to the book, Yogi Berra often said this, but Bohr originated the saying.
(2) Random House, New York, 2006. The name of the publisher is too appropriate to be true!
(3) See the Feb.19, 2008, Glazerbeam on conspiracy theories.
(4) "Expert Political Judgment" by Philip E Tetlock, 2005.
Labels: Black Swan, prediction, probability