In the early 18th century, Daniel Bernoulli proposed that individuals maximize expected utility when they make decisions under uncertainty. This reasoning launched the rationality model of human behavior that underpins many of today’s theories in economics and finance, including modern portfolio theory (MPT). The mathematical models that sprang from these theories provide a veneer of orderliness while obscuring the behavioral messiness of real-world financial markets.
The Rise of MPT
Pillar I
In 1952, Harry Markowitz published his article on portfolio selection, arguing that portfolios should optimize expected return relative to volatility, with volatility measured as the variance of return. He proposed the now ubiquitous efficient frontier. By the mid-1960s, this mean-variance model had become a mainstay within academic finance departments.
Pillar II
Combining Markowitz’s model with restrictive assumptions regarding investor rationality, information availability, and market trading structure, Bill Sharpe (and others) derived a model of capital market equilibrium in the mid-1960s. Soon the capital asset pricing model (CAPM) became a central tenet of MPT.
Pillar III
Eugene Fama erected the final MPT pillar in the mid-1960s, in perhaps the most famous finance doctoral dissertation of our generation. Extending the concept of rational investors to its logical conclusion, Fama proposed the efficient market hypothesis (EMH), that financial market prices reflect all relevant information and thus generating excess returns through active management is impossible.
MPT quickly became the ascendant paradigm. For the quantitative-based analysts who dominated the investment industry, a simple theory like MPT that explained messy financial markets was very attractive. Now they had a rigorous theory of markets and a rational approach to building investment portfolios.
But their conception could not have been further from the truth.
The Fall of MPT
The first shots were fired across MPT's bow in the late 1970s.
The initial CAPM empirical tests uncovered a negative return to beta relationship, the opposite of what was predicted. Rather than reject CAPM, however, the discipline responded by searching for statistical problems in these tests.
As EMH came under attack, Sanjay Basu’s research demonstrated that low P/E stocks outperformed high P/E stocks. In the early 1980s, Rolf Banz showed small-cap stocks outperformed large-cap stocks. The problem, of course, is that both P/E and firm size are public information and should not allow investors to earn excess returns.
In response, EMH proponents integrated these anomalies into a new “factor model,” though they admitted they did not know if the model captured either risk or opportunity. Ironically, these anomalies were then used by financial industry adjuncts — investment consultants, for example — to create that classic active management handcuff, the style box. In turn, the style box unintentionally led to additional active management restraints, such as style drift and tracking error.
These same proponents also argued that the EMH remained viable as long as active equity managers could not use anomalies to earn excess returns. But for the last 20 years, multiple studies have shown that many active equity managers are superior stock pickers and do indeed earn excess returns on these holdings. Russ Wermers demonstrated that the average stock held by active equity mutual funds earns a 1.3% alpha, and Randolph B. Cohen, Christopher Polk, and Bernhard Silli found that ex-ante best idea stocks earn a 6% alpha.
In the early 1980s, Robert Shiller argued that almost all volatility observed in the stock market, even on an annual basis, was noise rather than the result of changes in fundamentals. Since EMH held that prices fully reflect all relevant information, volatility driven by anything other than fundamentals strikes at the very heart of the theory.
Shiller’s noisy market model also created problems for Markowitz's portfolio optimization. If volatility is the result of emotional crowds, then . . . emotion has been placed in the middle of the portfolio construction process.
So rather than being a risk-return optimization, it is an emotion-return optimization.
In summary, all three pillars supporting EMH have been toppled.
Rejecting the World Rather Than the Paradigm
Much of finance pushes aside the mounting contrary evidence and soldiers on under the yoke of the MPT paradigm. This might seem surprising: Isn't finance a discipline based on empiricism, one that only accepts concepts supported by evidence? Unfortunately, as Thomas Kuhn argued years ago in his classic work, The Structure of Scientific Revolutions, scientific and professional organizations are human and are susceptible to the same cognitive errors that afflict individual decision making.
The concepts underlying MPT have not been rejected. Instead, they are widely used in studies and show up in textbooks all over the world. MPT's ubiquity confirms its legitimacy through social validation rather than empirical evidence. Emotional decision making is rampant in what is supposed to be a rational discipline.
Just because something is widely used doesn’t mean it's useful. The conventional wisdom is often wrong.
Let the Transition Begin
After decades, there is little evidence to support MPT. It is time to move on. There is an alternative way to view securities markets, their movements, and their participants: behavioral finance.
At some point, the industry will make the transition to something other than MPT. Behavioral finance is the leading candidate. Then the investment world as we have known it will be changed forever. As Kuhn observes, when paradigms change, everything changes, including basic concepts, facts, history, tools, and methodologies.
After the dust settles, virtually nothing of MPT will remain.
The ultimate irony of rationally based MPT is that it gives advisers and analysts the tools to enforce "The Cult of Emotion," including volatility as risk, efficient frontier, downside capture, downside risk, R-squared, and the Sharpe ratio.
The law of unintended consequences should not have the last word. As MPT fades into history, so will these tools. It's just another step on the road to the Active Equity Renaissance.
If you liked this post, don't forget to subscribe to the Enterprising Investor.
All posts are the opinion of the author. As such, they should not be construed as investment advice, nor do the opinions expressed necessarily reflect the views of CFA Institute or the author's employer.
Image credit: ©Getty Images/mmac72
35 Comments
Thomas/Jason:
Thanks for shedding light on this very important issue.
I have always had my doubts about MPT equating volatility to risk. This mathematically convenient "assumption" sits at the heart of every portfolio management decision. We know this is not correct, yet volatility is a widely-accepted measure of risk for portfolio managers. And therein lies the problem.
Essentially, active portfolio managers are the victims of MPT, which (through volatility-based constraints) corners them into making sub-par investment decisions to stay within their investment mandates. You are right, in this context they are nothing more than closet indexers and I take my hat off to those, who manage to generate alpha under these conditions. I also agree that active equity portfolio managers show their true potential when they are given the freedom to pursue their strategies without the overwhelming checklist of MPT-based limitations.
If we drop the erroneous assumption that volatility equals risk, we could free our collective minds to explore, measure and interpret real equity risks. Maybe in the process we would stumble upon a framework that would better encapsulate the true nature of equity analysis.
My conclusion, though, after spending more than a decade in finance industry, is that equity analysis does not lend itself to a static model or a scientific generalization. This is due to the embedded, unpredictable human nature in the decision-making processes of companies, consumers, suppliers, etc.
The most promising way to make sense of it all is to develop a non-static, AI-based framework and integrate it into the portfolio decision making process.
Hello Umed,
This is one of the most insightful summaries of the investment business I have read. Thank you for taking the time to share it. You have encapsulated so many of the concerns that Tom and I share about investment management. I can tell that you will very much enjoy the very next piece in the series which very specifically takes on the volatility as a proxy for risk assumption.
Separately, I also enjoyed your point about free will. Investing is less physics, and more social science...and the sooner that is recognized, the sooner we can begin developing better science to help investors and clients.
Yours, in service,
Jason
Thanks Thomas and Jason for concisely mapping out the rise/fall of MPT – very though provoking indeed, including the commentary. I’m not currently an active manager, but I’m interested in this from a theoretical basis. (BTW – your blog reminded me of the book “The Lunacy of Modern Finance Theory and Regulation” by Les Coleman – have you read it?)
A couple questions.
1. “Smart Beta” and factor investing: Is this just MPT/EMH on Steroids? (BTW – my local CFA Mpls society will host a speaker next month). Defined as the intersection of EMH and value investing to optimally diversify portfolio w/ attractive risk/return profile. Seems more of creating ‘manager constraints’ and enforcing a refined etiological approach – are prices/returns really reflective of only one or more few factors? Thoughts?
2. What’s in store for the new paradigm? Considering Kuhn’s seismic scientific revolution to yet hit the finance discipline, and based on systems thinking (whereby complex adaptive systems are emergent) that the whole is greater than the sum of the parts – What are your thoughts in how this might play out for portfolio construction?
3. ‘Cup half full’ or ‘half empty’ philosophy. What if we measured the variance asymmetrically or positive variance as the chance of gain as a ‘good’ thing? Risk profiles would look differently, I would think. Thoughts in what that might look like?
Look forward to your insights!
Joanne Ott, CFA
Why shouldn't emotion/Mr Market be "placed in the middle of the portfolio construction process”? Prices falling 50% because of emotions isn't a primary risk?
Like it or not, we're all married to the market. And you don't just ignore the emotions of your S.O. without consequences.
Lance-
Thanks for your comment.
The starting point is needs based planning: emergency liquidity portfolio funded with zero volatility investments such as money market funds, income portfolio (if needed) to fund 3-5 years of income (I prefer high yield stocks for lower initial investment and income growth), and long-term growth portfolio funded with truly active equity.
This approach gives the advisory the best opportunity to remove volatility from client discussions (this actually works as evidenced by the advsors we work with who use this approach).
The growth portfolio is long-term so has the opportunity to recover from short-term draw downs. And in the 200+ year history of the stock market, all draw downs, including the 50% one you mention, have been short-term and fully recovered.
An important role of the advisor is to help clients avoid making serious investing errors based on reacting to strong emotions. In other words, be an emotional coach.
Highlighting the very rare 50% drop is not a good start as an emotional coach. Not that this should never be discussed, but putting it in proper historical perspective helps reduce client fears.
Tom,
In this portfolio, how do you determine which asset classes to hold in the income and long-term growth portfolio? Once you determine acceptable asset classes, how much do you decide to put in each one? If I have high-yield stocks in my income portfolio and active equity in my long-term growth portfolio, it will be difficult to remove volatility from the client discussion in a 2008 or similar market downturn when BOTH portfolios have lost substantial principal. Is there a place for diversifying asset classes like commodities, real estate, or private equities in either of these portfolios? Your solution divides portfolios behaviorally for the benefit of client discussions, but still does not solve the problem of how to construct the portfolios.
Nathan-
In the income portfolio I favor high yield stocks since less is needed to be invested to generate the desired income level, the dividend stream grows over time (generally faster than inflation), and this allows avoiding dipping into principal, which reduces the risk of running out of funds.
Other high yield bonds/REITs/MLPs can also we included, but I suggest a significant allocation to high yield stocks.
The stable, growing income stream should be the focus in client discussions. Dividend payments display very little volatility versus stock prices. This is because dividend payments are based on company earnings which are in turn driven by the economy.
On the contrary, stock prices are very noisy, since they are driven by emotional crowds and not fundamentals.
But as you suggest, the shiny object of market volatility is what investors will often focus on even though there is little or no relevant information being revealed by price movements.
In the growth portfolio I suggest 3-8 equally weighted, truly active equity managers/funds.
Other asset classes that might be considered are real estate and managed futures, both of which have equity like expected returns.
The Markowitz model basically says that a rational person wants to reach their return goal with the least amount of total variance possible.
What I hear you saying is that people are so irrational that they should ignore their total variance so long as they have a few years of expenses socked away in the money market/yield because the stock market always bounces back within a few years. Is that the gist of it?
Lance-
Right on!
If we can help clients meet basic needs via no vol funds, estate planning, tax planning, and insurance, then we have a better chance of getting them to look past short term market volatility in order to build as much long horizon wealth as possible.
Jason,
The problem with this and many other articles that discredit MPT is that they offer no alternative, at least in the sense of multi-asset class portfolio construction. If you're speaking purely of equity portfolio construction, then certainly there are many other approaches and I would imagine very few PMs who use MPT in that context. But in the case of multi-asset class portfolio construction, without MPT how do we build portfolios? The vast majority of advisors merely guess, or go with their gut, which leads to emotional decision making. I'm not ignoring the flaws in MPT, just pointing out that there is no better alternative for process driven portfolio construction. Clearly rational decision making is preferable to irrational, and disciplined investing preferable to undisciplined. If we believe that in the long run asset classes fairly price a return for the risk taken, then why wouldn't we use MPT to construct portfolios with long time horizons? Or as I asked previously, if we don't use MPT what should we do?