One modern portfolio theory (MPT) pillar that is unquestionably broken is the use of volatility, specifically standard deviation, as a measure of risk. This initial error in MPT's development is a major contributor to active investment management underperformance.
Volatility Is Not Risk
The concept of volatility as risk rests on a critical assumption that is overlooked by most of the industry: Only in finance is risk defined as volatility, or the bumpiness of the ride.
Various dictionary definitions of risk converge on something like the “chance of loss.”
- Noun: exposure to the chance of injury or loss; a hazard or dangerous chance.
- Insurance: the degree of probability of such loss.
- Verb: to expose to the chance of injury or loss; hazard.
Not a single definition includes volatility as a part of its explanation. Dictionary definitions and popular understandings of risk might differ from a business definition, yet a popular business dictionary describes over a dozen different forms of risk, ranging from exchange rate risk to unsystematic risk, all of which focus on the chance of permanent loss.
The insurance business relies on an understanding of risk, and an insurance licensing tutorial says that “Risk means the same thing in insurance that it does in everyday language. Risk is the chance or uncertainty of loss.”
Only finance defines risk as short-term volatility. Why? In the 1950s, academics recognized that hundreds of years of statistics research thinking could be borrowed to analyze the performance of investment portfolios — if some of the definitions could be bent to their aims. Once standard deviation was transformed into “risk,” the work of analyzing portfolios could begin and theories could be developed.
The Origins of This Misconception
Harry Markowitz states, “V (variance) is the average squared deviation of Y from its expected value. V is a commonly used measure of dispersion,” in his seminal 1952 Journal of Finance paper “Portfolio Selection.” Then he continues:
“We next consider the rule that the investor does (or should) consider expected return a desirable thing and variance of return an undesirable thing. . . . We illustrate geometrically relations between beliefs and choice of portfolio according to the ‘expected returns — variance of returns’ rule.”
Whoa, hold on a second! Investors do want variance of return, and to the upside. Not only that, how did a blithe proposition regarding a statistical calculation turn into a rule in less than a paragraph? As Markowitz then states, again blithely, “[This rule] assumes that there is a portfolio which gives both maximum expected return and minimum variance, and it commends this portfolio to the investor.”
This sentence creates a major problem for how investment managers are currently evaluated. When investment product distributors prefer "maximum return versus minimum variance," then closet indexing is not far behind.
Markowitz is borrowing on hundreds of years of statistical theory to make an important point: Diversification can lead to better outcomes in investing. But to make the leap to volatility and its close cousin, beta, as risk measures, as much of the industry has done, is an egregious mistake.
Volatility Is Emotions
Nobel laureate Robert Shiller showed that stock prices fluctuate much more than the underlying dividends, the source of value, in his seminal paper. The implication is that stock price changes are largely driven by something other than changing fundamentals. Volatility is the result of investors' collective emotional decisions. Shiller’s contention has withstood the test of time. Numerous studies have attempted and failed to dislodge it.
So not only does volatility capture both undesirable down price movements along with desirable up movements, it is mostly driven by the collective emotions of investors and has little to do with fundamental risks. Since emotions are transitory and much of the resulting effect can be diversified away over time, volatility fails as a risk measure.
Finally, some maintain that since investors enter and exit funds based on strong short-term upsurges and short-term drawdowns, volatility represents business risk for the fund. But why should fund business risk be intertwined with investment risk? There need to be separate measures since the risk faced by investors and funds is distinctly different.
Possible Risk Measures
So if volatility as risk is flawed, how do we measure investment risk? The metric should focus on the chance of permanent loss — investment value dropping to zero, for example — or the opportunity cost of underperforming a benchmark.
Qualitative Risk Measures
One approach that we used at the Davis Appreciation and Income Fund is to carefully consider the fundamental risks facing a business. The varieties of risk could include economic, environmental, political, regulatory, public opinion, geographic, technology, competition, management, organizational, overhead, pricing power, equipment, raw materials, product distribution, access to capital, and capital structure, to name a few.
If the business is affected by one or more of these risks, that will likely influence the firm's ability to make good on its promises regardless of where you claim a cash flow in its capital structure (debt, preferred, convertible, equity, option, etc.). One drawback of such evaluation techniques: The subjective nature of these risks cannot be summarized in a single measure. But the truth is investment risk is complex and multifaceted, so no single number could suffice, much less an emotionally driven statistical measure like standard deviation.
Returns Relative to Opportunity Set
Pioneering work by Ron Surz called Portfolio Opportunity Distributions (POD) takes an entirely different approach. This performance- and risk-evaluation technique examines the strategy laid out by the investment manager in the prospectus and explores all possible portfolios the manager may have held within these constraints. It then compares actual manager performance to these opportunity sets.
This approach unshackles managers from being compared to an index. Instead, they are measured against their opportunity set. Significantly, the metric also takes care of the "free pass" problem, when benchmarks are the basis for comparison.
Tom’s firm AthenaInvest has developed a similar approach that evaluates fund performance relative to that of a strategy peer group.
This technique can also be applied to asset allocation and other portfolio decisions. For example, investing $10,000 in the S&P 500 at the end of 1950 would have generated $9 million by the end of 2016, while an investment in T-Bonds would have generated less than $500,000. The $8.5 million “left on the table” is the true risk, not the increased volatility of stocks over this period. The chance of a real loss should be the risk measure used in making such decisions, not the bumpiness of the ride. Viewed in this light, bonds are far riskier than stocks for building long-horizon wealth.
No Simple Solution
As Tom has told his investment classes for years: Academics have little meaningful insight into measuring risk. This hasn't exactly endeared him to department colleagues or to some of his students. In essence, he was saying that the research on measuring risk conducted at hundreds of academic institutions over the decades has largely been fruitless.
No discipline likes to admit such monumental failure. But this is where we are in finance today.
Forty years ago, measuring investment risk was largely the purview of sell-side and buy-side analysts. Today, we have come full circle: Once again analysts are the go-to source for assessing risk. It may be frustrating that their analysis cannot be summed up in a single number. But we tried a model that did just that and it failed.
Measuring investment risk is a messy process and is not amenable to a simple solution.
At the 70th CFA Institute Annual Conference, which will be held 21–24 May 2017, C. Thomas Howard will discuss ways that active equity mutual funds can be evaluated through behavioral concepts during his presentation, “The Behavioral Financial Analyst."
If you liked this post, don't forget to subscribe to the Enterprising Investor.
All posts are the opinion of the author. As such, they should not be construed as investment advice, nor do the opinions expressed necessarily reflect the views of CFA Institute or the author's employer.
Image credit: ©Getty Images/valentinrussanov
If you liked this post, don’t forget to subscribe to the Enterprising Investor.
All posts are the opinion of the author. As such, they should not be construed as investment advice, nor do the opinions expressed necessarily reflect the views of CFA Institute or the author’s employer. Image credit: ©Getty Images / Ascent / PKS Media Inc.
Professional Learning for CFA Institute Members
CFA Institute members are empowered to self-determine and self-report professional learning (PL) credits earned, including content on Enterprising Investor. Members can record credits easily using their online PL tracker.
43 Comments
Hello JY,
Thank you for engaging with this 'embarrassing' content. I appreciate the time you have taken to elaborate your thoughts. In response...
I am not sure asking investors to define risk and to consider risk as every other person on the planet does - including, and especially, the insurance industry - is embarrassing. More embarrassing is that our industry continues to believe that because something can be measured statistically, that is the best and only way to predict or anticipate that thing in the future. As the comment thread here suggests, even Markowitz has abandoned the foolishness, of at least, standard deviation as a proxy for risk.
As for your claim that I am promoting my firm, a quick bit of due diligence on your part would reveal that my firm is CFA Institute. Another part of due diligence on your part would reveal that less than half of our members make their living as active managers; approximately 40%, in fact. Our Charter is held by over 300 job titles, including many who I know support your point of view. But a part of the beating heart of the CFA charter is principled disagreement. Ironically, CFA Institute is routinely lambasted for its defense of MPT. So your comments are, in some ways, really nice to receive, and an indication that these articles are in service to our mission.
I sense in your response a rejection of the article because it does not proffer data. Correct? In my Alpha Wounds series I linked to my masters thesis work in which I demonstrated that when active equity and active balanced funds are evaluated, with Sharpe ratios that the classic result holds: two-thirds of active managers underperform. Yet, when downside volatility is included in the denominator instead that the reverse result holds, two-thirds out-perform.
Next, as was mentioned in this thread previously, we concede the historical point. We offer a diagnosis for some of the ways active management went astray, and then offer prescription. This prescription is based on data, and in our series we have repeatedly linked to it. Both Tom and I acknowledge that we are making philosophical points. Your contributions for how to help end clients are welcomed. In fact, that is one of the lovely things about The Enterprising Investor: we encourage our readers and authors to engage with one another.
As for the 'jump' you refer to...from my above responses it should be less jarring for you as most of the connections are laid more bare. I believe volatility does not measure risk, but instead is a weighted average around a mean. Break out a calculator and do this by hand and you will see this is not supposition on my part, but mathematical reality. Use of standard deviation made the math easy circa 1950-1985, but we no longer need to rely on such metrics. If you insist on describing risk quantitatively, then ensure that your measure measures what you believe it does. But, for me, and based on my experience as a former portfolio manager of some success, risk is better evaluated the way business leaders evaluate risks. Also, is there language in this article that indicates to you that we ask for a final verdict? Instead, Tom and I have routinely said, "What the industry is doing doesn't work for end clients. How can we make it better?" In other words, we value your opinion.
I am not a believer in false absolutes, like the one that you use, "no matter how you try to spin it, active managers...will in the future under perform." The reason is that to do so is a misunderstanding of the meaning of the word and concept of 'absolute.' I think you are making, instead, a probability argument, and you mean there is a high probability of active management failure. Yes?
Do you believe that some business leaders can better steer their businesses than others through their intelligence, wisdom, and efforts, or is business performance also random? And do you believe that publicly traded securities prices will eventually reflect the performance? If so, then why would it be impossible for a person to identify superior management engaged in executing business plans in a superior way? And to Tom's points here and over the years, so you think there is predictability in securities price volatility? If so, then good predictions of volatility would be a good basis for constructing portfolios, too. If, on the other hand, and this is important for you to acknowledge, you believe that securities price volatility (measured by standard deviation) is random, then why would you use it as a risk measure, or to evaluate the performance of investment managers? Otherwise it is a tacit admission that managers should not be held accountable for it, since the results are random. You cannot have it both ways. If securities returns are random, then the time series of standard deviation for securities and portfolios must be, too.
Yours, in service,
Jason
Jason,
You are promoting your prior fund, my apologies. Thanks for clearing that up.
So only 40% of charterholders make their living off of active management? You're right, I stand corrected, the institute definitely doesn't have it's fate tied to the future of active management or any incentive to promote articles promising a bright future for stock and bond pickers.
Your masters thesis also claims that 87% of non-us equity managers outperform their benchmarks when measured by the Sharpe ratio. That's all I needed to see to know that these numbers are incredibly outdated and no longer relevant. You should probably stop referencing a 20 year old analysis that only covers a 10 year time period. If you were to replicate that exact same analysis, instead of using 1987-1997 use 1987-2017, I guarantee (I'm a fan of absolutes) that the results are significantly less favorable for active managers, regardless of if we're talking sharpe, treynor, sortino, etc.
Plain and simple, downside deviation is more than adequate as a risk measurement for broadly diversified investments. Anyone who reads this article and is unaware of the difference between standard deviation and downside deviation has been educated and is better off now. That is the real service of this article. However, the implication that an alternative method of measuring risk will improve outcomes for active managers is false logic.
Hello again, JY,
Thanks again for your comments. First, if you consider mentioning my former employer of 12 years ago in passing is promotional. Then I could argue by the same logic that you are shilling for yahoo because you use a yahoo e-mail account. I think that is pretty flimsy. In my case, I highlighted my work as an investment manager because I believe that experience and success in the industry are relevant to the conversation.
My research does not show that 87% of managers, as measured by a Sharpe ratio, beat their index. Sharpe ratios use standard deviation as their denominators. We have been over this before, and the research does not state what you are stating. Is the research outdated. Perhaps.
Separately, Tom and I have authored an entire series of posts about how to improve active management. Not just this singular post. Two more are forthcoming. Additionally, you should read my series entitled Alpha Wounds to see if you get a more comprehensive view of what Tom and I consider to be a systemic problem.
I do believe that using different risk measures than standard deviation, or semi-standard deviation can improve the returns of active managers. But so long as most are evaluated in that way, and manage their funds that way we won't have the ability to test the theory out. And that is a part of what Tom and I are discussing. Additionally, as we have said throughout this series. We hope to spark a discussion about how to improve active equity.
Next, I never conferred with any member of CFA Institute to write this series. Nor have I ever conferred with any member of management to author any of my pieces. As writers for Enterprising Investor, we are not held in check by a business plan mandate. You might want to peruse this post I authored less than a year ago before you draw another absolute conclusion: https://blogs.stage.cfainstitute.org/investor/2016/06/07/alpha-wounds-l… This is pretty strong proof to the contrary about your contention. Additionally, I can tell that you are relatively recent reader of The Enterprising Investor because for years we have featured articles from both sides of the passive vs. active debate.
Further, if you look at the roster of authors for out site you will see at least several hundred authors. Almost all of those are outside contributors, and not employees. The platform is open to you as well, and you don't even have to have a CFA charter. If you accept the challenge, as many who have authored a pro-passive management article have, and submit an article that meets our guidelines, and your writing is understandable and compelling, and your logic consistent, then you, too could be a writer for The Enterprising Investor. I am not one of the editors. So if our openness to your point of view is not evidence that we are not shilling, then can you be satisfied? You can find our requirements by clicking on the contributor tab at the top of the page.
Last, you did not answer the questions I asked you in my previous comments. I invite you do so, again.
Yours, in service,
Jason