One modern portfolio theory (MPT) pillar that is unquestionably broken is the use of volatility, specifically standard deviation, as a measure of risk. This initial error in MPT's development is a major contributor to active investment management underperformance.
Volatility Is Not Risk
The concept of volatility as risk rests on a critical assumption that is overlooked by most of the industry: Only in finance is risk defined as volatility, or the bumpiness of the ride.
Various dictionary definitions of risk converge on something like the “chance of loss.”
- Noun: exposure to the chance of injury or loss; a hazard or dangerous chance.
- Insurance: the degree of probability of such loss.
- Verb: to expose to the chance of injury or loss; hazard.
Not a single definition includes volatility as a part of its explanation. Dictionary definitions and popular understandings of risk might differ from a business definition, yet a popular business dictionary describes over a dozen different forms of risk, ranging from exchange rate risk to unsystematic risk, all of which focus on the chance of permanent loss.
The insurance business relies on an understanding of risk, and an insurance licensing tutorial says that “Risk means the same thing in insurance that it does in everyday language. Risk is the chance or uncertainty of loss.”
Only finance defines risk as short-term volatility. Why? In the 1950s, academics recognized that hundreds of years of statistics research thinking could be borrowed to analyze the performance of investment portfolios — if some of the definitions could be bent to their aims. Once standard deviation was transformed into “risk,” the work of analyzing portfolios could begin and theories could be developed.
The Origins of This Misconception
Harry Markowitz states, “V (variance) is the average squared deviation of Y from its expected value. V is a commonly used measure of dispersion,” in his seminal 1952 Journal of Finance paper “Portfolio Selection.” Then he continues:
“We next consider the rule that the investor does (or should) consider expected return a desirable thing and variance of return an undesirable thing. . . . We illustrate geometrically relations between beliefs and choice of portfolio according to the ‘expected returns — variance of returns’ rule.”
Whoa, hold on a second! Investors do want variance of return, and to the upside. Not only that, how did a blithe proposition regarding a statistical calculation turn into a rule in less than a paragraph? As Markowitz then states, again blithely, “[This rule] assumes that there is a portfolio which gives both maximum expected return and minimum variance, and it commends this portfolio to the investor.”
This sentence creates a major problem for how investment managers are currently evaluated. When investment product distributors prefer "maximum return versus minimum variance," then closet indexing is not far behind.
Markowitz is borrowing on hundreds of years of statistical theory to make an important point: Diversification can lead to better outcomes in investing. But to make the leap to volatility and its close cousin, beta, as risk measures, as much of the industry has done, is an egregious mistake.
Volatility Is Emotions
Nobel laureate Robert Shiller showed that stock prices fluctuate much more than the underlying dividends, the source of value, in his seminal paper. The implication is that stock price changes are largely driven by something other than changing fundamentals. Volatility is the result of investors' collective emotional decisions. Shiller’s contention has withstood the test of time. Numerous studies have attempted and failed to dislodge it.
So not only does volatility capture both undesirable down price movements along with desirable up movements, it is mostly driven by the collective emotions of investors and has little to do with fundamental risks. Since emotions are transitory and much of the resulting effect can be diversified away over time, volatility fails as a risk measure.
Finally, some maintain that since investors enter and exit funds based on strong short-term upsurges and short-term drawdowns, volatility represents business risk for the fund. But why should fund business risk be intertwined with investment risk? There need to be separate measures since the risk faced by investors and funds is distinctly different.
Possible Risk Measures
So if volatility as risk is flawed, how do we measure investment risk? The metric should focus on the chance of permanent loss — investment value dropping to zero, for example — or the opportunity cost of underperforming a benchmark.
Qualitative Risk Measures
One approach that we used at the Davis Appreciation and Income Fund is to carefully consider the fundamental risks facing a business. The varieties of risk could include economic, environmental, political, regulatory, public opinion, geographic, technology, competition, management, organizational, overhead, pricing power, equipment, raw materials, product distribution, access to capital, and capital structure, to name a few.
If the business is affected by one or more of these risks, that will likely influence the firm's ability to make good on its promises regardless of where you claim a cash flow in its capital structure (debt, preferred, convertible, equity, option, etc.). One drawback of such evaluation techniques: The subjective nature of these risks cannot be summarized in a single measure. But the truth is investment risk is complex and multifaceted, so no single number could suffice, much less an emotionally driven statistical measure like standard deviation.
Returns Relative to Opportunity Set
Pioneering work by Ron Surz called Portfolio Opportunity Distributions (POD) takes an entirely different approach. This performance- and risk-evaluation technique examines the strategy laid out by the investment manager in the prospectus and explores all possible portfolios the manager may have held within these constraints. It then compares actual manager performance to these opportunity sets.
This approach unshackles managers from being compared to an index. Instead, they are measured against their opportunity set. Significantly, the metric also takes care of the "free pass" problem, when benchmarks are the basis for comparison.
Tom’s firm AthenaInvest has developed a similar approach that evaluates fund performance relative to that of a strategy peer group.
This technique can also be applied to asset allocation and other portfolio decisions. For example, investing $10,000 in the S&P 500 at the end of 1950 would have generated $9 million by the end of 2016, while an investment in T-Bonds would have generated less than $500,000. The $8.5 million “left on the table” is the true risk, not the increased volatility of stocks over this period. The chance of a real loss should be the risk measure used in making such decisions, not the bumpiness of the ride. Viewed in this light, bonds are far riskier than stocks for building long-horizon wealth.
No Simple Solution
As Tom has told his investment classes for years: Academics have little meaningful insight into measuring risk. This hasn't exactly endeared him to department colleagues or to some of his students. In essence, he was saying that the research on measuring risk conducted at hundreds of academic institutions over the decades has largely been fruitless.
No discipline likes to admit such monumental failure. But this is where we are in finance today.
Forty years ago, measuring investment risk was largely the purview of sell-side and buy-side analysts. Today, we have come full circle: Once again analysts are the go-to source for assessing risk. It may be frustrating that their analysis cannot be summed up in a single number. But we tried a model that did just that and it failed.
Measuring investment risk is a messy process and is not amenable to a simple solution.
At the 70th CFA Institute Annual Conference, which will be held 21–24 May 2017, C. Thomas Howard will discuss ways that active equity mutual funds can be evaluated through behavioral concepts during his presentation, “The Behavioral Financial Analyst."
If you liked this post, don't forget to subscribe to the Enterprising Investor.
All posts are the opinion of the author. As such, they should not be construed as investment advice, nor do the opinions expressed necessarily reflect the views of CFA Institute or the author's employer.
Image credit: ©Getty Images/valentinrussanov
If you liked this post, don’t forget to subscribe to the Enterprising Investor.
All posts are the opinion of the author. As such, they should not be construed as investment advice, nor do the opinions expressed necessarily reflect the views of CFA Institute or the author’s employer. Image credit: ©Getty Images / Ascent / PKS Media Inc.
Professional Learning for CFA Institute Members
CFA Institute members are empowered to self-determine and self-report professional learning (PL) credits earned, including content on Enterprising Investor. Members can record credits easily using their online PL tracker.
43 Comments
Dear Mr. Voss,
Since, we both agree that the way to understand business risk is by spending time in order to study an industry/business and develop a conceptual framework which allows us to understand the main factors that will drive performance in the future. By doing so not only do we develop a deeper understanding of how the business/industry operates but we also become aware of the risks associated with these business drivers and how they could negatively impact the business/industry and eventually our investments.
I saw the CFAI ''industry guides'' a few weeks back and was instantly hooked to them! (Excellent work by the Institute I must say!) I am sure you would agree that these are quite important readings, along with corporate filings, for anyone who wishes to understand and develop a deeper understanding of specific industries.
As I am currently interested in specializing in analyzing and evaluating the energy sector (including oil and gas, coal, electricity and alternatives) I would like to ask if you believe there is value in going for a specialized study program such as the Energy Risk Professional (offered by GARP)?
This program is designed to develop a candidates ability to understand how businesses operate in the energy sector as well as the risks associated with them so that one is eventually able to manage and mitigate risk.
Your advice would be most helpful to me.
Thanking you for taking out the time to read my comments and responding!
Best wishes.
Muhammad.
Hello Muhammad,
I am not familiar with that program, so cannot comment about its quality. I began my career as an E&P analyst, and ended up being a ranked analyst by Reuters (they rank buyside analysts), and I did not have the ERP designation. Instead, I studied the industry intensively and thoroughly read "Money in the Ground" and "Security Analysis and Business Valuation on Wall Street" by Jeffrey Hooke. Both prepared me very well for the industry. That said, designations are very important to some hiring managers, and so it may make a difference.
I am sorry that I cannot be more helpful.
Yours, in service,
Jason
Hello Mr. Voss,
''Instead, I studied the industry intensively and thoroughly read “Money in the Ground” and “Security Analysis and Business Valuation on Wall Street” by Jeffrey Hooke. Both prepared me very well for the industry.''
Thank you for your recommendations. I am sure they will be invaluable resources in helping me understand the industry. Very kind of you for sharing your experience with everyone.
Wishing you the best.
Muhammad.
The question you raise is interesting. It is worth mentioning that Markowitz, as early as 1959, devoted significant attention to using semi-variance as a measure of risk. That approach may still be valid and useful.
Semi-variance is preferable to total variance as a measure of risk, given that risk should focus on "disappointing" returns that are below the expectation rather than "delightful" returns that are above expectation. An even better measure is risk relative to the investor's "minimum acceptable return" as defined by Frank Sortino. If we must think of the client's goal in terms of a return (rather than a monetary outcome) then the return that is expected to meet the client's financial goals should be used to define and to quantify any risk measure. This "lower partial moment" approach to risk takes a little more work, but it is much more intuitive and relevant than these other academic measures of risk.
"The metric should focus on the chance of permanent loss — investment value dropping to zero, for example — or the opportunity cost of underperforming a Benchmark"
I dont have any assets, where permanent loss is possible, because if these assets would go to 0, world would not exist anymore... and opportunity costs of underperforming a Benchmark? I dont understand why this would be more relevant as volatility? BM is going down 50%, Strategy is going down 50% = Risk is 0?
I also think that you compared apples with bananas. Of course you "risk" is just a flappy word, but still I would rather focus on the historical difference to the mean, as to any other measure the author described... that might be the difference between theoretical and actual working in that business...
Hello Ellen and Hannes,
You are thinking of risk only within a MPT framework, which is what this article is about (breaking free of that context), and this article fits within an entire series. Variation around a mean is not risk, it just isn't. It was borrowed mathematically by Markowitz so he could author his thesis, and fast forward 70 years later and we are still using it as a flawed measure. Someone in this thread said that Markowitz realized the error of his ways and now uses a measure that is commensurate with loss only, and not gain, too.
If you would like to intimately understand the issue then calculate standard deviation by hand, which I am guessing you have either never done, or have not done since you studied statistics. What you will discover is that variance, and its digits-copasetic twin, standard deviation, are weighted averages, not just averages. The result is that significant numbers above the mean (i.e. in our example, an active manager that kicks ass) look riskier because of the weight they receive. This makes no sense. How is outperformance, or even performance above a risk-free rate of return, or a required rate of return counted as risk? The insurance industry knows a thing or two about risk since they have been underwriting them for 500 years, and they define risk as the chance of loss, not as variation around a mean.
My own preference for risk is to evaluate risk the way business people do - and I am not referring to the Mandarins of finance or banking. Here I am talking about the seemingly magical ability (if you are a lover of MPT) of business people to anticipate risks to their business models and build in to the business plan appropriate responses to anticipated risks, as well as their ability to respond to risks if they occur. Most militaries around the world have scenario plans for different events that may never unfold, but if they do they have an appropriate response. Not only that, but they alter force structure so that they can execute if one of the scenarios occurs. Why is it that when lives are the line, the risk of death or being conquered, militaries do not use standard deviation when assessing risk? In each of the example I have provided it is not any different than in finance. Human actors who have preferred outcomes recognize that the future may not unfold as they might like and they build a response to those possible non-preferred outcomes. No one except Markowitz and those who believe in MPT use standard deviation as their sole description of risk.
Yours, in service,
Jason
Very good topic that a lot of people are showing interest in. The best thing I read on this subject a few years ago was Howard Marks memo to clients "Risk Revisited Again". He talked about the limitations of variance as risk and how to deal with the uncertainty of not being able to predict the future.
This is an embarrassing article to be posted on the CFA website, but then again the fate of this organization is closely tied to the fate of active managers, so I guess I shouldn't be surprised by this content being produced.
This article can easily be rebutted by two points of logic. The first claim of this article is that volatility is a poor measure of risk. The author says 'look, volatility to the upside is good, therefore we've been measuring risk incorrectly'. Then he promotes his fund and suggests they measure risk appropriately by looking at ''economic, environmental, political, regulatory, public opinion, geographic, technology, competition, management, organizational, overhead, pricing power, equipment, raw materials, product distribution, access to capital, and capital structure, to name a few'.
How did we make the jump here? How does the author expect the reader to just conclude that this is the appropriate way to define risk? Are readers expected to be unaware that downside deviation is a better measure of risk than standard deviation?
The second failing of this article is to intertwine the idea that active managers will benefit from this new way of measuring risk. The implicit suggestion is that because we've been measuring risk incorrectly in the past, we've somehow distorted the incentives of active managers and led them to under perform. Poor guys, it was the investors fault all along!
Nope, no matter how you try to spin it, active managers have historically, recently and will in the future under perform. I understand that your careers depend on you not accepting this premise, but you're harming your investors and their families along the way.