• What We Do
    • Wealth Counseling
    • Investment Advisory Services
    • Family Governance
  • Who We Are
    • Our Team
    • Research Roundtable
    • Our Fiduciary Pledge
  • How We Invest
    • Investment Approach
    • Questions To Consider
  • Insights and Research

Insights and Research

Home  »  Performance Measurement • Private Investing • Transparency   »   Bungled Benchmarking

Bungled Benchmarking

By Preston McSwain, December 20, 2019

We think most anyone would agree that you can’t compare apples to oranges.

We also think most people in the investment world would agree that the following comparison would be a chart crime.

It would allow a salesperson for this U.S. large cap fund to boast that they had outperformed by over 2.5% per year net of all fees for 10 years.

The chart crime would be that the salesperson would be making an apples to oranges comparison of a U.S. large cap fund to an index that was made up of stocks from around the world.

Below is how the same fund performed against a more comparable U.S. large cap S&P 500 index fund.

When comparing apples to apples, the fund didn’t outperform.

It underperformed a peer group index fund alternative by approximately 1% per year for 10 years.

Financial Twitter would likely be in an uproar over the apples to oranges illustration and regulators might also come calling related to the fund’s sales materials.

Why then do charts like the following circulate freely with little push back?

* The MSCI World index illustrations present the performance of the MSCI ACWI Index.  Global Private Equity index performance represents the Cambridge Associates Buyout and Growth Equity Index

This “outperformance” illustration is a recreation of a chart from a private investment sales presentation that we recently received from a wealth manager.

It is impressive, and could create lines like the following, which is similar to a quote we heard not long ago:

“We have been able to deliver outperformance consistently, and on average across all years, we have provided 4.8% of annualized outperformance.”

What’s the Problem?

The following summary of LinkedIn and Twitter posts from a top Private Equity (PE) researcher from the University of Oxford, Ludovic Phalippou, might say it the best:

“The same people who said that it was normal to compare Private Equity to the S&P 500, even though it was not comparable…  [now say] that we should not use the S&P 500.”

“[They] now advocate the MSCI world index, [which is one of] the worst performing indexes over the last ten years and… has even less to do with PE.”

“Most PE is U.S. small and mid-cap..”

The MSCI World index used in the previous comparison is not predominately U.S. small and mid-cap.

In writing this we could touch again on why Ludovic and many others have warned that PE can be calculated and presented using an internal rate of return (IRR) methodology that can make direct comparisons to public market indices “IRRelevant” or “dangerous.”

Fund managers, investment publications and index providers should know this, however.

When the indices are published each quarter, they have this disclosure at the bottom of the page.

“Due to the fundamental differences between [how private equity and public market returns are calculated], direct comparison . . . is not recommended.”

This always makes us ask why they continue to be widely distributed in a direct comparison form every quarter, but alas, no answers yet.

As an example of this, below is another chart we recently received from another investment advisor that was promoting their “fiduciary” approach to PE fund selection.

This firm did show the S&P 500 in addition to the MSCI World Index, and warned in small print that the “timing and magnitude of cash flows are integral” to the PE performance calculation.

I wonder, though…

Why didn’t this advisor include the “direct comparison… is not recommended” disclosure language that the index provider they used included in their direct comparisons?

New proposals to expand access to these types of presentations then bring me to this question:

How many investors will be able to apply the “complex multi-dimensional analysis” required to evaluate how the timing of cash flows can distort and often inflate PE returns as compared to returns investors have actually received?

Finally, should this “fiduciary” also disclose how lines of credit used by many PE firms might now be inflating these comparative returns that are “not recommended” even more – to the tune of 3-7% per year, depending on the age of the fund?

Looking back to the PE performance comparison chart…

If credit lines have been inflating what might be artificially high pooled IRRs by an additional 3-7%, has PE really outperformed more comparable U.S. small cap public equity index funds?

In a paper published in November 2019, researchers wrote that when PE is compared to U.S. small cap stock funds, “excess performance disappears” and is close “across all vintage years.”

Before some might think we are anti-PE, keep in mind that we write something like this each time we publish something on private equity.

We do not feel that private investing is bad or should not be part of investment allocations.

Many private investments are good and many good private equity managers exist.

On behalf of clients, we also have relatively large sums invested in private equity.

Apples to oranges comparisons, however, do no one any good.

They can make the industry look bad and could be setting false expectations, which might drive long-term commitments into investments that are illiquid (little to no liquidity = little to no options for change if expectations are wrong).

For the good of all in the investment community (managers, consultants and investors) we hope comparisons like this will stop.

In the meantime, when you see PE return presentations, review all disclosures and ask questions to make sure benchmark comparisons are reasonable.

If presentations don’t have simple plain language disclosures, have little to no disclosures, or have notes stating that index comparisons are “not recommended,” check carefully.

Some of the apples you are being asked to compare and consume might be rotten.

 


Related Reading:

Are We Baking Portfolios with Bad Ingredients? – Research Roundtable

Persistence That Just Ain’t So – CFA Institute

Fake News? – Provoking Posts

Preston McSwain
+ posts
  • Preston McSwain
    https://fwpwealth.com/author/preston/
    Transparency, Simplicity and Peace of Mind®
  • Preston McSwain
    https://fwpwealth.com/author/preston/
    Fiduciary Wealth Partners Reading List
  • Preston McSwain
    https://fwpwealth.com/author/preston/
    If We Had A Chief Economist We Would Have to Pay Them
  • Preston McSwain
    https://fwpwealth.com/author/preston/
    Is Trying to Pick Active Managers a Loser's Game?
SHARE
Tags:
Investment Advise, IRR, Private Equity
RELATED ARTICLES
Is Top Manager Performance A Random Walk?
What the data says at the 50th anniversary of Malkiel's Random Walk Down Wall Street.
Smaller Is Better
Bigger is not better in the money management business and the larger you are as an investor, the harder it is to allocate in a manner that keeps managers small.
The Simple Alternative – Keeps On Winning
The evidence continues to suggest that we should work harder on being simple.
All articles

Follow us on social media

Search Our Ideas

Subscribe to Our Posts


Important disclosures

Most Popular

  • The Simple Alternative – Keeps On Winning
  • The Simple Alternative
  • Say It Ain’t So, Joe
  • Are We Baking Portfolios with Bad Ingredients?
  • Crucial Elements in Wealth Management: Simplicity and Transparency

Browse by Theme

  • Fees
  • Fiduciary Duty
  • Investment Philosophy
  • Managing The Market
  • Peace of Mind
  • Performance Measurement
  • Private Investing
  • Quarterly Letter
  • Simplicity
  • Taxes
  • Transparency
  • Uncategorized
  • Values

FWP Logo Dark

Fiduciary Wealth Partners is a 100% employee owned firm that serves clients in a transparent, fiduciary manner.

We do not have any fee sharing arrangements with managers and do not have any broker-dealer conflicts. In addition, you will never see an arbitration clause in our contracts.

Everything we do is focused on assisting trustees, institutions and families with investment consulting, management and overall asset planning strategies.

  • Disclosures
  • ADV
  • Privacy Policy
  • Form CRS

Useful Links

  • Investment Advisory Services
  • Wealth Counseling
  • Our Team
  • Research Roundtable
  • Our Values
  • Questions To Consider
  • Insights and Ideas
  • Contact Us

Contact us

Phone

(617) 602-1900

Email

info@fwpwealth.com

Address

177 Huntington Avenue
20th Floor
Boston, MA 02115

 

View larger map

© 2020 FWP. All Rights Reserved. Fiduciary Wealth Partners Is An SEC Registered Investment Adviser.