Our approach
The Bestinvest MRI has been designed to separate the monkeys from the geniuses.
Fund managers change jobs, on average, every four years – so the past performance
records of most funds can be disregarded as a reliable indicator of the future.
The solution to this problem is to track the performance of the manager, NOT the
fund.
Manager Statistical Research Methodology
Our statistical analysis comprises a series of steps:
-
1 Career record
We try to look at the record of a manager, for the entire duration of their career,
in each sector (we split out different sectors because some benchmarks can be much
easier to beat than others). If a manager runs more than one fund in a sector for
any period of time, the results of those funds for that period are averaged.
-
2 Relative performance
We look at the returns on a monthly basis, both in absolute terms and, more importantly,
relative to a benchmark index.
-
3 Cumulative performance
We then carry out a number of calculations on this dataset so that we can look at
performance in each of the past five years and cumulatively over the past 3 and
5 years. In cases where the manager has taken gardening leave, or a sabbatical,
the periods will not be continuous, in which case the records for the past 3 years
and 5 years may be incomplete.
-
4 Risk control
As part of our process to try and understand the style of the manager we calculate
the Maximum Loss (in both absolute and relative terms) over the manager's career.
Every manager goes through periods of underperformance, but some operate with strict
risk controls to limit the downside. Statistically, it is to be expected that managers
with long track records will also have incurred larger losses, although this is
not inevitable.
-
5 Statistically analysis
Then, we look at the probability that these results could have been generated simply
by chance. Remember that if you allowed 1,000 monkeys to run funds on a random basis
you would expect 31 of them to beat the Index every year for five years (assuming
nil charges), at which point they would be accorded the status of investment geniuses
by many.
How we calculate the MRI
Our Bestinvest MRI (Manager Record Index) has been designed to try to separate the
monkeys from the geniuses.
First, we add back to the performance figures the monthly running costs of the funds,
so that we can assess the performance on a pre-charges basis. We then calculate
the Information Ratio:
((Relative Performance + Charges) / Standard deviation of returns)
The Bestinvest MRI is then derived from plotting the Information Ratio on a normal
distribution curve (on the assumption that the returns are, in statistical terms,
normally distributed) and taking this probability away from 100.
Values for the Bestinvest MRI over 99% indicate very strongly that the manager is
adding value and over 95% is also a strong indicator. Low values (under 10%) indicate
that it is highly likely the manager is destroying value (i.e. they would probably
do better by picking stocks out of a hat!). Any manager with a positive average
monthly return (after adding back the running costs) will have an MRI of greater
than 50%.
Funds which operate with a strong style bias (e.g. most Equity Income funds) can
go through sustained periods of under and over performance which does not directly
reflect the input of the manager. We suggest that a track record of at least five
years should generally be used to demonstrate how a manager has fared in different
market conditions.
We believe that data for shorter periods than 30 months is unlikely to be statistically
significant and so we do not calculate the Bestinvest MRI in these cases.
Joint Managers and Team Track Records
Dealing with joint managers or management teams with a number of staff is problematic.
In the case of joint managers we could either attribute the fund's record to each
of the managers individually or treat them as a unit. In cases where the managers
are taking joint decisions on stock selection (rather than individually running
parts of the portfolio) we take the latter approach. Where teams are responsible
for managing funds we will usually treat the team as one unit but identify the key
decision makers within that team and what their roles are. As a result the departure
of one member of a team or management pair can be significant for our rating of
a fund.