Risk profiling: Advisers question tools’ ‘spurious’ accuracy claims

Author: Rahul Odedra
Professional Adviser | 20 Oct 2011 | 08:00

Categories: RDR| TCF

Topics: ATR| risk

climbing-risk

Providers’ claims that attitude-to-risk questionnaires can be as much as 93% accurate are being challenged by advisers.

Claims that a new risk profiler is more accurate than standard versions because it includes extra questions have re-ignited a debate about the precision of attitude-to-risk (ATR) tools.

Adviser network Personal Touch Financial Services said a ‘reliability analysis’ of its 15-question Risk Profiler – provided by Oxford Risk - found it correctly places clients in one of ten linear bands 90% of the time.

This improved on the 86% accuracy of Oxford Risk’s standard ten-question version, it said.

But wealth managers and advisers said risk profilers should form no more than a “starting point” with clients.

One said he had evidence that in-depth conversations with customers who had already been placed in a risk category by a 'risk profiler' often led to them being re-assigned.

Verbatim Asset Management, the investment arm of SimplyBiz, currently offers advisers the choice of Distribution Technology questionnaires, which have ten or 20 questions.

But managing director Neil Stevens said the result given by risk-profilers should not be seen as a definitive reflection of a client’s ATR.

“You’ve got to be careful of spurious accuracy,” he said. “Trying to pretend these things can be more accurate than is the case is really quite dangerous. It’s about how well the adviser has done the fact find and how well they know the questionnaire.

“I think the FSA is worried about people abdicating responsibility to the questionnaire. They are very useful tools but advisers can’t let them take over.”

Stevens said small-sample research he had recently undertaken suggested clients’ risk ratings were changed in around 40% of cases after a deeper conversation with the adviser.

Neil Liversidge, managing director of IFA West Riding Personal Financial Solutions, said the accuracy of risk-profiling tools was irrelevant.

He said he used the tools as a means to start client conversations and to get customers to “confront their own conflicting ideas of what they want and should have from their portfolio”.

“I’m suspicious of all systems, such as psychometric tests," he said. “We have a conversation, we explain risk and, if anything, we overdo the risk warnings. Advisers who rely on questionnaires are the ones who don’t know anything about investments.”

Martin Vaughan, director of Paragon Paraplanning, agreed that ATR questionnaires should provide a starting point for a conversation with the client, although he pointed out more questions can sometimes help.

He said: “With risk, we need to check that the answers clients are giving are the correct ones and that they haven’t misunderstood anything.

“If there are any anomalies, the adviser can then explore that with the client. Having more questions than less, to a point, would appear to be beneficial.”

 

The ATR questionnaire market

Skandia
Provided by Towers Watson
11 questions for investments, 13 for pensions
Accuracy: unavailable

Personal Touch Financial Services
Questions by Oxford Risk
15 questions
Accuracy: 90%

Finametrica
Has a 28% market share (according to research by Paraplan Plus)
25 questions
Accuracy: “Exceeds international standards”

Morningstar
Provided by Ibbotson
11 questions
Accuracy: unavailable

Financial Express
Questions provided by eValue (subsidiary of Financial Express)
13 questions
Accuracy: 93%

Verbatim Asset Management
Provided by Distribution Technology
10 or 20 questions
Accuracy: 84% and 93%

 

 What the FSA says about risk questionnaires

In guidance published earlier this year, the FSA set out some of its concerns around the use of risk profiling tools and questionnaires. It looked at 11 tools and found nine had “weaknesses which could, in certain circumstances, lead to flawed outputs”.

It pointed out that “the fewer the questions – coupled with a possibility of misinterpreting an answer – the greater the probability of making an inaccurate assessment”.

The FSA was also concerned about cases where the resulting risk category was effectively determined by the answer to just one question which was heavily weighted.

It urged firms to “take particular care to ensure a customer understands each question and that the answers they give are an accurate reflection of their views”.

Other concerns included “vague” descriptions of risk profiles, investments which poorly reflected the resulting risk profiles and a lack of understanding of the tools in general.

 

More from professional adviser

Recommended reading

Categories

Topics

Comments

accuracy of risk tolerance test

It would be safe to say that having an accurate assesssment of an investors risk tolerance is a 'necessary but not sufficient' part of the investment suitability process. The conversations that follow need to be informed by more than just a risk tolerance score. This is particularly true where clients are business or life partners. Invariably they will have key differences that should be explored in discussion with the adviser in order to resolve the preferred tradeoffs in the financial plan.

Posted by: Paul Resnik

24 Oct 2011 | 12:27
Complain about this comment

Risk Profiling

Most risk profiling is total twaddle. Subjective questions, subjective understanding of the questions, subjective answers, subjective interpretation of the answers, subjective implementation, subjective risk assessment of asset classes - all to satisfy the regulator who, knowing nothing, is trying to make investment recommendations a matter of science. When people with deposits in major UK financial institutions (like NR) or holding shares in Railtrack, Marconi etc or a structured product underpinned by Lehman Brothers can lose all their money, all risk assessment is suspect. Is the client willing to risk his money investing into the stock market knowing that his investment could be worth 30% less this time next year ? Will he be able to sleep at night ? Will he disinvest given such a fall in value or pile more money in ? Any attempt to be more rigorous is the investment world trying to kid the punter that recommendations are based on incontrovertible truths - which, of course, is bullshit!

Posted by: Bill Wells

24 Oct 2011 | 13:50
Complain about this comment

Related articles

Most Read

Audio / Visual

Coffee Lounge

View all the winners here

PPR Structured Product Awards 2011

View all the winners here

This year we have 14 awards designed to mark out the very best products in a highly competitive and innovative market. This includes three new awards for 2011 to reflect the developments in this rapidly growing market: Best Dual/Multi-Index Product, Best Structured (Oeic) Fund and Best Structured Product Provider.

Events

event logo

International Fund & Product Awards 2012

14 Jun 2012 - 14 Jun 2012

London, UK

event logo

British Mortgage Awards 2012

03 Jul 2012 - 03 Jul 2012

London, UK

event logo

Cover Webinars

04 Jul 2012 - 04 Jul 2012

London, UK

Poll

Should there be a cap on hourly fees?

In Focus

Viewpoints