<< Back to Learning Resources
APPROX TIME

  • Share This

MRS recently launched their latest Delphi report: Prediction and planning in an uncertain world. We spoke to Jane Frost, CEO, about the findings.

In his talk at EffWeek 2016 Professor Patrick Barwise drew a wry laugh of recognition from the audience with this statement:

“When you as a marketer stand next to someone from finance or operations, much of what you say will sound less reliable… because it is”

“Marketing is about the future – future sales, future campaigns, future products,” he continues. “And when someone says to you ‘I can tell you about the future’, what do you think? Well, you’re sceptical aren’t you?”

Patrick Barwise speaking at EffWeek 2016
Professor Patrick Barwise talks to Ravi Mattu, Editorial Director for FT² at Effweek 2016

This scepticism when it comes to prediction has become part of the popular consciousness recently. From Michael Gove’s ‘experts’ observation during Brexit, and its apparent validation by the failure of the polls at both the referendum and the general election – predicting the future has become a risky business for all involved.

MRS commissioned the report to move the conversation on and broaden the debate from the “Polling doesn’t work,” rhetoric. They also wanted to try to provide some practical advice and context for mid-senior managers involved in forecasting decisions.

The power of uncertainty

Most people try to predict the future to try to reduce uncertainty. But one thing that stood out in the report was the value of simply not being sure. “As companies become more successful, the trigger for change is reduced, “says Jane. “Dominance leads to inertia and in this scenario companies often do bad research. They talk to their customers and forget the people who don’t buy their products. They base their predictions on past success, and they don’t bring in outsiders to the research process. The result is that they often miss something crucial that is happening in the world. Their predictions simply don’t include any big surprises. Unfortunately the world does.”

Coloured fans spread out

Uncertainty plays a huge part in the predictions of some of the most powerful economic players. The Bank of England use what they call ‘Fan charts‘ to predict metrics such as inflation. The charts allow them to show a range of possibilities and a confidence interval for each possibility. It forces the reader to consider that for example, although 2% inflation looks likely, 5% is also within the range of possibilities. This is what bad research lacks.

Jane thinks we can see examples of this out in the world now. “I would argue that Uber for example, may not have been thinking forward enough,” she says. “You can see that they are getting themselves into unnecessary problems now. It looks as though they may not have considered the point at which technology would not be the answer to their problems.”

Meeting the unreported need

Someone opening the door to a hotel room

Disruptive technology has a knack for meeting a previously unreported need. Airbnb understood that customers needs had fundamentally changed, while the hotel industry was busy with business as usual – refining and refining the model they already had. “Companies with a strong mono-culture often fail to see the unreported need,” says Jane. They tend to forecast based on previous successes and failure and historical data. So when someone comes along with a new and better idea, suddenly all that data is obsolete, because it is looking at the problem through the wrong lens.”

The radical influence of ethnography

When organisations rely on historical big data for their reporting they can get the wrong picture. A good example is American Airlines. “They looked at their data and saw that no-one was using their loyalty points,” says Jane. “So it seemed a no-brainer to get rid of the scheme and its associated costs. It was a commercial disaster. What all the data and numbers weren’t telling them was that their customers loyalty relationship with the brand was not the same thing as their price relationship. Customers have several approaches to a brand and they aren’t all based on it being the cheapest.”

Jane Frost, CEO of MRS speaking at EffWeek 2016 on research and prediction
Jane Frost, CEO of MRS speaking at EffWeek 2016

Jane thinks that ethnography and behavioural science offer solutions, but are often absent as approaches from predictive research.

“If American Airlines had considered the possible impact of loss aversion for example, they might have spotted the problem,” she says. “If they had carried out some ‘ethnographic’ research on the ground with their customers, it might have revealed this hidden relationship that they had with the brand.”

“Ethnography is radical in the sense that it issues a challenge,” says Jane. “It says: ‘okay, this reports as X. But if you actually go and look at what is happening amongst real people you see that it is something different.’ It illuminates. If you rely on a pure numbers approach to prediction you exclude outsider voices – because your data is all about your customers. You run the risk risk of walking blindly into a future that is significantly different from the one your data projected and with no real insight into how your customers are going to behave in this new world.”

Download the MRS report: Prediction and Planning in an Uncertainty World.

<< Back to Learning Resources

Effectiveness Week 2016

“Just what the industry needs, great collaboration between clients and agencies on the topics that drive business growth.”

Bridget Angear, Joint Chief Strategy Officer at AMV BBDO

“It’s great to see the IPA in the UK bring the whole industry and particularly the trade bodies together to focus on effectiveness. This new Marketing Effectiveness initiative will enable people across the industry to work together to build on best practice.”

David Wheldon, Chief Marketing Officer, RBS

“Effectiveness is a team sport, so it was great to see the industry in the widest sense, come together. In an increasingly diverse and fragmented world, only by using all parts of the brain will we solve effectiveness challenges and design our campaigns to deliver short and long term value. That’s why what happens next is important – if the IPA can help facilitate progress on this with a long-term initiative around Marketing Effectiveness, we’ll definitely crack it.”

Bart Michels, Global CEO Kantar Added Value and Country Leader Kantar UK

“The time spent at #EffWeek was extraordinarily effective. It was great to hear the diverse views from all areas of the industry. All tied together with the common themes of accountability and effectiveness.”

Andrew Canter, Global CEO, BCMA

“It has been a privilege to be part of the inaugural Effectiveness Week. The agenda is one which we at O2 UK feel passionately about. To see and hear perspectives across the industry demonstrates how the breadth of marketing effectiveness is increasingly being valued within businesses. Data, insight, social, customer experience, test and learn, ROI, these are all fundamentals and were covered expansively at the event”.

Sandra Fazackerley, Marketing & Consumer, Telefónica UK Limited

“The full week of effectiveness events brought into clear focus the need for marketers to use data and insight to achieve the key business objectives of growth and profits. Marketers today are in a better position to quantify their knowledge of customers and measure the ability of investments in marketing to increase brand and shareholder value.”

Chris Combemale, Group CEO, DMA