'This is the largest emotional dataset linked to real business outcomes in existence'

Facial expressions show Mars the adverts that will drive sales

Facial expressions show Mars the adverts that will drive sales

It’s a claim that will raise a few eyebrows: researchers working for Mars can identify with 75% accuracy whether or not an advert will deliver a big sales uplift by studying facial expressions.

Traditionally, brands have used panel discussions or self-reporting to determine how their marketing influences consumer preferences, action and behaviour. It’s not a bad approach, but it’s difficult to scale or identify which ads will work and which won’t. And marketing doesn’t come cheap.

Experts at the Mars Marketing Laboratory and software company Realeyes have taken a different approach. The team used webcams and the latest computer vision and machine-learning technologies to analyse facial expressions to determine “how people felt” whilst they watched adverts for brands including Dolmio, Galaxy, Uncle Ben’s and Bounty.

I spy … with 75% accuracy

The team first measured the micro-movements in the faces of willing consumers and used computer vision and machine learning to analyse them. They focused on expressions of happiness, surprise, confusion, disgust, engagement, as well as behaviours such as how and when people move their head. These emotions data were then cross-referenced with Mars’ known sales lift data for each ad.

Their analysis – involving 149 ads across 35 brands and 22,334 people in six countries – created the “largest emotional dataset linked to real business outcomes currently in existence”.

They discovered that emotions data could be used to correctly identify whether the ads tested had a ‘no to low’ or ‘high’ impact on sales 75% of the time”. The accuracy was “nearly identical” regardless of the product category, they noted in their paper due to be published in the journal Image and Vision Computing. For chewing gum ads it was 76%, whilst in food and confectionery the associations were 75% and 70% accurate.

Splitting results by country there was more variation, however. The best results were in France (87%), Russia (82%) and the US (80%). UK associations were 79% accurate, but in Germany they were only 64%. The researchers are not sure why there was such a discrepancy.

The full study can be read here.

Adspend saver

The team also discovered that successful ads “grow happiness” for longer than unsuccessful ones, whilst the absolute level of happiness matters less than the dynamics of it developing over time. For instance, an advert that steadily increases happiness up to a level of seven out of 10 is likely to do better than one in which levels hit eight at some point but fluctuate more.

The findings are good news for brands. Analysing adverts in this way could ensure marketing budgets are spent more effectively, said Realeyes CEO Mihkel Jäätma. “Being able to identify strong creative with high sales impact enables advertisers to push these ads, and avoid putting media spend behind those with low, or worse – no sales impact,” he explained.

The “promising results” may lead to a new generation of automated, cost-efficient, behavioural cue driven market research tools for analysis, the authors explained.

“Just think – an algorithm can detect how people feel about an advert by tracking their facial expressions, and that can tell us whether that ad will sell or not,” explained Realeyes CEO Mihkel Jäätma. “That’s exactly what our scientists been working to achieve.”

Related News

Photo: Mars

Mars pledges to use 100% high-oleic peanuts in M&Ms, Munch Bar, by end of 2017

Nutella: Proudly contains palm oil.   © iStock/AlinLyre

Ferrero defends palm oil in Nutella with advert against 'unfair smear campaign'

Fanta advertising messages that consumers swallow, literally...

Coke claims world first with ‘edible’ Fanta print advert

The advertising watchdog upheld complaints about one advert in Unilever's Piri Piri Pot Noodle Facebook campaign but rejected two others

Unilever slammed for ‘offensive’ Facebook noodle advert

Picture Copyright: AB InBev

Don’t link alcohol to ‘sexual success’ in future Budweiser adverts, ASA warns AB InBev

Birds Eye food additive advert cleared by watchdog

Coconut sugar is seen as a healthier alternative to cane or beet sugar but the science behind the claims remains shaky. © iStock

Far from shy: Shouts about coconut sugar fall foul of advert regulators

Snack makers pledge to cut out adverts aimed at children

Related Products

See more related products

Submit a comment

Your comment has been saved

Post a comment

Please note that any information that you supply is protected by our Privacy and Cookie Policy. Access to all documents and request for further information are available to all users at no costs, In order to provide you with this free service, William Reed Business Media SAS does share your information with companies that have content on this site. When you access a document or request further information from this site, your information maybe shared with the owners of that document or information.