Heineken 0.0% video campaign — a case study with Facial Coding

In the world of advertising, one of the most crucial indicators of advertisement success is what emotions it evokes. Of course, it’s important for an ad to be noticeable and to draw consumers’ attention, but (especially for video ads) emotions seem to be the key.

Adam Cellary
7 min readOct 22, 2020

The image below shows the difference in the entertainment level of two(out of 5 which we tested) Heineken advertisements. It’s clear that one of them brings more entertainment to viewers and this pretty clear that this insight can help a lot when planning a campaign.

Entertainment level, based on 27 participants using Facial Coding

How to discover those insights?

There are several approaches to do so: conduct a survey in the control group, meet participants to talk with them (ask about opinion, see their reactions), or… use facial coding. Due to Wikipedia: “Facial coding is the process of measuring human emotions through facial expressions”. All these expressions can be detected by a computer using a simple webcam. Algorithms analyze the shape and movement of the main facial features (eyebrows, eyes, mouth) and translate it all into human emotions — joy, sadness, fear, disgust, etc.

Heineken video campaign

To conduct this research we chose 5 Heineken ads, including 4 Heineken 0.0% ads (the message of these four was similar). 27 participants were asked to watch those ads one by one (display for each tester was set in random order) and after each of them to answer a question: How do you feel about this advertisement?

  • Saw the first time, I LIKED IT!
  • Saw the first time, I DIDN’T LIKE IT
  • I saw it before, I LIKED IT!
  • I saw it before, I DIDN’T LIKE IT

Before we start analyzing the results you can make the study yourself (and see your own results instantly after the test) by clicking HERE

Now, let’s take a look at what we get. For sure all of the ads can be rated positively in terms of eye-tracking results and emotions level. This should be expected as they are high-end ads, of a very popular product, from a big, worldwide company.

Ad1: Heineken 0.0, Now You Can: Presentation

Results: Click here to see study results live

The chart is pretty even the whole time. The score varies from 0.06 to 0.24 points. We can conclude that the lowest point is at revealing the product, as participants don’t know the context yet. They seem to be confused about the reaction of the people in the video, but once it’s explained they tend to smile a bit.

Ad2: Heineken 0.0, Now You Can: Gas Station

Results: Click here to see study results live

At the beginning of this ad, as in the previous video, nothing really happens, so the entertainment level is close to 0. But once the ridiculousness of the situation is explained the level of entertainment is clearly and significantly increasing (up to 0.24 points on average).

Ad3: Heineken 0.0, Now You Can: Parking

Results: Click here to see study results live

So far, it seems to be the best, most entertaining advertisement. The chart reaches on average 0.32 points when the gag is explained.

Ad4: Heineken 0.0, Now You Can: Locker Room

Results: Click here to see study results live

The highest grade for this video equals 0.18 points. The chart is flat and it doesn’t change much once the story is explained. Probably not the best choice.

Now let’s compare the 4 ads above with the most popular Heineken ad (from another campaign).

Ad5: Heineken Commercial Fridge

Results: Click here to see study results live

For this video, the entertainment chart rises steadily for the whole time reaching 0.42 points(!). There is no clearly marked climax that suddenly changes the audience’s reactions but the entertainment level is clearly above all previous ads!

And the winner is…

It’s clear that “Heineken Commercial Fridge” brings the most entertainment to viewers. It’s also easy to discover which advertisement from the 0.0% campaign is the winning one (Parking) as it’s entertainment level increases higher than the lowest ones.

Entertainment level, based on 27 participants using Facial Coding

The entire campaign is made really well. All the graphs are above “zero” and from declarative answers, we know that our testers/participants had a lot of fun while participating in the RealEye tests and watching those ads.

To sum things up

What are the advantages of our solution?

  • Combining insights from eye-tracking, emotion recognition and declarative surveys in one tool.
  • Participants can make the test at home, in the natural, non-corrupted laboratory environment.
  • You can compare answers for different target groups by easily filtering them, i.e. how an ad is perceived by men and women or in different age groups (this option wasn’t enabled in this study) or filter results by tags that you can create by yourself (like tag by the survey answers).
  • It’s easy to observe the climax (and whether one exists or changes the perception of an ad).
  • It may happen, that a participant didn’t realize that he/she liked an ad or he/she deliberately answered in a way that was misleading or did not want to admit liking the ad. Thanks to this kind of study we are able to answer on the behavioral level, not declarative.
  • It allows you to save money before launching the campaign — you can place a higher budget on the ads that had the highest score.
  • Results are provided as soon, as a tester finishes the task. That means that the whole study can be conducted within one day.

Don’t hesitate, try out our tool yourself and bring your research (and ads) to a whole new level. Remember that the most important thing is how consumers perceive the advertisement — their opinions, but also their emotions.

Still hungry? OK! Let’s compare the facial analysis insight with the survey results.

Surprisingly, for the people that saw the ads for the first time, the results seem to be similar for surveys and facial expressions — winning ads are “Gas station” and “Parking” (although this time the first one wins). The exception is the Fridge ad — the most known one and without a clearly defined climax. Another conclusion is that if somebody has seen the ad before, he/she liked it. This phenomenon of liking what has been seen before is well known to neuroscience researchers. This happened for the Fridge ad — based on the survey results it’s the worst one, but it clearly provides the highest score in terms of entertainment.

There is one more thing that we can do while analyzing results. You can add tags to each tester and then filter the results by those tags.

In this case, tags were added based on the questions’ answers. Each tester received five tags (as there are 5 videos) and each tag has an ad name and answer number, where:

name:

  • “parking” means Ad3: Heineken 0.0, Now You Can: Parking
  • “gas” means Ad2: Heineken 0.0, Now You Can: Gas Station
  • “locker” means Ad4: Heineken 0.0, Now You Can: Locker Room
  • “presentation” means Ad1: Heineken 0.0, Now You Can: Presentation
  • “fridge” means Ad5: Heineken Commercial Fridge

answer number:

  • “1” means “Saw first time, I LIKED IT!”
  • “2” means “Saw first time, I DIDN’T LIKE IT”
  • “3” means “I saw it before, I LIKED IT!”
  • “4” means “I saw it before, I DIDN’T LIKE IT”

Let’s see an example, what we can get from these additional insights. For the “Ad3: Heineken 0.0, Now You Can: Parking” we can see the results for:

people, who saw the ad for the first time and liked it

people, who saw the ad for the first time and didn’t like it

people, who saw the ad before and liked it

People who declared not liking the ad in fact didn’t — their entertainment chart is nearly flat with values around 0 points (with negative values which indicates dislike). For the other two groups that liked the ad, there’s no much difference between the charts (maximum values for both were 0.37 and 0.33 points), but for participants that haven’t seen the ad before, the entertainment chart changes more suddenly after the joke was revealed and maintains slightly higher values.

Big thanks to Beata Lewandowska for her huge input in this text & research!

Originally published at https://www.realeye.io.

--

--

Adam Cellary

I love to engage in interesting and forward-looking projects. I am a mixture of scrum master interested in startups with strong technical knowledge