Dolf Schinkel, KPN
dolf DOT schnikel AT kpn.com
Summer 2021
On 18, 20, and 22 May, KPN distributed the live Eurovision Song Contest 2021 with Dolby Atmos sound in a project with NPO Innovation and the Dutch ESC2021 organisation.
KPN has an interactive TV platform with over 2 million users. About 25% of the users have a set-top box capable of decoding HEVC, which supports Dolby Atmos in passthrough mode. And it can downmix to 5.1 or 2.0 when a device is attached that doesn’t support Dolby Atmos. The older set-top boxes are AVC-based; these support neither MPEG HEVC nor Dolby Atmos.
We positioned the broadcast as a technical trial. The original broadcast was distributed on the main “NPO1” public broadcast channel, while the Atmos trial was accessible on a separate event channel.
In this paper, I will give some insights into this innovative audio-visual project.
“Just add the extra audio.”
It might seem easy to add an extra audio distribution channel when your country hosts the Eurovision Song Contest. Still, we ran into many obstacles starting this project: rights, responsibilities, and an inflexible broadcast architecture made this much harder than we had anticipated.
The regular NPO1 broadcast of the European Song Contest (ESC) was already designed and being built when we decided to add an Atmos signal.
A simplified version of the original setup is shown in figure 1. In this setup, the components not relevant for the event channel are left out.
The TV signal is produced by the ESC 2021 organisation for the EBU and sent to all the Eurovision countries, Israel and Australia, over satellite.
For the Netherlands, the signal is received in Hilversum by the broadcast organisation AVROTROS that produces the local program. The feed was a satellite feed that we replaced with a fibre feed during the project. AVROTROS adds titles and a live commentary from the venue.
The signal is then provided to NPO, the public broadcaster, which adds logos and extras such as Teletext and subtitles. The NPO1 channel is distributed to users by KPN and other TV distributors in the Netherlands.
Figure 1 – simplified diagram for the NPO1 channel during the event.
And this is how we did it.
To create the immersive audio, we placed extra microphones and an additional mixing console in the venue.
NEP supplied their newly built audio truck, the “NEP MusicOne”, operated by audio technicians from both NEP and United.
We fed the TV signal and commentary back from Hilversum to this truck.
All audio coming from the stage was merged with the extra microphones and the commentary to create the discrete audio tracks for the Dolby Atmos mix.
The incoming audio feeds were delayed to compensate for the Rotterdam-to-Hilversum satellite and fibre round-trip delays.
In the NEP MusicOne truck, two audio technicians mixed the immersive audio in a 5.1.4 format and were able to have the 5.1 and stereo downmixes from Atmos in real-time (thanks to the Dolby DP590 unit). The original stereo audio was passed through.
The combined 5.1.4 and stereo signals were fed over a fibre connection in HD SDI with discrete audio to NEP live centre in Hilversum.
NEP provided a playout with Dolby Atmos sound to fill the gaps in programming between the Eurovision transmissions. The choice was not to use a test pattern but a Dolby Atmos test sequence, allowing people to test their home equipment before the show starts.
From NEP in Hilversum, the signal was sent to KPN’s Hilversum-in HD SDI, with discrete audio. It was then encoded using an Ateme HEVC encoder that included a Dolby Atmos encoder.
Figure 2 illustrates how the Dolby Atmos TV channel is produced.
Channel-based versus object-based audio
The minimal preparation time for this forced us to make it as straightforward as possible.
Dolby Atmos supports both channel-based and object-based audio, and we had to choose which one to use. The KPN set-top box does not support AC4 yet, so the audio was put in an E-AC3 container (Dolby Digital + Atmos).
By design, all Dolby Atmos encoders support the addition of a voice-over to the signal. The metadata controls these objects so that we can add more than one voice-over.
In an ideal situation, the metadata for this is generated in the audio mix. For this project, we had no hands-on experience with this specific Dolby Atmos metadata. And there was no time to test this out, as we only had one full day to complete the sound setup.
Lack of experience, combined with the requirement of AVROTROS and NPO that the program is delivered with the commentary voice-over, made us decide to mix the voice-over into the 5.1.4 audio to make this as robust as possible.
For this project, we only had a single voice-over. In situations where there is more than one voice-over (multiple languages), the Dolby Atmos object-based solution is the more logical choice.
In figure 3, the chosen configuration is shown.
“Hello Europe”
The audio technicians were briefed by Dolby, sharing the insights of past (live) events broadcast with Atmos like, e.g., Premier League matches in the UK.
The Eurovision Song Contest has rehearsals and a separate jury show for each program. There was, therefore, some time to test. And having an audience was necessary as the sound of the audience was a relevant component of the overall sound. The jury show, which is not publicly broadcast, but has an audience, was fed back to the MusicOne using a VPN connection.
Experts from KPN and NEP listened to test signals that came into homes via secure access to give feedback on how the sound was coming through in the living room. We performed our quality testing the day before the first live show.
The advice from earlier Dolby Atmos projects was to give more rear and top speaker signal strength than the spatial audio producers would expect when listening in the NEP MusicOne. This advice is helpful because a typical living room has specific acoustic dampening characteristics. The expert listeners confirmed that these adjustments were necessary.
Also, during rehearsal, we had to measure the delay and compensate to maintain lip sync. It took a few minutes during this first attempt, but this delay proved to be constant over the three broadcast days, and we calibrated it about 25 minutes before every broadcast.
After the trial day on Monday, we were ready to transfer the NPO1 event channel to the half-million set-top boxes in the KPN interactive TV network, waiting for the famous opening line: “Hello Europe.”
Customer feedback and learnings.
To gather feedback, KPN opened a thread on the public KPN forum (KPN.com/forum). On the forum, customers could react and ask questions.
With the help of partners in the project, we provided Atmos soundbars to the two moderators of the forum to help them with their tasks.
The forum was a structured way of presenting the extra information needed by our customers to start using Dolby Atmos.
Reactions of customers were, on average more than positive. They considered the sound quality to be excellent.
People found it helpful that there was a test sequence with Dolby Atmos playing when no live event was on.
Downmix in the set-top box to Dolby Digital 5.1 was perceived as providing better quality than the standard 5.1 audio (subscribers could compare by zapping between the signals).
A general reaction was: “This sound so good, give us more!”.
The KPN forum’s guidance (e.g. “try this solution”) solved some practical issues customers suffered from bad lip-syncing.
For operational control and management of TV distribution, KPN used automatic silence detection. During the tests phase, we suffered an interruption on some of the discrete audio signals leaving the truck, resulting in missing audio in some of the rear loudspeakers in the living room.
Because we did not have automated monitoring and silence detection, it took us more time than usual to discover and resolve the issue. To solve this, we made someone responsible for monitoring the signal for distribution.
The learning on the sound level of the overhead speakers in living rooms, “Make them louder than you think is necessary”, was confirmed in this project.
Thank you
This project was a cooperation between NPO innovation, AVROTROS, ESC2021, Dolby, Ateme, NEP, United, Samsung Benelux, LG Benelux, TP Vision and VodafoneZiggo and KPN. The goal was to test the entire chain from production to the living room for Dolby Atmos immersive audio. This project was a success, and I would like to thank everybody for their participation. This paper is meant to help people implementing immersive sound. The user feedback is publicly accessible in the KPN Forum (KPN.com/forum, in the Dutch language).
