Authoring and Monitoring for the emerging 3D immersive Broadcast Audio formats


Anthony Wilkins TV-Bay Magazine
Read ezine online
by Anthony Wilkins
Issue 107 - November 2015

The world of broadcast audio is on the verge of a major revolution. Numerous 3D Immersive formats are under development and will find their way into the mainstream of broadcast production and distribution in the near future. Unlike the world of relatively constrained channel based coding as we are accustomed to (most commonly Left / Right for Stereo and Left / Centre / Right / Surround Left / Surround Right + LFE or Low Frequency Effects for surround), these new codecs will support more channels and/or object based audio coding. For the end consumer, there will be two major benefits from this new approach, a greater sense of involvement or immersion, and a degree of personalisation.

Greater involvement will come from an increased channel count typically by the addition of overhead height channels. Several proponents including the MPEG-H Alliance (Fraunhofer IIS, Technicolor and Qualcomm), Dolby and DTS have successfully demonstrated broadcast compatible systems based on 5.1.4 or 7.1.4 layouts where 4 overhead speakers have augmented the traditional 6 or 8 floor level speakers. This creates a 3D sound image where the viewer or listener is immersed in audio in all dimensions.

Object based audio will give the end user the option to personalise their experience by selecting from a number of audio sources and controlling the level and maybe even the position in the mix. In object based audio, an object is essentially an audio stream with accompanying descriptive metadata. The metadata carries information about where the engineer placed the object in the mix and at what level, and is used to re-create, or render, the audio experience for the end user. Objects may be static and placed at a fixed point in the mix (for example dialog) or dynamic where they are panned across the 3 dimensional soundscape (maybe a plane flying overhead). Depending on restrictions and limitations decided at the point of content creation (and signaled in the descriptive metadata), the end user could select which audio source(s) they want to hear from an on-screen list and perhaps vary the level at which they are reproduced. Think of a sporting event where the options could include home or away commentary, crowd sounds, the referee or match officials voice or pitch side microphones at team ball games. At motor racing events examples could be commentary, drivers voice or pit crew communication.

Does this mean multiple speakers need to be installed to avail of these new benefits? Not necessarily, although of course the best experience will result from a full installation of discrete speakers at both floor level and overhead, however where this is not practical (most likely the majority of typical domestic situations), the final renderer will re-create the mix as accurately as possible based on the actual number and location of speakers the end user has. An increasing number of Soundbars that are designed to sit underneath a display are already available to create a surround experience without consuming valuable space. Better still, a wall mounted Soundframe completely surrounds the display and can give an incredibly realistic reproduction from the height channels.

What does this all mean for the broadcaster? A complete re-build of existing facilities and a total re-think about the audio processing equipment required for outside broadcast vehicles? Well, if we get it right, it should entail just relatively minimal changes to overall workflow and hardware, but inevitably some additions to production and distribution equipment. In the case of object based audio, the metadata appropriate for the final codec needs to be created and added to the audio for insertion into a conventional SDI stream, and the engineer needs to be able to monitor this complex mix (and all the potential downmix variations) to ensure that the distribution chain is fed with all available objects correctly. Loudness levels should also be considered in respect of existing standards and there should be provision for local insertion of content at any point in the chain. Although this all sounds somewhat futuristic, the fact is that the broadcast industry is already seriously considering the potential adoption of these concepts. At Jnger Audio we have already worked closely with Fraunhofer IIS to design a prototype Multichannel Monitoring and Authoring unit (MMA) that is capable of directly interfacing with existing mixing consoles via AES, SDI, MADI, Dante or even analog audio formats. At NAB 2015 there was a comprehensive demonstration of a complete object audio based end-to-end broadcast chain including the original outside broadcast capture, distribution via the network operation centre, insertion of local content from an affiliate station and finally reception at the end-users home with full control of object selection and audio reproduction via Soundframe. At all stages of the distribution chain, the audio could be monitored to verify metadata parameters, downmix(s) could be auditioned and loudness levels could be checked and corrected if required.

Although that particular demonstration was using the MPEG-H codec, it is important to understand that the monitoring and authoring unit is agnostic, or independent, of the final codec used for transmission. Such a device would be easily adaptable to create and monitor metadata for any of the existing or future 3D Immersive formats irrespective of vendor or developer.

www.jungeraudio.com

Tags: iss107 | broadcast audio | 3d immersive formats | facilities | equipment | authoring | monitoring | Anthony Wilkins
Contributing Author Anthony Wilkins

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Infinity Arm - Matthews Studio Equipment at NAB 2016

    Infinity Arm - Matthews Studio Equipment at NAB 2016

  • Cineline Fluid Head from Miller Camera Support at NAB 2014

    Cineline Fluid Head from Miller Camera Support at NAB 2014

  • Belfast TOUR

    Belfast TOUR

  • Miranda on BroadcastShow LIVE at IBC 2013

    Miranda on BroadcastShow LIVE at IBC 2013

  • Tektronix at IBC 2013

    Tektronix at IBC 2013

  • Thear Technology at BVE 2013

    Thear Technology at BVE 2013

  • Guntermann and Drunck GmbH at BVE 2013

    Guntermann and Drunck GmbH at BVE 2013

  • Bexel at NAB 2012

    Bexel at NAB 2012

  • Thear Technology Limited at ProVideo2011

    Thear Technology Limited at ProVideo2011

  • JVC monitoring solutions DT-G, DT-E, DT-U, and DT-V range at BVE 2018

    JVC monitoring solutions DT-G, DT-E, DT-U, and DT-V range at BVE 2018

  • IP, 3G-SDI + HDR generation, analysis and monitoring from Phabrix NAB 2017

    IP, 3G-SDI + HDR generation, analysis and monitoring from Phabrix NAB 2017

  • Apantac monitoring over IP at NAB 2016

    Apantac monitoring over IP at NAB 2016

  • Wohler MPEG Monitoring Series at IBC 2014

    Wohler MPEG Monitoring Series at IBC 2014

  • Wohler MPEG Monitoring at BVE 2014

    Wohler MPEG Monitoring at BVE 2014

  • Bridge Technologies QoE Monitoring with Mobile Videowall Display at IBC 2013

    Bridge Technologies QoE Monitoring with Mobile Videowall Display at IBC 2013

  • The Telos Alliance at IBC 2016

    The Telos Alliance at IBC 2016

  • Wohler at IBC 2016

    Wohler at IBC 2016

  • Phabrix Qx at IBC 2015

    Phabrix Qx at IBC 2015

  • Phabrix TAG and Rx at IBC 2015

    Phabrix TAG and Rx at IBC 2015

  • NUGEN Audio at BVE 2015

    NUGEN Audio at BVE 2015

  • Phabrix RX series at IBC 2014

    Phabrix RX series at IBC 2014

  • Volicon Products at IBC 2014

    Volicon Products at IBC 2014

  • Volicon at IBC 2014

    Volicon at IBC 2014

  • Wohler DPP at BVE 2014

    Wohler DPP at BVE 2014

  • Wohler Technologies on BroadcastShow LIVE at IBC 2013

    Wohler Technologies on BroadcastShow LIVE at IBC 2013

  • Volicon on BroadcastShow LIVE at IBC 2013

    Volicon on BroadcastShow LIVE at IBC 2013

  • Calrec Callisto at IBC 2013

    Calrec Callisto at IBC 2013

  • Bridge Technologies PocketProbe App at NAB 2013

    Bridge Technologies PocketProbe App at NAB 2013

  • Sound Devices at NAB 2013

    Sound Devices at NAB 2013

  • TSL Products at NAB 2013

    TSL Products at NAB 2013

  • TSL Systems at BVE 2013

    TSL Systems at BVE 2013

  • TSL Products at BVE 2013

    TSL Products at BVE 2013

  • Oxygen DCT at BVE North 2012

    Oxygen DCT at BVE North 2012

  • RTW at NAB 2012

    RTW at NAB 2012

  • TSL at NAB 2012

    TSL at NAB 2012

  • Qualis at NAB 2012

    Qualis at NAB 2012

  • Digital Nirvana at NAB 2012

    Digital Nirvana at NAB 2012

  • Leader at IBC2011

    Leader at IBC2011

  • Murraypro at IBC2011

    Murraypro at IBC2011

  • DK Technology at IBC2011

    DK Technology at IBC2011


Related Shows
  • Sony monitoring at BVE with Den Lennie

    Sony monitoring at BVE with Den Lennie


Articles
Creating Authentic Content That Counts
Frank le Mair We’re deep into the 2010’s and the way in which we consume content has changed forever. Broadcasters and content owners are fighting for eyeballs in a saturated market where consumers are watching their favourite shows on different devices across a number of platforms. To target millennials and younger generations, who generally consume short bursts of video on YouTube and social media - particularly Snapchat, Instagram and now IGTV - media companies are creating more and more authentic stories and are using platforms that are compelling for this demographic. Unlike generations before them, they have totally new video viewing patterns and ideals.
Tags: iss133 | insight tv | monster energy | amazon | millennial | Frank le Mair
Contributing Author Frank le Mair Click to read or download PDF
Managing Technological Change
Alan Wheable Continual technological change in the broadcast and media industries can make it difficult to plan for the mid to long term. Typically, broadcasters and media organisation are still implementing the last set of changes to working practices when the next changes come along.
Tags: iss133 | omnitek | ip | waveform | vectorscope | ultra tq | Alan Wheable
Contributing Author Alan Wheable Click to read or download PDF
Smashing the WTA Tour
Danny Ridler The Women’s Tennis Association (WTA) is the global leader in women’s professional sport with more than 2500 players representing nearly 100 nations competing for a record $146 million in prize money. The 2018 WTA competitive season includes 54 events and four Grand Slams in 30 countries. In 2017, the WTA was watched around the world by a total TV audience of 500 million – with host broadcast services provided by NEP UK.
Tags: iss133 | tennis | wta | nep | outside broadcast | ob | Danny Ridler
Contributing Author Danny Ridler Click to read or download PDF
Perimeter LED screens management
Nicolas Houel Opened in January 2016, Parc Olympique Lyonnais, also known as Groupama Stadium, is the new home of Olympique Lyonnais football club, one of the most popular clubs in France. Since its inauguration, the stadium was a host of UEFA Euro 2016, and was also chosen to stage, among other important events, the 2018 UEFA Europa League Final and football at the 2024 Summer Olympics.
Tags: iss133 | 3dstorm | graphics | groupama stadium | liveexpert | livecg | deltacast | Nicolas Houel
Contributing Author Nicolas Houel Click to read or download PDF
Fast-moving productions need multi-cam RF reliability
Darren Bilton Wireless acquisition creates a level of freedom not possible with any other form of filming yet only a decade ago the technique was barely possible. The technology enabling live real-time connections over radio frequencies has advanced leaps and bounds such that there is barely an entertainment, documentary, sports or news format today that doesn’t benefit from at least one link system. That means the demands on the kit continues to rise and includes the need for fail safe multi-camera operation, ease of use and backwards compatibility all within a small, lightweight and budget-friendly package.
Tags: iss133 | boxx tv | wireless | mpeg-4 | multicam | rf | multi-cam | Darren Bilton
Contributing Author Darren Bilton Click to read or download PDF