How machine learning might affect media


Bruce Devlin - new TV-Bay Magazine
Read ezine online
Download PDF
Download PDF

Why has AI suddenly becoming interesting?

I have a curious relationship with technology. I’ve been doing it all my life and I see topics come and go over the years. This is the 3rd time around that I’ve seen Artificial Intelligence become trendy and this time, I think it will stick. There are 4 things that are different this time around and they are (in alphabetical order) Amazon, IBM, Google, Microsoft. All of those companies have had AI research programs running for years, but the big change now is that there is enough ubiquitous compute resource in the form of the cloud to make it commercially viable to build products around the platforms.

How does AI actually work? Firstly, I’m going to stop using the term AI which is a catch-all phrase that implies some sort of sentience to the computer. All experts agree that we’re a long way from that. Instead, I’m going to use the term Machine Learning (ML) which more accurately reflects where we are. Typically, an ML engine consists of some software that is able to extract information from a large data set and then correlate that data against a set of known outcomes. An example from years ago is a large data set of camouflaged tanks in forests from which information such as edges, contrast, and geometric pattern were correlated against the simple outcome tank or no tank. The computation required was immense and the standard methodology of using 80% of your data to train the model and 20% of the data to test the model was used.

Training in this context is basically the adjusting of the parameters of the model until the ML engine gets the right result for all of the training data. Once you’ve done this you can remember the parameters and see if it works for the test data. In the tank example, the results on the test data were pretty good and it seemed like the system worked. In real life, however, the system was virtually useless. Later scrutiny discovered that in the training data, all of the photos of tanks were on cloudy days and all the photos of no tanks were on sunny days. In effect the system had been trained to detect that the sun was shining.

Why you should be sceptical of ML

Given this scenario, you may dismiss this as a case of old technology and badly understood training methodologies. Unfortunately, we still have this problem today. If you’re not white Caucasian, then you might wonder why facial recognition software doesn’t work for you as well as it does for your white Caucasian friends. If you’re applying for a job in a big organisation, then you should be rightly worried about the training sets used to identify the perfect resume.

Why you should be optimistic about ML

So, in 2018 we still suffer from the issue of not really knowing what we have trained the ML engine to do, but we do know that there are certain applications that continue to get better and will have an impact on our life as media professionals.

Voice command and synthesis. I believe will radically change the way in which we interact with media equipment. In live TV we train humans and give them instructions by voice. It’s will not be long until software applications join that merry gang.

Auto translation and voice synthesis. This gets better every day and is good enough for many applications. If you haven’t played with Amazon’s Polly, then go here and click: https://aws.amazon.com/polly/ . Bruce’s Shorts will soon become Polly aware. I look forward to the responses from my international followers!

Image, pattern and emotion recognition. As a tennis fan, I have to say that the highlights shots being selected by IBM’s Watson for https://wimbledon.com are pretty amazing. I know that there is additional human curation, but the speed and accuracy empower the humans to create packages that would otherwise not get made because there is not enough time. Just remember that every time you search for an image on google, there is an ML algorithm curating content for you.

Will the machines take over?

AI and ML will dramatically change the way we do our media jobs. In that same way that the synthesiser did not replace live musicians, I don’t think that machines will replace humans in the media world. I think that the real creatives who understand the technology will make amazing content to keep my aging brain happy. Visit https://google.github.io/creatism/ and https://jukedeck.com/ to see if you agree.

Ciao

Bruce


Tags: iss132 | class | machine learning | ml | watson | ibm | Bruce Devlin - new
Contributing Author Bruce Devlin - new

Read this article in the tv-bay digital magazine
Download PDF
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Classic tubes reinvented by Kino Flo at IBC 2018

    Classic tubes reinvented by Kino Flo at IBC 2018

  • Winner of the LP54 Miller Classic

    Winner of the LP54 Miller Classic

  • Global Distribution with mLogic at IBC 2013

    Global Distribution with mLogic at IBC 2013

  • Hamlet at IBC2011

    Hamlet at IBC2011

  • VITEC EZTV Lite Platform for IPTV and digital Signage at ISE2020

    VITEC EZTV Lite Platform for IPTV and digital Signage at ISE2020

  • Bebob V-Mount Batteries at NAB 2019

    Bebob V-Mount Batteries at NAB 2019

  • Yospace: Advert Insertion at NAB 2013

    Yospace: Advert Insertion at NAB 2013


Related Shows
  • Post Covid-19 workflows for media & entertainment production.

    Post Covid-19 workflows for media & entertainment production.


Articles
Sennheiser MKE 400 hands on review and test
KitPlus

Sennheiser have just released two products aimed at simplifying audio on the move, the MKE400 shotgun microphone and the XS Lav Mic, in this review we’re looking at the MKE400.

Tags: sennheiser mke400 | sennheiser mke 400 | sennheiser mke 400 quality | best microphones for youtube | mic for youtube videos | sennheiser mke 400 hands on | microphone review | iphone videography | microphones | sound for video | camera microphone | microphone for iphone | microphone for youtube | video microphone | shotgun mics | smartphone microphone | vlogging mic | best microphone for video | shotgun microphone review | mke 400 | sennheiser mke 400 hands on review | sennheiser mke 400 test | KitPlus
Contributing Author KitPlus Click to read
A Broadcasters Guide to Microservices
Roger Persson

The word “microservices” has been creeping into the conversation about software-centric systems recently. Is it really a different approach, what does it mean, and what are the advantages?

Tags: nxt edition | microservices | modular software | Roger Persson
Contributing Author Roger Persson Click to read
Streaming Technologies Explained
Bruce Devlin - new

The word streaming can relate to different technologies from different manufacturers in different scenarios and in this short article we are going to take a little tour of what it all means. 

Tags: mr mxf | streaming | hls | dash | cmaf | mpeg | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read
REVIEW - Hollyland MARS 400S PRO Digital Wireless Transmission System
Phil Vinter

Built by Hollyland and costing around £600 the Mars 400S is an easy-to-use wireless video transmitter/receiver system – it will be right up the alley of anyone who, like me, considers an instruction manual to be nothing more than box padding.

Read Phils Full review here, and link to the video review.

Tags: HOLLYLAND | MARS 400 | wireless | tx | rx | Phil Vinter
Contributing Author Phil Vinter Click to read
HOLLYLAND LARK 150 Review
Phil Vinter

The exponential growth of video supercharged a technological revolution that began in the early noughties with the advent of DSLR cameras.
The cinematic-style shallow depth of field image video quality from DSLRs was a revelation, but, back then audio was the big drawback. As demand has grown so the technology has improved and today’s one-man-band small rig set ups can capture pretty good sound into a DSLR style camera.

Phil Vinter reviews the latest release from HOLLYLAND and it's a thumbs up from us.

Tags: HOLLYLAND | radio mic | audio | LARK-150 | CVP | Phil Vinter
Contributing Author Phil Vinter Click to read