How machine learning might affect media


Bruce Devlin - new TV-Bay Magazine
Read ezine online
Download PDF
Download PDF

Why has AI suddenly becoming interesting?

I have a curious relationship with technology. I’ve been doing it all my life and I see topics come and go over the years. This is the 3rd time around that I’ve seen Artificial Intelligence become trendy and this time, I think it will stick. There are 4 things that are different this time around and they are (in alphabetical order) Amazon, IBM, Google, Microsoft. All of those companies have had AI research programs running for years, but the big change now is that there is enough ubiquitous compute resource in the form of the cloud to make it commercially viable to build products around the platforms.

How does AI actually work? Firstly, I’m going to stop using the term AI which is a catch-all phrase that implies some sort of sentience to the computer. All experts agree that we’re a long way from that. Instead, I’m going to use the term Machine Learning (ML) which more accurately reflects where we are. Typically, an ML engine consists of some software that is able to extract information from a large data set and then correlate that data against a set of known outcomes. An example from years ago is a large data set of camouflaged tanks in forests from which information such as edges, contrast, and geometric pattern were correlated against the simple outcome tank or no tank. The computation required was immense and the standard methodology of using 80% of your data to train the model and 20% of the data to test the model was used.

Training in this context is basically the adjusting of the parameters of the model until the ML engine gets the right result for all of the training data. Once you’ve done this you can remember the parameters and see if it works for the test data. In the tank example, the results on the test data were pretty good and it seemed like the system worked. In real life, however, the system was virtually useless. Later scrutiny discovered that in the training data, all of the photos of tanks were on cloudy days and all the photos of no tanks were on sunny days. In effect the system had been trained to detect that the sun was shining.

Why you should be sceptical of ML

Given this scenario, you may dismiss this as a case of old technology and badly understood training methodologies. Unfortunately, we still have this problem today. If you’re not white Caucasian, then you might wonder why facial recognition software doesn’t work for you as well as it does for your white Caucasian friends. If you’re applying for a job in a big organisation, then you should be rightly worried about the training sets used to identify the perfect resume.

Why you should be optimistic about ML

So, in 2018 we still suffer from the issue of not really knowing what we have trained the ML engine to do, but we do know that there are certain applications that continue to get better and will have an impact on our life as media professionals.

Voice command and synthesis. I believe will radically change the way in which we interact with media equipment. In live TV we train humans and give them instructions by voice. It’s will not be long until software applications join that merry gang.

Auto translation and voice synthesis. This gets better every day and is good enough for many applications. If you haven’t played with Amazon’s Polly, then go here and click: https://aws.amazon.com/polly/ . Bruce’s Shorts will soon become Polly aware. I look forward to the responses from my international followers!

Image, pattern and emotion recognition. As a tennis fan, I have to say that the highlights shots being selected by IBM’s Watson for https://wimbledon.com are pretty amazing. I know that there is additional human curation, but the speed and accuracy empower the humans to create packages that would otherwise not get made because there is not enough time. Just remember that every time you search for an image on google, there is an ML algorithm curating content for you.

Will the machines take over?

AI and ML will dramatically change the way we do our media jobs. In that same way that the synthesiser did not replace live musicians, I don’t think that machines will replace humans in the media world. I think that the real creatives who understand the technology will make amazing content to keep my aging brain happy. Visit https://google.github.io/creatism/ and https://jukedeck.com/ to see if you agree.

Ciao

Bruce


Tags: iss132 | class | machine learning | ml | watson | ibm | Bruce Devlin - new
Contributing Author Bruce Devlin - new

Read this article in the tv-bay digital magazine
Download PDF
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Classic tubes reinvented by Kino Flo at IBC 2018

    Classic tubes reinvented by Kino Flo at IBC 2018

  • Winner of the LP54 Miller Classic

    Winner of the LP54 Miller Classic

  • Global Distribution with mLogic at IBC 2013

    Global Distribution with mLogic at IBC 2013

  • Hamlet at IBC2011

    Hamlet at IBC2011

  • Bebob V-Mount Batteries at NAB 2019

    Bebob V-Mount Batteries at NAB 2019

  • Yospace: Advert Insertion at NAB 2013

    Yospace: Advert Insertion at NAB 2013


Articles
TVFutures - Learning Editing Platforms
Connor Eves Long before I even started University, I knew I wanted to be a video editor. I used to spend large amounts of my time editing together my own YouTube videos (In fact, I still do- occasionally) My name is Connor Eves, and I’m now just a few months away from attempting to enter the post-production realm at a professional level, a thought that is on my mind near enough everyday.
Tags: iss141 | portsmouth university | ccitv | premiere pro | blackmagic | davinci | avid | fcp | final cut pro | Connor Eves
Contributing Author Connor Eves Click to read
Gearing up for The Americas with Simon Reeve
Jonathan Joung For several years, it has been my honour to collaborate as director of photography with Simon Reeve, the well-known British author, adventurer, and TV presenter. Our latest partnership, the popular BBC Two program “The Americas With Simon Reeve,” is our most ambitious project yet, tracing Simon’s journey from the top to the toe of two continents. Series 1 of “The Americas,” covering North and Central America, has just finished airing on BBC Two. Currently in production, Series 2 will continue the story down through South America and will air in 2020.
Tags: iss141 | litepanels | vitec | pxw x500 | a7s dslr | dionic xt | flowtech | smallhd 702 | Jonathan Joung
Contributing Author Jonathan Joung Click to read
Creating Broadcast Quality Live Streams for Social
Alex Pettitt

We go behind the scenes of YouTube Premiere League Football Show, “The Kick Off”

Now in its third season, live streamed roundtable “The Kick Off” is the perfect weekly companion show for football fans looking to discuss the latest Premiere league match. Featuring YouTube sensation, True Geordie, and including the option to chat interactively with the show hosts as standard, it’s no surprise that “The Kick Off” now regularly attracts around 1.7 million views.

Tags: iss141 | kickoff | blackmagic design | atem | youtube | ursa mini pro | grabyo | super chat | adsense | Alex Pettitt
Contributing Author Alex Pettitt Click to read
CLASS - Software Workflows
Bruce Devlin - new NAB is approaching. Apart from deciding on whether to come for a bike ride with myself and the KitPlus Team, you should also be thinking about what information you want to get from the vendors and the thought leaders that will stay relevant long enough be deployed.
Tags: iss141 | class | dpp | dpp tech leader | cots | smpte | nab2020 | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read
CVP Helps Productions Choose the Right Lens for the Job
Sam Measure CVP Technical Specialist, Sam Measure, on how the company’s free online Lens Coverage and Camera Comparison tool is giving something back to the filmmaking community.
Tags: iss141 | cvp | lens tool | arri | fuji | red | alexa lf | venuce | monstro | full frame | super 35 | hawks | vantage | david fincher | Sam Measure
Contributing Author Sam Measure Click to read