How machine learning might affect media


Bruce Devlin - new TV-Bay Magazine
Read ezine online
Download PDF
Download PDF

Why has AI suddenly becoming interesting?

I have a curious relationship with technology. I’ve been doing it all my life and I see topics come and go over the years. This is the 3rd time around that I’ve seen Artificial Intelligence become trendy and this time, I think it will stick. There are 4 things that are different this time around and they are (in alphabetical order) Amazon, IBM, Google, Microsoft. All of those companies have had AI research programs running for years, but the big change now is that there is enough ubiquitous compute resource in the form of the cloud to make it commercially viable to build products around the platforms.

How does AI actually work? Firstly, I’m going to stop using the term AI which is a catch-all phrase that implies some sort of sentience to the computer. All experts agree that we’re a long way from that. Instead, I’m going to use the term Machine Learning (ML) which more accurately reflects where we are. Typically, an ML engine consists of some software that is able to extract information from a large data set and then correlate that data against a set of known outcomes. An example from years ago is a large data set of camouflaged tanks in forests from which information such as edges, contrast, and geometric pattern were correlated against the simple outcome tank or no tank. The computation required was immense and the standard methodology of using 80% of your data to train the model and 20% of the data to test the model was used.

Training in this context is basically the adjusting of the parameters of the model until the ML engine gets the right result for all of the training data. Once you’ve done this you can remember the parameters and see if it works for the test data. In the tank example, the results on the test data were pretty good and it seemed like the system worked. In real life, however, the system was virtually useless. Later scrutiny discovered that in the training data, all of the photos of tanks were on cloudy days and all the photos of no tanks were on sunny days. In effect the system had been trained to detect that the sun was shining.

Why you should be sceptical of ML

Given this scenario, you may dismiss this as a case of old technology and badly understood training methodologies. Unfortunately, we still have this problem today. If you’re not white Caucasian, then you might wonder why facial recognition software doesn’t work for you as well as it does for your white Caucasian friends. If you’re applying for a job in a big organisation, then you should be rightly worried about the training sets used to identify the perfect resume.

Why you should be optimistic about ML

So, in 2018 we still suffer from the issue of not really knowing what we have trained the ML engine to do, but we do know that there are certain applications that continue to get better and will have an impact on our life as media professionals.

Voice command and synthesis. I believe will radically change the way in which we interact with media equipment. In live TV we train humans and give them instructions by voice. It’s will not be long until software applications join that merry gang.

Auto translation and voice synthesis. This gets better every day and is good enough for many applications. If you haven’t played with Amazon’s Polly, then go here and click: https://aws.amazon.com/polly/ . Bruce’s Shorts will soon become Polly aware. I look forward to the responses from my international followers!

Image, pattern and emotion recognition. As a tennis fan, I have to say that the highlights shots being selected by IBM’s Watson for https://wimbledon.com are pretty amazing. I know that there is additional human curation, but the speed and accuracy empower the humans to create packages that would otherwise not get made because there is not enough time. Just remember that every time you search for an image on google, there is an ML algorithm curating content for you.

Will the machines take over?

AI and ML will dramatically change the way we do our media jobs. In that same way that the synthesiser did not replace live musicians, I don’t think that machines will replace humans in the media world. I think that the real creatives who understand the technology will make amazing content to keep my aging brain happy. Visit https://google.github.io/creatism/ and https://jukedeck.com/ to see if you agree.

Ciao

Bruce


Tags: iss132 | class | machine learning | ml | watson | ibm | Bruce Devlin - new
Contributing Author Bruce Devlin - new

Read this article in the tv-bay digital magazine
Download PDF
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Classic tubes reinvented by Kino Flo at IBC 2018

    Classic tubes reinvented by Kino Flo at IBC 2018

  • Winner of the LP54 Miller Classic

    Winner of the LP54 Miller Classic

  • Global Distribution with mLogic at IBC 2013

    Global Distribution with mLogic at IBC 2013

  • Hamlet at IBC2011

    Hamlet at IBC2011

  • Yospace: Advert Insertion at NAB 2013

    Yospace: Advert Insertion at NAB 2013


Articles
Using Wireless Transmission
Jeremy Benning Wireless acquisition is a staple of live sports, entertainment and reality shows where cable free capture permits shots not previously possible, for health and safety reasons, and gives the camera-operator greater artistic licence to roam. The same is increasingly true of narrative drama where cinematographers are keen to work handheld or Steadicam where that helps tell the story. Any equipment which frees their movement and time by being lighter, easier to use and reliable in performance is going to tick a lot of boxes.
Tags: iss134 | wireless | 4k | transmission | Jeremy Benning
Contributing Author Jeremy Benning Click to read or download PDF
An Epiphany Moment
Peter Savage 2 I had been negotiating the sale of my company and had reached the really hard end of the bargain. We were close to agreeing the final sum after a lot of too-much-give-and-not-enough-take negotiation. The solicitors were calling me, keen for a deal. It had come down to one sticking point and, in my hard ball “I am the Wolf of Wall Street” guise, I wasn’t going to let it go. It would make a value difference of 1.5% on the total outcome. Not much, you might think, but I had already nearly fallen out with the solicitors over their fees and I was giving my advisors an extremely hard time because the corporate adviser couldn’t see how I had already given more than an inch and the buyers were taking more than a mile. I was not going to let them win.
Tags: iss134 | azule | finance | Peter Savage 2
Contributing Author Peter Savage 2 Click to read or download PDF
Accelerated Workflows with eGPU
Mike Griggs From the UK’s National Trust to magazine publishers to manufacturers, digital content creator Mike Griggs has a wide and varied portfolio of clients for whom he creates 3D art, motion graphics and multimedia exhibits. A typical day might involve sampling birdsong near Virginia Woolf’s country estate or creating 3D animations for VR. To keep on top of these demands, Griggs wanted to take the full power of the GPU computing revolution on the road.
Tags: iss134 | sonnet | egpu | amd | post production | editing | Mike Griggs
Contributing Author Mike Griggs Click to read or download PDF
University and Mental Health
Rhiannon Jenkins University study and mental health has been in the media quite a bit over the last year, and I’m sure there are many people wondering what is going on? The issues are complex, and I suppose the focus of employability off the back of a degree course has raised the stress stakes for a lot of young people. I’m only qualified to talk about this from my perspective, and my story began when I joined a course not knowing I had a mental health condition.
Tags: iss134 | portsmouth uni | mental health | student | tvfutures | Rhiannon Jenkins
Contributing Author Rhiannon Jenkins Click to read or download PDF
Protecting the continuity of transmission
Lorna Garrett Your viewers love you. You consistently bring them their preferred channels 24/7. They’ve come to rely on you for their viewing pleasure. They never miss cheering on their beloved sports teams. They’re the envy of their friends as they watch live concerts of their favourite bands. They gather the family around and catch up on their must-see shows. They don’t have a bad word to say about you.
Tags: iss134 | garland | gpl | streaming | artel | disaster recovery | Lorna Garrett
Contributing Author Lorna Garrett Click to read or download PDF