Powerful New Levels of Discovery


Drew Lanham TV-Bay Magazine
Read ezine online
by Drew Lanham
Issue 90 - June 2014

For media creators, owners, and distributors, the amount of digital media in their libraries never stops growing as they continue to add new content every day. Those who dont organize and manage their data well are not getting the maximum value out of their archive. Thats why they need easy, accurate, and cost-effective tools to discover, repurpose, and monetize their media.

MAM or product asset management systems hold a lot of file-based metadata with attributes such as the date the footage was shot, but theres usually very little descriptive metadata about the content, making it difficult to find an asset quickly and accurately. To make matters worse, manual logging and transcription are not only time-consuming but prohibitively expensive, and yield limited detail. Transcripts are yet another asset to manage and is not directly tied to assets. There are software applications available that can semi-automatically tag assets, but they can be expensive and also might not provide enough detail to be useful. Image recognition might reveal whos in the media, but not what theyre talking about. Speech-to-text has insufficient performance and accuracy to be useful even on the clearest speech.
Fortunately theres a better way to do it automated phonetic-based dialogue search. Dialogue is the most abundant source of metadata in media. It is present in almost all program types and often provides more detailed, precise content description than any other metadata. As a result, phonetic-based dialogue search provides the richest, most relevant results at a fraction of the cost and time it takes for the other methods can in providing the same amount of metadata granularity. Its akin to Google for audio, where users enter keywords and phrases that locate the specific moments in the media, allowing them to take further action.

How It Works

In the phonetic-based search method, an application scans all of the audio in a media library and creates an index of sounds called phonemes, hundreds of times faster than real time. Once the assets are indexed, they are instantly searchable based not on the file properties or the information that has been typed into the metadata fields, but on what is actually spoken on the audio tracks. That means that traditional metadata descriptive or otherwise is optional once the index is created. (Even so, the system can still leverage any existing metadata, in combination with the dialogue, to further refine and improve the search.) As a result, the phonetic-based search method dramatically reduces logging and transcription costs, speeds production, and uncovers valuable assets that traditional metadata could never expose within hours of being added to the management system.

Phonetic search solutions integrate directly with MAMs, file systems, and editing applications, and no training is required. Users simply type any combination of words or phrases into the search interface, and it will quickly find any media clip in the system where those words or phrases are spoken. Users can then go to an integrated media player to audition the hits within each clip, quickly without having to scroll through numerous clips to find a specific asset. When the correct results are found, they are exported as timecoded markers to MAMs and video-editing applications.

Users can also deploy phonetic search technology to search from within their own production toolset via APIs. For example, Adobe Premiere Pro users can leverage the benefits of phonetic-based search functionality directly from Premiere Pros interface without having to leave the Premiere Pro application. By simply adding an extension to their workspaces, users can search and preview search results in a video player and then just drag and drop a clip into their project with the search terms and search terms automatically displayed as markers in their clips on their timelines.

Intended Applications

Versatile, affordable, accurate, and lightning-fast, phonetic-based search tools can change the way media operations discover and use their assets. They can be applied broadly to any market that creates, owns, or distributes content, including film and entertainment, sports, news, education, corporate, government, financial, house of worship, and nonprofit. As media-driven organizations build up ever larger stores of video content, or mine their archives, the need to locate specific pieces quickly and efficiently will play a huge role in an organizations competitive advantage and bottom line. After all, if you cant find it, then you cant monetize it. Creating a searchable index that does not rely on traditional logging or transcription metadata such as the one that results from phonetic-based searching can be the key to unlocking a media archives potential.


Tags: iss090 | Nexidia | organization | archives | Drew Lanham
Contributing Author Drew Lanham

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • Nexidias Drew Lanham on BroadcastShow LIVE at IBC 2013

    Nexidias Drew Lanham on BroadcastShow LIVE at IBC 2013

  • Nexidia QC on BroadcastShow LIVE at IBC 2013

    Nexidia QC on BroadcastShow LIVE at IBC 2013


Related Shows
  • Day 3 of BroadcastShow at IBC

    Day 3 of BroadcastShow at IBC


Articles
News Out Of The Cloud - Technology At The Front Line Of Journalism
Stuart Almond Throughout history, journalists have always had to seek and adapt to new technologies to deliver news in a format and at a speed that consumers demanded. Today, recent technological changes in the media environment have led to another inflection point. If modern media outlets want to empower journalists to remain agile and turn news stories around quickly and efficiently, they have to start embracing new, innovative technologies, like cloud-based media solutions.
Tags: iss138 | sony | ofcom | cloud-based media | intelligent | Stuart Almond
Contributing Author Stuart Almond Click to read or download PDF
TVFutures. No More Comfort Zone - Get a Placement
Michelle Brown I have often heard that any chance of getting work in the television industry is based quite heavily on who you know, and whilst that might indeed be true, I’ve also come to the realisation that it may also depends on what opportunities you seize and how far out of your comfort zone you might be prepared to push yourself.
Tags: iss138 | portsmouth uni | creative careers | placement | Michelle Brown
Contributing Author Michelle Brown Click to read or download PDF
Making a Difference in Wireless Transmission
Lukasz Malankowski

We are very proud to say that we are the only company that provides a highly specific service, and that is the hire of wireless video transmission solutions operating in the licence exempt spectrum.

There are other companies that provide licensed equipment and offer a diverse range of wireless solutions based on different modulations, but our products, coupled with the offerings of others rather than competing with them produce a wireless workflow that is greater than their separate capabilities.

Tags: iss138 | boxx | production | wireless | 4k | Lukasz Malankowski
Contributing Author Lukasz Malankowski Click to read or download PDF
How LiveU Has Changed The Way We Work At ITV Daytime
Tim Guilder As my job title suggests, I’m responsible for planning and executing technology projects across ITV’s Daytime, including outside broadcasts, which are central to what we do. We broadcast live for more than six hours every weekday with four shows: Good Morning Britain, This Morning, Lorraine and Loose Women. With a history as one of the main UK terrestrial broadcasters – of course, we have also evolved alongside the industry in terms of viewing options – we have high standards. We constantly generate new ideas to keep audiences engaged and we also need to be responsive to the latest breaking news.
Tags: iss138 | liveu | itv | daytime | cobham | explorer 8100 | satellite | lu600 hevc | ka-band | lu300 | garland | Tim Guilder
Contributing Author Tim Guilder Click to read or download PDF
State of the Nation: Wings, Fine Coffee and Fake Nudes
Dick Hobbs - new One of the many attractions of this time of year is that I get to meet with my fellow judges for the IBC Innovation Awards, and see what the industry sees as the most important, most forward-looking projects of the day. For me, this says what the key talking points are going to be in September, far more eloquently than the endless press releases from vendors which are already tumbling into my inbox.
Tags: iss138 | ibc | smpte 2110 | deepnude | cisco | Dick Hobbs - new
Contributing Author Dick Hobbs - new Click to read or download PDF