Redefining the archive with Raj Patel


Raj Patel TV-Bay Magazine
Read ezine online
by Raj Patel
Issue 80 - August 2013
The entire broadcast workflow has changed dramatically in recent years. Predictably, its been a slow-process. The enormity of transitioning from an analogue to a digital workflow is huge for a variety of reasons - planning, testing, implementation and budget, can mean some installations taking up to two years to complete. There are instances where a new digital infrastructure is in place but the facility continues to use tried and tested analogue workflows, somehow unaware of the potential thats now available to them. Almost as if there is a fear of embracing change or lack of understanding as to how they can fully utilise the system to create new workflows.

However, as broadcasters and content facilities make this transition, opportunities do arise for new ways of working, ways that take time to evolve. One of the biggest evolutions happening at the moment in the industry is in the role of the archive. For many years a last thought for broadcasters, the archive is often envisaged as the dusty, musty element at the end of the broadcast chain where material ends up once all the bells and whistles have been added and its been aired. Archived material sits there quietly in the background until someone needs to use it again after which its put back on the shelf. Until recently, like many other elements of the broadcast chain the archive was a fairly closed system: data was written to the media archive in a proprietary format, which meant there was no interoperability between systems from different vendors. Additionally, archive libraries could generally only be controlled by archive management systems.
Not any more. With the successful take-up of LTFS, broadcasters and content owners have true interoperability between what were once disparate systems. Now material can be acquired directly to disk and then dragged and dropped to data tape and transported back to the facility. This removes the need to re-ingest content to the archive and also enables large amounts of data to be transported and archived on a single LTO tape. This type of workflow is just as valid on location as it is in a production facility. To banish the end of the line archive message, once the tape has been loaded into the archive, duplicate copies can be made automatically to back-up the valuable material. The archive system can also automatically copy the content to a disk portion of the archive so that craft editors can start working with the material as swiftly as possible.

This places the archive much further forward in the production process alongside the ingest element of the chain. Instead of ingesting in the traditional sense, the material can now be moved directly into the LTFS archive. We can see how the archive begins to shake off the dusty tag, to create a more cool way of working.

So how did we get to this point? How did the archive leap from the back to the front of the broadcast chain and how does the MAM system know whats been ingested into the archive?
LTO has grown to become one of, if not the de-facto tape format installed in tape libraries by broadcast-centric organisations implementing tape (and disk)-based archives. What has to be kept in mind is that LTFS is not a file format or even a wrapper. Its a way of writing data to standard, off-the-shelf IT storage media. It presents an open standard for broadcasters to provide real interoperability between systems. Any tape written according to the LTFS specification can be read by any other system using the same specification.

As for the MAM system knowing whats arrived, intelligent archives can quickly read the index information from an LTFS-formatted tape (that may, for example, have been used on location to capture material directly from HD camera or intermediate disks) and directly assign UIDs to the content, populate the archive database and generate a low-resolution proxy (used for editing). Using a simple subscription setup, a Notification Service then announces the arrival of the new material to the controlling MAM system and pushes relevant data to the MAM describing the archived material based on rules selected by the broadcaster.

With all this in mind perhaps an archive really is no longer just an archive but what name should we give it? Answers on a tweet please @SGLFlashNet.


Tags: iss080 | sgl | product manager | redefining the archive | archive system | files | protection | data | workflow | Raj Patel
Contributing Author Raj Patel

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • SGL at NAB 2012

    SGL at NAB 2012

  • SGL Broadcast at IBC 2015

    SGL Broadcast at IBC 2015

  • SGL at NAB 2015

    SGL at NAB 2015

  • SGL at NAB 2014

    SGL at NAB 2014

  • SGL at NAB 2013

    SGL at NAB 2013

  • Object Based Storage Solutions from Object Matrix at NAB 2017

    Object Based Storage Solutions from Object Matrix at NAB 2017

  • TMD talk workflow on BroadcastShow LIVE at IBC 2013

    TMD talk workflow on BroadcastShow LIVE at IBC 2013

  • Viaccess-Orca at IBC 2016

    Viaccess-Orca at IBC 2016

  • Sennheiser HDM Pro at BVE 2014

    Sennheiser HDM Pro at BVE 2014

  • Petrol at NAB 2012

    Petrol at NAB 2012

  • Petrol at IBC2011

    Petrol at IBC2011

  • Atomos with the Datacolor Spyder on BroadcastShow LIVE at IBC 2013

    Atomos with the Datacolor Spyder on BroadcastShow LIVE at IBC 2013

  • Datacolor Spyder on the Atomos stand at IBC 2013

    Datacolor Spyder on the Atomos stand at IBC 2013

  • Datavideo on the Holdan stand at BVE 2013

    Datavideo on the Holdan stand at BVE 2013

  • Datavision at BVE 2012

    Datavision at BVE 2012

  • Datavideo at IBC2011

    Datavideo at IBC2011

  • Telestream Vantage support for DPP at IBC 2014

    Telestream Vantage support for DPP at IBC 2014

  • Prime Focus Technologies at IBC 2016

    Prime Focus Technologies at IBC 2016

  • EBS at IBC 2015

    EBS at IBC 2015

  • EBS at IBC 2014

    EBS at IBC 2014

  • Clear-Com ProGrid at NAB 2014

    Clear-Com ProGrid at NAB 2014

  • Clear-Com HelixNet Partyline at NAB 2014

    Clear-Com HelixNet Partyline at NAB 2014

  • Atomos with the Samurai Blade on BroadcastShow LIVE at IBC 2013

    Atomos with the Samurai Blade on BroadcastShow LIVE at IBC 2013

  • Primestream on BroadcastShow LIVE at IBC 2013

    Primestream on BroadcastShow LIVE at IBC 2013

  • Object Matrix at BVE 2013

    Object Matrix at BVE 2013

  • Root6 at BVE 2012

    Root6 at BVE 2012

  • MOG Technologies at BVE 2012

    MOG Technologies at BVE 2012

  • Holdan and Teradek at BVE North 2011

    Holdan and Teradek at BVE North 2011

  • Cooke at IBC2011

    Cooke at IBC2011

  • Sensio at IBC2011

    Sensio at IBC2011

  • Radiant Grid at IBC2011

    Radiant Grid at IBC2011

  • ChyronHego show their PRIME Workflow at IBC 2018

    ChyronHego show their PRIME Workflow at IBC 2018

  • All IP Workflow from Quantum with Xcellis Workflow Storage solutions at NAB 2018

    All IP Workflow from Quantum with Xcellis Workflow Storage solutions at NAB 2018

  • Object Matrix Hybrid Workflow and Artifical Intelligence at NAB 2018

    Object Matrix Hybrid Workflow and Artifical Intelligence at NAB 2018

  • Workflow Solutions from Pronology at NAB 2017

    Workflow Solutions from Pronology at NAB 2017

  • Snell Advanced Media (SAM) 4k workflow at IBC 2015

    Snell Advanced Media (SAM) 4k workflow at IBC 2015

  • LIVEU Workflow solutions at NAB 2015

    LIVEU Workflow solutions at NAB 2015

  • Quantels Stream-based Workflows at IBC 2013

    Quantels Stream-based Workflows at IBC 2013

  • Streaming Media with Interra Systems at NAB 2017

    Streaming Media with Interra Systems at NAB 2017

  • New CEO and news update from TMD at NAB 2017

    New CEO and news update from TMD at NAB 2017

  • Tiger Technology at BVE 2015

    Tiger Technology at BVE 2015

  • ERA - Adobe Anywhere - at BVE 2015

    ERA - Adobe Anywhere - at BVE 2015

  • NETIA at BVE 2015

    NETIA at BVE 2015

  • Dalet at IBC 2014

    Dalet at IBC 2014

  • Pronology at IBC 2014

    Pronology at IBC 2014

  • Quantel LiveTouch at IBC 2014

    Quantel LiveTouch at IBC 2014

  • Quantel deal with AFP at IBC 2014

    Quantel deal with AFP at IBC 2014

  • Snell Kahuna Production Switcher at IBC 2014

    Snell Kahuna Production Switcher at IBC 2014

  • Telestream Wirecast and Switch at IBC 2014

    Telestream Wirecast and Switch at IBC 2014

  • Broadstream Solutions at NAB 2014

    Broadstream Solutions at NAB 2014

  • Telestream Enterprise at NAB 2014

    Telestream Enterprise at NAB 2014

  • Telestream Switch at NAB 2014

    Telestream Switch at NAB 2014

  • Dalet at NAB 2014

    Dalet at NAB 2014

  • ERA at BVE 2014

    ERA at BVE 2014

  • ERA Avere at BVE 2014

    ERA Avere at BVE 2014

  • Pixel Power on BroadcastShow LIVE at IBC 2013

    Pixel Power on BroadcastShow LIVE at IBC 2013

  • Atomos talking 4K on BroadcastShow LIVE at IBC 2013

    Atomos talking 4K on BroadcastShow LIVE at IBC 2013

  • Metus on BroadcastShow LIVE at IBC 2013

    Metus on BroadcastShow LIVE at IBC 2013

  • Volicon on BroadcastShow LIVE at IBC 2013

    Volicon on BroadcastShow LIVE at IBC 2013

  • Broadstream Solutions on the Oasys stand at IBC 2013

    Broadstream Solutions on the Oasys stand at IBC 2013

  • Oasys Chameleon at IBC 2013

    Oasys Chameleon at IBC 2013

  • Loft London Solutions with Cubix on the Oasys stand at IBC 2013

    Loft London Solutions with Cubix on the Oasys stand at IBC 2013

  • Tony Taylor from TMD talks about LTFS at IBC 2013

    Tony Taylor from TMD talks about LTFS at IBC 2013

  • Tony Taylor from TMD talks about Mediaflex CI

    Tony Taylor from TMD talks about Mediaflex CI

  • Tony Taylor from TMD talks about Post Production

    Tony Taylor from TMD talks about Post Production

  • Facilis at IBC 2013

    Facilis at IBC 2013

  • Telestream with Wirecast version five at IBC 2013

    Telestream with Wirecast version five at IBC 2013

  • Telestream with Post Producer at IBC 2013

    Telestream with Post Producer at IBC 2013

  • Yospace: Advert Insertion at NAB 2013

    Yospace: Advert Insertion at NAB 2013

  • Vimond Control Center at NAB 2013

    Vimond Control Center at NAB 2013

  • Telestream Vantage v5 at NAB 2013

    Telestream Vantage v5 at NAB 2013

  • TMD at NAB 2013: MediaFlex Reporting Module

    TMD at NAB 2013: MediaFlex Reporting Module

  • TMD at NAB 2013: MediaFlex Systems

    TMD at NAB 2013: MediaFlex Systems

  • TMD at NAB 2013: Content Intelligence

    TMD at NAB 2013: Content Intelligence

  • Telestream at BVE 2013

    Telestream at BVE 2013

  • Guntermann and Drunck GmbH at BVE 2013

    Guntermann and Drunck GmbH at BVE 2013

  • Tedial at NAB 2012

    Tedial at NAB 2012

  • Marquis Broadcast at NAB 2012

    Marquis Broadcast at NAB 2012

  • Root6 at NAB 2012

    Root6 at NAB 2012

  • Editshare at NAB 2012

    Editshare at NAB 2012

  • TMD at NAB 2012

    TMD at NAB 2012

  • PlayBox Technology at BVE 2012

    PlayBox Technology at BVE 2012

  • Suitcase TV at IBC2011

    Suitcase TV at IBC2011

  • Net Insight at IBC2011

    Net Insight at IBC2011

  • Tedial at IBC2011

    Tedial at IBC2011

  • IPV at IBC2011

    IPV at IBC2011

  • TSL at IBC2011

    TSL at IBC2011


Related Shows
  • Bubble and Squeak: Live and Loud from Monday at IBC 2013

    Bubble and Squeak: Live and Loud from Monday at IBC 2013


Articles
Grading BBC Sounds
Simone Grattarola

The BBC has launched its new personalised music, radio and podcast app with a campaign that follows one listener’s journey from meeting Kylie Minogue in a lift to Idris Elba on a bus. 

BBC Sounds offers a single home for the BBC’s thousands of hours of audio content, including live and on-demand shows and special music mixes curated by artists.

BBC Creative, the broadcaster’s in-house creative division, took the brief to agency Riff Raff Films and Megaforce directing duo of Charles Brisgand and Raphaël Rodriguez who in turn brought on board regular collaborators Time Based Arts.

Tags: iss135 | bbc | grading | bbc sounds | davinici | resolve | blackmagic | editing | Simone Grattarola
Contributing Author Simone Grattarola Click to read or download PDF
Switching to Internet Based Distribution
Chris Clark

"An IP status check for the broadcast industry", "Resistance is futile", "IP points the way forward for the broadcast industry"...

Yes, we've read the headlines too. But rather than force you into submission, scare you, or leave you feeling like you have no other choice, we want to give you the information that helps you to make a sensible decision about Internet-based distribution.

So what’s stopping you from making the switch right now?

Tags: iss135 | ip | internet | distribution | cerberus | Chris Clark
Contributing Author Chris Clark Click to read or download PDF
Test, Measurement and Standards
Alan Wheable The Alliance for IP Media Solutions (AIMS), is a non-profit trade alliance that fosters the adoption of one set of common, ubiquitous, standards-based protocols for interoperability over IP in the media and entertainment, and professional audio/video industries.
Tags: iss135 | omnitek | aims | SNMP | hdr | ai | Alan Wheable
Contributing Author Alan Wheable Click to read or download PDF
21st Century Technology for 20th Century Content
James Hall A big challenge facing owners of legacy content is rationalising and archiving their tape and film-based media in cost effective and efficient ways, whilst also adding value. Normally the result of this is to find a low cost means of digitising the content – usually leaving them with a bunch of assets on HDD. But then what? How can content owners have their cake and eat it?
Tags: iss135 | legacy | digitising | digitizing | archive | James Hall
Contributing Author James Hall Click to read or download PDF
Future proofing post production storage
Josh Goldenhar Advancements in NVMe (Non-Volatile Memory Express), the storage protocol designed for flash, are revolutionising data storage. According to G2M Research, the NVMe market will grow to $60 billion by 2021, with 70 percent of all-flash arrays being based on the protocol by 2020. NVMe, acting like steroids for flash-based storage infrastructures, dynamically and dramatically accelerates data delivery.
Tags: iss135 | nvme | sas | sata | it | storage | post production | Josh Goldenhar
Contributing Author Josh Goldenhar Click to read or download PDF