Redefining the archive with Raj Patel


Raj Patel TV-Bay Magazine
Read ezine online
by Raj Patel
Issue 80 - August 2013
The entire broadcast workflow has changed dramatically in recent years. Predictably, its been a slow-process. The enormity of transitioning from an analogue to a digital workflow is huge for a variety of reasons - planning, testing, implementation and budget, can mean some installations taking up to two years to complete. There are instances where a new digital infrastructure is in place but the facility continues to use tried and tested analogue workflows, somehow unaware of the potential thats now available to them. Almost as if there is a fear of embracing change or lack of understanding as to how they can fully utilise the system to create new workflows.

However, as broadcasters and content facilities make this transition, opportunities do arise for new ways of working, ways that take time to evolve. One of the biggest evolutions happening at the moment in the industry is in the role of the archive. For many years a last thought for broadcasters, the archive is often envisaged as the dusty, musty element at the end of the broadcast chain where material ends up once all the bells and whistles have been added and its been aired. Archived material sits there quietly in the background until someone needs to use it again after which its put back on the shelf. Until recently, like many other elements of the broadcast chain the archive was a fairly closed system: data was written to the media archive in a proprietary format, which meant there was no interoperability between systems from different vendors. Additionally, archive libraries could generally only be controlled by archive management systems.
Not any more. With the successful take-up of LTFS, broadcasters and content owners have true interoperability between what were once disparate systems. Now material can be acquired directly to disk and then dragged and dropped to data tape and transported back to the facility. This removes the need to re-ingest content to the archive and also enables large amounts of data to be transported and archived on a single LTO tape. This type of workflow is just as valid on location as it is in a production facility. To banish the end of the line archive message, once the tape has been loaded into the archive, duplicate copies can be made automatically to back-up the valuable material. The archive system can also automatically copy the content to a disk portion of the archive so that craft editors can start working with the material as swiftly as possible.

This places the archive much further forward in the production process alongside the ingest element of the chain. Instead of ingesting in the traditional sense, the material can now be moved directly into the LTFS archive. We can see how the archive begins to shake off the dusty tag, to create a more cool way of working.

So how did we get to this point? How did the archive leap from the back to the front of the broadcast chain and how does the MAM system know whats been ingested into the archive?
LTO has grown to become one of, if not the de-facto tape format installed in tape libraries by broadcast-centric organisations implementing tape (and disk)-based archives. What has to be kept in mind is that LTFS is not a file format or even a wrapper. Its a way of writing data to standard, off-the-shelf IT storage media. It presents an open standard for broadcasters to provide real interoperability between systems. Any tape written according to the LTFS specification can be read by any other system using the same specification.

As for the MAM system knowing whats arrived, intelligent archives can quickly read the index information from an LTFS-formatted tape (that may, for example, have been used on location to capture material directly from HD camera or intermediate disks) and directly assign UIDs to the content, populate the archive database and generate a low-resolution proxy (used for editing). Using a simple subscription setup, a Notification Service then announces the arrival of the new material to the controlling MAM system and pushes relevant data to the MAM describing the archived material based on rules selected by the broadcaster.

With all this in mind perhaps an archive really is no longer just an archive but what name should we give it? Answers on a tweet please @SGLFlashNet.


Tags: iss080 | sgl | product manager | redefining the archive | archive system | files | protection | data | workflow | Raj Patel
Contributing Author Raj Patel

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • SGL at NAB 2012

    SGL at NAB 2012

  • SGL Broadcast at IBC 2015

    SGL Broadcast at IBC 2015

  • SGL at NAB 2015

    SGL at NAB 2015

  • SGL at NAB 2014

    SGL at NAB 2014

  • SGL at NAB 2013

    SGL at NAB 2013

  • Object Based Storage Solutions from Object Matrix at NAB 2017

    Object Based Storage Solutions from Object Matrix at NAB 2017

  • TMD talk workflow on BroadcastShow LIVE at IBC 2013

    TMD talk workflow on BroadcastShow LIVE at IBC 2013

  • Viaccess-Orca at IBC 2016

    Viaccess-Orca at IBC 2016

  • Sennheiser HDM Pro at BVE 2014

    Sennheiser HDM Pro at BVE 2014

  • Petrol at NAB 2012

    Petrol at NAB 2012

  • Petrol at IBC2011

    Petrol at IBC2011

  • Atomos with the Datacolor Spyder on BroadcastShow LIVE at IBC 2013

    Atomos with the Datacolor Spyder on BroadcastShow LIVE at IBC 2013

  • Datacolor Spyder on the Atomos stand at IBC 2013

    Datacolor Spyder on the Atomos stand at IBC 2013

  • Datavideo on the Holdan stand at BVE 2013

    Datavideo on the Holdan stand at BVE 2013

  • Datavision at BVE 2012

    Datavision at BVE 2012

  • Datavideo at IBC2011

    Datavideo at IBC2011

  • Telestream Vantage support for DPP at IBC 2014

    Telestream Vantage support for DPP at IBC 2014

  • Prime Focus Technologies at IBC 2016

    Prime Focus Technologies at IBC 2016

  • EBS at IBC 2015

    EBS at IBC 2015

  • EBS at IBC 2014

    EBS at IBC 2014

  • Clear-Com ProGrid at NAB 2014

    Clear-Com ProGrid at NAB 2014

  • Clear-Com HelixNet Partyline at NAB 2014

    Clear-Com HelixNet Partyline at NAB 2014

  • Atomos with the Samurai Blade on BroadcastShow LIVE at IBC 2013

    Atomos with the Samurai Blade on BroadcastShow LIVE at IBC 2013

  • Primestream on BroadcastShow LIVE at IBC 2013

    Primestream on BroadcastShow LIVE at IBC 2013

  • Object Matrix at BVE 2013

    Object Matrix at BVE 2013

  • Root6 at BVE 2012

    Root6 at BVE 2012

  • MOG Technologies at BVE 2012

    MOG Technologies at BVE 2012

  • Holdan and Teradek at BVE North 2011

    Holdan and Teradek at BVE North 2011

  • Cooke at IBC2011

    Cooke at IBC2011

  • Sensio at IBC2011

    Sensio at IBC2011

  • Radiant Grid at IBC2011

    Radiant Grid at IBC2011

  • ChyronHego show their PRIME Workflow at IBC 2018

    ChyronHego show their PRIME Workflow at IBC 2018

  • All IP Workflow from Quantum with Xcellis Workflow Storage solutions at NAB 2018

    All IP Workflow from Quantum with Xcellis Workflow Storage solutions at NAB 2018

  • Object Matrix Hybrid Workflow and Artifical Intelligence at NAB 2018

    Object Matrix Hybrid Workflow and Artifical Intelligence at NAB 2018

  • Workflow Solutions from Pronology at NAB 2017

    Workflow Solutions from Pronology at NAB 2017

  • Snell Advanced Media (SAM) 4k workflow at IBC 2015

    Snell Advanced Media (SAM) 4k workflow at IBC 2015

  • LIVEU Workflow solutions at NAB 2015

    LIVEU Workflow solutions at NAB 2015

  • Quantels Stream-based Workflows at IBC 2013

    Quantels Stream-based Workflows at IBC 2013

  • Streaming Media with Interra Systems at NAB 2017

    Streaming Media with Interra Systems at NAB 2017

  • New CEO and news update from TMD at NAB 2017

    New CEO and news update from TMD at NAB 2017

  • Tiger Technology at BVE 2015

    Tiger Technology at BVE 2015

  • ERA - Adobe Anywhere - at BVE 2015

    ERA - Adobe Anywhere - at BVE 2015

  • NETIA at BVE 2015

    NETIA at BVE 2015

  • Dalet at IBC 2014

    Dalet at IBC 2014

  • Pronology at IBC 2014

    Pronology at IBC 2014

  • Quantel LiveTouch at IBC 2014

    Quantel LiveTouch at IBC 2014

  • Quantel deal with AFP at IBC 2014

    Quantel deal with AFP at IBC 2014

  • Snell Kahuna Production Switcher at IBC 2014

    Snell Kahuna Production Switcher at IBC 2014

  • Telestream Wirecast and Switch at IBC 2014

    Telestream Wirecast and Switch at IBC 2014

  • Broadstream Solutions at NAB 2014

    Broadstream Solutions at NAB 2014

  • Telestream Enterprise at NAB 2014

    Telestream Enterprise at NAB 2014

  • Telestream Switch at NAB 2014

    Telestream Switch at NAB 2014

  • Dalet at NAB 2014

    Dalet at NAB 2014

  • ERA at BVE 2014

    ERA at BVE 2014

  • ERA Avere at BVE 2014

    ERA Avere at BVE 2014

  • Pixel Power on BroadcastShow LIVE at IBC 2013

    Pixel Power on BroadcastShow LIVE at IBC 2013

  • Atomos talking 4K on BroadcastShow LIVE at IBC 2013

    Atomos talking 4K on BroadcastShow LIVE at IBC 2013

  • Metus on BroadcastShow LIVE at IBC 2013

    Metus on BroadcastShow LIVE at IBC 2013

  • Volicon on BroadcastShow LIVE at IBC 2013

    Volicon on BroadcastShow LIVE at IBC 2013

  • Broadstream Solutions on the Oasys stand at IBC 2013

    Broadstream Solutions on the Oasys stand at IBC 2013

  • Oasys Chameleon at IBC 2013

    Oasys Chameleon at IBC 2013

  • Loft London Solutions with Cubix on the Oasys stand at IBC 2013

    Loft London Solutions with Cubix on the Oasys stand at IBC 2013

  • Tony Taylor from TMD talks about LTFS at IBC 2013

    Tony Taylor from TMD talks about LTFS at IBC 2013

  • Tony Taylor from TMD talks about Mediaflex CI

    Tony Taylor from TMD talks about Mediaflex CI

  • Tony Taylor from TMD talks about Post Production

    Tony Taylor from TMD talks about Post Production

  • Facilis at IBC 2013

    Facilis at IBC 2013

  • Telestream with Wirecast version five at IBC 2013

    Telestream with Wirecast version five at IBC 2013

  • Telestream with Post Producer at IBC 2013

    Telestream with Post Producer at IBC 2013

  • Yospace: Advert Insertion at NAB 2013

    Yospace: Advert Insertion at NAB 2013

  • Vimond Control Center at NAB 2013

    Vimond Control Center at NAB 2013

  • Telestream Vantage v5 at NAB 2013

    Telestream Vantage v5 at NAB 2013

  • TMD at NAB 2013: MediaFlex Reporting Module

    TMD at NAB 2013: MediaFlex Reporting Module

  • TMD at NAB 2013: MediaFlex Systems

    TMD at NAB 2013: MediaFlex Systems

  • TMD at NAB 2013: Content Intelligence

    TMD at NAB 2013: Content Intelligence

  • Telestream at BVE 2013

    Telestream at BVE 2013

  • Guntermann and Drunck GmbH at BVE 2013

    Guntermann and Drunck GmbH at BVE 2013

  • Tedial at NAB 2012

    Tedial at NAB 2012

  • Marquis Broadcast at NAB 2012

    Marquis Broadcast at NAB 2012

  • Root6 at NAB 2012

    Root6 at NAB 2012

  • Editshare at NAB 2012

    Editshare at NAB 2012

  • TMD at NAB 2012

    TMD at NAB 2012

  • PlayBox Technology at BVE 2012

    PlayBox Technology at BVE 2012

  • Suitcase TV at IBC2011

    Suitcase TV at IBC2011

  • Net Insight at IBC2011

    Net Insight at IBC2011

  • Tedial at IBC2011

    Tedial at IBC2011

  • IPV at IBC2011

    IPV at IBC2011

  • TSL at IBC2011

    TSL at IBC2011


Related Shows
  • Bubble and Squeak: Live and Loud from Monday at IBC 2013

    Bubble and Squeak: Live and Loud from Monday at IBC 2013


Articles
Review: JVC GY-HC900 Camera
Andy McKenzie JVC has a long history of developing relatively low price-point equipment, dating right back to its success in the 1970s with the VHS tape format. JVC products sometimes impact the broadcast mainstream but generally find greatest success in niche market segments such as news production where price and portability take priority over the no-comprise quality and robustness demanded by the leading studio-based and OB content producers.
Tags: iss138 | jvc review | camera | sdhc | sdxc | mpeg-2 | nab | gy-hc900 | Andy McKenzie
Contributing Author Andy McKenzie Click to read or download PDF
How the Womens World Cup was Boosted by Broadcast
John Griffiths As we write this article, England’s Lionesses have just beaten Norway 3-0 and are smashing viewing figure records, with 6.9 million viewers tuning in to watch them play Cameroon on BBC One. Rewind to the previous World Cup in 2015, and England’s group and early stage knockout games tempted up to 2.5 million viewers for each match. It’s safe to say that women’s football is finally having its moment; what was perhaps once considered a niche sport is finally gaining momentum in the mainstream space with broadcasters giving it the attention it deserves.
Tags: iss138 | wwc | world cup | spicymango | diversity | John Griffiths
Contributing Author John Griffiths Click to read or download PDF
Making the Workflow Flow
Bruce Devlin - new The toughest things about being the Standards Vice President (SVP) is that everyone expects standards to be the most important thing. In all the systems that I’ve designed and deployed over the years, I've yet to find any production workflow that is 100% standards based. True, the core technologies may well be standards based, but the overall workflow is made up of many technology pieces from open source code, through de-facto delivery specifications based upon SMPTE or Trade Association Specifications that in turn depend on full, International Standards to work. I can already hear some folks saying "In the good old days, everything used standards", but I beg to disagree.
Tags: iss138 | pye museum | pye-philips | smpte | ietf | ieee | w3c | aes | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read or download PDF
TVFutures. No More Comfort Zone - Get a Placement
Michelle Brown I have often heard that any chance of getting work in the television industry is based quite heavily on who you know, and whilst that might indeed be true, I’ve also come to the realisation that it may also depends on what opportunities you seize and how far out of your comfort zone you might be prepared to push yourself.
Tags: iss138 | portsmouth uni | creative careers | placement | Michelle Brown
Contributing Author Michelle Brown Click to read or download PDF
State of the Nation: Wings, Fine Coffee and Fake Nudes
Dick Hobbs - new One of the many attractions of this time of year is that I get to meet with my fellow judges for the IBC Innovation Awards, and see what the industry sees as the most important, most forward-looking projects of the day. For me, this says what the key talking points are going to be in September, far more eloquently than the endless press releases from vendors which are already tumbling into my inbox.
Tags: iss138 | ibc | smpte 2110 | deepnude | cisco | Dick Hobbs - new
Contributing Author Dick Hobbs - new Click to read or download PDF