Virtual sets come of age


Virtual studios (VS) have experienced a roller coaster ride of popularity through their short life. Initially they were hailed as the future for live broadcasting, seamlessly combining people and computer-generated environments without the need for post-production. But the racks of SGI computers, complex studio set-ups, complex camera tracking systems and 3D computer graphics ‘virtual set’ software that even highly skilled geeks took a while to set up, as well as the need for virtual studio experts, all made the systems too expensive to buy and run for wide deployment by broadcasters. But the idea was a good one, and today, after a lot of work on all aspects of VS technology, there are virtual set systems that can offer solutions to suit applications and budgets ranging from those of big broadcasters through to much smaller outfits such as those in the corporate and educational areas. Now the required technologies are more highly developed so, for example, computers can provide the necessary 3D image sources at a more reasonable price – thanks to the huge advances in both graphics cards and software. These help but are only a part of the solution that has made virtual studios more widely available and useable.
Despite the 3D graphics computer workstation developments, they do still add a significant part of the cost of the complete VS systems. The VS principal involves manipulating computer-generated 3D images – the virtual bit – so that they perfectly track the movements and changes of the studio cameras. Typically in a news bulletin, the cameras are focussed on the newsreader placed in front of a blue screen; the studio vision mixer then keys the reader over the CG background. But, of course the idea is to be able to move the camera and have the background move appropriately at the same time – to look as if both were shot live by the same camera.
The CG images are much bigger than the studio camera pictures to allow the pans, tilts and zooms of the camera to be matched by the background CG without exposing their edges. These camera movements are picked up by sensors on the camera and fed to the 3D CG virtual set workstation that then manipulates its output accordingly. Some VS set-ups also allow for cameras to travel around the studio, involving more sensors, cost and complexity. Of course, shooting with just one camera would make for a rather dull presentation so, typically, three are used, with one CG workstation for each, so providing three separate backgrounds and foregrounds to the vision mixer.
FOR-A recognised where the difficulties and cost was adversely affecting the progress of virtual studios and so did something about it. One problem was in camera sensor set-up. This involved experts to calibrate the camera pan, tilt and zoom sensors’ data so that the CG background can be moved in perfect sympathy with the camera, not too much and not too little! The introduction of FOR-A’s ifCALIB interface calibration software now greatly simplifies this task so it can be done quickly and without specialist experts. With this system the camera itself does not travel around the studio, so further simplifying set up and greatly reducing costs.
Despite the advances of technology, another high cost area is still the computers, as one is required per camera. Logically the virtual studio output usually only shows the result of one camera and one computer at a time, so why have more? Of course, cameras cannot instantly change shots, but computers can! So FOR-A introduced its DSC100/200 interface control boxes that switch the cameras’ sensor data feeds, carried over RS422, to a single CG workstation as the studio mixer cuts between cameras. The workstation is able to immediately produce the appropriate background in the right 3D position for that on-air camera. So this further reduces system costs by using only one CG workstation.
FOR-A is well known for its wide range of vision mixers and so can provide for that element of the virtual studio, but it does not have the expertise needed to produce the 3D CG image software. For that it has partnered with Brainstorm Multimedia who provides 3D virtual set applications including Easyset3D. Clearly Brainstorm realised the need for a user-friendly 3D graphics application and Easyset3D provides an extremely simple GUI that pretty much anyone can easily use. It can include a useful starter pack comprising a large number of different objects that are pre-set in a library. As a result you can build a virtual scene by simply selecting and placing the objects on the walls ceiling and floor of your virtual set. Some say they are up and running after two minutes! So this software has earned a reputation as the beginner's choice for 3D virtual software and a part of a virtual set that anyone can easily use. Of course the use of Easyset3D can extend into more complex operations and set-ups and it plays a vital part in extending virtual studio use not just too big broadcasters, but also to smaller stations, schools and corporate set-ups.
One of the many advantages of virtual studios is that they can create a big-set look from a really small studio. Howden in East Yorkshire is the location of the main operations centre of the Press Association. Renowned for many years as a producer of press reports it is vigorously exploring expansion into new media, while still retaining its core text and still picture service at the heart of the business. As a part of this new strategy it has installed a virtual television studio within 6.5 x 6.5m of its offices.
The requirement was to build a very adaptable studio to cater for clients’ needs and to be future-proof. Set building and replacement would have been impossible in the office area available whereas, with a virtual studio, sets could be changed with a few mouse clicks. The FOR-A digiStorm (a combination of FOR-A and Brainstorm) virtual studio system was selected and initially equipped with two remotely controlled cameras steered from the adjacent control room. The set-up included a FOR-A VPS studio vision mixer. It is an integral part of the virtual studio equipment where the live images of the newsreader, reporter, linkman, etc, are keyed in over the virtual set images.
This virtual studio is a part of a larger move where existing PA journalists from around the UK are being trained to become multi-skilled. They are expanding on their traditional text and still picture-based operations to involve using video cameras and other skills and make them video journalists (VJs) who can shoot and edit video news packages, as well as, in some cases, continuing with their traditional ‘text’ operations.
The transformation of virtual studios from the initial designs has involved considerable further development of most of the technologies involved, as well as some new and innovative ideas. A very obvious example of the progress is the 3D graphics ‘virtual set’ workstations that used to occupy a rack now pack into a standard PC tower unit, and cost a fraction of the original price. FOR-A’s approach to virtual studios with pan, tilt and zoom live camera controls provides the freedom to make attractive productions without the extra hassle and expense of tracking moving cameras. FOR-A has also greatly simplified the set-up process with its ifCALIB interface calibration software allowing existing studio engineers to do the job. Similarly, the use of Brainstorm’ Easyset3D to generate the 3D virtual sets means that regular staff can quickly produce results. Overall, FOR-A’s innovative approach to virtual sets has helped to make them both more affordable and easier to use. As a result their appeal is widened to include broadcasters big and small as well as the corporate market.
VPS-715
VPS-715

Tags: virtual sets | 3d graphics | graphics | cg background | for-a | iss022 | N/A
Contributing Author N/A

Read this article in the tv-bay digital magazine
Article Copyright tv-bay limited. All trademarks recognised.
Reproduction of the content strictly prohibited without written consent.

Related Interviews
  • BRAINSTORM VIRTUAL SETS at NAB 2015

    BRAINSTORM VIRTUAL SETS at NAB 2015

  • Brainstorm Multimedia at IBC 2015

    Brainstorm Multimedia at IBC 2015

  • Brainstorm with Aston demonstration at IBC 2013

    Brainstorm with Aston demonstration at IBC 2013

  • Brainstorm at IBC 2013

    Brainstorm at IBC 2013

  • VIZRT at BVE 2012

    VIZRT at BVE 2012

  • ChyronHego update Prime Graphics Platform to 3.5 at IBC 2019

    ChyronHego update Prime Graphics Platform to 3.5 at IBC 2019

  • ChyronHego Prime Broadcast Graphics at NAB 2019

    ChyronHego Prime Broadcast Graphics at NAB 2019

  • Metacast Weather Graphics from ChyronHego at NAB 2017

    Metacast Weather Graphics from ChyronHego at NAB 2017

  • Stardom product range - Polar Graphics at NAB 2016

    Stardom product range - Polar Graphics at NAB 2016

  • Matrox Graphics at IBC 2012 Part Three

    Matrox Graphics at IBC 2012 Part Three

  • Matrox Graphics at IBC 2012 Part Two

    Matrox Graphics at IBC 2012 Part Two

  • Matrox Graphics at IBC 2012 Part One

    Matrox Graphics at IBC 2012 Part One

  • Paint from ChyronHego at NAB 2018

    Paint from ChyronHego at NAB 2018

  • LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

    LiveCG Broadcast and LiveMedia Server from 3D Storm at BVE 2018

  • Virtual 1st from ChyronHego at NAB 2017

    Virtual 1st from ChyronHego at NAB 2017

  • 3D Storm at IBC 2015

    3D Storm at IBC 2015

  • ChyronHego Lyric64 at IBC 2015

    ChyronHego Lyric64 at IBC 2015

  • ChyronHego Metacast at IBC 2014

    ChyronHego Metacast at IBC 2014

  • ChyronHego Lyric PRO at IBC 2014

    ChyronHego Lyric PRO at IBC 2014

  • Pixel Power at NAB 2014

    Pixel Power at NAB 2014

  • ChyronHego PowerClips at NAB 2014

    ChyronHego PowerClips at NAB 2014

  • ChyronHego at NAB 2014

    ChyronHego at NAB 2014

  • Ross Video at BVE 2014

    Ross Video at BVE 2014

  • ChyronHego on BroadcastShow LIVE at IBC 2013

    ChyronHego on BroadcastShow LIVE at IBC 2013

  • Brainstorm on BroadcastShow LIVE at IBC 2013

    Brainstorm on BroadcastShow LIVE at IBC 2013

  • Pixel Power at IBC 2013

    Pixel Power at IBC 2013

  • Softron Media at IBC 2013

    Softron Media at IBC 2013

  • Matrox Maevex at IBC 2013

    Matrox Maevex at IBC 2013

  • Matrox Avio at IBC 2013

    Matrox Avio at IBC 2013

  • Brainstorm Multimedia: Aston3D at NAB 2013

    Brainstorm Multimedia: Aston3D at NAB 2013

  • Dalet at NAB 2013

    Dalet at NAB 2013

  • Pixel Power at NAB 2013

    Pixel Power at NAB 2013

  • Pixel Power at NAB 2012

    Pixel Power at NAB 2012

  • Brainstorm at NAB 2012

    Brainstorm at NAB 2012

  • Chyron at NAB 2012

    Chyron at NAB 2012

  • Orad at NAB 2012

    Orad at NAB 2012

  • Chyron at BVE 2012

    Chyron at BVE 2012

  • PlayBox Technology at BVE North 2011

    PlayBox Technology at BVE North 2011

  • Elemental Technologies at IBC2011

    Elemental Technologies at IBC2011

  • Brainstorm at IBC2011

    Brainstorm at IBC2011

  • Avid at IBC2011

    Avid at IBC2011

  • Chyron at IBC2011

    Chyron at IBC2011

  • FOR-A at IBC2011

    FOR-A at IBC2011


Related Shows
  • KitPlusTV summarise the Broadcast and Pro Video News 6th April 2021

    KitPlusTV summarise the Broadcast and Pro Video News 6th April 2021


Articles
Avid and Rohde & Schwarz
Ciaran Doran

Rohde & Schwarz is the perfect ingest partner to build flexible workflows with Avid.

Tags: Rohde and Schwarz | avid | spycernode | editing | asset management | venice | Ciaran Doran
Contributing Author Ciaran Doran Click to read
Sennheiser MKE 400 hands on review and test
KitPlus

Sennheiser have just released two products aimed at simplifying audio on the move, the MKE400 shotgun microphone and the XS Lav Mic, in this review we’re looking at the MKE400.

Tags: sennheiser mke400 | sennheiser mke 400 | sennheiser mke 400 quality | best microphones for youtube | mic for youtube videos | sennheiser mke 400 hands on | microphone review | iphone videography | microphones | sound for video | camera microphone | microphone for iphone | microphone for youtube | video microphone | shotgun mics | smartphone microphone | vlogging mic | best microphone for video | shotgun microphone review | mke 400 | sennheiser mke 400 hands on review | sennheiser mke 400 test | KitPlus
Contributing Author KitPlus Click to read
A Broadcasters Guide to Microservices
Roger Persson

The word “microservices” has been creeping into the conversation about software-centric systems recently. Is it really a different approach, what does it mean, and what are the advantages?

Tags: nxt edition | microservices | modular software | Roger Persson
Contributing Author Roger Persson Click to read
Streaming Technologies Explained
Bruce Devlin - new

The word streaming can relate to different technologies from different manufacturers in different scenarios and in this short article we are going to take a little tour of what it all means. 

Tags: mr mxf | streaming | hls | dash | cmaf | mpeg | Bruce Devlin - new
Contributing Author Bruce Devlin - new Click to read
REVIEW - Hollyland MARS 400S PRO Digital Wireless Transmission System
Phil Vinter

Built by Hollyland and costing around £600 the Mars 400S is an easy-to-use wireless video transmitter/receiver system – it will be right up the alley of anyone who, like me, considers an instruction manual to be nothing more than box padding.

Read Phils Full review here, and link to the video review.

Tags: HOLLYLAND | MARS 400 | wireless | tx | rx | Phil Vinter
Contributing Author Phil Vinter Click to read